I am in almost the same situation. I promoted this season to D.III and I am in the finals (I have HCA).
I have to agree, attendence in the finals should not be linked to the previous game's results. My fan survey is awful after solidly winning my first home game and losing the away game by--gasp--seven!!
Show me a league in ANY SPORT where attendance in the finals goes down because the team lost an away fixture.