The A4 will definitely be the more exciting car to own, but the TCO is much higher despite the $300 insurance difference. I just had a new timing belt installed ($900 U.S.), new clutch ($1800 U.S. single mass flywheel), new battery and annual maintenance ($500 U.S.), and it is currently in the shop getting a new control module, front and rear brake job ($1000 U.S.).
So since April I've spent $4200 in repairs/maintenance on my 1.8t A4 and the only thing done at inflated dealer prices was the battery and annual maintenance.
Not to say you'll have such expensive work in the immediate future (my car is a 2002), but you'll definitely have pricey repairs at some time compared to the Honda. Of course I wouldn't trade my six year old A4 for a brand new Civic. I still think it's one of the best decisions I ever made and love the car as much as any man can love an inanimate object.
If modding is your thing, the A4 is a great choice and the modder community is huge. I actually feel bad that mine is so stock. If the A4 you are considering is a Quattro, that's a huge plus if you still reside in the Northeast. Driving in rain is like driving on dry roads, but watch out on the ice.