Keep in mind, you and I are tech nerds who visit an Apple Rumors blog (among other similar website) and are NOT in the majority of Apple consumers. With the tens of millions of units they sell every quarter, there's no way it can be that way.
The average consumer probably doesn't know of the Map "problems", or maybe briefly skimmed a headline in the news.
I think that the average user will try maps, immediately realise that it's unreliable and either try a few more times, or just not use it again. People will not use it if it doesn't come across as reliable.