I get this ocassionally too. As the previous poster says, try flipping airplane mode on/off, or restarting the phone.
If that doesn't solve it, I assume I have a good signal but that the cell tower is swamped. Vodafone in the UK used to get this all the time at Liverpoool St Station in London; the entire City (financial district) was on Vodafone, so standing under the cell tower does no good is everyone else around you is also using it ..
Other times I've had it have been where the network operator has had an issue. Once they fix that, I'm back online.
Unfortunately we rely heavily on 'always-on' 3G+ mobile connectivity & it's just not really there yet - even in & around London I frequently have little / no / poor signal. It's very frustrating, but an opportunity to practice your Zen calm ;-)