Google Voice does allow you to sms people. Works on *most* any phone with a half decent web browser.
It is possible that are talking about google chat, but I've no idea since I don't have a andriod phone.
AT&T also has an SMS portal on their site to allow you to send SMS to its customers.