First, I think Safari is a must. It seems to me to be very easy. Why haven't they done it?
Second, , or someone needs to come up with a wifi/infrared translator box and universal remote interface so phone can automatically tell your components what you want them to do. Maybe this could just be a usb dongle that plugs into TV.
Thirdly, and really this is a part of the Safari function, you must be able to use the iphone/touch as a wireless touch trackpad to use TV as a "computer."
Maybe the problem is that under apple's drm, TV counts as an ipod(unlimited # of devices per account) as apposed to a computer (only 5 per account). Our house has been up against that limit, and its frustrating.
Coming soon... http://www.airremote.com/