Why would your router software be creating a wireless hotspot with your computer? Or do you mean that it creates it on the router which would make sense?
In that case, yes, your router is creating a wifi network that your TV could connect (assuming your TV has that functionality) to. It would connect in much the same way any other device would. You should check your products manual to see if your TV has the ability to connect to wireless (not all do) and the method to do so.
You would need to know your wireless name and the password which you should know since you configured the router in the first place.