If you're not telling it what to do, then you would have to type something in, which would render Siri pointless. I'm not sure what you are looking for in terms of improvement? Do you want it to read your thoughts?
You do know you can bring the phone up to your ear and Siri will auto engage allowing you to give commands as though speaking on the phone therefore not seeming "abit werid "?