I feel like the issue with these devices is we're taking a completely incorrect approach to designing the UX.
The current approach seems to be to make a ridiculously gimped command line that has no "help", "man", "find", "grep", pipes, or variables.
I think a way better approach would be to take an apps approach, like a smartphone.
Me: "What were we talking about?"
Device: "We weren't talking about anything. What app would you like to launch?"
Me: "Oh, right. What apps do I have installed?"
Device: "Currently installed are weather, stocks, messages, phone..."
Me *cutting off*: "Open messages. Who texted me last?"
... so on...
Me: "Close apps" or "Goodnight" or "Goodbye" or something along those lines.
These AIs suck for general purpose. They need context and we need context. They need to be able to contextually tell us what our options are. They need to prompt us about what they can do. Apps can provide that context.