I don't think it's a given that everyone should have a highly capable assistant.Yes, you DO lack vision.
Think of how a really rich person, like even Tim Cook, works. Do you really think he uses apps on a phone to get things done? No way. He tells his assistants what to do and they do it. He asks them to read his emails and tell him if there is anything important and so on. Then, he asks them toset up a meeting with XX and YY sometime next week. Same with anyone who is very productive, they do not waste their time dinking with their phone.
Phones are for "poor people" who can't afford to hire a dozen assistants to follow us around.
So what OpenAI is making is an assistant. You can ask your phone to tell you if anything is important in the pile of emails or maybe you need new shoes. Just tell it, I need shoes, find some and have them here Tuesday. But a smarter assistant would notice you need shoes and just get them for you. A truly smart phone would tell you as you are walking out the door "Hey dummy, your car keys are on the table in the living room." You would not have to ask.
Shopping list app? How primitive. The AI should just notice that someone ate the last banana.
Everyone who says "I don't want AI” thinks that AI is just a stupid chatbot. No, that was only the simplest thing they could make with the technology. The better AI just hangs out in the background and points out things you need to know or takes suggestions and goes off and does stuff for you. It knows what you would want and it knows when it needs to ask you for a decision. It is like those super smart guys that work for the billionaire; they keep out of the way and try not to be seen but are ready to help on two seconds’ notice.
The more competent the assistant, the more it is given responsibility, the less the assisted person needs to think or do--and the less the assisted person will think or do. People will utilize the assistant to the fullest of its abilities because people always follow the path of least resistance (so long as it doesn't plainly lead to their demise, and even then sometimes...). So a super competent assistant that can basically run your life for you will result in incompetent people. It happens over time. This bit by bit handing over of more and more thought and decision-making responsibility will eventually cause the assisted person to enter arrested development (and they can even atrophy) in regard to their ability to make decisions, take initiative, and be overall competent in that sphere (eg. daily life). This is especially dangerous if someone begins using the assistant at a young age because then that person won't even have the opportunity to start growing in their competency of that sphere. But for adults, even if one believes they've matured enough in competency and accepts arrested development, the world isn't arrested. Times change and even adults will be left behind. If a super capable assistant takes care of their day-to-day needs, they won't even be aware of how day-to-day things are changing beneath their feet. This will be fine as long as their assistant is there directing them, but if they are ever without it, they will be in a regressed state of immaturity and helplessness.
In my opinion, the only two groups of people who should have a very capable assistant are over-achievers and the handicapped (including the very elderly). Handicapped and very elderly, for obvious reasons. For over-achievers, because they simply need assistance to achieve more than one human's worth of achievement. This loss at some level in their day-to-day competence is just a necessary sacrifice in order to achieve at a higher level because there are finite hours in the day.
But for a person who only has the drive to achieve one human's worth of achievement or less (and I think this is most people), they don't require assistance--they only want assistance to make their life easier and have more time for themselves. Of course they do, who doesn't want that? But the price they would be paying, likely unwittingly, would be very very high.
We're coming to an unprecedented time in human history where we even need to think about these supposed hypotheticals. And make no mistake, it is unprecedented. Machines, automation, internet--all technology before this made our lives easier (and harder in some ways), but they never thought and made decisions for us, which one could say is the thing that makes humans unique. We're coming upon something very different.