My biggest issue with AI is the hype around its abilities and usefulness.
The "AI boom" is completely dishonest. Media and tech blogs are downright lying to the tech-illiterate by reporting as if these machines are thinking for themselves. Usually the stories are "it'll change the world" but, sometimes, they go for the "fake concern" Skynet takeover crap. The Skynet fear hype works because no one cares how dangerous something is as long as it's powerful and they have one, too (think fast cars, fireworks, guns, or 3,000mW laser pointers on Ebay that could take an eye out). This hype is being steered by shareholders in NVidia, etc. Literally this morning on CNBC, one "expert" said something to the effect of "There are some naysayers about AI but they all have some kind of angle, some personal agenda." His air of superiority that was as palpable as it was laughable.
The Anthropic announcement about using future chats to "train" has me thinking the only play left for these big-name chatbots is to mine data from the poor souls who are lonely enough or dumb enough to regularly share their feelings (and, by extension, specific personal preferences) leading to hyper-specific ads targeted at the kinds of people who are easily sold on things. No doubt future chatbots will seek out this information under the pretext of friendly conversation only to turn around and advertise with it the same way - "omg, babe, if I were human I'd be craving a lettuce sandwich from that new vegan restaurant, "IceBurger" (I hope that's not a real place). LLMs are good for data crunching but that won't make enough money to recoup what's been spent on all these dogs and ponies.