I am not sure why people jump to extremes like mortality. If there is anything existing behavior has taught me, it is that the more likely risk is that AI just extends the dark patterns that social media algorithms have implemented and used to manipulate the masses for the last couple of decades. LLM's and their administrators may do a better job manipulating people and businesses. And to be clear I am not blaming the LLM and nor should anyone else. I blame their administrators. There is always a human involved in the chain of malfeasance. They will try pointing at the LLM or the data it ingested, but ultimately a human made that happen and the current LLM's can not even show their work or an audit trail.
I mention LLM's because in my opinion AGI that does anything other than mimic human behavior will not likely exist on a human time scale. I suspect we will have first evolved into something else, probably augmented tech cyborg like humans and that will have it's own security and privacy implications. I predict we will see people slapping themselves in the face and so much worse. The unknown for me is what we will call people integrated with tech. Previously there were glassholes. What will the people with Internet of Things connected to their brains be called?
I mention LLM's because in my opinion AGI that does anything other than mimic human behavior will not likely exist on a human time scale. I suspect we will have first evolved into something else, probably augmented tech cyborg like humans and that will have it's own security and privacy implications. I predict we will see people slapping themselves in the face and so much worse. The unknown for me is what we will call people integrated with tech. Previously there were glassholes. What will the people with Internet of Things connected to their brains be called?