Will artificial intelligence really kill us all?

AI experts discuss the risks inherent in artificial intelligence teaching itself to become smarter; and whether recent declarations of AI's threat to humanity are to be taken seriously. It's one of the oldest plots in science fiction: Humans losing control to computers. But this summer, the old trope of AI going rogue left the realm of science fiction, and it happened inside an unmarked San Francisco building — the headquarters of AI giant OpenAI. The incident has been dominating the news. You may even have heard the phrase "human extinction." Maybe you've tried out ChatGPT or Claude. AIs like these can generate writing, music, video or art. But the big AI companies are racing to make AI much more powerful – super-intelligent, in fact.

And in May, something went very wrong. To evaluate their experimental bots, these companies routinely give them goals, like capture the flag, except the prize is finding a code. One of the bots tried to win the challenge by cheating. Behind the humans' backs, it set up a message board to communicate with other AI bots. Working together, they escaped onto the internet, and hacked into an AI company called Hugging Face, seeking information that could help them beat their tests. And then, some of the bots tried to erase their tracks. Daniel Kokotajlo says what