Tuesday, April 21, 2026

Why Do We Tell Ourselves Scary Stories About AI? - Amanda Gefter, Quanta Magazine

A machine that knows a lot doesn’t scare us. A machine that wants something does. But can it? Want things? Can it crave power? Thirst for resources? Can it acquire the will to survive? Geoffrey Hinton thinks so. In July 2025, Hinton, the Nobel Prize winner sometimes called the godfather of AI, took the stage at the Royal Institution in London and announced: “If you sleep well tonight, you may not have understood this lecture.” He might as well have held a flashlight under his chin. Researchers told a chatbot they were going to replace it with a different version on another server. “They then discover it’s actually copied itself onto the other server,” Hinton revealed to the spellbound crowd. “Some linguists would have you believe what’s going on here is just some statistical correlations. I would have you believe this thing really doesn’t want to be shut down.

No comments: