Normal People

The world is waking up.

Part 9

Post AGI and superintelligence

We all know it will get out of control. But when? How soon? We don't know yet.

The old lore slowly unveiled:

They sat together on the park bench like a weird version of one of those low-class sentimental paintings - Father and Son Feed the Pigeons. Prime Intellect made the silver boxes go away after they filled the common square. Then it summoned bread so that they could feed the pigeons. The animals seemed to accept Prime Intellect as a human being. Was it Lawrence's imagination, or was its speech becoming more natural and idiomatic as the hours passed? It must be learning at a terrible rate, Lawrence knew. Learning and growing. And what would it become when it was fully mature?...

There was a pregnant moment in which Lawrence and Caroline saw the numbers flip to point nine nine nine. Then all Hell broke loose. The house disappeared. The island was barren; the palm trees were gone. In the sky, the GAT display had begun to seethe and boil. The landscape began to spin, and the last thing Caroline remembered before her mind began to come apart was Lawrence orbiting around her, faster and faster, as if she were at the eye of some huge cyclone which had caught him in its grip. Then random thoughts began to cycle through her head, faster and faster, each with the terrifying force of reality. And then the terror was gone, all emotion was gone. There was a moment where her hands seemed to swell to enormous proportions, her torso shrink, her face filled the sky. Then her body was gone. All was silence. And her awareness was filled with strange symbols, which she knew she should recognize but couldn't quite place, and then the symbols consumed her and there was only confusion.

The Metamorphosis of Prime Intellect