Will AGI be one mind? Rich Sutton says no
Rich Sutton argues AGI will be many minds sharing one design, not a single system
“It's a single design. There'll be many minds.”
Rich Sutton articulates that AGI will manifest as a single architectural design instantiated as many distinct minds, each learning from different experiences. This is grounded in his 'big world hypothesis' — the world contains infinitely more to learn than any one system can hold, making a single omniscient AGI mathematically impossible. The implication is that future AI ecosystems will be inherently plural and distributed, which has significant consequences for how labs think about alignment, coordination, and deployment.