🎧 Dwarkesh Podcast · Long interviews on AI and science
Paul Christiano – We could be 12 months away from AIs that can overthrow the government
· 99 min
Listen in your app
Listen now · Dwarkesh Podcast
Paul Christiano – We could be 12 months away from AIs that can overthrow the government
In this episode
Paul Christiano is head of the Alignment Research Center. Previously, he was head of AI safety at the US AI Safety Institute. Before that, he led alignment at OpenAI, where he invented RLHF. He’s recently joined OpenAI’s board (though here he is speaking as a private citizen). Paul thinks that on the current trajectory (absent any slowing down), there is a 1 in 3 chance that we could have superintelligence powerful enough to overthrow the government within a year. (He articulates a concrete scenario). He argues that the labs should pause further algorithmic progress until they can secure their weights and research secrets. Otherwise China could simply steal the superintelligence in the middl…
Full show notes ↗