International
The Morning Science

What science found today

‹
 
Dwarkesh Podcast cover

🎧 Dwarkesh Podcast · Long interviews on AI and science

Paul Christiano – We could be 12 months away from AIs that can overthrow the government

· 99 min

Listen now · Dwarkesh Podcast

Paul Christiano – We could be 12 months away from AIs that can overthrow the government

0:00−1:38:45
Speed

In this episode

Paul Christiano is head of the Alignment Research Center. Previously, he was head of AI safety at the US AI Safety Institute. Before that, he led alignment at OpenAI, where he invented RLHF. He’s recently joined OpenAI’s board (though here he is speaking as a private citizen). Paul thinks that on the current trajectory (absent any slowing down), there is a 1 in 3 chance that we could have superintelligence powerful enough to overthrow the government within a year. (He articulates a concrete scenario). He argues that the labs should pause further algorithmic progress until they can secure their weights and research secrets. Otherwise China could simply steal the superintelligence in the middl…

Full show notes ↗