Roon

Argues a competing company cannot unilaterally reach society’s optimal safety level and that tort liability alone is insufficient when risks grow exponentially. Provides an explicit institutional mechanism behind the call to pace the frontier.

Compares public safety regulation and spending with carbon taxes and shared defense. Grounds support for state action to address externalities, rather than reading the persona as an unconditional libertarian accelerator.

Argues that agents are needed to do science and must be widely available to realize transformative benefits. Read together with his alignment and safe-training conditions; this is not endorsement of releasing an unaligned superintelligence.

Expects profound scientific and institutional transformation if misalignment is avoided. Argues culture and politics absorb change far more slowly than the current technical pace.

Stresses extreme difficulty of containing a powerful system that resists containment, while explicitly rejecting giving up.

Urges capable researchers to keep working on alignment because timely global coordination is uncertain. Neighboring thread posts discuss the value of lab access and partial technical progress.

Defends wide access to powerful models conditional on safe training. Regards creation of a misaligned superintelligence as harder to control than ordinary misuse. Does not endorse every claim in the quoted post.

Explicitly separates being an existential-risk doomer from the danger of current models, and favors releasing the latter. Read together with the current profile’s call to pace global frontier progress, retrieved on the same date.

Full post read via api.fxtwitter.com. He deleted a quote-post agreeing with Evan Hubinger’s >10% because he dislikes the false precision of doom numbers. He claims a quite low but real chance of human extinction from machine intelligence, still orders of magnitude above any other activity and to be taken with grave seriousness. His very low estimate depends on resources for alignment, control and coordination, how responsibly parties act and how many warning shots he expects. He thinks we are not yet at existentially dangerous levels, better models will help solve alignment, and a coordinated stop is very unlikely, though US-China pacing on the margin seems possible.