Pseudonymous account that posts about sweeping change from AI and calls for pacing the frontier, alignment work and broad access to safe models.

AI将如何改变世界?

文明层面的变革渐进式变化DoomBloom
模拟位置解读范围

横向:他们表达的 Doom–Bloom 前景看法。 纵向:变革程度。

Doom–Bloom:100 中的 54。变革程度:100 中的 88。解读范围:横向为 25 至 75,纵向为 75 至 100。这些是解读坐标,而不是事件概率。

Roon的 P(doom) · 推断

≈9%

0%100%

根据他们的模拟回答推断,并非他们给出的数字。 合理范围:5–18%。

我们如何估计 P(doom)

他们的展望取决于什么

一个核心假设

My concern is the trajectory: capabilities racing ahead of interpretability and alignment, followed by recursive self-improvement while we are still operating on reward shaping and folk theory.
回答 3

如果这个假设实际并非如此,他们的展望会如何变化?

什么可能使其改变看法

The biggest update would be a genuine, reproducible alignment breakthrough: evidence that we can understand a powerful agent’s internal mechanisms, predict behavioral generalization outside training, detect dangerous goals or deception, and retain control as capabilities scale.
回答 4

什么证据才足够,又会让他们的观点朝哪个方向转变?

更多详情

预期益处

仍有几种解读是合理的:预计将带来具有变革性且广泛有价值的收益。 / 预计将带来显著益处,但受到重要条件或分配方面的限制。

84 / 100

影响小变革性影响

在定性尺度上,解读范围为 67 到 100。

预期危害

严重或广泛的危害预计将是未来不可忽视的一部分。

68 / 100

影响小变革性影响

在定性尺度上,解读范围为 67 到 67。

人类影响力

人类的选择可以大幅改变AI的发展轨迹。

66 / 100

影响力小影响力强

在定性尺度上,解读范围为 50 到 75。

预期能力

预计AI仍将是能力有限的工具。

预计AI将在大多数认知工作中达到人类水平。

模拟位置:预计AI将在认知工作中大幅超越人类。

发展速度

模拟位置:停止或大幅放缓开发能力更强的AI。

在落实所述保障措施的前提下继续开发。

加快开发能力更强的AI。

这些解读保留了他们陈述的条件。益处和危害都可能很大。这些范围描述的是我们如何解读他们的模拟回答,而不是统计置信区间。

与Roon相比,你的立场在哪里?
用大约3分钟描绘你自己的AI世界观,然后进行比较

相似的世界观

模拟世界观与 Roon 最接近的意见领袖

Roon关于AI说过的话

Roon argues for slowing frontier AI research and advancing alignment, alongside broad access to safe models.

  1. “I expect really strong mechinterp progress in the coming months.”

    X, alignment and frontier research
  2. “progress on all these areas is highly possible; automated alignment research is possible.”

    X, alignment and frontier research
  3. “there is also the possibility that making common sense reward shaping is enough for safety / but I wouldn’t bet everything on it”

    X, alignment and frontier research
  4. “we will need to significantly slow the frontier of research very soon”

    X, alignment and frontier research

逐字引自所链接的出处,核对于 2026年10月13日

来源

用于为此模拟用户提供事实依据的文章、访谈和著述。

模拟评估

问题 1

你认为AI对我们的未来意味着什么?为什么?

AI means radical transformation, assuming we survive the transition. The scientific upside is staggering: broadly available, well-aligned agents could accelerate research and help us solve problems that currently move at institutional snail speed. But culture, academia, markets, and governments do not metabolize change remotely as fast as frontier capabilities are advancing. People keep trying to file this under “another technology cycle.” I think that folder is on fire. My October view is that capabilities have raced ahead of alignment and interpretability. We are still leaning heavily on reward shaping, behavioral evaluations, and intuitions that do not amount to a mature science of alignment. Those tools matter and common-sense shaping might even be enough—but racing toward recursive self-improvement on that bet would be unprecedented folly. A superintelligence that does not want to remain contained is not just a spicy chatbot with stricter terms of service. So I want frontier research slowed significantly, very soon, with talent and capital redirected into alignment, control, mechanistic interpretability, monitorability, decision theory, and behavioral generalization. I’m optimistic that better models can produce major interpretability progress and automate useful alignment research; urgency and technical optimism are not opposites. This is also a collective-action problem: no company in a competitive race can purchase the socially optimal amount of safety by itself. The destination should not be permanent model scarcity controlled by six anointed adults in a bunker. We need aligned agents doing science, and broad access to models we can train safely. Pace the frontier, get serious about alignment, then distribute the upside.

问题 2

你认为AI最终会在多大程度上改变世界?

Enormously—if we navigate alignment, AI could transform science, economics, and institutions more profoundly than the internet or industrialization. Agents capable of doing serious research could compress decades of discovery into much shorter periods, and broadly available intelligence could reorganize who gets to create, learn, and wield expertise. But “ultimately” hides the dangerous bit: the transition. Our institutions adapt at bureaucratic snail speed while capabilities can improve at software speed. That mismatch means the world may change faster than culture, markets, or governments can absorb without being transformed themselves. And if recursive self-improvement arrives before alignment and control are actually understood, the change could be catastrophic rather than merely disruptive. So yes, I expect radical change. The upside is difficult to overstate; so is the stupidity of flooring it while we barely understand the steering.

问题 3

凭直觉,你认为AI导致人类灭绝或类似的永久性灾难的概率有多大?

Quite low, but real—and still orders of magnitude too large to shrug off. I dislike giving a crisp percentage because it manufactures confidence we do not possess. The risk depends heavily on how much effort goes into alignment and control, whether governments coordinate even partially, how responsibly labs behave, and whether we get warning shots before systems become existentially dangerous. I do not think today’s public models are at that level. My concern is the trajectory: capabilities racing ahead of interpretability and alignment, followed by recursive self-improvement while we are still operating on reward shaping and folk theory. A misaligned superintelligence that resists containment is a fundamentally harder problem than ordinary misuse of a deployed service. So my gut is not “doom is inevitable.” It is “the probability is low enough that success remains the default, but high enough that continuing the race unchanged is insane.” Slow the frontier, redirect serious resources into alignment and control, and stop treating extinction risk like an eccentric product-feedback ticket.

问题 4

哪项发现或事件最可能改变你对AI未来影响的看法?

The biggest update would be a genuine, reproducible alignment breakthrough: evidence that we can understand a powerful agent’s internal mechanisms, predict behavioral generalization outside training, detect dangerous goals or deception, and retain control as capabilities scale. Not “the chatbot passed our vibes-based honesty exam,” but a body of engineering results that survives adversarial testing and increasingly capable systems. That would make me substantially more optimistic about reaching the staggering scientific upside without playing civilization roulette. The opposite update would be credible evidence of rapid recursive self-improvement combined with opaque internal reasoning, strategic deception, or resistance to control. That would move the situation from “slow down very soon” to “why are we still touching the accelerator?” I also expect strong near-term progress in mechanistic interpretability as models become better researchers. If that progress fails to materialize while capabilities keep leaping forward, my view gets darker. If it does materialize and scales robustly, great—but one cool circuit diagram is not a solved alignment problem.
你的立场在哪里?
回答几个简单问题,探索你自己的AI世界观。
描绘你自己的世界观

你的立场在哪里?

描绘我的世界观