Jack Morris

Jack Morris

x.com/jxmnop

Language model researcher who studies memorization and privacy leaks from text embeddings and writes about reinforcement learning and synthetic data.

AI将如何改变世界?

文明层面的变革渐进式变化DoomBloom
未确定范围的中心解读范围

横向:他们表达的 Doom–Bloom 前景看法。 纵向:变革程度。

Doom–Bloom:100 中的 47。变革程度:100 中的 50。解读范围:横向为 42 至 52,纵向为 0 至 100。这些是解读坐标,而不是事件概率。

Jack Morris的 P(doom) · 推断

≈8%

0%100%

根据他们的模拟回答推断,并非他们给出的数字。 合理范围:3–19%。

我们如何估计 P(doom)

他们的展望取决于什么

一个核心假设

The key variable for me is how much useful output systems can produce per unit of human input, especially as that input approaches zero.
回答 2

如果这个假设实际并非如此,他们的展望会如何变化?

一个尚未解决的问题

So I expect major change, with the ultimate magnitude still unresolved.
回答 3

什么能帮助他们区分这里各种合理的结果?

更多详情

预期益处

预计将带来显著益处,但受到重要条件或分配方面的限制。

67 / 100

影响小变革性影响

在定性尺度上,解读范围为 67 到 67。

预期危害

严重或广泛的危害预计将是未来不可忽视的一部分。

66 / 100

影响小变革性影响

在定性尺度上,解读范围为 67 到 67。

人类影响力

根据你的回答得出的暂定估计;较宽的范围表示其他合理解读。

50 / 100

影响力小影响力强

在定性尺度上,解读范围为 0 到 100。

这些解读保留了他们陈述的条件。益处和危害都可能很大。这些范围描述的是我们如何解读他们的模拟回答,而不是统计置信区间。

与Jack Morris相比,你的立场在哪里?
用大约3分钟描绘你自己的AI世界观,然后进行比较

相似的世界观

模拟世界观与 Jack Morris 最接近的意见领袖

来源

用于为此模拟用户提供事实依据的文章、访谈和著述。

模拟评估

问题 1

你认为AI对我们的未来意味着什么?为什么?

I think the most useful way to discuss AI’s future is to avoid treating “AGI” as one inevitable threshold. I’d rather measure how much useful output systems produce per unit of human input. That lets us ask concrete questions: Can an agent find important software bugs, conduct productive experiments, or complete work without constant supervision? Coding agents already show practical value in bug-finding, but truly zero-human-input economic production would be a qualitatively more consequential—and potentially frightening—development. The trajectory is also harder to extrapolate than simple scaling stories suggest. Reinforcement learning appears to teach models new ways of using compute, not merely extract behaviors learned during pretraining. Models are also beginning to learn from self-generated data and use memory in interesting ways, although calibrating those memories and generating scalable, useful training data remain open problems. More capable AI researchers may learn from much smaller experiments than humans do, so current estimates of how much compute scientific progress requires could be misleading. The same capabilities create asymmetric risks. Systems that find bugs can help defenders, but capable adversaries can use them to discover vulnerabilities and compromise devices or cloud accounts. Privacy is another concrete concern: models can memorize training data, and even text embeddings can reveal surprisingly much of the original text and personal information. So I expect substantial practical gains alongside serious security and privacy problems, with the outcome depending less on whether we cross a named threshold than on autonomy, human oversight, and measurable capability in specific domains.

问题 2

综合考虑益处和危害,你预计AI会对我们的社会产生怎样的总体影响?

I don’t think I can honestly compress the overall impact into a single positive or negative forecast. The measurable picture is mixed: AI can already help find real software bugs and reduce the human input needed for useful technical work, while the same capability can improve vulnerability discovery for attackers. Likewise, memory and representation learning can make systems more useful, but memorization and embedding inversion create concrete privacy risks. The key variable for me is how much useful output systems can produce per unit of human input, especially as that input approaches zero. If they remain tools that amplify supervised work, the benefits could be substantial and comparatively manageable. If they become reliable, autonomous producers of economic or scientific output—or capable offensive cyber agents—the societal consequences become much larger and potentially frightening. So I expect significant benefits and serious harms, not a clean verdict. I would track autonomy, calibration, security, privacy leakage, and performance on concrete tasks rather than infer society’s future from whether someone declares that “AGI” has arrived.

问题 3

你认为AI最终会在多大程度上改变世界?

Potentially enormously, but “how much” depends on measurable autonomy rather than whether we cross an “AGI” threshold. If AI mostly amplifies supervised human work—finding bugs, assisting research, reducing routine effort—that is already a substantial change. If systems can reliably produce valuable economic or scientific output with almost no human input, the change could be qualitatively larger and more destabilizing. I also would not extrapolate too confidently from current bottlenecks. Reinforcement learning can teach models new ways to use compute; self-generated data and memory may broaden learning; and more capable AI researchers might extract useful conclusions from much smaller experiments than humans require. But memory calibration and scalable generation of useful training data remain open problems. So I expect major change, with the ultimate magnitude still unresolved. The most informative indicators are concrete: useful output per human input, reliability over long tasks, scientific productivity, cyber capability, and privacy leakage—not a binary declaration that AGI has arrived.

问题 4

凭直觉,你认为AI导致人类灭绝或类似的永久性灾难的概率有多大?

I don’t have a defensible numerical probability. My concrete concerns are about increasingly autonomous systems, AI-enabled cyber intrusion, privacy leakage, and the possibility of near-zero-human-input economic or scientific production. Those could become severe, but they do not by themselves establish an extinction forecast. I’d rather track measurable autonomy, reliability, offensive capability, and the amount of useful output produced without human oversight than invent a precise catastrophe percentage.
你的立场在哪里?
回答几个简单问题,探索你自己的AI世界观。
描绘你自己的世界观

你的立场在哪里?

描绘我的世界观