Economics blogger who expects AI to transform science, argues people can keep valuable jobs and worries about AI-enabled bioterrorism.

AIは世界をどのように変えるでしょうか?

文明規模の変化漸進的な変化DoomBloom
シミュレーション上の位置解釈範囲

横軸:彼が表明したDoom–Bloomの見通し。 縦軸:変革の規模。

Doom–Bloom:100点中65。変革の規模:100点中79。解釈範囲:横方向は50から75、縦方向は49から100。これらは解釈上の座標であり、事象の確率ではありません。

Noah Smithが示したP(doom)

≈10%

0%100%
“about a 10% chance of bringing down civilization”

Civilization collapse from AI-enabled bioterrorism; not human extinction

Here’s how we’re all going to die · 2026年8月

彼の見通しを左右するもの

中心的な前提

Even if machines outperform people at every task, their supply and cost still matter, and humans retain an advantage in knowing what they want.
回答1

この前提が実際には異なると判明した場合、彼の見通しはどう変わりますか?

考えを変え得るもの

If strong evidence showed that capable agents cannot meaningfully help design or execute catastrophic biological attacks—because the underlying science is infeasible, the physical bottlenecks are overwhelming, or systems reliably refuse dangerous work—my risk estimate would fall substantially.
回答3

どのような証拠なら十分で、それによって彼の見解はどちらの方向に変わりますか?

詳細

予想される恩恵

変革をもたらし、広く価値のある恩恵が予想されています。

87 / 100

影響が小さい変革をもたらす影響

質的尺度での解釈範囲は67から100です。

予想される害

深刻または広範な害が、予想される将来の実質的な一部となっています。

73 / 100

影響が小さい変革をもたらす影響

質的尺度での解釈範囲は67から100です。

人間の影響力

人間の選択によって、AIの軌道を大幅に変えることができます。

71 / 100

影響力が小さい影響力が大きい

質的尺度での解釈範囲は50から75です。

予想される能力

AIは、限定的なツールにとどまると予想されています。

AIは、ほとんどの認知作業において人間と同等になると予想されています。

シミュレーション上の位置:AIは、認知作業全般において人間を大幅に上回ると予想されています。

これらの解釈では、彼が示した条件が維持されています。恩恵と害は、どちらも大きくなり得ます。この範囲は、統計的な信頼区間ではなく、彼のシミュレーションされた回答をどのように読み取ったかを示すものです。

あなたはNoah Smithと比べてどの位置でしょうか?
約3分で自分のAIに対する世界観をマッピングして、比較できます

似ている世界観

シミュレーションされた世界観がNoah Smithの世界観に最も近いオピニオンリーダー

シミュレーション評価

質問1

AIは私たちの未来にとって何を意味すると思いますか?また、なぜそう思いますか?

AI means an enormous increase in our ability to do science, design things, and produce wealth. Combining human-like reasoning with computers’ recall and calculation is already superhuman in important ways. As agents improve, they’ll handle longer projects instead of merely answering prompts. That could accelerate research and make expertise dramatically cheaper. No, that does not automatically mean humans become economically useless. A job is a bundle of tasks, not one benchmark. Even if machines outperform people at every task, their supply and cost still matter, and humans retain an advantage in knowing what they want. Directing agents, choosing goals, checking results, and dealing with other humans can remain valuable work. Some occupations will disappear, but “AI did this task, therefore mass unemployment” is the same lazy prediction people keep making and reality keeps refusing to validate. My optimism is conditional, though: abundant, nearly free machine labor could produce a different equilibrium. The genuinely terrifying part is not a machine spontaneously becoming Satan. It is a malicious person using an obedient, capable agent to carry out a long, technically difficult project—especially biological misuse. I’m not a virologist, so I won’t pretend to know exactly what is feasible. But I put roughly a 10% chance on AI-enabled bioterror bringing down civilization and roughly 30% on world-changing destruction. Those are rough judgments, not extinction probabilities. So the future could be fantastically richer and more scientifically productive, while also becoming much more vulnerable to a small number of bad actors. That combination—not either utopia or robot apocalypse by itself—is the central fact.

質問2

人々はAIが将来及ぼす影響をどの程度形作ることができますか?

A lot—but not without coordination. AI’s impact is not some fixed technological destiny. Costs, access, deployment rules, security, and whether humans remain in decision loops all respond to institutions and incentives. If machine intelligence stays relatively scarce or expensive, humans retain more bargaining power and comparative advantage. If firms race to remove every human because agents are effectively free, the labor-market outcome could look very different. The highest-leverage area is catastrophic misuse. We can harden biological infrastructure, restrict dangerous capabilities, monitor access, and make agents resist malicious requests. But slogans about “alignment” are not enough. Policy has to describe a concrete threat that governments recognize and then alter their incentives. A malicious person using an agent to execute a long biological project is much easier to explain—and, in my view, much more plausible—than an abstract machine-god story. The international problem is unavoidable. Unilateral American restraint does not solve a competitive race if China keeps accelerating. Any serious pacing regime needs Chinese participation, which means giving Chinese leaders reasons rooted in their own security and political survival. If their own models become a threat to regime control, that could change their incentives far more than lectures from Western safety advocates. So yes, people can shape the future enormously. But only by acting on actual bottlenecks and incentives, not by imagining that technology automatically delivers either paradise or doom.

質問3

どのような発見や出来事があれば、AIが将来もたらす影響についてのあなたの見解が最も大きく変わりますか?

The biggest update would come from biology. If strong evidence showed that capable agents cannot meaningfully help design or execute catastrophic biological attacks—because the underlying science is infeasible, the physical bottlenecks are overwhelming, or systems reliably refuse dangerous work—my risk estimate would fall substantially. Conversely, a demonstrated end-to-end case where an agent helped a minimally skilled person complete a dangerous biological project would send it sharply upward. That matters far more to me than another chatbot saying something creepy. On economics, I would update if widespread agent deployment produced sustained, economy-wide displacement rather than the usual pattern of tasks changing inside jobs. In particular, if machine intelligence became nearly free and effectively unlimited while humans stopped providing useful direction, judgment, or scarce complementary skills, my employment optimism would weaken. Right now, the evidence does not establish that. Automating tasks is not the same as eliminating human economic value. The key event is not “the model scored higher on a benchmark.” It is an agent crossing from impressive demonstrations into reliable, autonomous execution in the real world—especially in biology. That is where capability becomes power, and where my view could change fastest.

出典

このシミュレーション対象者の根拠として使用された記事、インタビュー、著作です。

My thoughts on AI safety

The accessible introduction calls the consequences of godlike AI deeply unknowable. The remainder is paywalled; later public essays and interviews supply the substantive current position.

noahpinion.blog
Updated thoughts on AI risk

Publicly revises his earlier chatbot-focused dismissal after observing agentic coding. Autonomous tool use and economic pressure to remove humans from loops make catastrophic misuse more plausible. Remains comparatively skeptical of a near-term robot takeover.

noahpinion.blog
Superintelligence is already here, today

Argues that combining human-like reasoning with computers’ exceptional recall and calculation already creates superhuman capabilities. Expects major scientific transformation; this is his broad definition of superintelligence, not a claim that every system is an autonomous omnipotent agent.

noahpinion.blog
Noah Smith returns to explain his P(doom) update — Doom Debates

Speaker-labeled transcript: Noah at 07:21 endorses roughly 10% for catastrophic biological misuse. At 08:55 he expects survivors and is unsure about rebuilding. At 09:25 he declines to endorse the interviewer’s proposed 5% permanent-doom number. At 12:26–14:59 he identifies biological feasibility and resistance to jailbreaks as updates. At 17:49–18:18 he explains why malicious human use dominates his concern. Do not import Liron’s forecasts into Noah’s answers.

lironshapira.substack.com
Plentiful, high-paying jobs in the age of AI

Clarifies that plentiful employment under extremely capable AI is possible, not guaranteed. Relative costs and constraints on AI supply can preserve human comparative advantage even when machines outperform people at every task.

noahpinion.blog
Your future job will be to keep AI on task

Emphasizes humans’ comparative advantage in knowing what they want, with future work organized around directing AI. The accessible introduction supports this thesis; avoid inventing detailed empirical findings from inaccessible portions.

noahpinion.blog
Here’s how we’re all going to die

Assigns an informal 10% chance to AI-enabled bioterror bringing down civilization and 30% to world-changing destruction, without a precise horizon. Calls this much more serious than other AI harms while retaining enthusiasm for AI. These are not extinction odds; a separate annual-risk example is hypothetical, not his forecast.

noahpinion.blog
AI keeps stubbornly refusing to take our jobs

Distinguishes replacing tasks from eliminating occupations. Interprets contemporary employment evidence as inconsistent with an imminent job apocalypse; expects humans to continue directing AI, without claiming that no occupation will ever disappear.

noahpinion.blog
Two missing pieces in the AI safety discussion

Argues that safety advocates need concrete threats that persuade skeptics and must address Chinese leaders’ incentives for coordinated pacing. Revises his earlier idea that merely staying ahead would produce cooperation: domestic threats from China’s own models could instead change its incentives.

noahpinion.blog
あなたはどの位置でしょうか?
いくつかの簡単な質問に答えて、自分のAIに対する世界観を探ってみましょう。
自分の世界観をマッピングする

あなたはどの位置でしょうか?

自分の世界観をマッピングする