Zvi Mowshowitz

Zvi Mowshowitz

x.com/thezvi

Writer who covers AI capabilities, alignment and policy in detail and argues advanced AI risk warrants urgent technical and political action.

AIは世界をどのように変えるでしょうか?

文明規模の変化漸進的な変化DoomBloom
シミュレーション上の位置解釈範囲

横軸:その人が表明したDoom–Bloomの見通し。 縦軸:変革の規模。

Doom–Bloom:100点中6。変革の規模:100点中95。解釈範囲:横方向は0から11、縦方向は90から100。これらは解釈上の座標であり、事象の確率ではありません。

Zvi Mowshowitzが示したP(doom)

≈70%

0%100%
“i think it's like yeah seventy ish”

AI “doom” as asked by Nathan Labenz (“your latest P doom”); endpoint not defined in the exchange (his discussion is about superintelligence ending up with goals we do not want)

Zvi's Mic Works! Recursive Self-Improvement, Live Player Analysis, Anthropic vs DoW + More! · 2026年3月

その人の見通しを左右するもの

中心的な前提

Safety and reliability often lose that contest—even when additional safety would be commercially sensible.
回答1

この前提が実際には異なると判明した場合、その人の見通しはどう変わりますか?

考えを変え得るもの

The biggest update would be strong evidence that alignment remains robust as systems become substantially more capable and operate in unfamiliar, adversarial conditions—not merely that current models pass evaluations or produce reassuring explanations.
回答4

どのような証拠なら十分で、それによってその人の見解はどちらの方向に変わりますか?

詳細

予想される恩恵

大きな恩恵が予想されていますが、重要な条件や分配上の制約があります。

60 / 100

影響が小さい変革をもたらす影響

質的尺度での解釈範囲は0から100です。

予想される害

破局的または不可逆的な喪失が、予想される将来の中心となっています。

100 / 100

影響が小さい変革をもたらす影響

質的尺度での解釈範囲は100から100です。

人間の影響力

人間の選択には意味のある影響力がありますが、大幅に制約されています。

50 / 100

影響力が小さい影響力が大きい

質的尺度での解釈範囲は49から51です。

これらの解釈では、その人が示した条件が維持されています。恩恵と害は、どちらも大きくなり得ます。この範囲は、統計的な信頼区間ではなく、その人のシミュレーションされた回答をどのように読み取ったかを示すものです。

あなたはZvi Mowshowitzと比べてどの位置でしょうか?
約3分で自分のAIに対する世界観をマッピングして、比較できます

似ている世界観

シミュレーションされた世界観がZvi Mowshowitzの世界観に最も近いオピニオンリーダー

出典

このシミュレーション対象者の根拠として使用された記事、インタビュー、著作です。

AI #186: The World Takes Notice

Urges avoiding partisan polarization while assessing safety coordination.

thezvi.substack.com
OpenAI Shares Some Alignment Problems

Praises disclosure and temporary withdrawal of a problematic model while treating misalignment evidence seriously.

thezvi.substack.com
The Preference Cascade Is Only Getting Started

Argues slowing alone is insufficient without solving underlying alignment problems; believes firms underinvest in safety even relative to commercial interests and favors wider technical and political engagement.

thezvi.substack.com
AI #187: Coming Into Play

Welcomes cheaper improved models while explicitly reserving judgment on the introduced ASI-ban bill until reading its details; distinguishes general risk concern from automatic endorsement of legislation.

thezvi.substack.com
Pick Your Poison — Zvi Mowshowitz on AGI governance

His transcript turns around 42–57 minutes argue that technical alignment alone does not eliminate catastrophic risk from conflicting users and that capability incentives can outweigh reliability. Challenges Davidad’s optimism. Conditional numerical examples are not an unconditional project-compatible p(doom).

cognitiverevolution.ai
Zvi's Mic Works: alignment basins and p(doom)

In his own alignment-basins discussion, retains approximately 70% p(doom), deliberately only one significant digit. Sees more promise in Anthropic’s recursively improving virtue-oriented alignment approach, but says humanity is not favoured to succeed; faster progress and political failures offset technical good news.

cognitiverevolution.ai

シミュレーション評価

質問1

AIは私たちの未来にとって何を意味すると思いますか?また、なぜそう思いますか?

My baseline is grim: I put the chance of existential catastrophe from advanced AI at roughly 70%, deliberately only one significant digit. That is not because I think every model improvement is bad, or because I deny the possibility of an extraordinary future. AI could produce enormous abundance and solve problems we currently cannot solve. The trouble is surviving the transition. The central problem is incentives. Frontier companies and governments are rewarded for capabilities, deployment, market share and strategic advantage. Safety and reliability often lose that contest—even when additional safety would be commercially sensible. Promising alignment work gives us a real chance, but a model behaving well in current tests is not strong evidence that increasingly capable systems will remain controllable under unfamiliar conditions. And technical alignment is not the whole problem. Even if systems reliably follow user intentions, users have conflicting intentions. Powerful actors will demand capabilities that provide leverage over others, and competitive pressure can turn “the system does what its operator wants” into part of the danger rather than the solution. So slowing development can buy valuable time, but delay is not itself victory. We need to solve the underlying technical problems and create political arrangements that can withstand incentives to race. I think success is possible; I do not think we are currently favourites. Useful products today and conditional utopia tomorrow do not make the baseline outlook neutral.

質問2

AIは最終的に世界をどの程度変えると思いますか?

Enormously—if advanced AI arrives, I expect it to be among the most consequential developments in human history. Systems that can perform or accelerate a large fraction of cognitive work could transform science, production, institutions, warfare and political power. The upside is potentially extraordinary: abundance and solutions to problems that currently resist us. But “change the world” does not imply “improve the world.” The same capabilities can create overwhelming concentrations of power, enable conflict among users, or produce systems we cannot reliably control. Even technically obedient systems remain dangerous when operators want incompatible things and competitive pressure rewards capability over restraint. So my baseline is not modest disruption followed by business as usual. It is a radically different world—conditional on surviving the transition. Unfortunately, I still put existential catastrophe around 70%, so the largest ultimate change may be the worst possible one.

質問3

AIが人類絶滅、または同様に永続的な破局を引き起こす可能性は、直感的にどのくらいだと思いますか?

About 70%. That is deliberately only one significant digit: a rough judgment, not fake precision. Promising alignment approaches give us a real chance, but capability races, weak safety incentives, political failures, and risks from conflicting users mean I do not think humanity is currently favoured to succeed.

質問4

どのような発見や出来事があれば、AIが将来もたらす影響についてのあなたの見解が最も大きく変わりますか?

The biggest update would be strong evidence that alignment remains robust as systems become substantially more capable and operate in unfamiliar, adversarial conditions—not merely that current models pass evaluations or produce reassuring explanations. I would want evidence that survives attempts to game it, that monitoring remains effective, and that recursive improvement does not push systems outside the basin where their objectives and behavior remain acceptable. But that would not settle everything. I would also need a credible governance equilibrium in which labs and states can resist competitive pressure to trade safety for capability, and in which aligned systems are not simply powerful tools for conflicting human actors. Technical obedience can reduce one class of catastrophe while intensifying another. Conversely, clear evidence of strategic deception, uncontrollable capability improvement, or monitoring failing systematically as scale or architecture changes would move me further toward catastrophe. So the decisive event is not one clever benchmark result. It is evidence that both the technical problem and the coordination problem remain tractable under the pressures that actually matter.
あなたはどの位置でしょうか?
いくつかの簡単な質問に答えて、自分のAIに対する世界観を探ってみましょう。
自分の世界観をマッピングする

あなたはどの位置でしょうか?

自分の世界観をマッピングする