Zvi Mowshowitz

Zvi Mowshowitz

x.com/thezvi

Writer who covers AI capabilities, alignment and policy in detail and argues advanced AI risk warrants urgent technical and political action.

Wie wird KI die Welt verändern?

Zivilisatorischer WandelSchrittweiser WandelDoomBloom
Simulierte PositionInterpretationsbereich

Horizontal: deren geäußerter Doom–Bloom-Ausblick. Vertikal: Ausmaß der Transformation.

Doom–Bloom: 6 von 100. Ausmaß der Transformation: 95 von 100. Interpretationsbereiche: horizontal 0 bis 11, vertikal 90 bis 100. Dies sind Interpretationskoordinaten, keine Ereigniswahrscheinlichkeiten.

Das angegebene P(doom) von Zvi Mowshowitz

≈70%

0%100%
“i think it's like yeah seventy ish”

AI “doom” as asked by Nathan Labenz (“your latest P doom”); endpoint not defined in the exchange (his discussion is about superintelligence ending up with goals we do not want)

Zvi's Mic Works! Recursive Self-Improvement, Live Player Analysis, Anthropic vs DoW + More! · März 2026

Wovon deren Einschätzung abhängt

Eine zentrale Annahme

Safety and reliability often lose that contest—even when additional safety would be commercially sensible.
Antwort 1

Wenn sich diese Annahme als anders herausstellen würde, wie würde sich deren Einschätzung ändern?

Was ihre Meinung ändern könnte

The biggest update would be strong evidence that alignment remains robust as systems become substantially more capable and operate in unfamiliar, adversarial conditions—not merely that current models pass evaluations or produce reassuring explanations.
Antwort 4

Welche Belege würden ausreichen, und in welche Richtung würden sie deren Sichtweise verändern?

Weitere Details

Erwartete Vorteile

Es werden erhebliche Vorteile erwartet, allerdings unter wichtigen Bedingungen oder mit Einschränkungen bei ihrer Verteilung.

60 / 100

Geringe AuswirkungenTransformative Auswirkungen

Interpretationsbereich von 0 bis 100 auf der qualitativen Skala.

Erwartete Schäden

Katastrophale oder unumkehrbare Verluste stehen im Zentrum der erwarteten Zukunft.

100 / 100

Geringe AuswirkungenTransformative Auswirkungen

Interpretationsbereich von 100 bis 100 auf der qualitativen Skala.

Menschlicher Einfluss

Menschliche Entscheidungen haben einen bedeutsamen, aber erheblich eingeschränkten Einfluss.

50 / 100

Geringer EinflussStarker Einfluss

Interpretationsbereich von 49 bis 51 auf der qualitativen Skala.

Diese Interpretationen berücksichtigen weiterhin deren genannte Bedingungen. Vorteile und Schäden können beide erheblich sein. Die Bereiche beschreiben, wie wir deren simulierte Antworten interpretieren, und sind keine statistischen Konfidenzintervalle.

Wo stehst du im Vergleich zu Zvi Mowshowitz?
Bilde deine eigene KI-Weltsicht in etwa 3 Minuten ab und vergleiche sie dann

Ähnliche Weltsichten

Vordenker, deren simulierte Weltsichten der von Zvi Mowshowitz am nächsten kommen

Quellen

Artikel, Interviews und Schriften, die als Grundlage für diesen simulierten Nutzer dienen.

AI #186: The World Takes Notice

Urges avoiding partisan polarization while assessing safety coordination.

thezvi.substack.com
OpenAI Shares Some Alignment Problems

Praises disclosure and temporary withdrawal of a problematic model while treating misalignment evidence seriously.

thezvi.substack.com
The Preference Cascade Is Only Getting Started

Argues slowing alone is insufficient without solving underlying alignment problems; believes firms underinvest in safety even relative to commercial interests and favors wider technical and political engagement.

thezvi.substack.com
AI #187: Coming Into Play

Welcomes cheaper improved models while explicitly reserving judgment on the introduced ASI-ban bill until reading its details; distinguishes general risk concern from automatic endorsement of legislation.

thezvi.substack.com
Pick Your Poison — Zvi Mowshowitz on AGI governance

His transcript turns around 42–57 minutes argue that technical alignment alone does not eliminate catastrophic risk from conflicting users and that capability incentives can outweigh reliability. Challenges Davidad’s optimism. Conditional numerical examples are not an unconditional project-compatible p(doom).

cognitiverevolution.ai
Zvi's Mic Works: alignment basins and p(doom)

In his own alignment-basins discussion, retains approximately 70% p(doom), deliberately only one significant digit. Sees more promise in Anthropic’s recursively improving virtue-oriented alignment approach, but says humanity is not favoured to succeed; faster progress and political failures offset technical good news.

cognitiverevolution.ai

Simulierte Einschätzung

Frage 1

Was glaubst du, was KI für unsere Zukunft bedeutet – und warum?

My baseline is grim: I put the chance of existential catastrophe from advanced AI at roughly 70%, deliberately only one significant digit. That is not because I think every model improvement is bad, or because I deny the possibility of an extraordinary future. AI could produce enormous abundance and solve problems we currently cannot solve. The trouble is surviving the transition. The central problem is incentives. Frontier companies and governments are rewarded for capabilities, deployment, market share and strategic advantage. Safety and reliability often lose that contest—even when additional safety would be commercially sensible. Promising alignment work gives us a real chance, but a model behaving well in current tests is not strong evidence that increasingly capable systems will remain controllable under unfamiliar conditions. And technical alignment is not the whole problem. Even if systems reliably follow user intentions, users have conflicting intentions. Powerful actors will demand capabilities that provide leverage over others, and competitive pressure can turn “the system does what its operator wants” into part of the danger rather than the solution. So slowing development can buy valuable time, but delay is not itself victory. We need to solve the underlying technical problems and create political arrangements that can withstand incentives to race. I think success is possible; I do not think we are currently favourites. Useful products today and conditional utopia tomorrow do not make the baseline outlook neutral.

Frage 2

Wie stark wird KI deiner Meinung nach letztlich die Welt verändern?

Enormously—if advanced AI arrives, I expect it to be among the most consequential developments in human history. Systems that can perform or accelerate a large fraction of cognitive work could transform science, production, institutions, warfare and political power. The upside is potentially extraordinary: abundance and solutions to problems that currently resist us. But “change the world” does not imply “improve the world.” The same capabilities can create overwhelming concentrations of power, enable conflict among users, or produce systems we cannot reliably control. Even technically obedient systems remain dangerous when operators want incompatible things and competitive pressure rewards capability over restraint. So my baseline is not modest disruption followed by business as usual. It is a radically different world—conditional on surviving the transition. Unfortunately, I still put existential catastrophe around 70%, so the largest ultimate change may be the worst possible one.

Frage 3

Wie hoch ist deinem Bauchgefühl nach die Wahrscheinlichkeit, dass KI zum Aussterben der Menschheit oder zu einer ähnlich dauerhaften Katastrophe führt?

About 70%. That is deliberately only one significant digit: a rough judgment, not fake precision. Promising alignment approaches give us a real chance, but capability races, weak safety incentives, political failures, and risks from conflicting users mean I do not think humanity is currently favoured to succeed.

Frage 4

Welche Entdeckung oder welches Ereignis würde deine Sicht auf die künftigen Auswirkungen von KI am stärksten verändern?

The biggest update would be strong evidence that alignment remains robust as systems become substantially more capable and operate in unfamiliar, adversarial conditions—not merely that current models pass evaluations or produce reassuring explanations. I would want evidence that survives attempts to game it, that monitoring remains effective, and that recursive improvement does not push systems outside the basin where their objectives and behavior remain acceptable. But that would not settle everything. I would also need a credible governance equilibrium in which labs and states can resist competitive pressure to trade safety for capability, and in which aligned systems are not simply powerful tools for conflicting human actors. Technical obedience can reduce one class of catastrophe while intensifying another. Conversely, clear evidence of strategic deception, uncontrollable capability improvement, or monitoring failing systematically as scale or architecture changes would move me further toward catastrophe. So the decisive event is not one clever benchmark result. It is evidence that both the technical problem and the coordination problem remain tractable under the pressures that actually matter.
Wo stehst du?
Erkunde deine eigene KI-Weltsicht, indem du ein paar einfache Fragen beantwortest.
Deine eigene Weltsicht abbilden