Economics blogger who expects AI to transform science, argues people can keep valuable jobs and worries about AI-enabled bioterrorism.

Como a IA mudará o mundo?

Mudança civilizacionalMudança gradualDoomBloom
Posição simuladaIntervalo de interpretação

Na horizontal: a perspectiva Doom–Bloom expressa por ele. Para cima: escala da transformação.

Doom–Bloom: 47 de 100. Escala da transformação: 87 de 100. Intervalos de interpretação: 42 a 75 na horizontal, 75 a 100 na vertical. Estas são coordenadas de interpretação, não probabilidades de eventos.

P(doom) declarado de Noah Smith

≈10%

0%100%
“about a 10% chance of bringing down civilization”

Civilization collapse from AI-enabled bioterrorism; not human extinction

Here’s how we’re all going to die · ago. de 2026

Do que a perspectiva dele depende

Uma premissa central

If we give an AI tools, credentials, memory, and permission to execute a long project, then a malicious human can use it to do enormous damage even if the system remains perfectly obedient.
Resposta 4

Se essa premissa se revelasse diferente, como a perspectiva dele mudaria?

Uma questão não resolvida

The key uncertainty is whether the relevant biological capabilities are actually feasible.
Resposta 3

O que ajudaria essa pessoa a distinguir os resultados plausíveis aqui?

O que poderia mudar essa opinião

If experts demonstrated that AI agents still cannot materially help design or execute a catastrophic biological attack—or that systems reliably refuse dangerous requests even under determined attempts—I would sharply reduce my catastrophe estimate.
Resposta 5

Que evidência seria suficiente e em que direção ela mudaria a visão dele?

Mais detalhes

Benefícios esperados

Esperam-se ganhos transformadores e amplamente valiosos.

97 / 100

Pouco impactoImpacto transformador

Intervalo de interpretação de 100 a 100 na escala qualitativa.

Danos esperados

Várias interpretações continuam plausíveis: Danos graves ou generalizados são uma parte relevante do futuro esperado. / Uma perda catastrófica ou irreversível ocupa um lugar central no futuro esperado.

81 / 100

Pouco impactoImpacto transformador

Intervalo de interpretação de 67 a 100 na escala qualitativa.

Influência humana

Uma estimativa provisória com base nas suas respostas; o intervalo mais amplo mostra outras interpretações plausíveis.

53 / 100

Pouca influênciaForte influência

Intervalo de interpretação de 23 a 100 na escala qualitativa.

Estas interpretações mantêm as condições que ele declarou. Tanto os benefícios quanto os danos podem ser substanciais. Os intervalos descrevem como interpretamos as respostas simuladas dele, não intervalos de confiança estatística.

Onde você se situa em relação a Noah Smith?
Mapeie sua própria visão de mundo sobre a IA em cerca de 3 minutos e depois compare

Visões de mundo semelhantes

Líderes de opinião cujas visões de mundo simuladas são mais próximas da visão de Noah Smith

Fontes

Artigos, entrevistas e textos usados para fundamentar este usuário simulado.

My thoughts on AI safety

The accessible introduction calls the consequences of godlike AI deeply unknowable. The remainder is paywalled; later public essays and interviews supply the substantive current position.

noahpinion.blog
Updated thoughts on AI risk

Publicly revises his earlier chatbot-focused dismissal after observing agentic coding. Autonomous tool use and economic pressure to remove humans from loops make catastrophic misuse more plausible. Remains comparatively skeptical of a near-term robot takeover.

noahpinion.blog
Superintelligence is already here, today

Argues that combining human-like reasoning with computers’ exceptional recall and calculation already creates superhuman capabilities. Expects major scientific transformation; this is his broad definition of superintelligence, not a claim that every system is an autonomous omnipotent agent.

noahpinion.blog
Noah Smith returns to explain his P(doom) update — Doom Debates

Speaker-labeled transcript: Noah at 07:21 endorses roughly 10% for catastrophic biological misuse. At 08:55 he expects survivors and is unsure about rebuilding. At 09:25 he declines to endorse the interviewer’s proposed 5% permanent-doom number. At 12:26–14:59 he identifies biological feasibility and resistance to jailbreaks as updates. At 17:49–18:18 he explains why malicious human use dominates his concern. Do not import Liron’s forecasts into Noah’s answers.

lironshapira.substack.com
Plentiful, high-paying jobs in the age of AI

Clarifies that plentiful employment under extremely capable AI is possible, not guaranteed. Relative costs and constraints on AI supply can preserve human comparative advantage even when machines outperform people at every task.

noahpinion.blog
Your future job will be to keep AI on task

Emphasizes humans’ comparative advantage in knowing what they want, with future work organized around directing AI. The accessible introduction supports this thesis; avoid inventing detailed empirical findings from inaccessible portions.

noahpinion.blog
Here’s how we’re all going to die

Assigns an informal 10% chance to AI-enabled bioterror bringing down civilization and 30% to world-changing destruction, without a precise horizon. Calls this much more serious than other AI harms while retaining enthusiasm for AI. These are not extinction odds; a separate annual-risk example is hypothetical, not his forecast.

noahpinion.blog
AI keeps stubbornly refusing to take our jobs

Distinguishes replacing tasks from eliminating occupations. Interprets contemporary employment evidence as inconsistent with an imminent job apocalypse; expects humans to continue directing AI, without claiming that no occupation will ever disappear.

noahpinion.blog
Two missing pieces in the AI safety discussion

Argues that safety advocates need concrete threats that persuade skeptics and must address Chinese leaders’ incentives for coordinated pacing. Revises his earlier idea that merely staying ahead would produce cooperation: domestic threats from China’s own models could instead change its incentives.

noahpinion.blog

Avaliação simulada

Pergunta 1

O que você acha que a IA significa para o nosso futuro — e por quê?

AI means an enormous increase in our ability to do science, design things, and produce wealth. Combining human-like reasoning with computers’ memory, speed, and calculation is already a kind of superhuman capability. And the standard objection—“look, the chatbot said something stupid”—is increasingly irrelevant once agents can use tools and carry out long, multi-step projects. I also reject the lazy jump from “AI can perform this task” to “humans will have no jobs.” Jobs are bundles of tasks, and humans still know what they want. Directing agents, choosing goals, checking results, and adapting output to real human needs can itself be valuable work. Relative cost matters too: even if machines outperform us technically, limited or expensive machine intelligence can leave humans with comparative advantage. That makes continued employment plausible, not guaranteed. But the biggest issue is catastrophic misuse. I’m less worried about an alien machine spontaneously becoming a machine god than about a malicious person ordering an obedient, highly capable agent to complete a dangerous project. Biological misuse is the nightmare because agentic systems could potentially help with an end-to-end effort, not merely answer isolated questions. I’m not a virologist, so the feasibility is a crucial uncertainty. Still, I put roughly a 10% chance on AI-enabled bioterror bringing down civilization and about 30% on world-changing destruction. Those are rough judgments, not extinction probabilities. So my view is simultaneously enthusiastic and alarmed: AI could deliver a scientific and economic transformation while preserving valuable human work, and it could also give terrible people unprecedented leverage. Anyone treating only one side as real is missing the future.

Pergunta 2

Quanto você acha que a IA acabará mudando o mundo?

Enormously—probably on the scale of the biggest general-purpose technologies, because it expands the supply of reasoning itself. Systems that can search, calculate, code, design, and run long projects could accelerate science and production across much of the economy. That does not mean benchmark gains instantly become factories, medicines, or functioning institutions; physical deployment and social adaptation remain bottlenecks. Nor does enormous change imply that humans become economically useless. Replacing tasks is not the same as eliminating occupations. People still choose goals, direct systems, judge whether results fit human needs, and operate where machine intelligence is costly or constrained. Some jobs will disappear and many will be reorganized, but “AI gets better, therefore nobody works” skips the actual economics. The darker possibility is equally world-changing. Capable agents could let malicious humans execute dangerous projects at a scale they could not manage alone, especially in biology. That could mean not just disruption but civilizational catastrophe. So I expect AI to transform science, production, and work—and I think there is a frightening chance it transforms the world through mass destruction instead.

Pergunta 3

Qual é o seu palpite intuitivo sobre a probabilidade de a IA causar a extinção humana ou uma catástrofe permanente de magnitude semelhante?

I don’t have a useful number for human extinction or permanent collapse. My rough estimate is about a 10% chance that AI-enabled bioterror brings down civilization, but that is not a 10% extinction estimate. I expect there would probably be survivors; whether they rebuild is a separate question I cannot quantify responsibly. I’d also put roughly 30% on world-changing destruction from biological misuse. Again, that covers outcomes far short of extinction. The mechanism I worry about is not a machine god deciding to erase humanity. It is a malicious human using capable, obedient agents to carry out an end-to-end biological project. The key uncertainty is whether the relevant biological capabilities are actually feasible. So I’m very alarmed, but I’m not going to convert that alarm into a fake precise permanent-doom number.

Pergunta 4

Você espera que as pessoas mantenham o controle de sistemas de IA mais inteligentes que os humanos, e por quê?

“Smarter than humans” is too vague to answer with a clean yes or no. A system can be superhuman at coding, scientific reasoning, or planning while still functioning as a tool that follows human goals. Intelligence does not automatically generate an independent desire to seize power, and it certainly does not erase physical bottlenecks, institutional constraints, or human control over infrastructure. But agentic systems make control substantially harder. If we give an AI tools, credentials, memory, and permission to execute a long project, then a malicious human can use it to do enormous damage even if the system remains perfectly obedient. That is the control problem I find most concrete: not necessarily losing control *to* the AI, but losing control of what humans can accomplish *through* AI. So yes, I expect people can retain meaningful control over many systems smarter than themselves. I do not expect that control to guarantee safety. A compliant superhuman agent in the hands of a terrorist could be more dangerous than a mildly unruly one. The important distinction is between controlling the system’s behavior and controlling the dangerous capabilities it gives to people.

Pergunta 5

Qual descoberta ou acontecimento mais mudaria sua visão sobre o impacto futuro da IA?

The biggest update would come from biology. If experts demonstrated that AI agents still cannot materially help design or execute a catastrophic biological attack—or that systems reliably refuse dangerous requests even under determined attempts—I would sharply reduce my catastrophe estimate. Conversely, a credible demonstration of an agent autonomously completing most of that end-to-end pipeline would raise it dramatically. That matters far more than another chatbot saying something embarrassing. On the economic side, I would update if widespread deployment actually produced sustained mass unemployment rather than merely changing tasks and occupations. I’d especially want evidence that humans cannot retain useful roles directing, checking, or complementing agents even when machine intelligence remains costly or constrained. Until then, “the model beat a human on a benchmark, therefore humans are economically obsolete” is not an argument; it is a missing argument. A truly autonomous system developing persistent goals, acquiring resources, and evading human control would also force me to take the machine-takeover scenario much more seriously. But right now the clearest path to catastrophe is simpler: a dangerous human using an obedient agent.
Onde você se situa?
Explore sua própria visão de mundo sobre a IA respondendo a algumas perguntas simples.
Mapeie sua própria visão de mundo

Onde você se situa?

Mapear minha visão de mundo