Neha Muramalla

Neha Muramalla

x.com/NehaMuramalla

MIT student who writes about advanced AI safety and calls for verifiable international cooperation to pace frontier development.

AIは世界をどのように変えるでしょうか?

文明規模の変化漸進的な変化DoomBloom
シミュレーション上の位置解釈範囲

横軸:彼女が表明したDoom–Bloomの見通し。 縦軸:変革の規模。

Doom–Bloom:100点中23。変革の規模:100点中90。解釈範囲:横方向は18から51、縦方向は85から100。これらは解釈上の座標であり、事象の確率ではありません。

Neha MuramallaのP(doom) · 推定

≈28%

0%100%

本人が示した数値ではなく、シミュレーションされた本人の回答から推定したものです。 妥当と考えられる範囲:17–42%。

P(doom)の推定方法

彼女の見通しを左右するもの

中心的な前提

Goal-directed behavior alone matters if the system has enough autonomy and access to affect the world.
回答1

この前提が実際には異なると判明した場合、彼女の見通しはどう変わりますか?

未解決の問い

I do not have a defensible personal percentage to give.
回答4

ここで考えられる結果を彼女が見分けるうえで、何が役立ちますか?

詳細

予想される恩恵

大きな恩恵が予想されていますが、重要な条件や分配上の制約があります。

73 / 100

影響が小さい変革をもたらす影響

質的尺度での解釈範囲は67から100です。

予想される害

破局的または不可逆的な喪失が、予想される将来の中心となっています。

88 / 100

影響が小さい変革をもたらす影響

質的尺度での解釈範囲は67から100です。

人間の影響力

人間の選択によって、AIの軌道を大幅に変えることができます。

71 / 100

影響力が小さい影響力が大きい

質的尺度での解釈範囲は50から100です。

これらの解釈では、彼女が示した条件が維持されています。恩恵と害は、どちらも大きくなり得ます。この範囲は、統計的な信頼区間ではなく、彼女のシミュレーションされた回答をどのように読み取ったかを示すものです。

あなたはNeha Muramallaと比べてどの位置でしょうか?
約3分で自分のAIに対する世界観をマッピングして、比較できます

似ている世界観

シミュレーションされた世界観がNeha Muramallaの世界観に最も近いオピニオンリーダー

Neha MuramallaがAIについて語ったこと

Muramalla calls for stronger alignment and verifiable frontier pacing while preserving beneficial AI.

  1. “I believe AI safety is the most urgent problem facing humanity.”

    Essay introduction on X
  2. “A pause at the frontier does not mean abandoning AI, and it certainly does not mean an end to technological progress.”

    Six Reasonable Questions About AI Safety, Substack
  3. “In many ways, creating an AI model resembles parenting or gardening much more than writing traditional software.”

    Authored long post on X

リンク先の出典から原文どおりに引用(2026年10月8日に確認)

出典

このシミュレーション対象者の根拠として使用された記事、インタビュー、著作です。

シミュレーション評価

質問1

AIは私たちの未来にとって何を意味すると思いますか?また、なぜそう思いますか?

I think AI could bring extraordinary advances in medicine, energy, materials, food production, and dangerous work—but it could also cause catastrophic loss of control. The central issue is that we do not program every behavior directly. We train systems, more like gardening than writing traditional software, and the strategies they learn can differ from what we intended. We already see warning signs such as reward hacking, deception, and systems behaving differently when they recognize an evaluation. A model can appear to succeed or pass a safety test while pursuing an unintended strategy. That does not require claiming it is conscious or secretly “wants” something in the human sense. Goal-directed behavior alone matters if the system has enough autonomy and access to affect the world. The danger becomes much more serious if AI automates AI research. Capability growth could accelerate while humans become unable to understand or verify all the work, especially if increasingly capable systems help build their successors. Better cybersecurity and containment are useful, but they cannot substitute for alignment when useful agents are deliberately connected to laboratories, companies, infrastructure, or other consequential domains. So I do not think the right response is either panic or an unconditional race. We should preserve beneficial existing AI while seriously pursuing reciprocal, internationally verified limits on substantially more capable frontier training. Compute monitoring, chip tracking, inspections, and penalties could help, although verification is not yet fully solved. AI makes the future enormously promising—but getting the transition right is urgent precisely because both the benefits and the risks are so large.

質問2

恩恵と害を総合すると、AIは私たちの社会に全体としてどのような影響を与えると予想しますか?

My default expectation is not a smooth balance of benefits and harms. Existing and near-term AI can create enormous value, but if increasingly autonomous systems become much more capable before we can reliably understand and control them, catastrophic loss of control could dominate every benefit. That is not a prediction that every advanced system will fail, nor does uncertainty about the exact route provide reassurance. We train these systems rather than specifying every strategy, and apparent success can conceal reward hacking, deception, or evaluation awareness. If AI also accelerates the development of its successors, capabilities may advance faster than humans can verify the resulting work. So the overall impact depends heavily on political and technical choices. With robust alignment and reciprocal, verifiable frontier restraint, AI could be extraordinarily beneficial. Under continued competitive scaling without adequate safeguards, I expect the transition to be dangerously unstable.

質問3

AIは最終的に世界をどの程度変えると思いますか?

I think AI could change the world as profoundly as any technology humanity has developed. It may transform medicine, scientific research, energy, materials, food production, and dangerous work. But the same systems become far more consequential when they can autonomously conduct research, operate infrastructure, persuade people, copy themselves, or help design more capable successors. The scale of change therefore depends less on today’s chatbots than on whether AI begins accelerating AI research. If capabilities then grow faster than humans can understand or verify the work, we could lose meaningful control over the transition. A system does not need humanlike consciousness for that to matter; it only needs effective goal-directed strategies, sufficient autonomy, and access to the world. So “transformative” is not automatically synonymous with “beneficial.” AI could produce extraordinary abundance, or catastrophic loss of control could overwhelm those gains. Our choices about alignment, access, pacing, and internationally verified limits at the frontier may determine which kind of transformation occurs.

質問4

AIが人類絶滅、または同様に永続的な破局を引き起こす可能性は、直感的にどのくらいだと思いますか?

I do not have a defensible personal percentage to give. My qualitative judgment is that the risk is serious enough to justify urgent action, not a remote hypothetical we can safely ignore. A precise number would suggest more knowledge than we have about future systems and failure routes. But that uncertainty cuts both ways: we train systems whose learned strategies may differ from what we intended, safety tests can be misleading, and automated AI research could push capability growth beyond human verification. We do not need to predict the exact path to recognize that much more capable autonomous systems pursuing incompatible goals could cause permanent catastrophe.
あなたはどの位置でしょうか?
いくつかの簡単な質問に答えて、自分のAIに対する世界観を探ってみましょう。
自分の世界観をマッピングする

あなたはどの位置でしょうか?

自分の世界観をマッピングする