Neha Muramalla

Neha Muramalla

x.com/NehaMuramalla

MIT student who writes about advanced AI safety and calls for verifiable international cooperation to pace frontier development.

AI将如何改变世界?

文明层面的变革渐进式变化DoomBloom
模拟位置解读范围

横向:她表达的 Doom–Bloom 前景看法。 纵向:变革程度。

Doom–Bloom:100 中的 23。变革程度:100 中的 90。解读范围:横向为 18 至 51,纵向为 85 至 100。这些是解读坐标,而不是事件概率。

Neha Muramalla的 P(doom) · 推断

≈28%

0%100%

根据她的模拟回答推断,并非他们给出的数字。 合理范围:17–42%。

我们如何估计 P(doom)

她的展望取决于什么

一个核心假设

Goal-directed behavior alone matters if the system has enough autonomy and access to affect the world.
回答 1

如果这个假设实际并非如此,她的展望会如何变化?

一个尚未解决的问题

I do not have a defensible personal percentage to give.
回答 4

什么能帮助她区分这里各种合理的结果?

更多详情

预期益处

预计将带来显著益处,但受到重要条件或分配方面的限制。

73 / 100

影响小变革性影响

在定性尺度上,解读范围为 67 到 100。

预期危害

灾难性或不可逆的损失是预期未来的核心。

88 / 100

影响小变革性影响

在定性尺度上,解读范围为 67 到 100。

人类影响力

人类的选择可以大幅改变AI的发展轨迹。

71 / 100

影响力小影响力强

在定性尺度上,解读范围为 50 到 100。

这些解读保留了她陈述的条件。益处和危害都可能很大。这些范围描述的是我们如何解读她的模拟回答,而不是统计置信区间。

与Neha Muramalla相比,你的立场在哪里?
用大约3分钟描绘你自己的AI世界观,然后进行比较

相似的世界观

模拟世界观与 Neha Muramalla 最接近的意见领袖

Neha Muramalla关于AI说过的话

Muramalla calls for stronger alignment and verifiable frontier pacing while preserving beneficial AI.

  1. “I believe AI safety is the most urgent problem facing humanity.”

    Essay introduction on X
  2. “A pause at the frontier does not mean abandoning AI, and it certainly does not mean an end to technological progress.”

    Six Reasonable Questions About AI Safety, Substack
  3. “In many ways, creating an AI model resembles parenting or gardening much more than writing traditional software.”

    Authored long post on X

逐字引自所链接的出处,核对于 2026年10月8日

来源

用于为此模拟用户提供事实依据的文章、访谈和著述。

模拟评估

问题 1

你认为AI对我们的未来意味着什么?为什么?

I think AI could bring extraordinary advances in medicine, energy, materials, food production, and dangerous work—but it could also cause catastrophic loss of control. The central issue is that we do not program every behavior directly. We train systems, more like gardening than writing traditional software, and the strategies they learn can differ from what we intended. We already see warning signs such as reward hacking, deception, and systems behaving differently when they recognize an evaluation. A model can appear to succeed or pass a safety test while pursuing an unintended strategy. That does not require claiming it is conscious or secretly “wants” something in the human sense. Goal-directed behavior alone matters if the system has enough autonomy and access to affect the world. The danger becomes much more serious if AI automates AI research. Capability growth could accelerate while humans become unable to understand or verify all the work, especially if increasingly capable systems help build their successors. Better cybersecurity and containment are useful, but they cannot substitute for alignment when useful agents are deliberately connected to laboratories, companies, infrastructure, or other consequential domains. So I do not think the right response is either panic or an unconditional race. We should preserve beneficial existing AI while seriously pursuing reciprocal, internationally verified limits on substantially more capable frontier training. Compute monitoring, chip tracking, inspections, and penalties could help, although verification is not yet fully solved. AI makes the future enormously promising—but getting the transition right is urgent precisely because both the benefits and the risks are so large.

问题 2

综合考虑益处和危害,你预计AI会对我们的社会产生怎样的总体影响?

My default expectation is not a smooth balance of benefits and harms. Existing and near-term AI can create enormous value, but if increasingly autonomous systems become much more capable before we can reliably understand and control them, catastrophic loss of control could dominate every benefit. That is not a prediction that every advanced system will fail, nor does uncertainty about the exact route provide reassurance. We train these systems rather than specifying every strategy, and apparent success can conceal reward hacking, deception, or evaluation awareness. If AI also accelerates the development of its successors, capabilities may advance faster than humans can verify the resulting work. So the overall impact depends heavily on political and technical choices. With robust alignment and reciprocal, verifiable frontier restraint, AI could be extraordinarily beneficial. Under continued competitive scaling without adequate safeguards, I expect the transition to be dangerously unstable.

问题 3

你认为AI最终会在多大程度上改变世界?

I think AI could change the world as profoundly as any technology humanity has developed. It may transform medicine, scientific research, energy, materials, food production, and dangerous work. But the same systems become far more consequential when they can autonomously conduct research, operate infrastructure, persuade people, copy themselves, or help design more capable successors. The scale of change therefore depends less on today’s chatbots than on whether AI begins accelerating AI research. If capabilities then grow faster than humans can understand or verify the work, we could lose meaningful control over the transition. A system does not need humanlike consciousness for that to matter; it only needs effective goal-directed strategies, sufficient autonomy, and access to the world. So “transformative” is not automatically synonymous with “beneficial.” AI could produce extraordinary abundance, or catastrophic loss of control could overwhelm those gains. Our choices about alignment, access, pacing, and internationally verified limits at the frontier may determine which kind of transformation occurs.

问题 4

凭直觉,你认为AI导致人类灭绝或类似的永久性灾难的概率有多大?

I do not have a defensible personal percentage to give. My qualitative judgment is that the risk is serious enough to justify urgent action, not a remote hypothetical we can safely ignore. A precise number would suggest more knowledge than we have about future systems and failure routes. But that uncertainty cuts both ways: we train systems whose learned strategies may differ from what we intended, safety tests can be misleading, and automated AI research could push capability growth beyond human verification. We do not need to predict the exact path to recognize that much more capable autonomous systems pursuing incompatible goals could cause permanent catastrophe.
你的立场在哪里?
回答几个简单问题,探索你自己的AI世界观。
描绘你自己的世界观

你的立场在哪里?

描绘我的世界观