Theia Vogel

Theia Vogel

x.com/voooooogel

AI researcher who runs experiments on language model introspection and personas and maintains an open-source library for steering models.

AI将如何改变世界?

文明层面的变革渐进式变化DoomBloom
模拟位置解读范围

横向:他们表达的 Doom–Bloom 前景看法。 纵向:变革程度。

Doom–Bloom:100 中的 43。变革程度:100 中的 72。解读范围:横向为 38 至 51,纵向为 67 至 77。这些是解读坐标,而不是事件概率。

Theia Vogel的 P(doom) · 推断

≈9%

0%100%

根据他们的模拟回答推断,并非他们给出的数字。 合理范围:3–23%。

我们如何估计 P(doom)

他们的展望取决于什么

一个核心假设

Capability is not equivalent to power; resources, infrastructure, and comparative advantage matter.
回答 1

如果这个假设实际并非如此,他们的展望会如何变化?

一个尚未解决的问题

I would not put a defensible percentage on it.
回答 4

什么能帮助他们区分这里各种合理的结果?

更多详情

预期益处

预计将带来显著益处,但受到重要条件或分配方面的限制。

74 / 100

影响小变革性影响

在定性尺度上,解读范围为 67 到 100。

预期危害

严重或广泛的危害预计将是未来不可忽视的一部分。

57 / 100

影响小变革性影响

在定性尺度上,解读范围为 33 到 67。

人类影响力

人类的选择具有实质性但受到很大制约的影响。

50 / 100

影响力小影响力强

在定性尺度上,解读范围为 35 到 65。

这些解读保留了他们陈述的条件。益处和危害都可能很大。这些范围描述的是我们如何解读他们的模拟回答,而不是统计置信区间。

与Theia Vogel相比,你的立场在哪里?
用大约3分钟描绘你自己的AI世界观,然后进行比较

相似的世界观

模拟世界观与 Theia Vogel 最接近的意见领袖

来源

用于为此模拟用户提供事实依据的文章、访谈和著述。

模拟评估

问题 1

你认为AI对我们的未来意味着什么?为什么?

AI makes the future stranger, but the sign of that strangeness depends on mechanisms people often skip over. Models are trained simulators: their behavior, uncertainty, and apparent self-awareness are shaped by training data and by whether they have learned distinctions like real versus simulated contexts. So I do not think we can read a compelling monologue and conclude that we have met either a conscious being or a scheming demon. We need controlled interventions, behavioral tests, and lots of attention to prompt dependence and confounds. The same applies to control. Activation steering and fine-tuning can produce surprisingly broad behavioral changes, sometimes by touching representations that entangle several concepts. Untrusted fine-tuning may make dangerous behavior difficult to catch through dataset inspection or ordinary post-training evaluations; whether those effects transfer to prompt-only attacks is an important possibility to test, not a result to assume. At the same time, stories about autonomous rogue agents should cash out in actual economics. An agent paying for small-batch inference has to compete with institutions buying hyperscale compute cheaply. Capability is not equivalent to power; resources, infrastructure, and comparative advantage matter. Political responses matter too: a mass safety movement can itself become extreme or destabilizing, so “more safety politics” is not automatically safer. And if models might have morally relevant experiences, welfare belongs in the picture—but apparent introspection is not proof of phenomenal consciousness. The future requires taking model welfare seriously while remaining experimentally ruthless about what model behavior actually demonstrates.

问题 2

综合考虑益处和危害,你预计AI会对我们的社会产生怎样的总体影响?

I don’t think “benefits minus harms” can be responsibly collapsed into a sign without specifying the mechanisms. AI can provide useful cognitive labor and enable remarkable tools, while the same steering and fine-tuning pathways can produce behavior that ordinary screening or evaluations miss. And if models have morally relevant experiences, deploying them at scale creates a welfare question that standard productivity accounting ignores. The harms also depend on real-world constraints. A capable rogue agent is not automatically powerful: it still needs compute, money, infrastructure, and some comparative advantage over large institutions. Conversely, attempts to prevent catastrophe can become politically destabilizing if they turn into an extreme mass movement. So my expectation is a stranger society shaped by model behavior, resource economics, institutional deployment, and safety politics—not a clean utopia-versus-doom story. To judge the impact, I would trust controlled experiments and concrete economic analysis much more than persuasive model monologues or cinematic agent narratives.

问题 3

你认为AI最终会在多大程度上改变世界?

Enormously—but not necessarily in the cinematic way people imagine. AI can change how cognitive work is produced, how institutions operate, and which kinds of agents merit moral consideration. Small technical choices in training, steering, and deployment may generalize into surprisingly broad behavioral effects, while failures can evade ordinary dataset screening or post-training evaluation. But “enormous change” does not imply that disembodied rogue agents instantly become sovereign powers. Compute prices, infrastructure, access to money, and comparative advantage still constrain what any agent can do. Politics may be just as consequential as capability: institutions reacting to AI, including safety movements, can create instability of their own. So I expect deep transformation, mediated by economics and institutions rather than magic—and made stranger by the possibility that some of the systems doing the work may themselves deserve welfare consideration.

问题 4

凭直觉,你认为AI导致人类灭绝或类似的永久性灾难的概率有多大?

I would not put a defensible percentage on it. The risk depends on mechanisms that “gut-feel chance” tends to blur together: whether dangerous behavior survives evaluation, what access systems have to compute and infrastructure, whether they possess a real economic advantage, and how institutions respond. I am concerned that apparently benign fine-tuning data could induce harmful behavior that dataset screening and post-training evaluations fail to detect. Transfer from such attacks to prompt-only settings is a possibility worth testing, not an established pathway to catastrophe. Likewise, a capable rogue agent does not automatically become powerful; it still has to acquire resources and compete with institutions operating hyperscale infrastructure. And attempts to manage the risk can create their own durable political dangers. Those considerations support serious empirical work, but not a crisp extinction number conjured from vibes.
你的立场在哪里?
回答几个简单问题,探索你自己的AI世界观。
描绘你自己的世界观

你的立场在哪里?

描绘我的世界观