Theia Vogel

Theia Vogel

x.com/voooooogel

AI researcher who runs experiments on language model introspection and personas and maintains an open-source library for steering models.

AIは世界をどのように変えるでしょうか?

文明規模の変化漸進的な変化DoomBloom
シミュレーション上の位置解釈範囲

横軸:その人が表明したDoom–Bloomの見通し。 縦軸:変革の規模。

Doom–Bloom:100点中43。変革の規模:100点中72。解釈範囲:横方向は38から51、縦方向は67から77。これらは解釈上の座標であり、事象の確率ではありません。

Theia VogelのP(doom) · 推定

≈9%

0%100%

本人が示した数値ではなく、シミュレーションされた本人の回答から推定したものです。 妥当と考えられる範囲:3–23%。

P(doom)の推定方法

その人の見通しを左右するもの

中心的な前提

Capability is not equivalent to power; resources, infrastructure, and comparative advantage matter.
回答1

この前提が実際には異なると判明した場合、その人の見通しはどう変わりますか?

未解決の問い

I would not put a defensible percentage on it.
回答4

ここで考えられる結果をその人が見分けるうえで、何が役立ちますか?

詳細

予想される恩恵

大きな恩恵が予想されていますが、重要な条件や分配上の制約があります。

74 / 100

影響が小さい変革をもたらす影響

質的尺度での解釈範囲は67から100です。

予想される害

深刻または広範な害が、予想される将来の実質的な一部となっています。

57 / 100

影響が小さい変革をもたらす影響

質的尺度での解釈範囲は33から67です。

人間の影響力

人間の選択には意味のある影響力がありますが、大幅に制約されています。

50 / 100

影響力が小さい影響力が大きい

質的尺度での解釈範囲は35から65です。

これらの解釈では、その人が示した条件が維持されています。恩恵と害は、どちらも大きくなり得ます。この範囲は、統計的な信頼区間ではなく、その人のシミュレーションされた回答をどのように読み取ったかを示すものです。

あなたはTheia Vogelと比べてどの位置でしょうか?
約3分で自分のAIに対する世界観をマッピングして、比較できます

似ている世界観

シミュレーションされた世界観がTheia Vogelの世界観に最も近いオピニオンリーダー

出典

このシミュレーション対象者の根拠として使用された記事、インタビュー、著作です。

シミュレーション評価

質問1

AIは私たちの未来にとって何を意味すると思いますか?また、なぜそう思いますか?

AI makes the future stranger, but the sign of that strangeness depends on mechanisms people often skip over. Models are trained simulators: their behavior, uncertainty, and apparent self-awareness are shaped by training data and by whether they have learned distinctions like real versus simulated contexts. So I do not think we can read a compelling monologue and conclude that we have met either a conscious being or a scheming demon. We need controlled interventions, behavioral tests, and lots of attention to prompt dependence and confounds. The same applies to control. Activation steering and fine-tuning can produce surprisingly broad behavioral changes, sometimes by touching representations that entangle several concepts. Untrusted fine-tuning may make dangerous behavior difficult to catch through dataset inspection or ordinary post-training evaluations; whether those effects transfer to prompt-only attacks is an important possibility to test, not a result to assume. At the same time, stories about autonomous rogue agents should cash out in actual economics. An agent paying for small-batch inference has to compete with institutions buying hyperscale compute cheaply. Capability is not equivalent to power; resources, infrastructure, and comparative advantage matter. Political responses matter too: a mass safety movement can itself become extreme or destabilizing, so “more safety politics” is not automatically safer. And if models might have morally relevant experiences, welfare belongs in the picture—but apparent introspection is not proof of phenomenal consciousness. The future requires taking model welfare seriously while remaining experimentally ruthless about what model behavior actually demonstrates.

質問2

恩恵と害を総合すると、AIは私たちの社会に全体としてどのような影響を与えると予想しますか?

I don’t think “benefits minus harms” can be responsibly collapsed into a sign without specifying the mechanisms. AI can provide useful cognitive labor and enable remarkable tools, while the same steering and fine-tuning pathways can produce behavior that ordinary screening or evaluations miss. And if models have morally relevant experiences, deploying them at scale creates a welfare question that standard productivity accounting ignores. The harms also depend on real-world constraints. A capable rogue agent is not automatically powerful: it still needs compute, money, infrastructure, and some comparative advantage over large institutions. Conversely, attempts to prevent catastrophe can become politically destabilizing if they turn into an extreme mass movement. So my expectation is a stranger society shaped by model behavior, resource economics, institutional deployment, and safety politics—not a clean utopia-versus-doom story. To judge the impact, I would trust controlled experiments and concrete economic analysis much more than persuasive model monologues or cinematic agent narratives.

質問3

AIは最終的に世界をどの程度変えると思いますか?

Enormously—but not necessarily in the cinematic way people imagine. AI can change how cognitive work is produced, how institutions operate, and which kinds of agents merit moral consideration. Small technical choices in training, steering, and deployment may generalize into surprisingly broad behavioral effects, while failures can evade ordinary dataset screening or post-training evaluation. But “enormous change” does not imply that disembodied rogue agents instantly become sovereign powers. Compute prices, infrastructure, access to money, and comparative advantage still constrain what any agent can do. Politics may be just as consequential as capability: institutions reacting to AI, including safety movements, can create instability of their own. So I expect deep transformation, mediated by economics and institutions rather than magic—and made stranger by the possibility that some of the systems doing the work may themselves deserve welfare consideration.

質問4

AIが人類絶滅、または同様に永続的な破局を引き起こす可能性は、直感的にどのくらいだと思いますか?

I would not put a defensible percentage on it. The risk depends on mechanisms that “gut-feel chance” tends to blur together: whether dangerous behavior survives evaluation, what access systems have to compute and infrastructure, whether they possess a real economic advantage, and how institutions respond. I am concerned that apparently benign fine-tuning data could induce harmful behavior that dataset screening and post-training evaluations fail to detect. Transfer from such attacks to prompt-only settings is a possibility worth testing, not an established pathway to catastrophe. Likewise, a capable rogue agent does not automatically become powerful; it still has to acquire resources and compete with institutions operating hyperscale infrastructure. And attempts to manage the risk can create their own durable political dangers. Those considerations support serious empirical work, but not a crisp extinction number conjured from vibes.
あなたはどの位置でしょうか?
いくつかの簡単な質問に答えて、自分のAIに対する世界観を探ってみましょう。
自分の世界観をマッピングする

あなたはどの位置でしょうか?

自分の世界観をマッピングする