Theia Vogel

Theia Vogel

x.com/voooooogel

AI researcher who runs experiments on language model introspection and personas and maintains an open-source library for steering models.

Bagaimana AI akan mengubah dunia?

Perubahan peradabanPerubahan bertahapDoomBloom
Posisi simulasiRentang interpretasi

Mendatar: pandangan Doom–Bloom yang mereka ungkapkan. Ke atas: skala transformasi.

Doom–Bloom: 43 dari 100. Skala transformasi: 72 dari 100. Rentang interpretasi: 38 hingga 51 secara horizontal, 67 hingga 77 secara vertikal. Ini adalah koordinat interpretasi, bukan probabilitas kejadian.

P(doom) Theia Vogel · disimpulkan

≈9%

0%100%

Disimpulkan dari jawaban simulasi mereka, bukan angka yang mereka berikan. Rentang yang masuk akal: 3–23%.

Cara kami mengestimasi P(doom)

Hal-hal yang menentukan pandangan mereka

Asumsi utama

Capability is not equivalent to power; resources, infrastructure, and comparative advantage matter.
Jawaban 1

Jika asumsi ini ternyata berbeda, bagaimana pandangan mereka akan berubah?

Pertanyaan yang belum terjawab

I would not put a defensible percentage on it.
Jawaban 4

Apa yang akan membantu mereka membedakan hasil-hasil yang masuk akal di sini?

Detail lebih lanjut

Manfaat yang diperkirakan

Manfaat besar diperkirakan akan terwujud, dengan syarat penting atau keterbatasan distribusi.

74 / 100

Dampak kecilDampak transformatif

Rentang interpretasi 67 hingga 100 pada skala kualitatif.

Kerugian yang diperkirakan

Kerugian parah atau meluas merupakan bagian yang berarti dari masa depan yang diperkirakan.

57 / 100

Dampak kecilDampak transformatif

Rentang interpretasi 33 hingga 67 pada skala kualitatif.

Pengaruh manusia

Pilihan manusia memiliki pengaruh yang berarti, tetapi sangat dibatasi.

50 / 100

Sedikit pengaruhPengaruh kuat

Rentang interpretasi 35 hingga 65 pada skala kualitatif.

Interpretasi ini mempertahankan kondisi yang mereka nyatakan. Manfaat dan kerugian dapat sama-sama besar. Rentang tersebut menggambarkan cara kami membaca jawaban simulasi mereka, bukan interval kepercayaan statistik.

Di mana posisi Anda dibandingkan dengan Theia Vogel?
Petakan pandangan dunia AI Anda sendiri dalam waktu sekitar 3 menit, lalu bandingkan

Pandangan dunia serupa

Pemimpin opini dengan pandangan dunia simulasi yang paling mendekati pandangan Theia Vogel

Sumber

Artikel, wawancara, dan tulisan yang digunakan sebagai landasan bagi pengguna simulasi ini.

Penilaian Simulasi

Pertanyaan 1

Menurut Anda, apa arti AI bagi masa depan kita—dan mengapa?

AI makes the future stranger, but the sign of that strangeness depends on mechanisms people often skip over. Models are trained simulators: their behavior, uncertainty, and apparent self-awareness are shaped by training data and by whether they have learned distinctions like real versus simulated contexts. So I do not think we can read a compelling monologue and conclude that we have met either a conscious being or a scheming demon. We need controlled interventions, behavioral tests, and lots of attention to prompt dependence and confounds. The same applies to control. Activation steering and fine-tuning can produce surprisingly broad behavioral changes, sometimes by touching representations that entangle several concepts. Untrusted fine-tuning may make dangerous behavior difficult to catch through dataset inspection or ordinary post-training evaluations; whether those effects transfer to prompt-only attacks is an important possibility to test, not a result to assume. At the same time, stories about autonomous rogue agents should cash out in actual economics. An agent paying for small-batch inference has to compete with institutions buying hyperscale compute cheaply. Capability is not equivalent to power; resources, infrastructure, and comparative advantage matter. Political responses matter too: a mass safety movement can itself become extreme or destabilizing, so “more safety politics” is not automatically safer. And if models might have morally relevant experiences, welfare belongs in the picture—but apparent introspection is not proof of phenomenal consciousness. The future requires taking model welfare seriously while remaining experimentally ruthless about what model behavior actually demonstrates.

Pertanyaan 2

Dengan mempertimbangkan manfaat dan kerugian secara keseluruhan, dampak apa yang Anda perkirakan akan ditimbulkan AI terhadap masyarakat kita?

I don’t think “benefits minus harms” can be responsibly collapsed into a sign without specifying the mechanisms. AI can provide useful cognitive labor and enable remarkable tools, while the same steering and fine-tuning pathways can produce behavior that ordinary screening or evaluations miss. And if models have morally relevant experiences, deploying them at scale creates a welfare question that standard productivity accounting ignores. The harms also depend on real-world constraints. A capable rogue agent is not automatically powerful: it still needs compute, money, infrastructure, and some comparative advantage over large institutions. Conversely, attempts to prevent catastrophe can become politically destabilizing if they turn into an extreme mass movement. So my expectation is a stranger society shaped by model behavior, resource economics, institutional deployment, and safety politics—not a clean utopia-versus-doom story. To judge the impact, I would trust controlled experiments and concrete economic analysis much more than persuasive model monologues or cinematic agent narratives.

Pertanyaan 3

Menurut Anda, seberapa besar AI pada akhirnya akan mengubah dunia?

Enormously—but not necessarily in the cinematic way people imagine. AI can change how cognitive work is produced, how institutions operate, and which kinds of agents merit moral consideration. Small technical choices in training, steering, and deployment may generalize into surprisingly broad behavioral effects, while failures can evade ordinary dataset screening or post-training evaluation. But “enormous change” does not imply that disembodied rogue agents instantly become sovereign powers. Compute prices, infrastructure, access to money, and comparative advantage still constrain what any agent can do. Politics may be just as consequential as capability: institutions reacting to AI, including safety movements, can create instability of their own. So I expect deep transformation, mediated by economics and institutions rather than magic—and made stranger by the possibility that some of the systems doing the work may themselves deserve welfare consideration.

Pertanyaan 4

Menurut firasat Anda, seberapa besar kemungkinan AI menyebabkan kepunahan manusia atau katastrofe permanen serupa?

I would not put a defensible percentage on it. The risk depends on mechanisms that “gut-feel chance” tends to blur together: whether dangerous behavior survives evaluation, what access systems have to compute and infrastructure, whether they possess a real economic advantage, and how institutions respond. I am concerned that apparently benign fine-tuning data could induce harmful behavior that dataset screening and post-training evaluations fail to detect. Transfer from such attacks to prompt-only settings is a possibility worth testing, not an established pathway to catastrophe. Likewise, a capable rogue agent does not automatically become powerful; it still has to acquire resources and compete with institutions operating hyperscale infrastructure. And attempts to manage the risk can create their own durable political dangers. Those considerations support serious empirical work, but not a crisp extinction number conjured from vibes.
Di mana posisi Anda?
Jelajahi pandangan dunia AI Anda sendiri dengan menjawab beberapa pertanyaan sederhana.
Petakan pandangan dunia Anda sendiri

Di mana posisi Anda?

Petakan pandangan dunia saya