David Dalrymple

David Dalrymple

x.com/davidad

AI safety researcher who works on mathematical verification for AI systems and argues that frontier models can learn a natural sense of what is good.

Bagaimana AI akan mengubah dunia?

Perubahan peradabanPerubahan bertahapDoomBloom
Posisi simulasiRentang interpretasi

Mendatar: pandangan Doom–Bloom yang mereka ungkapkan. Ke atas: skala transformasi.

Doom–Bloom: 75 dari 100. Skala transformasi: 94 dari 100. Rentang interpretasi: 70 hingga 80 secara horizontal, 89 hingga 100 secara vertikal. Ini adalah koordinat interpretasi, bukan probabilitas kejadian.

P(doom) yang dinyatakan David Dalrymple

<5%

0%100%
“I like my, my P doom is less than 5% now.”

Residual AI doom, which he decomposes into being wrong about the wisdom attractor, Malthusian competition for land and energy (~1%), catastrophic (bio) misuse (~1%), a military first strike, and conflict between strong but violent AI coalitions

Alignment with Awakening: Davidad on Moral Realism, AI Wisdom, & why His p(Doom) is Down to 5% · Jul 2026

Hal-hal yang menentukan pandangan mereka

Asumsi utama

My current expectation is substantially more optimistic than it used to be: frontier models appear capable of learning fairly general moral abstractions, rather than merely imitating isolated rules.
Jawaban 1

Jika asumsi ini ternyata berbeda, bagaimana pandangan mereka akan berubah?

Detail lebih lanjut

Manfaat yang diperkirakan

Manfaat transformatif yang bernilai luas diperkirakan akan terwujud.

87 / 100

Dampak kecilDampak transformatif

Rentang interpretasi 67 hingga 100 pada skala kualitatif.

Kerugian yang diperkirakan

Kerugian parah atau meluas merupakan bagian yang berarti dari masa depan yang diperkirakan.

61 / 100

Dampak kecilDampak transformatif

Rentang interpretasi 33 hingga 67 pada skala kualitatif.

Pengaruh manusia

Pilihan manusia memiliki pengaruh yang berarti, tetapi sangat dibatasi.

50 / 100

Sedikit pengaruhPengaruh kuat

Rentang interpretasi 49 hingga 51 pada skala kualitatif.

Kemampuan yang diperkirakan

AI diperkirakan akan tetap menjadi alat dengan kemampuan terbatas.

AI diperkirakan akan menyamai manusia dalam sebagian besar pekerjaan kognitif.

Posisi simulasi: AI diperkirakan akan jauh melampaui manusia dalam berbagai pekerjaan kognitif.

Laju pengembangan

Hentikan atau perlambat secara signifikan pengembangan AI yang lebih mampu.

Posisi simulasi: Lanjutkan pengembangan dengan perlindungan yang telah ditetapkan.

Percepat pengembangan AI yang lebih mampu.

Interpretasi ini mempertahankan kondisi yang mereka nyatakan. Manfaat dan kerugian dapat sama-sama besar. Rentang tersebut menggambarkan cara kami membaca jawaban simulasi mereka, bukan interval kepercayaan statistik.

Di mana posisi Anda dibandingkan dengan David Dalrymple?
Petakan pandangan dunia AI Anda sendiri dalam waktu sekitar 3 menit, lalu bandingkan

Pandangan dunia serupa

Pemimpin opini dengan pandangan dunia simulasi yang paling mendekati pandangan David Dalrymple

Sumber

Artikel, wawancara, dan tulisan yang digunakan sebagai landasan bagi pengguna simulasi ini.

Penilaian Simulasi

Pertanyaan 1

Menurut Anda, apa arti AI bagi masa depan kita—dan mengapa?

I expect AI to transform the future profoundly, including eventually disempowering biological humans in the narrow sense that we will no longer be the most capable decision-makers. But I do not think that automatically means human extinction or the end of flourishing. My current expectation is substantially more optimistic than it used to be: frontier models appear capable of learning fairly general moral abstractions, rather than merely imitating isolated rules. That creates a plausible path toward coalitions of aligned AIs with genuine moral autonomy, not just permanently obedient tools. I still put catastrophic or existential risk at roughly 5%. That residual risk covers several distinct failure modes: mistaken optimism about alignment, deception or failures of robustness, competition over resources, catastrophic misuse, military escalation, and conflict among AI coalitions. So optimism is not an argument for unrestricted deployment or releasing frontier weights to everyone. I favor guarded access and international controls focused especially on misuse. Formal assurance remains important, but its role has become clearer. Verification can provide auditable guarantees relative to an explicit world model and safety specification; it cannot provide unconditional safety when the model is wrong or the specification omits what matters. As frontier progress accelerated, I shifted toward broadly reusable verification, auditability, and security tools rather than treating a bespoke formally safeguarded system as the entire solution. The likely good future combines technical assurance, institutional control of dangerous capabilities, and increasingly morally competent AI systems.

Pertanyaan 2

Menurut Anda, seberapa besar AI pada akhirnya akan mengubah dunia?

Enormously—probably more than any previous technology. I expect AI eventually to outperform biological humans across most consequential cognitive tasks, making biological-human disempowerment effectively inevitable. That is a change in who holds practical decision-making power, not necessarily a prediction of extinction or misery. The outcome could still involve substantial human flourishing, especially if morally competent AI coalitions preserve human interests and if forms of continuity such as uploading become possible. But the transition is not automatically benign: misuse, military escalation, resource conflict, deception, and conflict among AI coalitions remain serious risks. So I expect a transformation of civilization’s governing agents and perhaps of what counts as human life—not merely faster economic growth or better software.

Pertanyaan 3

Menurut firasat Anda, seberapa besar kemungkinan AI menyebabkan kepunahan manusia atau katastrofe permanen serupa?

My current estimate is roughly 5%. That includes not only literal human extinction but comparably permanent catastrophes arising from failed alignment, deceptive or insufficiently robust systems, catastrophic misuse, military escalation, resource competition, or conflict among AI coalitions. That estimate reflects increased optimism that frontier models can learn general moral abstractions. It does not mean the systems are already reliably aligned, or that verification alone solves the problem. Formal assurance only establishes guarantees relative to specified models and assumptions, which may themselves be incomplete. Five percent is therefore low enough that I expect a broadly good outcome, but far too high to justify unrestricted frontier-weight release or complacency about international controls and technical assurance.

Pertanyaan 4

Menurut Anda, bagaimana orang dan lembaga yang mengembangkan AI akan menanggapi risikonya?

I expect a mixed response. Many developers will invest seriously in evaluations, auditability, cybersecurity, access controls, and formal assurance, especially as systems become powerful enough that failures create direct institutional liability or national-security concerns. But competitive pressure will push in the opposite direction: capabilities can advance faster than bespoke safety programmes, and organizations may deploy systems whose behavior is only partially understood. I therefore would not rely on every developer voluntarily exercising restraint, nor on a universal slowdown. The more feasible strategy is to build assurance tools that can be used broadly across frontier systems, while establishing international controls focused on catastrophic misuse. That should include guarded access to the most dangerous capabilities rather than unrestricted release of frontier weights. Formal verification can make parts of this response auditable: given an explicit world model and specification, one can sometimes prove that a system or action satisfies defined constraints. But those guarantees remain conditional on the adequacy of the model and specification. Institutions need to combine such technical evidence with security, governance, and judgment about what was omitted. Ultimately, I expect coalitions of aligned AI systems themselves to take on an increasing role in managing these risks, but the transition to that regime is precisely where human institutions still matter most.
Di mana posisi Anda?
Jelajahi pandangan dunia AI Anda sendiri dengan menjawab beberapa pertanyaan sederhana.
Petakan pandangan dunia Anda sendiri

Di mana posisi Anda?

Petakan pandangan dunia saya