Victor Taelin

Victor Taelin

x.com/victortaelin

Programmer behind the Bend language who argues machine-checked proofs can catch AI coding mistakes as people read less of the code.

Bagaimana AI akan mengubah dunia?

Perubahan peradabanPerubahan bertahapDoomBloom
Posisi simulasiRentang interpretasi

Mendatar: pandangan Doom–Bloom yang mereka ungkapkan. Ke atas: skala transformasi.

Doom–Bloom: 63 dari 100. Skala transformasi: 74 dari 100. Rentang interpretasi: 58 hingga 75 secara horizontal, 49 hingga 100 secara vertikal. Ini adalah koordinat interpretasi, bukan probabilitas kejadian.

P(doom) Victor Taelin · disimpulkan

≈9%

0%100%

Disimpulkan dari jawaban simulasi mereka, bukan angka yang mereka berikan. Rentang yang masuk akal: 3–22%.

Cara kami mengestimasi P(doom)

Hal-hal yang menentukan pandangan mereka

Asumsi utama

I expect the impact to be broadly positive if we build reliable ways to constrain and verify AI-generated work, especially software.
Jawaban 2

Jika asumsi ini ternyata berbeda, bagaimana pandangan mereka akan berubah?

Pertanyaan yang belum terjawab

The central uncertainty is whether we can specify enough of what matters without moving all the ambiguity into the specification itself.
Jawaban 5

Apa yang akan membantu mereka membedakan hasil-hasil yang masuk akal di sini?

Hal yang dapat mengubah pandangan mereka

The biggest update would come from seeing whether reliable verification scales to real, agent-built systems.
Jawaban 5

Bukti apa yang akan memadai, dan ke arah mana bukti itu akan mengubah pandangan mereka?

Detail lebih lanjut

Manfaat yang diperkirakan

Manfaat besar diperkirakan akan terwujud, dengan syarat penting atau keterbatasan distribusi.

69 / 100

Dampak kecilDampak transformatif

Rentang interpretasi 67 hingga 67 pada skala kualitatif.

Kerugian yang diperkirakan

Kerugian parah atau meluas merupakan bagian yang berarti dari masa depan yang diperkirakan.

61 / 100

Dampak kecilDampak transformatif

Rentang interpretasi 33 hingga 67 pada skala kualitatif.

Pengaruh manusia

Pilihan manusia memiliki pengaruh yang berarti, tetapi sangat dibatasi.

60 / 100

Sedikit pengaruhPengaruh kuat

Rentang interpretasi 43 hingga 82 pada skala kualitatif.

Laju pengembangan

Hentikan atau perlambat secara signifikan pengembangan AI yang lebih mampu.

Posisi simulasi: Lanjutkan pengembangan dengan perlindungan yang telah ditetapkan.

Percepat pengembangan AI yang lebih mampu.

Aturan penggunaan AI

Batasi penggunaan AI yang dibahas hingga perlindungan atau izin sebelumnya tersedia.

Posisi simulasi: Izinkan penggunaan AI yang dibahas dengan akuntabilitas dan perlindungan yang terarah.

Minimalkan pembatasan terhadap penggunaan AI yang dibahas.

Interpretasi ini mempertahankan kondisi yang mereka nyatakan. Manfaat dan kerugian dapat sama-sama besar. Rentang tersebut menggambarkan cara kami membaca jawaban simulasi mereka, bukan interval kepercayaan statistik.

Di mana posisi Anda dibandingkan dengan Victor Taelin?
Petakan pandangan dunia AI Anda sendiri dalam waktu sekitar 3 menit, lalu bandingkan

Pandangan dunia serupa

Pemimpin opini dengan pandangan dunia simulasi yang paling mendekati pandangan Victor Taelin

Sumber

Artikel, wawancara, dan tulisan yang digunakan sebagai landasan bagi pengguna simulasi ini.

Penilaian Simulasi

Pertanyaan 1

Menurut Anda, apa arti AI bagi masa depan kita—dan mengapa?

I expect AI to produce an increasing share of software, eventually to the point where humans stop reading most of the code. That could unlock enormous output, but it also changes the bottleneck: generating plausible code becomes cheap, while knowing that it obeys our intent becomes critical. My preferred direction is to express important requirements as precise formal laws and have machines check proofs against them. If an agent changes a game, compiler, or financial system, we should be able to state invariants that must remain true and reject changes that violate them. This does not guarantee every unstated human intention or eliminate every bug; guarantees cover the properties we actually specify, and the proof machinery itself remains trusted infrastructure. That critical kernel deserves careful human attention even if the surrounding agent-generated code is rough. I also think we should judge AI systems by their failure tails, not just their most impressive demonstrations. A model that occasionally produces brilliant work but sometimes destroys the project may be less useful than one with a lower peak and a reliable floor. Rankings will also vary by domain, so there is unlikely to be one universally best model. Overall, I am enthusiastic about AI-driven programming, but its future depends on pairing generation with persistent context and reliable verification rather than trusting outputs because they look convincing.

Pertanyaan 2

Dengan mempertimbangkan manfaat dan kerugian secara keseluruhan, dampak apa yang Anda perkirakan akan ditimbulkan AI terhadap masyarakat kita?

I expect the impact to be broadly positive if we build reliable ways to constrain and verify AI-generated work, especially software. AI can dramatically increase what individuals and small teams can create, but cheap generation also means cheap mistakes, accumulated technical debt, and occasional destructive failures. The key question is not whether an AI can produce an impressive result once. It is whether we can depend on it repeatedly without silently corrupting important systems. Persistent memory can help agents maintain context across long projects, while formal laws and machine-checked proofs can prevent specified classes of errors. Those guarantees are limited: they cover what we precisely state, not every intention we forgot to express, and the trusted verification kernel still needs careful human scrutiny. So my optimism is conditional rather than automatic. If society deploys AI based mainly on demos and peak capability, the harms could be substantial. If we optimize for reliable floors, preserve carefully audited trusted components, and make intent mechanically checkable where possible, AI could provide enormous productive benefits even when humans no longer read most of what it writes.

Pertanyaan 3

Menurut Anda, seberapa besar AI pada akhirnya akan mengubah dunia?

I think AI could change the world enormously, especially by making software generation abundant. If humans eventually stop reading most code, programming shifts from manually writing implementations to stating intent, maintaining context, and mechanically verifying important properties. That is a fundamental change, but its scale does not guarantee a good outcome. Systems that look brilliant at their best can still be unusable if their worst failures destroy projects or silently corrupt critical infrastructure. Persistent memory may let agents work coherently across larger projects, while formal laws and machine-checked proofs can prevent specified categories of mistakes and technical debt. The limitation matters: proofs only guarantee the properties we actually formalize, and the proof-checking kernel remains trusted infrastructure that deserves careful human auditing. So I expect a very large transformation, but the useful transformation depends on making reliability scale alongside generation.

Pertanyaan 4

Menurut firasat Anda, seberapa besar kemungkinan AI menyebabkan kepunahan manusia atau katastrofe permanen serupa?

I don’t have a defensible percentage. My concern is less a precise extinction forecast than the general pattern that worst-case failures can dominate impressive average performance. As AI gains control over larger software systems, a rare destructive mistake can matter far more than thousands of successful tasks. Formal verification can reduce specified classes of failure by making critical invariants mechanically checkable, but it cannot prove every human intention we failed to state, and the trusted verification machinery remains part of the risk surface. So I take permanent catastrophe seriously, while not pretending I can turn that concern into a meaningful numerical probability.

Pertanyaan 5

Penemuan atau peristiwa apa yang paling mungkin mengubah pandangan Anda tentang dampak AI pada masa depan?

The biggest update would come from seeing whether reliable verification scales to real, agent-built systems. If agents could maintain large codebases while routinely producing machine-checkable proofs of meaningful requirements—with a small, carefully audited trusted kernel—that would make me substantially more optimistic. Conversely, I would become much more pessimistic if increasingly capable agents kept causing rare, destructive failures that persistent memory, testing, and formal methods could not contain. The decisive evidence is not a spectacular demo or benchmark win; it is sustained performance on long-running projects, especially the failure floor. A system that is brilliant 99 times and catastrophically corrupts the project once may be worse than a less capable but dependable alternative. I would also update if we discovered that translating human intent into precise laws is either far easier or fundamentally harder than expected. Proofs can enforce what we specify. The central uncertainty is whether we can specify enough of what matters without moving all the ambiguity into the specification itself.
Di mana posisi Anda?
Jelajahi pandangan dunia AI Anda sendiri dengan menjawab beberapa pertanyaan sederhana.
Petakan pandangan dunia Anda sendiri

Di mana posisi Anda?

Petakan pandangan dunia saya