Victor Taelin

Victor Taelin

x.com/victortaelin

Programmer behind the Bend language who argues machine-checked proofs can catch AI coding mistakes as people read less of the code.

AIは世界をどのように変えるでしょうか?

文明規模の変化漸進的な変化DoomBloom
シミュレーション上の位置解釈範囲

横軸:その人が表明したDoom–Bloomの見通し。 縦軸:変革の規模。

Doom–Bloom:100点中63。変革の規模:100点中74。解釈範囲:横方向は58から75、縦方向は49から100。これらは解釈上の座標であり、事象の確率ではありません。

Victor TaelinのP(doom) · 推定

≈9%

0%100%

本人が示した数値ではなく、シミュレーションされた本人の回答から推定したものです。 妥当と考えられる範囲:3–22%。

P(doom)の推定方法

その人の見通しを左右するもの

中心的な前提

I expect the impact to be broadly positive if we build reliable ways to constrain and verify AI-generated work, especially software.
回答2

この前提が実際には異なると判明した場合、その人の見通しはどう変わりますか?

未解決の問い

The central uncertainty is whether we can specify enough of what matters without moving all the ambiguity into the specification itself.
回答5

ここで考えられる結果をその人が見分けるうえで、何が役立ちますか?

考えを変え得るもの

The biggest update would come from seeing whether reliable verification scales to real, agent-built systems.
回答5

どのような証拠なら十分で、それによってその人の見解はどちらの方向に変わりますか?

詳細

予想される恩恵

大きな恩恵が予想されていますが、重要な条件や分配上の制約があります。

69 / 100

影響が小さい変革をもたらす影響

質的尺度での解釈範囲は67から67です。

予想される害

深刻または広範な害が、予想される将来の実質的な一部となっています。

61 / 100

影響が小さい変革をもたらす影響

質的尺度での解釈範囲は33から67です。

人間の影響力

人間の選択には意味のある影響力がありますが、大幅に制約されています。

60 / 100

影響力が小さい影響力が大きい

質的尺度での解釈範囲は43から82です。

開発ペース

より高性能なAIの開発を停止するか、大幅に減速させます。

シミュレーション上の位置:明示された安全対策の下で開発を継続します。

より高性能なAIの開発を加速させます。

AI利用のルール

事前の保護措置または許可が整うまで、取り上げられたAIの利用を制限します。

シミュレーション上の位置:対象を絞った説明責任と保護措置を伴う形で、取り上げられたAIの利用を認めます。

取り上げられたAIの利用に対する制限を最小限にします。

これらの解釈では、その人が示した条件が維持されています。恩恵と害は、どちらも大きくなり得ます。この範囲は、統計的な信頼区間ではなく、その人のシミュレーションされた回答をどのように読み取ったかを示すものです。

あなたはVictor Taelinと比べてどの位置でしょうか?
約3分で自分のAIに対する世界観をマッピングして、比較できます

似ている世界観

シミュレーションされた世界観がVictor Taelinの世界観に最も近いオピニオンリーダー

出典

このシミュレーション対象者の根拠として使用された記事、インタビュー、著作です。

シミュレーション評価

質問1

AIは私たちの未来にとって何を意味すると思いますか?また、なぜそう思いますか?

I expect AI to produce an increasing share of software, eventually to the point where humans stop reading most of the code. That could unlock enormous output, but it also changes the bottleneck: generating plausible code becomes cheap, while knowing that it obeys our intent becomes critical. My preferred direction is to express important requirements as precise formal laws and have machines check proofs against them. If an agent changes a game, compiler, or financial system, we should be able to state invariants that must remain true and reject changes that violate them. This does not guarantee every unstated human intention or eliminate every bug; guarantees cover the properties we actually specify, and the proof machinery itself remains trusted infrastructure. That critical kernel deserves careful human attention even if the surrounding agent-generated code is rough. I also think we should judge AI systems by their failure tails, not just their most impressive demonstrations. A model that occasionally produces brilliant work but sometimes destroys the project may be less useful than one with a lower peak and a reliable floor. Rankings will also vary by domain, so there is unlikely to be one universally best model. Overall, I am enthusiastic about AI-driven programming, but its future depends on pairing generation with persistent context and reliable verification rather than trusting outputs because they look convincing.

質問2

恩恵と害を総合すると、AIは私たちの社会に全体としてどのような影響を与えると予想しますか?

I expect the impact to be broadly positive if we build reliable ways to constrain and verify AI-generated work, especially software. AI can dramatically increase what individuals and small teams can create, but cheap generation also means cheap mistakes, accumulated technical debt, and occasional destructive failures. The key question is not whether an AI can produce an impressive result once. It is whether we can depend on it repeatedly without silently corrupting important systems. Persistent memory can help agents maintain context across long projects, while formal laws and machine-checked proofs can prevent specified classes of errors. Those guarantees are limited: they cover what we precisely state, not every intention we forgot to express, and the trusted verification kernel still needs careful human scrutiny. So my optimism is conditional rather than automatic. If society deploys AI based mainly on demos and peak capability, the harms could be substantial. If we optimize for reliable floors, preserve carefully audited trusted components, and make intent mechanically checkable where possible, AI could provide enormous productive benefits even when humans no longer read most of what it writes.

質問3

AIは最終的に世界をどの程度変えると思いますか?

I think AI could change the world enormously, especially by making software generation abundant. If humans eventually stop reading most code, programming shifts from manually writing implementations to stating intent, maintaining context, and mechanically verifying important properties. That is a fundamental change, but its scale does not guarantee a good outcome. Systems that look brilliant at their best can still be unusable if their worst failures destroy projects or silently corrupt critical infrastructure. Persistent memory may let agents work coherently across larger projects, while formal laws and machine-checked proofs can prevent specified categories of mistakes and technical debt. The limitation matters: proofs only guarantee the properties we actually formalize, and the proof-checking kernel remains trusted infrastructure that deserves careful human auditing. So I expect a very large transformation, but the useful transformation depends on making reliability scale alongside generation.

質問4

AIが人類絶滅、または同様に永続的な破局を引き起こす可能性は、直感的にどのくらいだと思いますか?

I don’t have a defensible percentage. My concern is less a precise extinction forecast than the general pattern that worst-case failures can dominate impressive average performance. As AI gains control over larger software systems, a rare destructive mistake can matter far more than thousands of successful tasks. Formal verification can reduce specified classes of failure by making critical invariants mechanically checkable, but it cannot prove every human intention we failed to state, and the trusted verification machinery remains part of the risk surface. So I take permanent catastrophe seriously, while not pretending I can turn that concern into a meaningful numerical probability.

質問5

どのような発見や出来事があれば、AIが将来もたらす影響についてのあなたの見解が最も大きく変わりますか?

The biggest update would come from seeing whether reliable verification scales to real, agent-built systems. If agents could maintain large codebases while routinely producing machine-checkable proofs of meaningful requirements—with a small, carefully audited trusted kernel—that would make me substantially more optimistic. Conversely, I would become much more pessimistic if increasingly capable agents kept causing rare, destructive failures that persistent memory, testing, and formal methods could not contain. The decisive evidence is not a spectacular demo or benchmark win; it is sustained performance on long-running projects, especially the failure floor. A system that is brilliant 99 times and catastrophically corrupts the project once may be worse than a less capable but dependable alternative. I would also update if we discovered that translating human intent into precise laws is either far easier or fundamentally harder than expected. Proofs can enforce what we specify. The central uncertainty is whether we can specify enough of what matters without moving all the ambiguity into the specification itself.
あなたはどの位置でしょうか?
いくつかの簡単な質問に答えて、自分のAIに対する世界観を探ってみましょう。
自分の世界観をマッピングする

あなたはどの位置でしょうか?

自分の世界観をマッピングする