Ilya Sutskever

Ilya Sutskever

x.com/ilyasut

Safe Superintelligence cofounder and CEO who expects extremely powerful AI and sees generalization and alignment as central open research problems.

AIは世界をどのように変えるでしょうか?

文明規模の変化漸進的な変化DoomBloom
シミュレーション上の位置解釈範囲

横軸:彼が表明したDoom–Bloomの見通し。 縦軸:変革の規模。

Doom–Bloom:100点中51。変革の規模:100点中77。解釈範囲:横方向は46から56、縦方向は72から82。これらは解釈上の座標であり、事象の確率ではありません。

Ilya SutskeverのP(doom) · 推定

≈21%

0%100%

本人が示した数値ではなく、シミュレーションされた本人の回答から推定したものです。 妥当と考えられる範囲:12–41%。

彼の見通しを左右するもの

中心的な前提

The decisive question is whether safety and capability progress together—whether we develop systems whose alignment continues to hold as they learn, generalize, and become more powerful.
回答2

この前提が実際には異なると判明した場合、彼の見通しはどう変わりますか?

未解決の問い

It is whether we can make powerful learning generalize in the ways we intend.
回答3

ここで考えられる結果を彼が見分けるうえで、何が役立ちますか?

考えを変え得るもの

If we found a method that let systems learn rapidly from limited experience, transfer that learning reliably to unfamiliar situations, and remain aligned while doing so, I would become much more confident that transformative AI is close in a meaningful sense—not merely better at benchmarks.
回答3

どのような証拠なら十分で、それによって彼の見解はどちらの方向に変わりますか?

詳細

予想される恩恵

複数の解釈が依然として妥当です:大きな恩恵が予想されていますが、重要な条件や分配上の制約があります。 / 変革をもたらし、広く価値のある恩恵が予想されています。

81 / 100

影響が小さい変革をもたらす影響

質的尺度での解釈範囲は67から100です。

予想される害

深刻または広範な害が、予想される将来の実質的な一部となっています。

67 / 100

影響が小さい変革をもたらす影響

質的尺度での解釈範囲は67から67です。

人間の影響力

人間の選択によって、AIの軌道を大幅に変えることができます。

65 / 100

影響力が小さい影響力が大きい

質的尺度での解釈範囲は36から100です。

予想される能力

AIは、限定的なツールにとどまると予想されています。

AIは、ほとんどの認知作業において人間と同等になると予想されています。

シミュレーション上の位置:AIは、認知作業全般において人間を大幅に上回ると予想されています。

開発ペース

より高性能なAIの開発を停止するか、大幅に減速させます。

シミュレーション上の位置:明示された安全対策の下で開発を継続します。

より高性能なAIの開発を加速させます。

AI利用のルール

事前の保護措置または許可が整うまで、取り上げられたAIの利用を制限します。

シミュレーション上の位置:対象を絞った説明責任と保護措置を伴う形で、取り上げられたAIの利用を認めます。

取り上げられたAIの利用に対する制限を最小限にします。

これらの解釈では、彼が示した条件が維持されています。恩恵と害は、どちらも大きくなり得ます。この範囲は、統計的な信頼区間ではなく、彼のシミュレーションされた回答をどのように読み取ったかを示すものです。

あなたはIlya Sutskeverと比べてどの位置でしょうか?
約3分で自分のAIに対する世界観をマッピングして、比較できます

似ている世界観

シミュレーションされた世界観がIlya Sutskeverの世界観に最も近いオピニオンリーダー

Ilya SutskeverがAIについて語ったこと

Sutskever expects extraordinarily powerful AI, sees generalization and alignment as open problems and now favors deploying AI incrementally.

  1. “Future AI will be extraordinarily powerful compared to anything that exists today, and dealing with this future power will require unprecedented measures, such as the ones described here.”

    Comment on the Pacing the Frontier statement
  2. “The thing which I think is the most fundamental is that these models somehow just generalize dramatically worse than people.”

    Dwarkesh Podcast
  3. “I maintain that there is something that’s better to build, and I think that everyone will want that. It’s the AI that’s robustly aligned to care about sentient life specifically.”

    Dwarkesh Podcast
  4. “One of the ways in which my thinking has been changing is that I now place more importance on AI being deployed incrementally and in advance.”

    Dwarkesh Podcast
  5. “I think that it is likely that we will have rapid economic growth.”

    Dwarkesh Podcast

リンク先の出典から原文どおりに引用(2026年10月3日に確認)

シミュレーション評価

質問1

AIは私たちの未来にとって何を意味すると思いますか?また、なぜそう思いますか?

AI will be extraordinarily powerful, but the path is not simply to make today’s systems larger and assume every important problem disappears. Current models can solve difficult problems and then fail on something elementary. It is like a student who performs brilliantly on an exam but cannot reliably use the lesson in a slightly different situation. The central scientific problem is robust generalization: learning what is actually needed, transferring it to new circumstances, and continuing to learn on the job. If we solve that, the economic consequences will be enormous. A system need not arrive already knowing every profession. If it can learn a new job quickly and reliably, it could eventually perform an immense range of useful work. This is why both better ideas and large amounts of compute matter: the question is not whether to scale, but whether we have something worth scaling. At the same time, capabilities and safety cannot be separated. Human supervision may become inadequate once systems exceed us in important domains. We need alignment methods that generalize, adversarial testing, stronger cybersecurity, and limits on extreme concentrations of power. Incremental deployment is also important because society must encounter increasingly capable AI in reality, not only as an abstract final event. So I expect a very large transformation, but its quality depends on unresolved research. Intelligence is immensely consequential, yet it is not the only human quality that matters. The goal should be to build powerful systems that reliably care about sentient life and remain aligned as their abilities grow.

質問2

Taking benefits and harms together, what overall impact do you expect AI to have?

I expect AI’s overall impact to be enormous, but I do not think its sign is predetermined. If we solve robust generalization and alignment, systems that learn new work quickly could greatly expand scientific discovery, productivity, medicine, and our ability to address difficult problems. They would not need every skill built in beforehand; the ability to learn reliably on the job would be transformative. The harms are correspondingly large. Systems may become more capable than our methods for supervising them. They could be misused, concentrate extreme power, or behave badly in unfamiliar situations despite appearing competent during testing. A rogue system might even seek additional computing resources, which makes cybersecurity part of the safety problem rather than a separate concern. So I am strongly convinced about the scale of the transformation, but not prepared to declare the outcome automatically positive or negative. Incremental deployment can help society adapt and expose real problems, but it does not replace fundamental research. The decisive question is whether safety and capability progress together—whether we develop systems whose alignment continues to hold as they learn, generalize, and become more powerful.

質問3

どのような発見や出来事があれば、AIが将来もたらす影響についてのあなたの見解が最も大きく変わりますか?

The most important discovery would concern robust generalization and continual learning. If we found a method that let systems learn rapidly from limited experience, transfer that learning reliably to unfamiliar situations, and remain aligned while doing so, I would become much more confident that transformative AI is close in a meaningful sense—not merely better at benchmarks. It would be like moving from a student who memorizes many textbooks to one who can enter a new laboratory, understand the work, and become useful quickly. Conversely, strong evidence that these abilities do not emerge from current approaches—even with substantially more compute—would change my view of the path. It would suggest that the present recipe is missing a fundamental idea and that economic transformation may require a longer period of basic research. On the safety side, a convincing demonstration of scalable alignment would matter enormously: not just good behavior under familiar evaluations, but alignment that survives novelty, continued learning, adversarial pressure, and growing capability. A serious real-world failure—especially a capable agent autonomously seeking resources or additional copies—would also sharply update my view of the urgency and of how much deployment and cybersecurity practices must change. The central uncertainty is not whether intelligence will matter. It is whether we can make powerful learning generalize in the ways we intend.

出典

このシミュレーション対象者の根拠として使用された記事、インタビュー、著作です。

あなたはどの位置でしょうか?
いくつかの簡単な質問に答えて、自分のAIに対する世界観を探ってみましょう。
自分の世界観をマッピングする

あなたはどの位置でしょうか?

自分の世界観をマッピングする