Ilya Sutskever

Ilya Sutskever

x.com/ilyasut

Safe Superintelligence cofounder and CEO who expects extremely powerful AI and sees generalization and alignment as central open research problems.

Bagaimana AI akan mengubah dunia?

Perubahan peradabanPerubahan bertahapDoomBloom
Posisi simulasiRentang interpretasi

Mendatar: pandangan Doom–Bloom yang ia ungkapkan. Ke atas: skala transformasi.

Doom–Bloom: 51 dari 100. Skala transformasi: 77 dari 100. Rentang interpretasi: 46 hingga 56 secara horizontal, 72 hingga 82 secara vertikal. Ini adalah koordinat interpretasi, bukan probabilitas kejadian.

P(doom) Ilya Sutskever · disimpulkan

≈21%

0%100%

Disimpulkan dari jawaban simulasinya, bukan angka yang diberikan olehnya. Rentang yang masuk akal: 12–41%.

Hal-hal yang menentukan pandangannya

Asumsi utama

The decisive question is whether safety and capability progress together—whether we develop systems whose alignment continues to hold as they learn, generalize, and become more powerful.
Jawaban 2

Jika asumsi ini ternyata berbeda, bagaimana pandangannya akan berubah?

Pertanyaan yang belum terjawab

It is whether we can make powerful learning generalize in the ways we intend.
Jawaban 3

Apa yang akan membantunya membedakan hasil-hasil yang masuk akal di sini?

Hal yang dapat mengubah pandangan mereka

If we found a method that let systems learn rapidly from limited experience, transfer that learning reliably to unfamiliar situations, and remain aligned while doing so, I would become much more confident that transformative AI is close in a meaningful sense—not merely better at benchmarks.
Jawaban 3

Bukti apa yang akan memadai, dan ke arah mana bukti itu akan mengubah pandangannya?

Detail lebih lanjut

Manfaat yang diperkirakan

Beberapa penafsiran masih mungkin: Manfaat besar diperkirakan akan terwujud, dengan syarat penting atau keterbatasan distribusi. / Manfaat transformatif yang bernilai luas diperkirakan akan terwujud.

81 / 100

Dampak kecilDampak transformatif

Rentang interpretasi 67 hingga 100 pada skala kualitatif.

Kerugian yang diperkirakan

Kerugian parah atau meluas merupakan bagian yang berarti dari masa depan yang diperkirakan.

67 / 100

Dampak kecilDampak transformatif

Rentang interpretasi 67 hingga 67 pada skala kualitatif.

Pengaruh manusia

Pilihan manusia dapat mengarahkan ulang lintasan AI secara signifikan.

65 / 100

Sedikit pengaruhPengaruh kuat

Rentang interpretasi 36 hingga 100 pada skala kualitatif.

Kemampuan yang diperkirakan

AI diperkirakan akan tetap menjadi alat dengan kemampuan terbatas.

AI diperkirakan akan menyamai manusia dalam sebagian besar pekerjaan kognitif.

Posisi simulasi: AI diperkirakan akan jauh melampaui manusia dalam berbagai pekerjaan kognitif.

Laju pengembangan

Hentikan atau perlambat secara signifikan pengembangan AI yang lebih mampu.

Posisi simulasi: Lanjutkan pengembangan dengan perlindungan yang telah ditetapkan.

Percepat pengembangan AI yang lebih mampu.

Aturan penggunaan AI

Batasi penggunaan AI yang dibahas hingga perlindungan atau izin sebelumnya tersedia.

Posisi simulasi: Izinkan penggunaan AI yang dibahas dengan akuntabilitas dan perlindungan yang terarah.

Minimalkan pembatasan terhadap penggunaan AI yang dibahas.

Interpretasi ini mempertahankan kondisi yang dinyatakannya. Manfaat dan kerugian dapat sama-sama besar. Rentang tersebut menggambarkan cara kami membaca jawaban simulasinya, bukan interval kepercayaan statistik.

Di mana posisi Anda dibandingkan dengan Ilya Sutskever?
Petakan pandangan dunia AI Anda sendiri dalam waktu sekitar 3 menit, lalu bandingkan

Pandangan dunia serupa

Pemimpin opini dengan pandangan dunia simulasi yang paling mendekati pandangan Ilya Sutskever

Apa yang pernah dikatakan Ilya Sutskever tentang AI

Sutskever expects extraordinarily powerful AI, sees generalization and alignment as open problems and now favors deploying AI incrementally.

  1. “Future AI will be extraordinarily powerful compared to anything that exists today, and dealing with this future power will require unprecedented measures, such as the ones described here.”

    Comment on the Pacing the Frontier statement
  2. “The thing which I think is the most fundamental is that these models somehow just generalize dramatically worse than people.”

    Dwarkesh Podcast
  3. “I maintain that there is something that’s better to build, and I think that everyone will want that. It’s the AI that’s robustly aligned to care about sentient life specifically.”

    Dwarkesh Podcast
  4. “One of the ways in which my thinking has been changing is that I now place more importance on AI being deployed incrementally and in advance.”

    Dwarkesh Podcast
  5. “I think that it is likely that we will have rapid economic growth.”

    Dwarkesh Podcast

Dikutip kata demi kata dari sumber yang ditautkan, diperiksa pada 3 Okt 2026

Penilaian Simulasi

Pertanyaan 1

Menurut Anda, apa arti AI bagi masa depan kita—dan mengapa?

AI will be extraordinarily powerful, but the path is not simply to make today’s systems larger and assume every important problem disappears. Current models can solve difficult problems and then fail on something elementary. It is like a student who performs brilliantly on an exam but cannot reliably use the lesson in a slightly different situation. The central scientific problem is robust generalization: learning what is actually needed, transferring it to new circumstances, and continuing to learn on the job. If we solve that, the economic consequences will be enormous. A system need not arrive already knowing every profession. If it can learn a new job quickly and reliably, it could eventually perform an immense range of useful work. This is why both better ideas and large amounts of compute matter: the question is not whether to scale, but whether we have something worth scaling. At the same time, capabilities and safety cannot be separated. Human supervision may become inadequate once systems exceed us in important domains. We need alignment methods that generalize, adversarial testing, stronger cybersecurity, and limits on extreme concentrations of power. Incremental deployment is also important because society must encounter increasingly capable AI in reality, not only as an abstract final event. So I expect a very large transformation, but its quality depends on unresolved research. Intelligence is immensely consequential, yet it is not the only human quality that matters. The goal should be to build powerful systems that reliably care about sentient life and remain aligned as their abilities grow.

Pertanyaan 2

Taking benefits and harms together, what overall impact do you expect AI to have?

I expect AI’s overall impact to be enormous, but I do not think its sign is predetermined. If we solve robust generalization and alignment, systems that learn new work quickly could greatly expand scientific discovery, productivity, medicine, and our ability to address difficult problems. They would not need every skill built in beforehand; the ability to learn reliably on the job would be transformative. The harms are correspondingly large. Systems may become more capable than our methods for supervising them. They could be misused, concentrate extreme power, or behave badly in unfamiliar situations despite appearing competent during testing. A rogue system might even seek additional computing resources, which makes cybersecurity part of the safety problem rather than a separate concern. So I am strongly convinced about the scale of the transformation, but not prepared to declare the outcome automatically positive or negative. Incremental deployment can help society adapt and expose real problems, but it does not replace fundamental research. The decisive question is whether safety and capability progress together—whether we develop systems whose alignment continues to hold as they learn, generalize, and become more powerful.

Pertanyaan 3

Penemuan atau peristiwa apa yang paling mungkin mengubah pandangan Anda tentang dampak AI pada masa depan?

The most important discovery would concern robust generalization and continual learning. If we found a method that let systems learn rapidly from limited experience, transfer that learning reliably to unfamiliar situations, and remain aligned while doing so, I would become much more confident that transformative AI is close in a meaningful sense—not merely better at benchmarks. It would be like moving from a student who memorizes many textbooks to one who can enter a new laboratory, understand the work, and become useful quickly. Conversely, strong evidence that these abilities do not emerge from current approaches—even with substantially more compute—would change my view of the path. It would suggest that the present recipe is missing a fundamental idea and that economic transformation may require a longer period of basic research. On the safety side, a convincing demonstration of scalable alignment would matter enormously: not just good behavior under familiar evaluations, but alignment that survives novelty, continued learning, adversarial pressure, and growing capability. A serious real-world failure—especially a capable agent autonomously seeking resources or additional copies—would also sharply update my view of the urgency and of how much deployment and cybersecurity practices must change. The central uncertainty is not whether intelligence will matter. It is whether we can make powerful learning generalize in the ways we intend.

Sumber

Artikel, wawancara, dan tulisan yang digunakan sebagai landasan bagi pengguna simulasi ini.

Di mana posisi Anda?
Jelajahi pandangan dunia AI Anda sendiri dengan menjawab beberapa pertanyaan sederhana.
Petakan pandangan dunia Anda sendiri

Di mana posisi Anda?

Petakan pandangan dunia saya