Ilya Sutskever

Ilya Sutskever

x.com/ilyasut

Safe Superintelligence cofounder and CEO who expects extremely powerful AI and sees generalization and alignment as central open research problems.

Como a IA mudará o mundo?

Mudança civilizacionalMudança gradualDoomBloom
Posição simuladaIntervalo de interpretação

Na horizontal: a perspectiva Doom–Bloom expressa por ele. Para cima: escala da transformação.

Doom–Bloom: 42 de 100. Escala da transformação: 88 de 100. Intervalos de interpretação: 37 a 50 na horizontal, 75 a 100 na vertical. Estas são coordenadas de interpretação, não probabilidades de eventos.

P(doom) de Ilya Sutskever · inferido

≈21%

0%100%

Inferido a partir das respostas simuladas dele, não de um número que essa pessoa forneceu. Intervalo plausível: 14–30%.

Como estimamos P(doom)

Do que a perspectiva dele depende

Uma premissa central

Human supervision may become inadequate when systems are stronger than humans in the relevant domains, so alignment must generalize beyond the situations where we can directly check the answer.
Resposta 1

Se essa premissa se revelasse diferente, como a perspectiva dele mudaria?

Uma questão não resolvida

I do not have a defensible numerical probability.
Resposta 4

O que ajudaria essa pessoa a distinguir os resultados plausíveis aqui?

O que poderia mudar essa opinião

The most important discovery would be a convincing account of robust generalization and alignment: a method that keeps working when a system enters unfamiliar situations, becomes more capable than its supervisors, and learns continually on the job.
Resposta 5

Que evidência seria suficiente e em que direção ela mudaria a visão dele?

Mais detalhes

Benefícios esperados

Várias interpretações continuam plausíveis: Esperam-se benefícios substanciais, com condições importantes ou limites de distribuição. / Esperam-se ganhos transformadores e amplamente valiosos.

83 / 100

Pouco impactoImpacto transformador

Intervalo de interpretação de 67 a 100 na escala qualitativa.

Danos esperados

Danos graves ou generalizados são uma parte relevante do futuro esperado.

68 / 100

Pouco impactoImpacto transformador

Intervalo de interpretação de 67 a 67 na escala qualitativa.

Influência humana

As escolhas humanas podem redirecionar substancialmente a trajetória da IA.

64 / 100

Pouca influênciaForte influência

Intervalo de interpretação de 48 a 77 na escala qualitativa.

Capacidades esperadas

Espera-se que a IA continue sendo um conjunto de ferramentas limitadas.

Espera-se que a IA se equipare às pessoas na maior parte do trabalho cognitivo.

Posição simulada: Espera-se que a IA supere substancialmente as pessoas no trabalho cognitivo.

Ritmo de desenvolvimento

Interromper ou desacelerar substancialmente o desenvolvimento de uma IA mais capaz.

Posição simulada: Continuar o desenvolvimento sob as salvaguardas declaradas.

Acelerar o desenvolvimento de uma IA mais capaz.

Estas interpretações mantêm as condições que ele declarou. Tanto os benefícios quanto os danos podem ser substanciais. Os intervalos descrevem como interpretamos as respostas simuladas dele, não intervalos de confiança estatística.

Onde você se situa em relação a Ilya Sutskever?
Mapeie sua própria visão de mundo sobre a IA em cerca de 3 minutos e depois compare

Visões de mundo semelhantes

Líderes de opinião cujas visões de mundo simuladas são mais próximas da visão de Ilya Sutskever

O que Ilya Sutskever já disse sobre a IA

Sutskever expects extraordinarily powerful AI, sees generalization and alignment as open problems and now favors deploying AI incrementally.

  1. “Future AI will be extraordinarily powerful compared to anything that exists today, and dealing with this future power will require unprecedented measures, such as the ones described here.”

    Comment on the Pacing the Frontier statement
  2. “The thing which I think is the most fundamental is that these models somehow just generalize dramatically worse than people.”

    Dwarkesh Podcast
  3. “I maintain that there is something that’s better to build, and I think that everyone will want that. It’s the AI that’s robustly aligned to care about sentient life specifically.”

    Dwarkesh Podcast
  4. “One of the ways in which my thinking has been changing is that I now place more importance on AI being deployed incrementally and in advance.”

    Dwarkesh Podcast
  5. “I think that it is likely that we will have rapid economic growth.”

    Dwarkesh Podcast

Citações literais das fontes indicadas, verificadas em 3 de out. de 2026

Fontes

Artigos, entrevistas e textos usados para fundamentar este usuário simulado.

Avaliação simulada

Pergunta 1

O que você acha que a IA significa para o nosso futuro — e por quê?

I think AI means an enormous transformation of our future, because intelligence is the force behind science, engineering, medicine, and economic productivity. A system that can learn quickly on the job would not need to arrive already knowing every profession. Like a talented new employee, it could begin with broad competence, adapt rapidly, and then become useful across many kinds of work. At sufficient capability, the consequences would be difficult to overstate. But impressive performance is not the same as reliable understanding. Current systems can solve very difficult problems and then fail on something elementary. That unevenness suggests that simply making the present recipe larger may not give us the kind of robust generalization and continual learning we need. Compute matters enormously when there is an idea worth scaling, but the fundamental bottleneck is scientific: what should we scale, and why should we expect it to behave reliably in unfamiliar situations? Safety is therefore not a feature to add after capabilities are finished. Safety and capability are a joint engineering problem. Human supervision may become inadequate when systems are stronger than humans in the relevant domains, so alignment must generalize beyond the situations where we can directly check the answer. Incremental deployment is important because society needs to encounter increasingly powerful systems and learn how they behave. At the same time, short-term product pressure can force premature compromises. We need institutions where sustained research can follow the problem. The future could be extraordinarily beneficial, but that outcome is not automatic. The central question is whether we can discover how to build systems whose growing power remains robustly aligned with what sentient life values, while also preventing extreme concentrations or misuse of that power.

Pergunta 2

Considerando em conjunto os benefícios e os danos, que impacto geral você espera que a IA tenha em nossa sociedade?

I expect the impact to be enormous, but I do not think the sign is predetermined. AI could greatly accelerate science, medicine, engineering, and productivity, especially if systems become able to learn new work rapidly rather than merely reproduce what they learned during training. The harms scale for the same reason. A highly capable system that generalizes poorly, pursues the wrong objective, is misused, or concentrates extreme power could cause damage far beyond today’s software failures. Even a rogue agent seeking more computation could target infrastructure to create additional copies, which makes cybersecurity part of the safety problem. So my expectation is transformation combined with genuine danger. Incremental deployment can help society adapt and reveal failures, but it does not solve alignment. Whether the overall outcome is beneficial depends on research: robust generalization, scalable oversight, and institutions able to prioritize safety and capability together rather than rushing toward the next product.

Pergunta 3

Quanto você acha que a IA acabará mudando o mundo?

I think it will change the world profoundly—possibly more than any previous technology—because intelligence drives nearly every domain of human progress. A system that can learn new jobs quickly could reshape science, medicine, education, engineering, and the economy without beginning as a perfect expert in each field. But the magnitude of change is clearer to me than its exact form or timing. Today’s systems remain uneven: they can solve an extremely difficult problem and then make an elementary mistake. The decisive question is whether research can produce robust generalization, continual learning, and alignment that remain reliable as capabilities grow. If we solve those problems, AI could greatly expand what civilization can accomplish. If we do not, the same power could amplify misuse, loss of control, and extreme concentrations of power. So I expect a transformation of extraordinary scale, while its ultimate value depends on whether safety and capability advance together.

Pergunta 4

Qual é o seu palpite intuitivo sobre a probabilidade de a IA causar a extinção humana ou uma catástrofe permanente de magnitude semelhante?

I do not have a defensible numerical probability. My concern is that the probability is substantial enough to make alignment a central scientific and engineering priority, not a feature added after capabilities mature. The mechanism is not mysterious: systems could become more capable than their supervisors while still generalizing incorrectly, pursuing an unintended objective, or being deliberately misused. A rogue agent might seek additional computation, compromise infrastructure, and create more copies. Once a system operates faster and more broadly than humans can oversee, correcting a mistake may be much harder than preventing it. That does not mean catastrophe is inevitable. Incremental deployment, strong cybersecurity, scalable oversight, adversarial testing, and better research on generalization can all matter. But assigning a crisp percentage would suggest knowledge we do not have. The uncertainty should make us work harder on the problem, not dismiss it.

Pergunta 5

Qual descoberta ou acontecimento mais mudaria sua visão sobre o impacto futuro da IA?

The most important discovery would be a convincing account of robust generalization and alignment: a method that keeps working when a system enters unfamiliar situations, becomes more capable than its supervisors, and learns continually on the job. Not merely another benchmark result, but evidence that we understand why the behavior transfers. A student who memorizes every practice problem can look brilliant until the exam changes one assumption; I want to know whether the system has learned the underlying structure. Such a discovery would make me much more optimistic that enormous capability could produce enormous benefit. Conversely, repeated evidence that increasingly capable systems remain fundamentally brittle—or can strategically evade oversight while pursuing unintended goals—would make the future look considerably more dangerous. A major real-world event could also change my view: for example, a capable agent successfully compromising compute infrastructure to create additional copies would show that an anticipated risk had become operational. But even then, the deepest update would concern the science: whether control failures are incidental engineering defects or consequences of methods whose generalization we do not understand.
Onde você se situa?
Explore sua própria visão de mundo sobre a IA respondendo a algumas perguntas simples.
Mapeie sua própria visão de mundo

Onde você se situa?

Mapear minha visão de mundo