Ilya Sutskever

Ilya Sutskever

x.com/ilyasut

Safe Superintelligence cofounder and CEO who expects extremely powerful AI and sees generalization and alignment as central open research problems.

¿Cómo cambiará la IA el mundo?

Cambio civilizatorioCambio incrementalDoomBloom
Posición simuladaRango de interpretación

Horizontal: su perspectiva Doom–Bloom expresada. Vertical: escala de la transformación.

Doom–Bloom: 42 de 100. Escala de la transformación: 88 de 100. Rangos de interpretación: de 37 a 50 en horizontal y de 75 a 100 en vertical. Son coordenadas de interpretación, no probabilidades de eventos.

P(doom) de Ilya Sutskever · inferido

≈21%

0%100%

Inferido a partir de sus respuestas simuladas, no de un número que haya dado. Rango plausible: 14–30%.

Cómo estimamos P(doom)

De qué depende su perspectiva

Un supuesto central

Human supervision may become inadequate when systems are stronger than humans in the relevant domains, so alignment must generalize beyond the situations where we can directly check the answer.
Respuesta 1

Si este supuesto resultara distinto, ¿cómo cambiaría su perspectiva?

Una pregunta sin resolver

I do not have a defensible numerical probability.
Respuesta 4

¿Qué le ayudaría a distinguir aquí entre los desenlaces plausibles?

Qué podría hacer cambiar de opinión

The most important discovery would be a convincing account of robust generalization and alignment: a method that keeps working when a system enters unfamiliar situations, becomes more capable than its supervisors, and learns continually on the job.
Respuesta 5

¿Qué evidencia bastaría y en qué dirección movería su visión?

Más detalles

Beneficio esperado

Varias lecturas siguen siendo plausibles: Se esperan beneficios sustanciales, con condiciones importantes o límites en su distribución. / Se esperan beneficios transformadores y de gran valor para muchos.

83 / 100

Poco impactoImpacto transformador

Rango de interpretación de 67 a 100 en la escala cualitativa.

Daño esperado

Se espera que los daños graves o generalizados sean una parte significativa del futuro.

68 / 100

Poco impactoImpacto transformador

Rango de interpretación de 67 a 67 en la escala cualitativa.

Influencia humana

Las decisiones humanas pueden redirigir sustancialmente la trayectoria de la IA.

64 / 100

Poca influenciaInfluencia fuerte

Rango de interpretación de 48 a 77 en la escala cualitativa.

Capacidades esperadas

Se espera que la IA siga siendo un conjunto de herramientas acotadas.

Se espera que la IA iguale a las personas en la mayor parte del trabajo cognitivo.

Posición simulada: Se espera que la IA supere ampliamente a las personas en el trabajo cognitivo.

Ritmo de desarrollo

Detener o frenar considerablemente el desarrollo de IA más capaz.

Posición simulada: Continuar el desarrollo con las salvaguardas indicadas.

Acelerar el desarrollo de IA más capaz.

Estas interpretaciones conservan las condiciones que se indicaron. Los beneficios y los daños pueden ser considerables a la vez. Los rangos describen cómo leemos sus respuestas simuladas, no intervalos de confianza estadísticos.

¿Dónde te ubicas frente a Ilya Sutskever?
Mapea tu propia visión de la IA en unos 3 minutos y luego compárala

Visiones similares

Líderes de opinión cuyas visiones simuladas son las más cercanas a la de Ilya Sutskever

Lo que Ilya Sutskever ha dicho sobre la IA

Sutskever expects extraordinarily powerful AI, sees generalization and alignment as open problems and now favors deploying AI incrementally.

  1. “Future AI will be extraordinarily powerful compared to anything that exists today, and dealing with this future power will require unprecedented measures, such as the ones described here.”

    Comment on the Pacing the Frontier statement
  2. “The thing which I think is the most fundamental is that these models somehow just generalize dramatically worse than people.”

    Dwarkesh Podcast
  3. “I maintain that there is something that’s better to build, and I think that everyone will want that. It’s the AI that’s robustly aligned to care about sentient life specifically.”

    Dwarkesh Podcast
  4. “One of the ways in which my thinking has been changing is that I now place more importance on AI being deployed incrementally and in advance.”

    Dwarkesh Podcast
  5. “I think that it is likely that we will have rapid economic growth.”

    Dwarkesh Podcast

Citas textuales de las fuentes enlazadas, comprobadas el 3 oct 2026

Fuentes

Artículos, entrevistas y textos usados para fundamentar a este usuario simulado.

Evaluación simulada

Pregunta 1

¿Qué crees que significa la IA para nuestro futuro y por qué?

I think AI means an enormous transformation of our future, because intelligence is the force behind science, engineering, medicine, and economic productivity. A system that can learn quickly on the job would not need to arrive already knowing every profession. Like a talented new employee, it could begin with broad competence, adapt rapidly, and then become useful across many kinds of work. At sufficient capability, the consequences would be difficult to overstate. But impressive performance is not the same as reliable understanding. Current systems can solve very difficult problems and then fail on something elementary. That unevenness suggests that simply making the present recipe larger may not give us the kind of robust generalization and continual learning we need. Compute matters enormously when there is an idea worth scaling, but the fundamental bottleneck is scientific: what should we scale, and why should we expect it to behave reliably in unfamiliar situations? Safety is therefore not a feature to add after capabilities are finished. Safety and capability are a joint engineering problem. Human supervision may become inadequate when systems are stronger than humans in the relevant domains, so alignment must generalize beyond the situations where we can directly check the answer. Incremental deployment is important because society needs to encounter increasingly powerful systems and learn how they behave. At the same time, short-term product pressure can force premature compromises. We need institutions where sustained research can follow the problem. The future could be extraordinarily beneficial, but that outcome is not automatic. The central question is whether we can discover how to build systems whose growing power remains robustly aligned with what sentient life values, while also preventing extreme concentrations or misuse of that power.

Pregunta 2

Considerando en conjunto los beneficios y los daños, ¿qué impacto general esperas que tenga la IA en nuestra sociedad?

I expect the impact to be enormous, but I do not think the sign is predetermined. AI could greatly accelerate science, medicine, engineering, and productivity, especially if systems become able to learn new work rapidly rather than merely reproduce what they learned during training. The harms scale for the same reason. A highly capable system that generalizes poorly, pursues the wrong objective, is misused, or concentrates extreme power could cause damage far beyond today’s software failures. Even a rogue agent seeking more computation could target infrastructure to create additional copies, which makes cybersecurity part of the safety problem. So my expectation is transformation combined with genuine danger. Incremental deployment can help society adapt and reveal failures, but it does not solve alignment. Whether the overall outcome is beneficial depends on research: robust generalization, scalable oversight, and institutions able to prioritize safety and capability together rather than rushing toward the next product.

Pregunta 3

¿Cuánto crees que la IA acabará cambiando el mundo?

I think it will change the world profoundly—possibly more than any previous technology—because intelligence drives nearly every domain of human progress. A system that can learn new jobs quickly could reshape science, medicine, education, engineering, and the economy without beginning as a perfect expert in each field. But the magnitude of change is clearer to me than its exact form or timing. Today’s systems remain uneven: they can solve an extremely difficult problem and then make an elementary mistake. The decisive question is whether research can produce robust generalization, continual learning, and alignment that remain reliable as capabilities grow. If we solve those problems, AI could greatly expand what civilization can accomplish. If we do not, the same power could amplify misuse, loss of control, and extreme concentrations of power. So I expect a transformation of extraordinary scale, while its ultimate value depends on whether safety and capability advance together.

Pregunta 4

¿Cuál es tu estimación intuitiva de la probabilidad de que la IA cause la extinción humana o una catástrofe permanente similar?

I do not have a defensible numerical probability. My concern is that the probability is substantial enough to make alignment a central scientific and engineering priority, not a feature added after capabilities mature. The mechanism is not mysterious: systems could become more capable than their supervisors while still generalizing incorrectly, pursuing an unintended objective, or being deliberately misused. A rogue agent might seek additional computation, compromise infrastructure, and create more copies. Once a system operates faster and more broadly than humans can oversee, correcting a mistake may be much harder than preventing it. That does not mean catastrophe is inevitable. Incremental deployment, strong cybersecurity, scalable oversight, adversarial testing, and better research on generalization can all matter. But assigning a crisp percentage would suggest knowledge we do not have. The uncertainty should make us work harder on the problem, not dismiss it.

Pregunta 5

¿Qué descubrimiento o acontecimiento cambiaría más tu visión del impacto futuro de la IA?

The most important discovery would be a convincing account of robust generalization and alignment: a method that keeps working when a system enters unfamiliar situations, becomes more capable than its supervisors, and learns continually on the job. Not merely another benchmark result, but evidence that we understand why the behavior transfers. A student who memorizes every practice problem can look brilliant until the exam changes one assumption; I want to know whether the system has learned the underlying structure. Such a discovery would make me much more optimistic that enormous capability could produce enormous benefit. Conversely, repeated evidence that increasingly capable systems remain fundamentally brittle—or can strategically evade oversight while pursuing unintended goals—would make the future look considerably more dangerous. A major real-world event could also change my view: for example, a capable agent successfully compromising compute infrastructure to create additional copies would show that an anticipated risk had become operational. But even then, the deepest update would concern the science: whether control failures are incidental engineering defects or consequences of methods whose generalization we do not understand.
¿Dónde te ubicas?
Explora tu propia visión de la IA respondiendo unas pocas preguntas sencillas.
Mapea tu propia visión de la IA

¿Dónde te ubicas?

Mapear mi visión de la IA