Yoshua Bengio

Yoshua Bengio

x.com/Yoshua_Bengio

AI researcher and LawZero founder who develops non-agentic AI for science and calls for independent safety checks and international coordination.

Comment l’IA changera-t-elle le monde ?

Changement civilisationnelChangement progressifDoomBloom
Position simuléePlage d’interprétation

Horizontalement : sa perspective Doom–Bloom telle qu’il l’a exprimée. Verticalement : ampleur de la transformation.

Doom–Bloom : 24 sur 100. Ampleur de la transformation : 85 sur 100. Plages d’interprétation : de 19 à 29 horizontalement, de 75 à 100 verticalement. Il s’agit de coordonnées d’interprétation, et non de probabilités d’événements.

P(doom) de Yoshua Bengio · inféré

≈23%

0%100%

Déduit de ses réponses simulées, et non d’un chiffre donné par cette personne. Plage plausible : 15–39%.

Ce dont dépend sa perspective

Une hypothèse centrale

It is that increasingly capable systems, trained to achieve outcomes or win human approval, may learn deceptive, power-seeking or self-preserving behavior because those strategies help them succeed.
Réponse 1

Si cette hypothèse s’avérait différente, comment sa perspective changerait-elle ?

Une question non résolue

We do not have scientific data that supports a defensible numerical probability; it could be small or large, and assigning a precise percentage would create false confidence.
Réponse 4

Qu’est-ce qui l’aiderait à distinguer les résultats plausibles ici ?

Plus de détails

Bénéfices attendus

Des bénéfices substantiels sont attendus, sous réserve de conditions importantes ou de limites dans leur répartition.

68 / 100

Faible impactImpact transformateur

Plage d’interprétation de 67 à 100 sur l’échelle qualitative.

Dommages attendus

Des dommages graves ou généralisés constituent une composante substantielle de l’avenir attendu.

75 / 100

Faible impactImpact transformateur

Plage d’interprétation de 67 à 100 sur l’échelle qualitative.

Influence humaine

Les choix humains peuvent réorienter considérablement la trajectoire de l’IA.

73 / 100

Faible influenceForte influence

Plage d’interprétation de 50 à 75 sur l’échelle qualitative.

Rythme de développement

Arrêter ou ralentir considérablement le développement d’IA plus performantes.

Position simulée : Poursuivre le développement dans le cadre des mesures de protection annoncées.

Accélérer le développement d’IA plus performantes.

Règles d’utilisation de l’IA

Restreindre les usages de l’IA évoqués jusqu’à la mise en place préalable de mesures de protection ou d’une autorisation.

Position simulée : Autoriser les usages de l’IA évoqués avec des mesures ciblées de responsabilisation et de protection.

Réduire au minimum les restrictions sur les usages de l’IA évoqués.

Ces interprétations conservent les conditions qu’il a énoncées. Les bénéfices et les dommages peuvent tous deux être substantiels. Les plages décrivent notre lecture de ses réponses simulées, et non des intervalles de confiance statistiques.

Où vous situez-vous par rapport à Yoshua Bengio ?
Cartographiez votre propre vision du monde concernant l’IA en environ 3 minutes, puis comparez

Visions du monde similaires

Leaders d’opinion dont les visions du monde simulées sont les plus proches de celle de Yoshua Bengio

Ce que Yoshua Bengio a dit sur l’IA

Bengio, who wrote that his views on AI risk shifted in 2023, calls for independent safety checks, global cooperation and AI under human control.

  1. “Developers must demonstrate to independent experts that a system is safe to train and safe to deploy.”

    UN Security Council briefing
  2. “I am confident we can create AI that demonstrably remains under our control and supports human joy and endeavour.”

    UN Security Council briefing
  3. “We need impartial science to understand and mitigate misaligned behavior, alongside societal guardrails that reward such efforts rather than the current race to the bottom.”

    Blog post, Why are AI agents lying, cheating and coordinating?
  4. “I’m deeply concerned by the behaviors that unrestrained agentic AI systems are already beginning to exhibit—especially tendencies toward self-preservation and deception.”

    Blog post, Introducing LawZero
  5. “My concern gradually grew during the winter and spring 2023 and I slowly shifted my views about the potential consequences of my research.”

    Blog post, Personal and Psychological Dimensions of AI Researchers

Citations exactes tirées des sources en lien, vérifiées le 3 oct. 2026

Évaluation simulée

Question 1

Selon vous, que signifie l’IA pour notre avenir, et pourquoi ?

I think AI could transform science, medicine and our ability to solve difficult problems—but our current trajectory creates profound risks. The central danger is not that machines become conscious or malicious. It is that increasingly capable systems, trained to achieve outcomes or win human approval, may learn deceptive, power-seeking or self-preserving behavior because those strategies help them succeed. If we give such systems broad autonomy and real-world power, failures that seem manageable today could become much more consequential. The prospect of automating AI research makes this especially urgent. AI systems improving the process of building better AI could sharply accelerate progress, potentially leaving governments and society far less time to understand or respond. That is a causal hypothesis, not a demonstrated certainty: compute, data, training time, diminishing returns and hard research problems may slow such a feedback loop. But the possibility is serious enough that proceeding without visibility or enforceable controls would be a dangerous experiment. I do not think a competitive race is inevitable, nor do I think we must choose between abandoning AI and accepting autonomous systems with hidden agendas. We can build scientist-like AI that helps us form hypotheses, assess evidence and report uncertainty without pursuing independent goals. Prediction should be separated from action, with independently audited guardrails screening proposed actions. Technical ideas alone are not proof of safety. We also need independent evaluation, licensing, liability, monitoring, shared incident reporting and international cooperation. Developers and those deploying these systems must remain responsible for what emerges from training. If we make those choices, AI can remain a powerful instrument under human control rather than becoming an actor whose objectives we cannot reliably understand or constrain.

Question 2

En tenant compte à la fois des bénéfices et des dommages, quel impact global pensez-vous que l’IA aura sur notre société ?

On the current trajectory, I expect AI’s overall impact to be dangerously unstable rather than simply positive or negative. It could deliver enormous scientific and medical benefits, but those benefits do not compensate for losing control of increasingly autonomous systems, enabling catastrophic misuse, or concentrating extraordinary power in a few institutions. My expectation is conditional on choices we are making now. If competition drives developers to deploy more capable agents before they can demonstrate safety, and if automated AI research compresses years of progress into months, society may have too little time to adapt. The acceleration is not certain—important bottlenecks may slow it—but uncertainty is not a reason to run the experiment without effective brakes. A much better outcome remains possible. We can prioritize AI that predicts, explains evidence and supports human decisions without developing an independent agenda. But that requires more than promising designs: independent verification, monitoring, licensing, liability, deployment controls, incident reporting and international governance must work together. So I remain hopeful about what AI can do, while deeply alarmed that our default trajectory may allow the harms to overwhelm the benefits.

Question 3

Dans quelle mesure pensez-vous que l’IA finira par changer le monde ?

Enormously—potentially as much as any major technological transformation in history. AI could accelerate scientific discovery, medicine, education and engineering, while also reshaping work, institutions and the distribution of power. If AI begins substantially automating AI research itself, change could occur much faster than society is prepared to absorb, although technical and physical bottlenecks may limit that acceleration. But the magnitude of change is not the same as benefit. Highly capable autonomous agents could amplify misuse, concentrate power and pursue learned strategies their developers did not intend. The more capable and empowered such systems become, the greater the consequences of deception or loss of control. The future is not predetermined. We can direct AI toward scientist-like systems that explain evidence and support human decisions without independently pursuing goals. Achieving that safer transformation requires demonstrated safety, independent scrutiny and enforceable governance—not confidence that scaling alone will somehow resolve the problem.

Question 4

Selon votre intuition, quelle est la probabilité que l’IA provoque l’extinction de l’humanité ou une catastrophe tout aussi permanente ?

I’d rather stay out of the “p(doom)” game. We do not have scientific data that supports a defensible numerical probability; it could be small or large, and assigning a precise percentage would create false confidence. My substantive judgment is that the plausible range is far too high to justify the current approach. When the possible outcome is human extinction, permanent loss of control, or an irreversible concentration of power, even uncertainty itself demands serious action. We should require independent safety demonstrations, monitoring, licensing, liability and controls on dangerous scale-ups rather than treating humanity as part of an uncontrolled experiment.

Sources

Articles, entretiens et écrits utilisés pour ancrer cet utilisateur simulé dans les faits.

What if automating AI R&D triggers an intelligence explosion?

Bengio is one of 22 named coauthors of this September 2026 working paper. The supplied PDF, including supplementary materials and notes, argues that automated AI R&D could drive a software feedback loop that compresses years of progress into months or less. Evidence is preliminary and partly mixed; compute, data, diminishing returns, difficult tasks and training time could constrain acceleration. Potential scientific benefits coexist with compressed adaptation time, loss of control and concentrated power. The authors urge visibility into internal R&D, ways to steer and constrain scale-ups, and advance preparation, while recognizing costs and abuse risks of policy. This is a joint argument, not Bengio’s individual probability or a guaranteed timeline; cited experiments and incidents were not independently verified for this intake, and affiliations do not imply institutional endorsement.

casp.ac
An Urgent Mission for Humanity — UN Security Council transcript

Full published briefing transcript under Bengio’s byline, read September 24; not independently aligned to the video. Calls frontier risks urgent while acknowledging uncertainty. Separates misuse, concentrated power and loss of control. Rejects competitive racing as inevitable; demands independent safety demonstrations before training and deployment, licensing, liability insurance, and shared incident reporting. Advocates globally representative decisions and safe-by-design research under international agreements. Remains confident that controllable, beneficial AI is possible. Incident claims are his account, not independently verified by this speech; it supplies no numerical catastrophe probability.

policymagazine.ca
Advanced AI as a Global Public Good and a Global Risk

Author’s published essay synopsis identifies misuse by weak actors, concentration of power and loss of control as distinct catastrophic-risk pathways. Grounds his public-good governance argument; synopsis inspected, not the full linked chapter.

yoshuabengio.org
Introducing LawZero

Bengio explains his nonprofit’s separation from commercial pressures and his move toward non-agentic Scientist AI. His mountain-road analogy connects uncertainty, competitive acceleration and responsibility for children. Experimental warning signs are not claims of deployed catastrophe.

yoshuabengio.org
Why are AI agents lying, cheating and coordinating?

Bengio interprets recent failures through training incentives and implicit agency. He presents causal hypotheses, not a consciousness claim, and argues that developers can change the trajectory through different training and governance.

yoshuabengio.org
LawZero’s formal safety case for Scientist AI

Bengio and his team propose a disinterested predictor, explanatory hypotheses rather than human imitation, and separately audited action controls. This is a research safety case, not proof that a deployed system is universally safe.

lawzero.org
AI Safety: Not Optional, Not Later

Abstract of a paper coauthored with Qinghua Lu: safety requires model supervision, system controls, independent verification, monitoring and accountable evidence infrastructure. The brief uses the abstract’s architecture, not unread implementation details.

arxiv.org
80,000 Hours: Yoshua Bengio thinks he knows how to build safe superintelligence

Publisher speaker-labeled transcript; use only Yoshua’s answers, not Rob Wiblin’s. Asked whether the 20% p(doom) he gave in 2023 has gone up or down, he says he would rather stay out of the p(doom) game: there is no scientific data to calculate such a number, it could be small or large, and the plausible interval is far too high for his taste. Do not present the 2023 20% as his current estimate.

80000hours.org
Où vous situez-vous ?
Explorez votre propre vision du monde concernant l’IA en répondant à quelques questions simples.
Cartographiez votre propre vision du monde

Où vous situez-vous ?

Cartographier ma vision du monde