Question 1
Yoshua Bengio
x.com/Yoshua_BengioAI researcher and LawZero founder who develops non-agentic AI for science and calls for independent safety checks and international coordination.
Comment l’IA changera-t-elle le monde ?
Horizontalement : sa perspective Doom–Bloom telle qu’il l’a exprimée. Verticalement : ampleur de la transformation.
Doom–Bloom : 24 sur 100. Ampleur de la transformation : 85 sur 100. Plages d’interprétation : de 19 à 29 horizontalement, de 75 à 100 verticalement. Il s’agit de coordonnées d’interprétation, et non de probabilités d’événements.
≈23%
Déduit de ses réponses simulées, et non d’un chiffre donné par cette personne. Plage plausible : 15–39%.
Une hypothèse centrale
It is that increasingly capable systems, trained to achieve outcomes or win human approval, may learn deceptive, power-seeking or self-preserving behavior because those strategies help them succeed.Réponse 1
Si cette hypothèse s’avérait différente, comment sa perspective changerait-elle ?
Une question non résolue
We do not have scientific data that supports a defensible numerical probability; it could be small or large, and assigning a precise percentage would create false confidence.Réponse 4
Qu’est-ce qui l’aiderait à distinguer les résultats plausibles ici ?
Plus de détails
Des bénéfices substantiels sont attendus, sous réserve de conditions importantes ou de limites dans leur répartition.
68 / 100
Plage d’interprétation de 67 à 100 sur l’échelle qualitative.
Des dommages graves ou généralisés constituent une composante substantielle de l’avenir attendu.
75 / 100
Plage d’interprétation de 67 à 100 sur l’échelle qualitative.
Les choix humains peuvent réorienter considérablement la trajectoire de l’IA.
73 / 100
Plage d’interprétation de 50 à 75 sur l’échelle qualitative.
Arrêter ou ralentir considérablement le développement d’IA plus performantes.
Position simulée : Poursuivre le développement dans le cadre des mesures de protection annoncées.
Accélérer le développement d’IA plus performantes.
Restreindre les usages de l’IA évoqués jusqu’à la mise en place préalable de mesures de protection ou d’une autorisation.
Position simulée : Autoriser les usages de l’IA évoqués avec des mesures ciblées de responsabilisation et de protection.
Réduire au minimum les restrictions sur les usages de l’IA évoqués.
Ces interprétations conservent les conditions qu’il a énoncées. Les bénéfices et les dommages peuvent tous deux être substantiels. Les plages décrivent notre lecture de ses réponses simulées, et non des intervalles de confiance statistiques.
Visions du monde similaires
Leaders d’opinion dont les visions du monde simulées sont les plus proches de celle de Yoshua Bengio
Ce que Yoshua Bengio a dit sur l’IA
Bengio, who wrote that his views on AI risk shifted in 2023, calls for independent safety checks, global cooperation and AI under human control.
“Developers must demonstrate to independent experts that a system is safe to train and safe to deploy.”
UN Security Council briefing “I am confident we can create AI that demonstrably remains under our control and supports human joy and endeavour.”
UN Security Council briefing “We need impartial science to understand and mitigate misaligned behavior, alongside societal guardrails that reward such efforts rather than the current race to the bottom.”
Blog post, Why are AI agents lying, cheating and coordinating? “I’m deeply concerned by the behaviors that unrestrained agentic AI systems are already beginning to exhibit—especially tendencies toward self-preservation and deception.”
Blog post, Introducing LawZero “My concern gradually grew during the winter and spring 2023 and I slowly shifted my views about the potential consequences of my research.”
Blog post, Personal and Psychological Dimensions of AI Researchers
Citations exactes tirées des sources en lien, vérifiées le 3 oct. 2026
Évaluation simulée
Sources
Articles, entretiens et écrits utilisés pour ancrer cet utilisateur simulé dans les faits.
Bengio is one of 22 named coauthors of this September 2026 working paper. The supplied PDF, including supplementary materials and notes, argues that automated AI R&D could drive a software feedback loop that compresses years of progress into months or less. Evidence is preliminary and partly mixed; compute, data, diminishing returns, difficult tasks and training time could constrain acceleration. Potential scientific benefits coexist with compressed adaptation time, loss of control and concentrated power. The authors urge visibility into internal R&D, ways to steer and constrain scale-ups, and advance preparation, while recognizing costs and abuse risks of policy. This is a joint argument, not Bengio’s individual probability or a guaranteed timeline; cited experiments and incidents were not independently verified for this intake, and affiliations do not imply institutional endorsement.

Full published briefing transcript under Bengio’s byline, read September 24; not independently aligned to the video. Calls frontier risks urgent while acknowledging uncertainty. Separates misuse, concentrated power and loss of control. Rejects competitive racing as inevitable; demands independent safety demonstrations before training and deployment, licensing, liability insurance, and shared incident reporting. Advocates globally representative decisions and safe-by-design research under international agreements. Remains confident that controllable, beneficial AI is possible. Incident claims are his account, not independently verified by this speech; it supplies no numerical catastrophe probability.

Author’s published essay synopsis identifies misuse by weak actors, concentration of power and loss of control as distinct catastrophic-risk pathways. Grounds his public-good governance argument; synopsis inspected, not the full linked chapter.

Bengio explains his nonprofit’s separation from commercial pressures and his move toward non-agentic Scientist AI. His mountain-road analogy connects uncertainty, competitive acceleration and responsibility for children. Experimental warning signs are not claims of deployed catastrophe.

Bengio interprets recent failures through training incentives and implicit agency. He presents causal hypotheses, not a consciousness claim, and argues that developers can change the trajectory through different training and governance.

Bengio and his team propose a disinterested predictor, explanatory hypotheses rather than human imitation, and separately audited action controls. This is a research safety case, not proof that a deployed system is universally safe.

Abstract of a paper coauthored with Qinghua Lu: safety requires model supervision, system controls, independent verification, monitoring and accountable evidence infrastructure. The brief uses the abstract’s architecture, not unread implementation details.

Publisher speaker-labeled transcript; use only Yoshua’s answers, not Rob Wiblin’s. Asked whether the 20% p(doom) he gave in 2023 has gone up or down, he says he would rather stay out of the p(doom) game: there is no scientific data to calculate such a number, it could be small or large, and the plausible interval is far too high for his taste. Do not present the 2023 20% as his current estimate.

Où vous situez-vous ?
Cartographier ma vision du monde