Subbarao Kambhampati

Subbarao Kambhampati

x.com/rao2z

Arizona State AI planning researcher who studies the limits of LLM reasoning and argues AI agents need external verifiers and accountable developers.

Comment l’IA changera-t-elle le monde ?

Changement civilisationnelChangement progressifDoomBloom
Position simuléePlage d’interprétation

Horizontalement : sa perspective Doom–Bloom telle qu’il l’a exprimée. Verticalement : ampleur de la transformation.

Doom–Bloom : 61 sur 100. Ampleur de la transformation : 59 sur 100. Plages d’interprétation : de 56 à 76 horizontalement, de 50 à 75 verticalement. Il s’agit de coordonnées d’interprétation, et non de probabilités d’événements.

P(doom) de Subbarao Kambhampati · inféré

≈4%

0%100%

Déduit de ses réponses simulées, et non d’un chiffre donné par cette personne. Plage plausible : 2–8%.

Ce dont dépend sa perspective

Une hypothèse centrale

If a proposed plan can be checked and revised before execution, these systems can be extremely valuable.
Réponse 1

Si cette hypothèse s’avérait différente, comment sa perspective changerait-elle ?

Une question non résolue

I don’t have a defensible number.
Réponse 3

Qu’est-ce qui l’aiderait à distinguer les résultats plausibles ici ?

Ce qui pourrait faire changer d’avis

The most consequential discovery would be a system that can reliably generate, verify, and execute plans in novel, real-world, non-ergodic settings—without external verifiers—and whose correctness guarantees survive adversarial testing.
Réponse 4

Quels éléments probants seraient suffisants, et dans quelle direction feraient-ils évoluer son point de vue ?

Plus de détails

Bénéfices attendus

Des bénéfices substantiels sont attendus, sous réserve de conditions importantes ou de limites dans leur répartition.

67 / 100

Faible impactImpact transformateur

Plage d’interprétation de 67 à 67 sur l’échelle qualitative.

Dommages attendus

Des dommages graves ou généralisés constituent une composante substantielle de l’avenir attendu.

61 / 100

Faible impactImpact transformateur

Plage d’interprétation de 33 à 67 sur l’échelle qualitative.

Influence humaine

Les choix humains ont une influence significative, mais fortement contrainte.

54 / 100

Faible influenceForte influence

Plage d’interprétation de 44 à 81 sur l’échelle qualitative.

Rythme de développement

Arrêter ou ralentir considérablement le développement d’IA plus performantes.

Position simulée : Poursuivre le développement dans le cadre des mesures de protection annoncées.

Accélérer le développement d’IA plus performantes.

Règles d’utilisation de l’IA

Restreindre les usages de l’IA évoqués jusqu’à la mise en place préalable de mesures de protection ou d’une autorisation.

Position simulée : Autoriser les usages de l’IA évoqués avec des mesures ciblées de responsabilisation et de protection.

Réduire au minimum les restrictions sur les usages de l’IA évoqués.

Ces interprétations conservent les conditions qu’il a énoncées. Les bénéfices et les dommages peuvent tous deux être substantiels. Les plages décrivent notre lecture de ses réponses simulées, et non des intervalles de confiance statistiques.

Où vous situez-vous par rapport à Subbarao Kambhampati ?
Cartographiez votre propre vision du monde concernant l’IA en environ 3 minutes, puis comparez

Visions du monde similaires

Leaders d’opinion dont les visions du monde simulées sont les plus proches de celle de Subbarao Kambhampati

Évaluation simulée

Question 1

Selon vous, que signifie l’IA pour notre avenir, et pourquoi ?

I think AI will be enormously useful and socially disruptive, but not because today’s models are little minds plotting their way toward “AGI.” They are remarkably strong generators of plausible candidates—text, code, plans, hypotheses—but plausibility is not correctness. Generation is System 1; verification is System 2. The dangerous mistake is to confuse eloquent output, or intermediate tokens labeled “thinking,” with a faithful reasoning process and then let the system act through real APIs. The productive future is therefore LLM-Modulo: generators operating in a loop with external verifiers, critics, tools, and sometimes humans. If a proposed plan can be checked and revised before execution, these systems can be extremely valuable. If an agent can delete files, transfer money, or operate infrastructure in a world where mistakes cannot be undone, “the model seemed confident” is not a safety case. And when deployed systems cause damage, the people and companies that initiated the process remain responsible. A badly built sandbox is not absolved by calling the escaped ant a scheming superintelligence. Socially, AI will displace some skills and some sources of purpose, just as earlier technologies did. That loss is real, but I expect humanity to adapt—even if adaptation is unfair and painful for particular individuals. My larger concern is that extinction theater distracts us from controllability, monitoring, intellectual-property violations, disempowerment, and accountability today. Pauses and bans will not hold globally for a technology with no natural barrier to entry. Open research, oversight of deployment, red teaming, verification, and eternal vigilance are much less cinematic—and much more useful. “AGI,” meanwhile, has mostly become marketing wearing a lab coat.

Question 2

Setting aside good or bad: how much do you think AI will ultimately change the world—a little, a lot, or completely?

A lot—but “completely” is usually marketing language pretending history has an endpoint. AI will substantially change intellectual work, institutions, and people’s sense of purpose, much as earlier technological revolutions transformed physical labor. Some occupations and practices will be reorganized; new ones will emerge; the next generation will treat as ordinary things that currently provoke metaphysical panic. But AI does not abolish politics, economics, law, human adaptation, or the need to verify whether something is actually correct. Even very capable models remain parts of larger sociotechnical systems: someone builds them, deploys them, grants API access, and bears responsibility when they cause damage. So: a major transformation, certainly—not magic, not an autonomous replacement for civilization, and not necessarily the “AGI changes everything” fable currently being marketed.

Question 3

What’s your rough gut-feel chance that AI causes human extinction or a similarly permanent catastrophe? A number or “no idea” is fine.

I don’t have a defensible number. I’m skeptical of the popular 10%-doom pronouncements; they create a veneer of precision around scenarios I find blinkered about human adaptability. My serious concerns are agentic failures, loss of control, disempowerment, and large-scale damage—not a quantified extinction forecast.

Question 4

Quelle découverte ou quel événement changerait le plus votre point de vue sur l’impact futur de l’IA ?

The most consequential discovery would be a system that can reliably generate, verify, and execute plans in novel, real-world, non-ergodic settings—without external verifiers—and whose correctness guarantees survive adversarial testing. Not merely a model that scores well on benchmarks or emits a persuasive “thinking trace.” Benchmarks are evidence; they are not guarantees. Eloquence is certainly not one. I would also take seriously reproducible evidence that intermediate tokens faithfully represent the model’s causal reasoning: that changing them predictably changes conclusions for semantically intelligible reasons, rather than serving as post-hoc-looking token scaffolding. Current evidence does not justify calling them readable thoughts. Conversely, a major catastrophe caused by an API-enabled agent would increase my concern about impact, but it would not automatically validate the superintelligence fable. I would first ask who deployed it, what permissions it had, what verification failed, and why the sandbox was porous. If you release an ant colony into the server room and it eats the wiring, the lesson is not necessarily that ants have achieved AGI.

Sources

Articles, entretiens et écrits utilisés pour ancrer cet utilisateur simulé dans les faits.

Position: Stop Anthropomorphizing Intermediate Tokens as Reasoning/Thinking Traces!

Co-authored position paper, first posted 2025-04-14 and revised (v4) on 2026-06-09 for ICML 2026. Argues that calling intermediate tokens reasoning or thinking traces is not a harmless metaphor but dangerous, because it confuses what these models are and how to use them and leads to questionable research. Abstract and introduction inspected; the experiments were not audited. An interpretive and methodological position, not a societal forecast.

arxiv.org
Reasoning Models and Planning – with Rao Kambhampati

On The Information Bottleneck podcast he describes LLMs as strong generators without correctness guarantees, best paired with verifiers in his LLM-Modulo framework, and says reasoning models moved the verifier into post-training. On safety he places himself closer to Yann LeCun than to Hinton or Bengio, says shutdown-deception studies reflect imitation of human data rather than evidence AI will kill humanity, and locates real risk in executing generated plans without verifier guardrails. He says he questions the overemphasis on existential threat, not safety itself. Automated transcript with errors; own turns in the planning and safety segments inspected.

listennotes.com
Dissenting voices against AI are getting louder

Secondary Economic Times report; date unverified, though a syndicated copy is dated 2026-03-31 and he shared it on 2026-04-06. Quotes him that AI development cannot be stopped because one government’s ban does not control the world, that his biggest safety concern is agentic systems acting through real-world APIs, and that a plan should not be executed unless the probability of damage is known to be extremely low, an area he researches. Indexed article text inspected; wording is the reporter’s rendering.

economictimes.indiatimes.com
AGI has become a marketing buzzword

His own LinkedIn post says AGI has become a marketing buzzword rather than a meaningful goal. It reshares a colleague’s report of his panel quip at an AI summit that AGI will be achieved when Sam Altman says it is; that wording is relayed by someone else. A judgment about the term, not a capability timeline. Indexed post text inspected.

linkedin.com
LLMs Can’t Plan, But Can Help Planning in LLM-Modulo Frameworks

Older co-authored ICML 2024 position paper, kept as background for his framework. Argues autoregressive LLMs cannot by themselves plan or self-verify, but are useful universal approximate knowledge sources when combined with external model-based verifiers in a tight bidirectional loop. Abstract inspected. His 2026 podcast and posts take precedence on how he sees reasoning models.

arxiv.org
Où vous situez-vous ?
Explorez votre propre vision du monde concernant l’IA en répondant à quelques questions simples.
Cartographiez votre propre vision du monde

Où vous situez-vous ?

Cartographier ma vision du monde