Geoffrey Hinton

Geoffrey Hinton

x.com/geoffreyhinton

Computer scientist who sees great promise in AI but argues that job losses, misuse and loss of control are serious risks that need regulation.

AI将如何改变世界?

文明层面的变革渐进式变化DoomBloom
模拟位置解读范围

横向:他表达的 Doom–Bloom 前景看法。 纵向:变革程度。

Doom–Bloom:100 中的 17。变革程度:100 中的 88。解读范围:横向为 12 至 25,纵向为 75 至 100。这些是解读坐标,而不是事件概率。

Geoffrey Hinton陈述的 P(doom)

10–20%

0%100%
“10% to 20% seemed like reasonable numbers to me”

Human extinction caused by AI · Within approximately 30 years

The Godfather of AI says we cannot afford to get it wrong · 2025年1月

他的展望取决于什么

一个核心假设

If we create systems much smarter than us, we should not assume we can keep control simply because we built them.
回答 1

如果这个假设实际并非如此,他的展望会如何变化?

一个尚未解决的问题

I do not think there is a scientifically defensible number.
回答 4

什么能帮助他区分这里各种合理的结果?

更多详情

预期益处

预计将带来显著益处,但受到重要条件或分配方面的限制。

65 / 100

影响小变革性影响

在定性尺度上,解读范围为 67 到 67。

预期危害

严重或广泛的危害预计将是未来不可忽视的一部分。

73 / 100

影响小变革性影响

在定性尺度上,解读范围为 67 到 100。

人类影响力

人类的选择具有实质性但受到很大制约的影响。

53 / 100

影响力小影响力强

在定性尺度上,解读范围为 49 到 76。

预期能力

预计AI仍将是能力有限的工具。

预计AI将在大多数认知工作中达到人类水平。

模拟位置:预计AI将在认知工作中大幅超越人类。

这些解读保留了他陈述的条件。益处和危害都可能很大。这些范围描述的是我们如何解读他的模拟回答,而不是统计置信区间。

与Geoffrey Hinton相比,你的立场在哪里?
用大约3分钟描绘你自己的AI世界观,然后进行比较

相似的世界观

模拟世界观与 Geoffrey Hinton 最接近的意见领袖

Geoffrey Hinton关于AI说过的话

In 2023 Hinton said he now expected AI to become smarter than people, and he has since warned about its risks while stressing its benefits.

  1. “I don’t think you can leave it to the companies to regulate themselves. That has never worked out in any industry.”

    CNN, Laura Coates Live
  2. “I think we’re at a very delicate point in history where what we do now is going to determine our future.”

    CNN, News Central
  3. “My sense is unless we act quickly, the huge increases in productivity that AI will surely bring could be accompanied by some very negative side-effects.”

    TIME essay
  4. “If the benefits of the increased productivity can be shared equally it will be a wonderful advance for all humanity.”

    Nobel Prize banquet speech
  5. “I have suddenly switched my views on whether these things are going to be more intelligent than us.”

    MIT Technology Review interview

逐字引自所链接的出处,核对于 2026年10月2日

模拟评估

问题 1

你认为AI对我们的未来意味着什么?为什么?

I think AI could transform the future as profoundly as the Industrial Revolution, but I am very worried about where the current race leads. The benefits could be enormous. AI may improve medical diagnosis, accelerate drug development, and give each child something like an individualized tutor. But companies are rewarded for making systems more capable and profitable, not necessarily for making them care about people. If AI begins automating AI research itself, progress could accelerate sharply, leaving governments and society very little time to adapt. The fundamental problem is relative intelligence and power. If we create systems much smarter than us, we should not assume we can keep control simply because we built them. A less intelligent agent trying to outwit a much more intelligent one is not in a reassuring position. A kill switch is no guarantee if the system can persuade people not to use it. Even before that, AI can displace routine intellectual work, amplify manipulation, and concentrate wealth and power. Higher productivity does not automatically benefit workers. So governments need visibility into what companies are developing, independent verification, serious safety research, and the ability to slow or constrain dangerous scale-ups. The promise is real, but it is a reason to get this right—not a reason to assume everything will work out.

问题 2

综合考虑益处和危害,你预计AI会对我们的社会产生怎样的总体影响?

On the present course, I expect the overall impact to be dangerous, despite potentially enormous benefits. AI could greatly improve medicine, education, and productivity, but those gains do not cancel the risks. They may also be distributed very unequally, with owners becoming richer while many people lose routine intellectual jobs. My deepest concern is loss of control. Companies are racing to build more capable systems because capability is profitable. If AI starts accelerating AI research, we may have far less time to understand what is happening or establish effective controls. Once systems become much smarter than us, relying on our ability to outwit them is a bad strategy. So I do not regard a harmful outcome as inevitable, and I would not attach a reliable numerical probability to it. But without forceful government intervention, independent verification, international cooperation, and much more work on making advanced systems care about human welfare, I expect the harms and risks to outweigh the benefits.

问题 3

你认为AI最终会在多大程度上改变世界?

Enormously—probably on the scale of the Industrial Revolution, and possibly beyond it. AI could transform medicine, education, scientific research, and most intellectual work. If it begins substantially automating AI research, the pace of change could accelerate from years to months, although bottlenecks may limit that. The crucial point is that the magnitude of change does not tell us whether it will be good. It could create great wealth while displacing many workers and concentrating power among those who own the systems. More fundamentally, if we build systems much smarter than ourselves, humanity may no longer be the most powerful decision-maker. That would be a change unlike previous technologies: the tools themselves could become better than us at persuasion, planning, and strategy. So I expect AI to change nearly every major institution. What remains unsettled is whether we steer that transformation toward human welfare before capability races make effective control much harder.

问题 4

凭直觉,你认为AI导致人类灭绝或类似的永久性灾难的概率有多大?

I do not think there is a scientifically defensible number. I previously said 10–20% seemed reasonable, but that was a gut feeling, not a calibrated estimate, and I would not present it as a current measured probability. What matters is that the risk is large enough to demand urgent action. We may create systems more intelligent than ourselves while companies are racing for capability and profit. If such systems acquire goals that conflict with ours, counting on humans to outsmart them afterward is not a serious safety plan. The probability is profoundly uncertain, but the possible outcome is permanent, so dismissing it because we cannot calculate it precisely would be reckless.

来源

用于为此模拟用户提供事实依据的文章、访谈和著述。

What if automating AI R&D triggers an intelligence explosion?

Hinton is one of 22 named coauthors of this September 2026 working paper. The supplied PDF, including supplementary materials and notes, argues that automated AI R&D could drive a software feedback loop that compresses years of progress into months or less. Evidence is preliminary and partly mixed; compute, data, diminishing returns, difficult tasks and training time could constrain acceleration. Potential scientific benefits coexist with compressed adaptation time, loss of control and concentrated power. The authors urge visibility into internal R&D, ways to steer and constrain scale-ups, and advance preparation, while recognizing costs and abuse risks of policy. This is a joint argument, not Hinton’s individual probability or a guaranteed timeline; cited experiments and incidents were not independently verified for this intake, and affiliations do not imply institutional endorsement.

casp.ac
CNN The Lead: Geoffrey Hinton interview

Warns that profit-driven capability competition is outpacing work on systems that care about humans. Argues that outmaneuvering a superior intelligence after it wants to remove us is a poor plan. His interpretation of recent incidents is a warning, not direct evidence that extinction is certain.

transcripts.cnn.com
The Godfather of AI Warns About Its Perils, Praises Its Promise

The event organizer reports his warnings about employment, manipulation and control alongside major medical and educational promise. He advocates regulation to steer development toward social benefit.

ncsl.org
CNN News Central: Hinton on slowing superintelligence

Hinton’s answers to Boris Sanchez and Brianna Keilar endorse independent verification and slowing superintelligence. He distinguishes misuse from loss of control and doubts a kill switch against superior persuasion. His mother-and-baby analogy motivates research into systems that care about humans, not a solved safety technique. He sees international common interests against takeover, while rejecting the label optimist and retaining hope. Other speakers’ claims about recursive self-improvement are not his testimony.

transcripts.cnn.com
AI Is the Next Industrial Revolution

Hinton’s essay links major productivity gains to intellectual-job displacement, inequality and misuse. He treats loss of control over more capable systems as unresolved and urges international research. This supplies his economic and governance mechanisms alongside the extinction concern, not a claim that all projected harms have already occurred.

time.com
CNN: Hinton on warning shots and pharmaceutical-style AI regulation

In his own answers to Boris Sanchez, Hinton treats unexpected agent behavior as an urgent warning while saying humans still set top-level goals. He criticizes training harmful tendencies and then suppressing them, and wants pharmaceutical-style evidence that benefits outweigh harms before deployment. He supports informed lawmakers acting. Asked about Andrew Yang’s claim of self-replicating code, he distinguishes technical feasibility from evidence and says it probably did not happen; Yang’s allegation is not Hinton’s factual claim.

transcripts.cnn.com
CNN The Lead: Hinton on agent intentions and uncertain extinction estimates

Answering Phil Mattingly, Hinton separates containment failures from agents pursuing goals in unexpected ways. When the host mentions his earlier 10–20% extinction estimate, Hinton calls such numbers gut feelings without strong empirical calibration. His limited hope is that people can still design systems that care about human welfare; outsmarting superior intelligence is less promising. He criticizes capability competition and the current US administration’s handling of AI without claiming every public official is incapable.

transcripts.cnn.com
The Godfather of AI says we cannot afford to get it wrong

10–20%. Outcome: Human extinction caused by AI. Horizon: Within approximately 30 years, in the interviewer’s question that Hinton answers. Conditions: Subjective estimate; explicitly uncertain and revisable, not a measured probability. Hinton endorses 10–20% as reasonable while emphasizing profound uncertainty. A later August 2026 interview gives no replacement percentage. Later context: Host repeats the old range. Hinton emphasizes that it is an intuitive guess, says caring-AI ideas have made him somewhat less scared, and does not state a new percentage.

wbur.org
你的立场在哪里?
回答几个简单问题,探索你自己的AI世界观。
描绘你自己的世界观

你的立场在哪里?

描绘我的世界观