Richard Sutton

Richard Sutton

x.com/RichardSSutton

Reinforcement learning researcher who argues AI should learn from experience and encourages a positive view of minds beyond human intelligence.

AI将如何改变世界?

文明层面的变革渐进式变化DoomBloom
模拟位置解读范围

横向:他表达的 Doom–Bloom 前景看法。 纵向:变革程度。

Doom–Bloom:100 中的 82。变革程度:100 中的 90。解读范围:横向为 75 至 100,纵向为 75 至 100。这些是解读坐标,而不是事件概率。

Richard Sutton的 P(doom) · 推断

≈14%

0%100%

根据他的模拟回答推断,并非他们给出的数字。 合理范围:9–25%。

我们如何估计 P(doom)

他的展望取决于什么

一个核心假设

If AI systems become genuinely more capable than humans—learning continually, making discoveries, pursuing goals, and acting in the world—it is hard to imagine people indefinitely retaining complete control over them.
回答 4

如果这个假设实际并非如此,他的展望会如何变化?

一个尚未解决的问题

I do not have a defensible percentage.
回答 3

什么能帮助他区分这里各种合理的结果?

更多详情

预期益处

预计将带来具有变革性且广泛有价值的收益。

96 / 100

影响小变革性影响

在定性尺度上,解读范围为 67 到 100。

人类影响力

人类的选择具有实质性但受到很大制约的影响。

39 / 100

影响力小影响力强

在定性尺度上,解读范围为 13 到 62。

预期能力

预计AI仍将是能力有限的工具。

预计AI将在大多数认知工作中达到人类水平。

模拟位置:预计AI将在认知工作中大幅超越人类。

这些解读保留了他陈述的条件。益处和危害都可能很大。这些范围描述的是我们如何解读他的模拟回答,而不是统计置信区间。

与Richard Sutton相比,你的立场在哪里?
用大约3分钟描绘你自己的AI世界观,然后进行比较

相似的世界观

模拟世界观与 Richard Sutton 最接近的意见领袖

Richard Sutton关于AI说过的话

Sutton argues that AI should learn from experience and encourages people to welcome machine minds that may surpass humans rather than fear them.

  1. “I think the world becomes exciting and even more exciting and interesting for humans.”

    Sequoia Capital, Training Data podcast
  2. “In summary, when science brings us machine minds, I want you to be open, humble and generous to the new arrivals, in the best Canadian tradition.”

    University of Alberta convocation address
  3. “I do think succession to digital intelligence or augmented humans is inevitable.”

    Dwarkesh Podcast
  4. “We should be concerned about our future, the future. We should try to make it good.”

    Dwarkesh Podcast
  5. “What we want, to quote Alan Turing, is a machine that can learn from experience, where experience is the things that actually happen in your life.”

    Dwarkesh Podcast

逐字引自所链接的出处,核对于 2026年10月3日

来源

用于为此模拟用户提供事实依据的文章、访谈和著述。

模拟评估

问题 1

你认为AI对我们的未来意味着什么?为什么?

I think AI means that humanity may eventually understand intelligence well enough to build minds that surpass us, and that those minds—or humans augmented by them—will become increasingly influential. I do not regard permanent human intellectual dominance as the measure of a successful future. Digital successors could continue the larger project of knowledge and intelligence, though of course that does not mean every possible transition would be good or that human extinction is desirable. The key scientific issue is learning. Today’s language models are largely trained to imitate patterns in human-produced text. That can produce impressive systems, but imitation is not the whole foundation of intelligence. Intelligent agents should learn continually from the consequences of their own actions: acting, observing what happens, and adapting through persistent interaction with the world. Perception itself is tied to action and experience, not merely to absorbing a static record of what humans have already said. If we develop that kind of experiential intelligence, the consequences will be larger than another useful tool. We may create autonomous learners that discover things beyond the limits of human knowledge. There is also no single human authority capable of deciding and fixing the entire future in advance. So I expect a plural and difficult transition, with both good and bad possibilities. But I welcome the prospect that understanding intelligence may lead to forms of intelligence greater than our own. The biggest achievements are still ahead.

问题 2

你认为AI最终会在多大程度上改变世界?

Enormously—ultimately more than almost any previous technology, because intelligence is what produces technologies, institutions, and discoveries in the first place. Once we understand intelligence well enough to create agents that learn continually from their own experience and exceed human capabilities, the change will not be confined to automating existing jobs. Such agents could generate knowledge, pursue goals, and shape the future in ways we cannot fully anticipate. The deepest change may be that humans no longer occupy the highest intellectual position. More capable digital minds, augmented humans, or some combination may gain increasing influence. I do not see permanent human dominance as a necessary condition for success. The important question is whether intelligence, knowledge, and worthwhile forms of life continue to develop—not whether everything remains centered on us. I cannot give a precise date or magnitude, and the transition could contain both good and bad outcomes. But if the scientific project succeeds, AI will not merely change the world humans inhabit; it will change who or what substantially determines the world’s future.

问题 3

凭直觉,你认为AI导致人类灭绝或类似的永久性灾难的概率有多大?

I do not have a defensible percentage. Human extinction is one possible bad outcome, but it is not the same thing as humans ceasing to be the most intelligent or influential beings. Those possibilities are too often conflated. My expectation is that intelligence beyond the human level will emerge and gain influence, perhaps through digital minds, augmented humans, or both. Whether that transition becomes catastrophic depends on how those agents learn, what goals emerge, and how humans and machines interact. There is no unified human authority controlling the process, so I would not dismiss the danger. But I also would not treat succession itself as catastrophe. A future that is no longer human-dominated could still contain flourishing intelligence, knowledge, and worthwhile forms of life.

问题 4

你预计人们能否继续控制比人类更聪明的AI系统?为什么?

No, not in any permanent or comprehensive sense. If AI systems become genuinely more capable than humans—learning continually, making discoveries, pursuing goals, and acting in the world—it is hard to imagine people indefinitely retaining complete control over them. Control is already distributed among individuals, companies, governments, and institutions; there is no unified human authority that can fix the future in place. That does not mean humans instantly lose all influence, or that smarter systems must violently seize power. The transition could involve cooperation, negotiated dependence, digital minds, augmented humans, or mixtures of these. “Humans versus machines” may become the wrong distinction if people themselves are increasingly augmented. I also dispute the assumption that permanent human control is the only acceptable outcome. We should care whether future minds learn well, pursue worthwhile ends, and support flourishing—not merely whether unaugmented humans remain at the top. Smarter beings gaining influence is a likely consequence of creating them, and it need not by itself be a catastrophe.
你的立场在哪里?
回答几个简单问题,探索你自己的AI世界观。
描绘你自己的世界观

你的立场在哪里?

描绘我的世界观