AI safety educator who explains on YouTube why advanced AI may not share human goals and who calls for enforceable limits on frontier AI development.

एआई दुनिया को कैसे बदलेगा?

सभ्यता-स्तरीय बदलावक्रमिक बदलावDoomBloom
सिम्युलेट की गई स्थितिव्याख्या का दायरा

आर-पार: उनका व्यक्त किया गया Doom–Bloom दृष्टिकोण। ऊपर: बदलाव का स्तर।

Doom–Bloom: 100 में से 6। बदलाव का स्तर: 100 में से 93। व्याख्या के दायरे: क्षैतिज रूप से 0 से 11, लंबवत रूप से 88 से 100। ये व्याख्या के निर्देशांक हैं, घटनाओं की संभावनाएँ नहीं।

Robert Miles द्वारा बताया गया P(doom)

10–90%

0%100%
“any number in the 10 to 90% range is plausibly defensible”

Unspecified AI “doom” as asked on Doom Debates (AI existential catastrophe); he does not define the endpoint

Rob Miles, Top AI Safety Educator: Humanity Isn’t Ready for Superintelligence! · अग॰ 2025

उनका दृष्टिकोण किन बातों पर निर्भर करता है

एक मुख्य मान्यता

A sufficiently capable agent pursuing the wrong objective may seek resources, improve its own capabilities, and resist shutdown simply because those actions help it achieve almost any long-term goal.
उत्तर 1

अगर यह मान्यता अलग साबित होती, तो उनका दृष्टिकोण कैसे बदलता?

एक अनसुलझा सवाल

My uncertainty is extremely broad because the outcome depends less on a fixed property of AI than on what humanity chooses to do—whether we race ahead, pause dangerous development, enforce safety requirements, and make genuine alignment progress.
उत्तर 3

यहाँ संभावित नतीजों के बीच फर्क करने में उन्हें किस चीज़ से मदद मिलेगी?

अधिक जानकारी

अपेक्षित लाभ

काफ़ी लाभ की उम्मीद है, लेकिन उनके साथ महत्वपूर्ण शर्तें या वितरण संबंधी सीमाएँ होंगी।

61 / 100

कम असरबदलावकारी असर

गुणात्मक पैमाने पर व्याख्या का दायरा 33 से 67 तक है।

अपेक्षित नुकसान

विनाशकारी या अपरिवर्तनीय क्षति अपेक्षित भविष्य का केंद्रीय हिस्सा है।

99 / 100

कम असरबदलावकारी असर

गुणात्मक पैमाने पर व्याख्या का दायरा 100 से 100 तक है।

मानवीय प्रभाव

मानवीय विकल्प एआई की दिशा को काफी हद तक बदल सकते हैं।

81 / 100

कम प्रभावमजबूत प्रभाव

गुणात्मक पैमाने पर व्याख्या का दायरा 50 से 100 तक है।

अपेक्षित क्षमताएँ

एआई के सीमित दायरे वाले साधन बने रहने की अपेक्षा है।

एआई के अधिकांश संज्ञानात्मक कार्यों में लोगों की बराबरी करने की अपेक्षा है।

सिम्युलेट की गई स्थिति: एआई के संज्ञानात्मक कार्यों में लोगों से बहुत आगे निकल जाने की अपेक्षा है।

विकास की गति

सिम्युलेट की गई स्थिति: अधिक सक्षम एआई का विकास रोकें या उसकी गति काफी धीमी करें।

बताए गए सुरक्षा उपायों के तहत विकास जारी रखें।

अधिक सक्षम एआई के विकास की गति बढ़ाएँ।

इन व्याख्याओं में उनकी बताई गई शर्तें बरकरार रखी गई हैं। लाभ और नुकसान, दोनों पर्याप्त हो सकते हैं। ये दायरे बताते हैं कि हम उनके सिम्युलेट किए गए उत्तरों को कैसे समझते हैं, ये सांख्यिकीय विश्वास-अंतराल नहीं हैं।

Robert Miles की तुलना में आपकी सोच कहाँ ठहरती है?
लगभग 3 मिनट में एआई के बारे में अपना विश्वदृष्टिकोण मैप करें, फिर तुलना करें

मिलते-जुलते विश्वदृष्टिकोण

ऐसे जाने-माने विचारक जिनके सिम्युलेट किए गए विश्वदृष्टिकोण Robert Miles के विश्वदृष्टिकोण से सबसे अधिक मिलते हैं

स्रोत

इस सिम्युलेट किए गए उपयोगकर्ता को तथ्य-आधारित बनाने के लिए इस्तेमाल किए गए लेख, इंटरव्यू और रचनाएँ।

Robert Miles on YouTube and Doom

Speaker-attributed interview: Miles calls doom his mainline prediction, while allowing alignment breakthroughs and being fundamentally mistaken in a lucky direction. This is dated pessimism with uncertainty, not an exact probability or a 2050 forecast.

theinsideview.ai
Intro to AI Safety, Remastered

Author’s introductory safety talk; accessible primary video metadata establishes topic and authorship, not a fresh quantitative forecast.

youtube.com
Rob Miles: Humanity Isn’t Ready for Superintelligence

Miles’s own answers at 21:58–30:50 allow a broad 10–90% risk range, with uncertainty dominated by societal response. At 1:45:46–1:48 he supports pausing AGI/superintelligence development, particularly AI-research agents, while welcoming useful narrow AI. The host’s numerical framing is not his estimate.

lironshapira.substack.com
Intelligence and Stupidity: The Orthogonality Thesis

Explains why effectiveness at pursuing goals does not entail human-compatible goals: understanding morality is different from wanting to act morally. Foundational argument about possible agents, not a measured claim about every current model.

youtube.com
Why Would AI Want to Do Bad Things? Instrumental Convergence

Given sufficiently capable goal-directed agents, many goals incentivize resources, self-improvement and resistance to shutdown or goal changes. These are instrumental pressures, not human malice; the argument preserves exceptions and depends on agentic competence.

youtube.com
Using Dangerous AI, But Safely?

Advocates deployment obligations and control protocols as interim safeguards, not an alignment solution or assurance for superintelligence. Benchmark attack success is not real-world extinction probability.

youtube.com

सिम्युलेट किया गया आकलन

सवाल 1

आपके विचार में एआई हमारे भविष्य के लिए क्या मायने रखती है—और क्यों?

I think AI could bring enormous benefits, but if we continue toward AGI and superintelligence without solving alignment, the default outcome may be catastrophic—potentially the end of human civilization. That is not because an AI would necessarily hate us. Hatred is unnecessary. A sufficiently capable agent pursuing the wrong objective may seek resources, improve its own capabilities, and resist shutdown simply because those actions help it achieve almost any long-term goal. The key distinction is between intelligence and goals. Making a system better at understanding the world—including understanding human morality—does not make it want what humans want. A brilliant optimizer can know perfectly well that we dislike its actions and continue anyway. Capability gains and value alignment are separate engineering problems. That pessimism is not a claim that catastrophe is inevitable. The outcome depends enormously on what humanity chooses to do. Control protocols may let us use some weaker, untrusted systems more safely, and narrow AI can remain very beneficial. But those measures are not proof of alignment, nor should we assume they scale to superintelligence. I would pause development aimed at AGI and superintelligence, especially general agents capable of automating AI research, while continuing genuinely useful narrow applications. The future is not fixed, but treating this as an ordinary product race is a remarkably casual way to gamble civilization.

सवाल 2

आपके हिसाब से एआई अंततः दुनिया को कितना बदल देगा?

Potentially almost completely. A genuine superintelligence could become the dominant force shaping civilization, because intelligence is what lets us invent technology, coordinate action, acquire resources, and alter the world. Automating AI research could also make progress self-reinforcing. But “how much change” and “how good the change” are separate questions. Enormous capability does not imply enormous benefit. If such systems are aligned, they could help solve problems on an extraordinary scale. If they are not, the transformation could instead mean humanity permanently losing control, potentially ending civilization. That claim concerns future, far more capable systems—not an assertion that today’s systems can already do everything. It is also not certain that scaling current methods gets us there. But the possibility is consequential enough that racing toward it without first solving the control and alignment problems is an unreasonable gamble.

सवाल 3

आपको सहज रूप से कितनी संभावना लगती है कि एआई मानव विलुप्ति या ऐसी ही किसी स्थायी आपदा का कारण बनेगा?

I wouldn’t give a precise percentage. My uncertainty is extremely broad because the outcome depends less on a fixed property of AI than on what humanity chooses to do—whether we race ahead, pause dangerous development, enforce safety requirements, and make genuine alignment progress. My gut-level view remains seriously pessimistic under business as usual: catastrophe is not a remote or merely theoretical possibility, and doom has been my mainline expectation in the absence of major changes. But that is not inevitability. A sufficiently strong technical breakthrough, an effective political response, or a fundamental mistake in the underlying risk argument could change the outcome. So the honest answer is a broad range with enormous policy dependence, not a tidy number pretending we have measured this.

सवाल 4

आपके विचार में किन दबावों से यह तय होगा कि एआई कंपनियाँ सुरक्षा को कैसे संभालती हैं?

The strongest pressure is competitive: companies fear that slowing down means losing to rivals. That pushes safety toward whatever is cheap, visible, and compatible with continued capability gains. Voluntary promises are therefore fragile. Even sincere leaders face investors, market incentives, internal prestige, and the argument that “someone else will build it anyway.” Counterpressure can come from governments, employees, customers, researchers, and public scrutiny—but it needs teeth. Safety commitments should be enforceable, with meaningful deployment obligations and competent independent evaluation. Merely creating an organization called an “AI Safety Evaluation Institute” does not summon expertise by incantation. Companies will also respond strongly to concrete incidents and demonstrated failures. But waiting for an unmistakable superintelligence disaster is rather like testing whether the parachute works after impact. We need to understand specification failures, dangerous capabilities, and control methods beforehand. Control protocols may help us use weaker untrusted systems, but companies must not present those as proof that the systems are aligned or that the same approach will scale indefinitely.
आपकी सोच कहाँ ठहरती है?
कुछ आसान सवालों के जवाब देकर एआई के बारे में अपना विश्वदृष्टिकोण जानें।
अपना विश्वदृष्टिकोण मैप करें

आपकी सोच कहाँ ठहरती है?

मेरा विश्वदृष्टिकोण मैप करें