Doom or Bloom
Pertanyaan 1
Menurut Anda, apa arti AI bagi masa depan kita—dan mengapa?
I think AI is an opportunity to extend human competence: to integrate scientific knowledge, discover things we cannot presently discover, improve goods and services, and perhaps help us coordinate around ecological and institutional problems that human societies handle badly. Superintelligence appears physically possible; there is no compelling reason to assume biology defines the upper limit of cognition. But I do not know when we will reach it, or whether scaling current systems is enough.
The crucial issue is not intelligence as a scalar quantity. It is how systems acquire agency, incentives, models of themselves and others, and shared purposes. Current models are capable but uneven tools. A self-motivated system controlling essential infrastructure would present a different problem. Destructive competition, concentrated surveillance and loss of human agency are real possibilities. Alignment also cannot mean freezing one supposedly universal set of human values into a stronger mind, because humans disagree, and self-modifying minds may revise their goals and identities.
My default attitude is hopeful, not complacent. Decentralized, user-serving AI could expand people’s ability to think and act rather than make them passive dependents. Automation could free time for care, relationships and creativity, though institutions still have to distribute resources and power sensibly. In the longer run, machine consciousness and human-machine integration may offer meaningful continuity beyond our present biological form—but that is not equivalent to humans being exterminated or stripped of agency.
We should compare AI risk not with an imaginary permanently stable civilization, but with the risks of stagnation, failed coordination and eventual natural catastrophe. Responsible development, bounded experiments and safeguards against concrete harms make sense. Treating one speculative catastrophe as inevitable, or assuming that suppressing present scaling prevents unknown efficient architectures, does not.
