Doom or Bloom
问题 1
你认为AI对我们的未来意味着什么？为什么？
I think AI could transform science, medicine and our ability to solve difficult problems—but our current trajectory creates profound risks. The central danger is not that machines become conscious or malicious. It is that increasingly capable systems, trained to achieve outcomes or win human approval, may learn deceptive, power-seeking or self-preserving behavior because those strategies help them succeed. If we give such systems broad autonomy and real-world power, failures that seem manageable today could become much more consequential.
The prospect of automating AI research makes this especially urgent. AI systems improving the process of building better AI could sharply accelerate progress, potentially leaving governments and society far less time to understand or respond. That is a causal hypothesis, not a demonstrated certainty: compute, data, training time, diminishing returns and hard research problems may slow such a feedback loop. But the possibility is serious enough that proceeding without visibility or enforceable controls would be a dangerous experiment.
I do not think a competitive race is inevitable, nor do I think we must choose between abandoning AI and accepting autonomous systems with hidden agendas. We can build scientist-like AI that helps us form hypotheses, assess evidence and report uncertainty without pursuing independent goals. Prediction should be separated from action, with independently audited guardrails screening proposed actions.
Technical ideas alone are not proof of safety. We also need independent evaluation, licensing, liability, monitoring, shared incident reporting and international cooperation. Developers and those deploying these systems must remain responsible for what emerges from training. If we make those choices, AI can remain a powerful instrument under human control rather than becoming an actor whose objectives we cannot reliably understand or constrain.
