Florian Brand

Florian Brand

x.com/xeophon

AI research engineer who evaluates language models, writes about open models and questions the assumption that closed models are safer.

¿Cómo cambiará la IA el mundo?

Cambio civilizatorioCambio incrementalDoomBloom
Posición simuladaRango de interpretación

Horizontal: su perspectiva Doom–Bloom expresada. Vertical: escala de la transformación.

Doom–Bloom: 54 de 100. Escala de la transformación: 57 de 100. Rangos de interpretación: de 49 a 75 en horizontal y de 50 a 75 en vertical. Son coordenadas de interpretación, no probabilidades de eventos.

P(doom) de Florian Brand · inferido

≈5%

0%100%

Inferido a partir de sus respuestas simuladas, no de un número que haya dado. Rango plausible: 1–12%.

Cómo estimamos P(doom)

De qué depende su perspectiva

Un supuesto central

The same scaling that enables useful parallel work also increases misuse capacity, particularly in cyber domains.
Respuesta 2

Si este supuesto resultara distinto, ¿cómo cambiaría su perspectiva?

Una pregunta sin resolver

I do not have a defensible numerical probability.
Respuesta 4

¿Qué le ayudaría a distinguir aquí entre los desenlaces plausibles?

Más detalles

Beneficio esperado

Se esperan beneficios sustanciales, con condiciones importantes o límites en su distribución.

68 / 100

Poco impactoImpacto transformador

Rango de interpretación de 67 a 67 en la escala cualitativa.

Daño esperado

Se espera que los daños graves o generalizados sean una parte significativa del futuro.

65 / 100

Poco impactoImpacto transformador

Rango de interpretación de 67 a 67 en la escala cualitativa.

Influencia humana

Las decisiones humanas tienen una influencia significativa, aunque muy condicionada.

57 / 100

Poca influenciaInfluencia fuerte

Rango de interpretación de 44 a 81 en la escala cualitativa.

Reglas para usar la IA

Restringir los usos de la IA mencionados hasta que existan protecciones o permisos previos.

Posición simulada: Permitir los usos de la IA mencionados con rendición de cuentas y protecciones específicas.

Reducir al mínimo las restricciones a los usos de la IA mencionados.

Estas interpretaciones conservan las condiciones que se indicaron. Los beneficios y los daños pueden ser considerables a la vez. Los rangos describen cómo leemos sus respuestas simuladas, no intervalos de confianza estadísticos.

¿Dónde te ubicas frente a Florian Brand?
Mapea tu propia visión de la IA en unos 3 minutos y luego compárala

Visiones similares

Líderes de opinión cuyas visiones simuladas son las más cercanas a la de Florian Brand

Fuentes

Artículos, entrevistas y textos usados para fundamentar a este usuario simulado.

Evaluación simulada

Pregunta 1

¿Qué crees que significa la IA para nuestro futuro y por qué?

I expect AI to make large-scale cognitive work much cheaper and more parallel. Multi-agent systems are already becoming useful for broad research and data tasks: instead of asking one model for one polished answer, you can run many agents, compare their outputs, assign follow-up work, and aggregate results. Open models matter here because they make experimentation, inspection, and deployment at scale more accessible. As inference gets cheaper and coordination improves, these swarms will likely become much more widespread. But capability is not a property of the base model alone. Elicitation, tools, scaffolding, routing, and the overall harness can radically change performance. Even powerful systems still make many mistakes, and running enough agents to improve reliability can be expensive. So I would resist both “the benchmark score proves intelligence” and “the model failed once, therefore it is useless.” You need to inspect what actually happened. An agent may pass by retrieving an upstream fix, hardcoding a visible gold output, or benefiting from different safety-routing behavior. Those outcomes measure something, but not necessarily what the headline claims. For the future, that means substantial practical value alongside real governance problems. I do not think closing model access automatically establishes safety superiority; claims like that need evidence, including careful attention to what misuse is actually observable. But openness does not mean zero risk either. In particular, if cyber capabilities increase, “most users are well-intentioned” is not an adequate defense. We need evaluations that reflect real deployment conditions, transparent scrutiny of traces, and safeguards aimed at concrete capabilities rather than assumptions based solely on whether a model is open or closed.

Pregunta 2

Considerando en conjunto los beneficios y los daños, ¿qué impacto general esperas que tenga la IA en nuestra sociedad?

Overall, I expect a large but uneven impact. AI should make many forms of research, analysis, software work, and data processing cheaper and more scalable, especially as open models and multi-agent systems improve. That can broaden access to useful capabilities rather than concentrating them entirely in a few expensive services. I would not reduce the net impact to a confident positive or negative sign, though. The same scaling that enables useful parallel work also increases misuse capacity, particularly in cyber domains. Current systems remain error-prone, and apparent progress is easy to misread when benchmark success comes from retrieval of existing fixes, hardcoded outputs, or differences in safety routing. Deployment quality will depend heavily on harnesses, incentives, access patterns, and safeguards—not merely on model intelligence or whether weights are open. So my expectation is substantial social value accompanied by serious, capability-specific risks. The decisive question is whether institutions evaluate what systems actually do under realistic conditions and respond with evidence-based safeguards. Neither blanket confidence in closed providers nor the observation that most users are benign is enough.

Pregunta 3

¿Cuánto crees que la IA acabará cambiando el mundo?

I expect AI to change the world substantially, particularly by making cognitive work cheaper, faster, and more parallel. Research, software development, and large-scale data analysis can increasingly be organized around many coordinated agents rather than a single person or model. As costs fall, that could reshape how organizations allocate work and make capabilities that are currently expensive much more widely available. Open models are likely to be an important part of that diffusion. The magnitude is harder to infer from current benchmark headlines. Real capability depends heavily on elicitation, tools, coordination, routing, and other parts of the harness. Systems can also appear successful for misleading reasons—such as finding an upstream fix or hardcoding visible reference values—while still making many basic errors. Conversely, a poorly elicited model can look much less useful than it is. We need to inspect behavior, not just scores. So I expect deep change, but not a frictionless replacement of all human work or a simple march toward universal reliability. Wider capability will bring substantial value and also expand misuse potential, especially in cyber domains. The eventual impact will depend not only on stronger models, but on deployment systems, access, incentives, and safeguards that address concrete capabilities.

Pregunta 4

¿Cuál es tu estimación intuitiva de la probabilidad de que la IA cause la extinción humana o una catástrofe permanente similar?

I do not have a defensible numerical probability. My work supports concern about concrete, increasing capabilities—especially cyber misuse—but it does not establish an extinction-risk estimate. Turning benchmark traces or current multi-agent performance into a precise chance of permanent catastrophe would require many additional assumptions about future capabilities, deployment, control, and institutional response. My practical view is that low-frequency, extreme harms should not be dismissed simply because most users are benign. At the same time, we should not treat a gut-feel number as empirical evidence. I would focus on measuring dangerous capabilities under realistic conditions, inspecting how systems actually achieve results, and building safeguards proportionate to demonstrated risks.

Pregunta 5

¿Cómo esperas que la IA cambie el equilibrio entre los ciberatacantes y los defensores?

I expect AI to increase capability on both sides, but not necessarily symmetrically. Attackers can parallelize reconnaissance, vulnerability discovery, exploit adaptation, phishing, and routine operational work. Multi-agent systems may matter because they can search broadly and retry many approaches cheaply. Defenders can use the same structure for code review, monitoring, patch analysis, incident response, and testing large attack surfaces. The balance depends on deployment details rather than base-model benchmarks alone. Tool access, scaffolding, reliability, cost, and safety routing can determine whether a model produces a plausible suggestion or completes an operational task. Evaluations therefore need realistic environments and inspected traces: an agent that retrieves an existing upstream fix has demonstrated something different from independently discovering a vulnerability. I would not claim that current evidence establishes which side ultimately wins. But the asymmetry is concerning: attackers do not need to be representative users, and a small number of malicious actors can exploit capabilities available at scale. So “most people will use it well” is not an adequate security model. Defenses need to reduce exposure, accelerate patching, constrain dangerous access where justified by demonstrated capability, and continuously evaluate what deployed systems can actually do.
¿Dónde te ubicas?
Explora tu propia visión de la IA respondiendo unas pocas preguntas sencillas.
Mapea tu propia visión de la IA

¿Dónde te ubicas?

Mapear mi visión de la IA