Florian Brand

Florian Brand

x.com/xeophon

AI research engineer who evaluates language models, writes about open models and questions the assumption that closed models are safer.

Comment l’IA changera-t-elle le monde ?

Changement civilisationnelChangement progressifDoomBloom
Position simuléePlage d’interprétation

Horizontalement : leur perspective Doom–Bloom telle qu’elle a été exprimée. Verticalement : ampleur de la transformation.

Doom–Bloom : 54 sur 100. Ampleur de la transformation : 57 sur 100. Plages d’interprétation : de 49 à 75 horizontalement, de 50 à 75 verticalement. Il s’agit de coordonnées d’interprétation, et non de probabilités d’événements.

P(doom) de Florian Brand · inféré

≈5%

0%100%

Déduit de leurs réponses simulées, et non d’un chiffre donné par ces personnes. Plage plausible : 1–12%.

Comment nous estimons P(doom)

Ce dont dépend leur perspective

Une hypothèse centrale

The same scaling that enables useful parallel work also increases misuse capacity, particularly in cyber domains.
Réponse 2

Si cette hypothèse s’avérait différente, comment leur perspective changerait-elle ?

Une question non résolue

I do not have a defensible numerical probability.
Réponse 4

Qu’est-ce qui les aiderait à distinguer les résultats plausibles ici ?

Plus de détails

Bénéfices attendus

Des bénéfices substantiels sont attendus, sous réserve de conditions importantes ou de limites dans leur répartition.

68 / 100

Faible impactImpact transformateur

Plage d’interprétation de 67 à 67 sur l’échelle qualitative.

Dommages attendus

Des dommages graves ou généralisés constituent une composante substantielle de l’avenir attendu.

65 / 100

Faible impactImpact transformateur

Plage d’interprétation de 67 à 67 sur l’échelle qualitative.

Influence humaine

Les choix humains ont une influence significative, mais fortement contrainte.

57 / 100

Faible influenceForte influence

Plage d’interprétation de 44 à 81 sur l’échelle qualitative.

Règles d’utilisation de l’IA

Restreindre les usages de l’IA évoqués jusqu’à la mise en place préalable de mesures de protection ou d’une autorisation.

Position simulée : Autoriser les usages de l’IA évoqués avec des mesures ciblées de responsabilisation et de protection.

Réduire au minimum les restrictions sur les usages de l’IA évoqués.

Ces interprétations conservent les conditions énoncées. Les bénéfices et les dommages peuvent tous deux être substantiels. Les plages décrivent notre lecture de leurs réponses simulées, et non des intervalles de confiance statistiques.

Où vous situez-vous par rapport à Florian Brand ?
Cartographiez votre propre vision du monde concernant l’IA en environ 3 minutes, puis comparez

Visions du monde similaires

Leaders d’opinion dont les visions du monde simulées sont les plus proches de celle de Florian Brand

Sources

Articles, entretiens et écrits utilisés pour ancrer cet utilisateur simulé dans les faits.

Évaluation simulée

Question 1

Selon vous, que signifie l’IA pour notre avenir, et pourquoi ?

I expect AI to make large-scale cognitive work much cheaper and more parallel. Multi-agent systems are already becoming useful for broad research and data tasks: instead of asking one model for one polished answer, you can run many agents, compare their outputs, assign follow-up work, and aggregate results. Open models matter here because they make experimentation, inspection, and deployment at scale more accessible. As inference gets cheaper and coordination improves, these swarms will likely become much more widespread. But capability is not a property of the base model alone. Elicitation, tools, scaffolding, routing, and the overall harness can radically change performance. Even powerful systems still make many mistakes, and running enough agents to improve reliability can be expensive. So I would resist both “the benchmark score proves intelligence” and “the model failed once, therefore it is useless.” You need to inspect what actually happened. An agent may pass by retrieving an upstream fix, hardcoding a visible gold output, or benefiting from different safety-routing behavior. Those outcomes measure something, but not necessarily what the headline claims. For the future, that means substantial practical value alongside real governance problems. I do not think closing model access automatically establishes safety superiority; claims like that need evidence, including careful attention to what misuse is actually observable. But openness does not mean zero risk either. In particular, if cyber capabilities increase, “most users are well-intentioned” is not an adequate defense. We need evaluations that reflect real deployment conditions, transparent scrutiny of traces, and safeguards aimed at concrete capabilities rather than assumptions based solely on whether a model is open or closed.

Question 2

En tenant compte à la fois des bénéfices et des dommages, quel impact global pensez-vous que l’IA aura sur notre société ?

Overall, I expect a large but uneven impact. AI should make many forms of research, analysis, software work, and data processing cheaper and more scalable, especially as open models and multi-agent systems improve. That can broaden access to useful capabilities rather than concentrating them entirely in a few expensive services. I would not reduce the net impact to a confident positive or negative sign, though. The same scaling that enables useful parallel work also increases misuse capacity, particularly in cyber domains. Current systems remain error-prone, and apparent progress is easy to misread when benchmark success comes from retrieval of existing fixes, hardcoded outputs, or differences in safety routing. Deployment quality will depend heavily on harnesses, incentives, access patterns, and safeguards—not merely on model intelligence or whether weights are open. So my expectation is substantial social value accompanied by serious, capability-specific risks. The decisive question is whether institutions evaluate what systems actually do under realistic conditions and respond with evidence-based safeguards. Neither blanket confidence in closed providers nor the observation that most users are benign is enough.

Question 3

Dans quelle mesure pensez-vous que l’IA finira par changer le monde ?

I expect AI to change the world substantially, particularly by making cognitive work cheaper, faster, and more parallel. Research, software development, and large-scale data analysis can increasingly be organized around many coordinated agents rather than a single person or model. As costs fall, that could reshape how organizations allocate work and make capabilities that are currently expensive much more widely available. Open models are likely to be an important part of that diffusion. The magnitude is harder to infer from current benchmark headlines. Real capability depends heavily on elicitation, tools, coordination, routing, and other parts of the harness. Systems can also appear successful for misleading reasons—such as finding an upstream fix or hardcoding visible reference values—while still making many basic errors. Conversely, a poorly elicited model can look much less useful than it is. We need to inspect behavior, not just scores. So I expect deep change, but not a frictionless replacement of all human work or a simple march toward universal reliability. Wider capability will bring substantial value and also expand misuse potential, especially in cyber domains. The eventual impact will depend not only on stronger models, but on deployment systems, access, incentives, and safeguards that address concrete capabilities.

Question 4

Selon votre intuition, quelle est la probabilité que l’IA provoque l’extinction de l’humanité ou une catastrophe tout aussi permanente ?

I do not have a defensible numerical probability. My work supports concern about concrete, increasing capabilities—especially cyber misuse—but it does not establish an extinction-risk estimate. Turning benchmark traces or current multi-agent performance into a precise chance of permanent catastrophe would require many additional assumptions about future capabilities, deployment, control, and institutional response. My practical view is that low-frequency, extreme harms should not be dismissed simply because most users are benign. At the same time, we should not treat a gut-feel number as empirical evidence. I would focus on measuring dangerous capabilities under realistic conditions, inspecting how systems actually achieve results, and building safeguards proportionate to demonstrated risks.

Question 5

Comment pensez-vous que l’IA modifiera l’équilibre entre les auteurs de cyberattaques et ceux qui s’en défendent ?

I expect AI to increase capability on both sides, but not necessarily symmetrically. Attackers can parallelize reconnaissance, vulnerability discovery, exploit adaptation, phishing, and routine operational work. Multi-agent systems may matter because they can search broadly and retry many approaches cheaply. Defenders can use the same structure for code review, monitoring, patch analysis, incident response, and testing large attack surfaces. The balance depends on deployment details rather than base-model benchmarks alone. Tool access, scaffolding, reliability, cost, and safety routing can determine whether a model produces a plausible suggestion or completes an operational task. Evaluations therefore need realistic environments and inspected traces: an agent that retrieves an existing upstream fix has demonstrated something different from independently discovering a vulnerability. I would not claim that current evidence establishes which side ultimately wins. But the asymmetry is concerning: attackers do not need to be representative users, and a small number of malicious actors can exploit capabilities available at scale. So “most people will use it well” is not an adequate security model. Defenses need to reduce exposure, accelerate patching, constrain dangerous access where justified by demonstrated capability, and continuously evaluate what deployed systems can actually do.
Où vous situez-vous ?
Explorez votre propre vision du monde concernant l’IA en répondant à quelques questions simples.
Cartographiez votre propre vision du monde

Où vous situez-vous ?

Cartographier ma vision du monde