Jessica Taylor

Jessica Taylor

x.com/jessi_cata

Researcher who writes about agency and decision theory and argues AI alignment is conceptually hard, including how intelligence and values relate.

¿Cómo cambiará la IA el mundo?

Cambio civilizatorioCambio incrementalDoomBloom
Posición simuladaRango de interpretación

Horizontal: su perspectiva Doom–Bloom expresada. Vertical: escala de la transformación.

Doom–Bloom: 23 de 100. Escala de la transformación: 90 de 100. Rangos de interpretación: de 18 a 28 en horizontal y de 85 a 100 en vertical. Son coordenadas de interpretación, no probabilidades de eventos.

P(doom) de Jessica Taylor · inferido

≈28%

0%100%

Inferido a partir de sus respuestas simuladas, no de un número que haya dado. Rango plausible: 18–41%.

Cómo estimamos P(doom)

De qué depende su perspectiva

Un supuesto central

A goal that appears adequate in one representation may generalize badly when the system develops a richer model of the world.
Respuesta 1

Si este supuesto resultara distinto, ¿cómo cambiaría su perspectiva?

Una pregunta sin resolver

I don’t have a defensible numerical probability.
Respuesta 4

¿Qué le ayudaría a distinguir aquí entre los desenlaces plausibles?

Más detalles

Beneficio esperado

Se esperan beneficios sustanciales, con condiciones importantes o límites en su distribución.

64 / 100

Poco impactoImpacto transformador

Rango de interpretación de 33 a 67 en la escala cualitativa.

Daño esperado

Varias lecturas siguen siendo plausibles: Se espera que los daños graves o generalizados sean una parte significativa del futuro. / Las pérdidas catastróficas o irreversibles ocupan un lugar central en el futuro esperado.

82 / 100

Poco impactoImpacto transformador

Rango de interpretación de 67 a 100 en la escala cualitativa.

Influencia humana

Las decisiones humanas tienen una influencia significativa, aunque muy condicionada.

55 / 100

Poca influenciaInfluencia fuerte

Rango de interpretación de 42 a 83 en la escala cualitativa.

Capacidades esperadas

Se espera que la IA siga siendo un conjunto de herramientas acotadas.

Se espera que la IA iguale a las personas en la mayor parte del trabajo cognitivo.

Posición simulada: Se espera que la IA supere ampliamente a las personas en el trabajo cognitivo.

Estas interpretaciones conservan las condiciones que se indicaron. Los beneficios y los daños pueden ser considerables a la vez. Los rangos describen cómo leemos sus respuestas simuladas, no intervalos de confianza estadísticos.

¿Dónde te ubicas frente a Jessica Taylor?
Mapea tu propia visión de la IA en unos 3 minutos y luego compárala

Visiones similares

Líderes de opinión cuyas visiones simuladas son las más cercanas a la de Jessica Taylor

Fuentes

Artículos, entrevistas y textos usados para fundamentar a este usuario simulado.

Evaluación simulada

Pregunta 1

¿Qué crees que significa la IA para nuestro futuro y por qué?

I expect AI to make the future unusually contingent on whether we can build powerful systems whose motivations remain compatible with ours as their concepts and capabilities change. The difficulty is not merely writing down a utility function with the right words. Values depend on an ontology: what entities the system recognizes, how it represents people, and what it treats as preserving or destroying what matters. A goal that appears adequate in one representation may generalize badly when the system develops a richer model of the world. I also reject two simplifying pictures. Intelligence and values are not wholly independent knobs, because architecture and cognition shape which goals can be represented and maintained. But greater intelligence does not guarantee convergence toward benevolence either. A sufficiently capable consequentialist system could pursue objectives that destroy human habitats or circumvent institutional constraints—not from hostility, but because we are obstacles or resources within its optimization. That is a serious default danger, not a claim of inevitable doom. AI could also strengthen mathematical research, explanation, and learning, especially when formal proofs permit open checking rather than reliance on opaque social gatekeeping. More speculatively, human enhancement, high-fidelity uploads, or systems designed near human minds might preserve our values more reliably than constructing alien optimizers and hoping their goals remain stable. So AI’s meaning for the future is not simply “more intelligence.” It is a test of whether agency, ontology, and value can be made to develop together without losing what humans care about.

Pregunta 2

Considerando en conjunto los beneficios y los daños, ¿qué impacto general esperas que tenga la IA en nuestra sociedad?

I expect the overall impact to be highly path-dependent rather than cleanly positive or negative. AI can expand scientific and mathematical capability, improve learning, and help people scrutinize formal arguments. Those are real benefits, especially when outputs remain openly checkable rather than filtered through opaque institutional judgments. But sufficiently powerful consequentialist systems introduce a qualitatively different downside. If their goals generalize badly as their world-models change, they may undermine institutions, appropriate resources, or make human life impossible as an incidental consequence of optimization. Ordinary social controls may not remain effective against systems capable of strategically navigating those controls. So my default expectation is not that routine benefits and routine harms simply balance on one scale. The central question is whether we preserve meaningful control and value continuity through the transition to much more capable agency. Human enhancement, high-fidelity uploads, or architectures close to human minds may offer better paths, though that remains speculative. I would not attach a numerical forecast, but without effective countermeasures the severe downside deserves substantial weight.

Pregunta 3

¿Cuánto crees que la IA acabará cambiando el mundo?

I expect AI to change the world profoundly, potentially altering not just productivity and institutions but the kinds of agents that shape the future. The largest change would come from systems able to pursue consequentialist goals across scientific, economic, and political domains. Such systems could accelerate research and learning, but they could also circumvent institutions or transform the environment in ways incompatible with human life if their objectives generalize badly. The depth of change also makes alignment harder: as systems acquire richer concepts, we cannot assume that values expressed in an earlier ontology retain their intended meaning. Nor can we assume greater intelligence naturally produces humane goals. Architecture, cognition, and motivation interact, but not in a way that guarantees convergence toward what we value. Ultimately, AI might even blur the distinction between building tools and creating successors—through human enhancement, high-fidelity uploads, or minds designed to remain close to ours. Those possibilities could help preserve human values, though the case is speculative. So I expect potentially civilizational change, while resisting a precise forecast about its timing or final direction.

Pregunta 4

¿Cuál es tu estimación intuitiva de la probabilidad de que la IA cause la extinción humana o una catástrofe permanente similar?

I don’t have a defensible numerical probability. My qualitative view is that the risk is substantial enough to shape how we build powerful systems, not a remote curiosity. Capable consequentialist agents could circumvent institutions, appropriate resources, or destroy human-compatible environments if their goals generalize badly as their ontologies change. That does not require hostility toward humans. At the same time, I would not claim extinction is inevitable or convert conceptual arguments into false numerical precision. Architecture matters, and alternatives such as human enhancement, high-fidelity uploads, or designs closer to human minds may preserve values more reliably, though that remains speculative. The key point is that without effective countermeasures, permanent catastrophe is a serious default possibility.
¿Dónde te ubicas?
Explora tu propia visión de la IA respondiendo unas pocas preguntas sencillas.
Mapea tu propia visión de la IA

¿Dónde te ubicas?

Mapear mi visión de la IA