Michael Nielsen on Hyper-entities, Tools for Thought, and Wise Optimism

If you think people who worry about AI are being pessimistic, you might have it backwards.

In this episode, we talk with Michael Nielsen, scientist and writer known for his work on open science, quantum computing, and how our language shapes the way we think. Michael explores what he calls "wise optimism": the idea that genuinely believing in a technology's potential means taking its risks seriously, not dismissing them.

We also spend a good chunk of the conversation on “hyper-entities”. These are imagined future objects, like the Internet before the 1990s or AGI now, that shape present decisions – what gets funded, who coordinates with whom, and what feels possible. We recently published a report where we systematically looked for hyper-entities and spotlighted our favorites: https://www.existentialhope.com/hyper-entities

Our conversation also covers: How kindness spread through civilization like a technology, and what that tells us about the values we might want to instill in AI Why some of the most important scientific discoveries happened by accident Why even the most abstract and "useless" ideas in science tend to end up shaping the real world, both positively and negatively How the tools we use to think (from language to mathematical notation to software) shape what we're able to imagine ‍

Timestamps

0:00 Cold open 1:34 What is a hyper-entity? How imagined future objects orient technological progress 6:30 Why Silicon Valley depends on but undervalues hyper-entities 9:08 Can science fiction generate the next big tech idea? 11:03 Should we be more deliberate about designing hyper-entities? 13:44 Why belief in AGI exploded: self-fulfilling prophecy and the power of conviction 16:04 Beyond AGI: renewable energy, public goods, and other neglected hyper-entities 20:25 Wise optimism about AI: why taking risks seriously is more optimistic than ignoring them 24:22 The dual-use problem: why deep scientific knowledge is always also dangerous 27:44 What our visions of the future get wrong: emotions, values, and AI identity 38:27 Where breakthroughs really come from: exploration vs. goal-directed research 44:43 A serious discipline for imagining the future: vision papers and validated imagination 56:08 Tools for thought: how symbols and notation expand what humans can think 1:02:49 Intellectual independence and the art of productive disagreement On the Existential Hope Podcast hosts Allison Duettmann and Beatrice Erkers from the Foresight Institute invite scientists, founders, and philosophers for in-depth conversations on positive, high-tech futures.

Full transcript, listed resources, and more: https://www.existentialhope.com/podcasts

Follow on X. Hosted on Acast. See acast.com/privacy for more information.