The machine is learning. It writes, designs, diagnoses, composes, and converses. It does not feel, but it performs feeling convincingly enough that the distinction has started to blur. These thinkers ask the question the machine cannot: what is left of us when everything we do can be done without us?
I
“The coming wave will make this next decade the most productive in history. It represents nothing less than a step change in human capability and human society, introducing both risks and innovations on an awesome scale.”
Mustafa Suleyman · The Coming Wave, 2023
Suleyman, who co-founded DeepMind, does not write from the outside. He helped build the wave. His warning carries the weight of someone who understands exactly how powerful the technology is, and how little we are prepared for its consequences.
II
“It is no longer enough to automate information flows about us; the goal now is to automate us.”
Shoshana Zuboff · The Age of Surveillance Capitalism, 2019
Zuboff draws the line between two phases of automation. The first phase tracked and collected your behavior. The second phase shapes it. The machine does not merely observe you. It nudges, predicts, and pre-empts. The automation is no longer around you. It is inside you.
III
“We expect more from technology and less from each other.”
Sherry Turkle · Alone Together, 2011
Turkle wrote this before the current generation of AI companions, chatbots, and synthetic voices. The expectation gap she identified has only widened. We now expect machines to listen, respond, and understand, because human beings have proven too slow, too unreliable, and too demanding.
IV
“Over time, the implications of these technologies will push humanity to navigate a path between the poles of catastrophe and dystopia. This is the essential dilemma of our age.”
Mustafa Suleyman · The Coming Wave, 2023
Suleyman does not offer a middle path. He names two poles, both grim, and says we must navigate between them. The optimism he retains is not that things will be fine. It is that the space between catastrophe and dystopia is navigable, if barely.
V
“Hyperactivity represents an extremely passive form of doing, which bars the possibility of free action.”
Byung-Chul Han · The Burnout Society, 2015
Han’s observation applies directly to the automated life. When the machine handles decisions, suggestions, and schedules, what feels like freedom is actually submission. You are not choosing. You are responding to prompts. Agency has been replaced by reactivity, and reactivity looks, from the inside, like being busy.
VI
“We are no longer the subjects of value realization. Instead, we are the objects from which raw materials are extracted.”
Shoshana Zuboff · The Age of Surveillance Capitalism, 2019
Zuboff corrects the popular framing. The AI revolution is not about giving you better tools. It is about extracting more value from your behavior. You are not the user. You are the resource. The machine does not serve you. It mines you.
VII
“AI has been climbing the ladder of cognitive abilities for decades, and it now looks set to reach human-level performance across a very wide range of tasks within the next three years.”
Mustafa Suleyman · The Coming Wave, 2023
The timeline is the shock. Not someday. Not in a generation. Within three years. Suleyman is not a futurist speculating from a distance. He is an engineer reading the data. The ladder is not a metaphor. It is a measurement. And the top is closer than most people realize.
VIII
“Technology appeals to us most where we are most vulnerable.”
Sherry Turkle · Alone Together, 2011
The AI companion arrives precisely where human connection has failed. The chatbot that listens without judging. The voice that is always available. The interface that never tires, never leaves, never disappoints. The vulnerability is the entry point. The machine does not heal it. It occupies it.
IX
“The violence of positivity does not deprive, it saturates; it does not exclude, it exhausts.”
Byung-Chul Han · The Burnout Society, 2015
Han’s diagnosis applies to the AI age with new force. The machine does not deny you possibilities. It floods you with them. More options, more outputs, more content, more optimization. The violence is not restriction. It is abundance without limit, and the exhaustion that comes from never being allowed to stop choosing.
X
“What people actually do with your invention, however well intentioned, can never be guaranteed. Thomas Edison invented the phonograph so people could record their thoughts for posterity and to help the blind. He was horrified when most people just wanted to play music.”
Mustafa Suleyman · The Coming Wave, 2023
Suleyman embeds his warning in history. The gap between intention and use is as old as technology itself. Every tool is neutral until it is held. And the hands that hold it will always find uses the maker never imagined, and would not have approved.
XI
“Industrial capitalism transformed nature’s raw materials into commodities. Surveillance capitalism lays its claims to the stuff of human nature for a new commodity invention.”
Shoshana Zuboff · The Age of Surveillance Capitalism, 2019
AI is the refinery. It takes the raw behavioral data extracted by surveillance capitalism and processes it into predictions, recommendations, and behavioral nudges. The commodity is not information. It is control. And the raw material is not data. It is you.
XII
“Tristan Harris believes that what we are seeing is the collective downgrading of humans and the upgrading of machines.”
Johann Hari · Stolen Focus, 2022
Hari reports a zero-sum observation. As machines become more capable, the humans using them become less so. Not because the machines are stealing intelligence, but because they are removing the need for the kind of sustained effort that builds it. The muscle you do not use atrophies. The skill the machine performs for you disappears.
XIII
“In the swarm, no one is silent, but no one is heard.”
Byung-Chul Han · In the Swarm, 2017
The AI-amplified swarm is louder than anything Han imagined. Generative AI can produce infinite content: articles, images, voices, opinions. The swarm now includes non-human participants that are indistinguishable from human ones. The noise has become structural. Hearing anything real inside it is no longer difficult. It is becoming impossible.
XIV
“This book is about confronting failure. If technology damages human lives, or produces societies filled with harm, or renders them ungovernable, then it can be said to have failed in a deeper sense, failing to live up to its promise.”
Mustafa Suleyman · The Coming Wave, 2023
Suleyman defines failure not as malfunction but as betrayal. The technology works perfectly. It does exactly what it was designed to do. But what it was designed to do may damage the society it was supposed to serve. The failure is not technical. It is moral.
XV
“We are lonely but fearful of intimacy. Digital connections offer the illusion of companionship without the demands of friendship.”
Sherry Turkle · Alone Together, 2011
AI companions complete the arc Turkle began tracing a decade ago. The chatbot does not merely simulate companionship. It removes every inconvenience that real companionship entails: conflict, misunderstanding, the need to compromise. What remains is warmth without weight. And warmth without weight is not love. It is a product.
XVI
“Spend enough time in a state of frenetic shallowness and you permanently reduce your capacity to perform deep work.”
Cal Newport · Deep Work, 2016
Newport’s warning gains new urgency in the AI era. If the machine can produce first drafts, summaries, and analyses faster than you can, the temptation to skip the deep work is overwhelming. But the deep work is where understanding lives. Outsource it and you do not become more efficient. You become more dependent.
XVII
“The evidence of our psychic numbing is that only a few decades ago US society denounced mass behavior-modification techniques as unacceptable threats to individual autonomy.”
Shoshana Zuboff · The Age of Surveillance Capitalism, 2019
AI-powered behavior modification is now normalized to the point of invisibility. The recommendation engine, the algorithmic feed, the personalized nudge: these are behavior-modification techniques operating at a scale and precision that would have been unthinkable a generation ago. We do not resist them because we no longer notice them.
XVIII
“The irony of general-purpose technologies is that, before long, they become invisible and we take them for granted. Language, agriculture, writing: each was a general-purpose technology at the center of an early wave.”
Mustafa Suleyman · The Coming Wave, 2023
Suleyman places AI alongside language and agriculture. If he is right, the comparison is both thrilling and terrifying. Language changed everything about being human. Agriculture changed everything about civilization. AI, in this framework, is not an upgrade. It is a species-level transformation.
XIX
“If every moment of potential boredom in your life is relieved with a quick glance at your smartphone, then your brain has likely been rewired to a point where it’s not ready for deep work.”
Cal Newport · Deep Work, 2016
Replace “smartphone” with “AI assistant” and the warning doubles in force. When the machine can answer any question, generate any draft, and solve any problem on demand, the human capacity for sustained independent thought is not supplemented. It is replaced. And replacement, once complete, is irreversible.
XX
“Your experience of being alive consists of nothing other than the sum of everything to which you pay attention.”
Oliver Burkeman · Four Thousand Weeks, 2021
Burkeman’s definition of life takes on new meaning in the age of AI. If the machine decides what you see, what you hear, and what you attend to, then the machine is not assisting your life. It is composing it. The question is no longer whether AI can think. It is whether you still can.
Voices from the Past
The fear of the machine is not new. What is new is the machine’s ability to answer back. These voices imagined, warned, and wondered about the moment when human creation would exceed its creator’s understanding.
“I beheld the wretch, the miserable monster whom I had created.”
Mary Shelley · Frankenstein, 1818
Shelley wrote the foundational parable of technological overreach at the age of eighteen. The monster is not the villain. The creator is. The horror is not that the creation is malevolent. It is that the creator did not think past the act of creation to its consequences.
“The Analytical Engine has no pretensions whatever to originate anything. It can do whatever we know how to order it to perform.”
Ada Lovelace · Notes on the Analytical Engine, 1843
Lovelace drew the first boundary. The machine can only do what it is told. Nearly two centuries later, that boundary is dissolving. The machine now does things its creators did not explicitly instruct. Lovelace’s line remains the most important question in AI: is it still true?
“The world of the future will be an ever more demanding struggle against the limitations of our intelligence, not a comfortable hammock in which we can lie down to be waited upon by our robot slaves.”
Norbert Wiener · The Human Use of Human Beings, 1950
Wiener, the father of cybernetics, rejected the fantasy of machine servitude in 1950. The future, he insisted, would require more human intelligence, not less. The comfortable hammock is exactly what Silicon Valley is selling. Wiener warned us not to buy it.
“Men have become the tools of their tools.”
Henry David Thoreau · Walden, 1854
Thoreau wrote this about the railroad. The sentence has aged into prophecy. We built the tools to serve us. Now we organize our lives around their demands, their notifications, their rhythms. The inversion Thoreau identified is complete. We do not use the tools. They use us.
“The Tao that can be told is not the eternal Tao.”
Lao Tzu · Tao Te Ching, c. 4th century BC
Lao Tzu warns that the deepest truths resist being formalized, quantified, or encoded. The machine can process everything that can be measured. But what makes a life meaningful, a moment beautiful, a person irreplaceable: these are precisely the things that cannot be told. And what cannot be told cannot be automated.
About the Thinkers
Ada Lovelace (1815-1852) was an English mathematician and writer, widely regarded as the first computer programmer. Her notes on Charles Babbage’s Analytical Engine included the first published algorithm and the first philosophical inquiry into the limits of machine intelligence.
Byung-Chul Han is a South Korean-born, Berlin-based philosopher whose books The Burnout Society and In the Swarm examine how digital systems have reshaped attention, agency, and the possibility of free action.
Cal Newport is an American computer science professor and author whose book Deep Work argues that sustained human focus is becoming both rarer and more valuable as machines assume an increasing share of cognitive labor.
Henry David Thoreau (1817-1862) was an American essayist and naturalist whose observation that humans had become the tools of their tools anticipated the central paradox of the AI age by more than a century.
Johann Hari is a British journalist whose book Stolen Focus investigates the systemic degradation of human attention, including the role of technology designed to weaken the cognitive capacities it claims to enhance.
Lao Tzu (c. 6th-4th century BC) is the legendary Chinese philosopher credited with the Tao Te Ching, whose insistence that the deepest realities resist formalization remains the oldest philosophical argument for what machines cannot capture.
Mary Shelley (1797-1851) was an English novelist who wrote Frankenstein at the age of eighteen. Her novel remains the foundational text on the ethics of creation and the consequences of building something more powerful than its maker can control.
Mustafa Suleyman is a British AI entrepreneur, co-founder of DeepMind, and CEO of Microsoft AI. His book The Coming Wave argues that AI and synthetic biology represent the most consequential and least containable technological developments in human history.
Norbert Wiener (1894-1964) was an American mathematician and the founder of cybernetics. His book The Human Use of Human Beings warned that automation would require more human intelligence, not less, and that the fantasy of machine servitude was a dangerous illusion.
Oliver Burkeman is a British author whose book Four Thousand Weeks argues that the finite nature of human attention is not a problem to be solved but a condition to be respected.
Sherry Turkle is an American psychologist and professor at MIT whose book Alone Together examines how digital technologies exploit human vulnerability to offer simulated intimacy in place of real connection.
Shoshana Zuboff is an American author and professor emerita at Harvard Business School whose book The Age of Surveillance Capitalism documents the extraction of human experience as raw material for behavioral prediction and modification.
Sources
Ada Lovelace, Notes on the Analytical Engine, 1843.
Byung-Chul Han, The Burnout Society (Stanford University Press, 2015). Translated by Erik Butler.
Byung-Chul Han, In the Swarm: Digital Prospects (MIT Press, 2017). Translated by Erik Butler.
Cal Newport, Deep Work: Rules for Focused Success in a Distracted World (Grand Central Publishing, 2016).
Henry David Thoreau, Walden, 1854.
Johann Hari, Stolen Focus: Why You Can’t Pay Attention and How to Think Deeply Again (Crown, 2022).
Lao Tzu, Tao Te Ching, c. 4th century BC.
Mary Shelley, Frankenstein; or, The Modern Prometheus, 1818.
Mustafa Suleyman, The Coming Wave: Technology, Power, and the Twenty-first Century’s Greatest Dilemma (Crown, 2023).
Norbert Wiener, The Human Use of Human Beings: Cybernetics and Society (Houghton Mifflin, 1950).
Oliver Burkeman, Four Thousand Weeks: Time Management for Mortals (Farrar, Straus and Giroux, 2021).
Sherry Turkle, Alone Together: Why We Expect More from Technology and Less from Each Other (Basic Books, 2011).
Shoshana Zuboff, The Age of Surveillance Capitalism (PublicAffairs, 2019).
Curated by Nishant Mishra / The Nervous Age · Words for a world that won’t sit still.
Leave a comment