Surveillance Capitalism

I was lucky enough to get my hands on this book the day it was published, but it took me a solid month to consume its contents and make my visual notes. As there’s truly quite a lot to cover! The book delivers an abundance of information, insights, and counsel on, what Shoshana Zuboff calls, the darkening of the digital age. It is truly Shoshana’s magnum opus. Her thinking on the topic must have been initiated back in 1989, with the release of her book “In The Age Of the Smart Machine: The Future Of Work and Power.” She is an author who writes from a place of authenticity, one who has lived through much of what ended up in the book, including first-hand work with B.F. Skinner. Presented below are my brief reactions to each part, paired together with graphically organized quotes of importance.

Introduction

The message is clear – privacy is systematically removed with the advent of technologies and tools that, on the surface, make our lives easier, but underneath are designed to extract and learn our behaviors. Attractive products and services (such as Gmail or Google Maps) act as hooks that lure us into extractive operations. The exploitation our our privacy is, however, not the distinctive feature of technology. The technology is never good or bad. It is rather as a result of a new economic order which claims our experiences as its raw material. As a result, Google and others enjoy extraordinary new asymmetry – making users dependent on these tools and unlearning their old ways, while data-fueled models becomeing less dependent on us for prediction and, ultimately, automation. The reciprocity of producer-consumer is therefore disrupted.

Part I – The Foundations

The digital era offered tools to focus on the individual. 

First modernity (pre-1930)- a journey of self-creation, outside of oppressive limits of rulers, fueled by a notion of individualism, capitalism and urbanization. 
Second modernity (post WWII) – institutionalized shift in economic and social policies with the neoliberal paradigm reworked into a network society. 
The Double Movement – Karl Planyi’s concept: the process of marketization and the push for social protections against it. A network of measures and policies with powerful institutions designed to hold these powerful forces in check.
Neofeudalism (or a so called return to patrimonial capitalism) – a reversion to a premodern society in which one’s life depends upon inherited wealth rather than meritocratic achievements due to the consolidation of elite wealth and power beyond the control of the democratic mechanisms. 
Digital disposition as 4th wave commodity shift:  

1st: Life->Labor
2nd: Land->Real Estate 
3rd: Exchange->Money
4th: Experience->Behavioral data

The society ordering principle shifted from a division of labor to a division of learning and the implications are visible if we ask questions such as: 

Who knows? – question about the distribution of knowledge – it is now up to Google and the elite able to wield the analytical tools to extract value from information
Who decides? – question about authority – it is now the market with its business models.
Who decides who decides? – question about power – in the absence of a meaningful double movement with its insinuations, it is up to shareholder value maximization to answer that question. 

The first to notice the anti democratic notions behind surveillance capitalism was Spiros Simitis – a German pioneer in the field of data protection. Hal Varían (Google Chief Economist) recognized data as the raw material necessary for “manufacturing” processes where insights are reinvested to form improved services. No economic exchange, no price, no profit. Just products derived from our behaviours.

Part 2 – The Advance

Although it became obvious for Google that the insights gathered by their searches provided forecasting value, it wasn’t until later that insights started to be used to modify behavior. 

With Mark Weiser’s well thought out notion of Ubiquitous computing, where technology reduces its visibility to become ultimately invisible, the nightmare of social control become possible as in the futuristic book by Herman Kahn “The year 2000” where automation was no longer the goal but rather the replacement of society and its members’ freedom to create meaning from the experiences that are available to them. 

Since with all data in the world, it is possible to only measure correlation, and not causality, experiments need to be run in order to understand it. And thanks to the abundance of data, they started with herding – the remote orchestration of human situations, foreclosing alternatives and thus moving behavior along paths of heightened probability to approximate certainty. As a result, our will (called by the philosopher Hannah Arendt the „organ for the future”) is affected, mediated and, ultimately, compromised. What follows is the loss of the right to the future tense – it may no longer be us making the decisions anymore, but rather the placement of Poke stops or route suggestion affecting it.

Part 3 – Instrumentarian Power for a Third Modernity

For many, such as Meyer, Planck and Skinner, freedom of behavior seemed an “accident”, or “illusion”. Instrumentarian power, operating through the means of modifying our behavior, can succeed in removing this friction. 

How much better can it be for producers to improve their forecasts to the level of “certain outcomes”? How much better can it be for us, the consumers, as we only need to sacrifice our freedom for collective knowledge. In the human hive, individual freedoms need to be forfeit to the collective for the sake of the social efficiency of the whole. The instrumentarian order, it seems, begins with the death of individuality. Enter “Third modernity” with its quest for effective live together. 

The problem is not independent thought, as Pentland, the author of “Social Physics” puts it, the problem is in the observable thought processes that occasionally emerge to defeat social models. But if social pressure is elevated to the highest good – the unpredictable results of free thinking can soon be deemed morally inappropriate.

It is a decision for us to make – should we continue to strive for our reflection in the mirror, seeking what is desirable and trending, receiving dopamine shots with every received ‘like’? Or insist on our first-person voice, provoking us to carve out our own unique responses to the world? Responses that are composed of our inward sense of valid thought, of moral authority. Truthful responses in languages of reciprocity, intimacy, composed at the backstage of ourselves – the region that Goffman calls a retreat from the performative demands of social life. Privacy, intimacy, solitude, reserve and family, which are required for psychological health and truthful responses. And those depend on a sanctuary, an inviolable space where we are by ourselves, a space called home.

Conclusion

What defines Surveillance Capitalism is the convergence of freedom and knowledge. The absence of reciprocity in societies usually ended in acts of violence. The weakening of democracy at the same time makes it less likely for a response to be expressed in a civilized way. What is on the horizon is a different kind of extinction, that the author calls the “seventh extinction” after a sixth of vertebrate species who are disappearing faster than at any time since the dinosaurs. The seventh might be the extinction of what is most precious to our nature – our will to will, the sanctity of the individual, and intimacy in the aftermath of the dying off of human nature. 

However, as the author concludes, new beginnings are plausible beyond the natural instincts to bow down. And they always begin from the capacity of freedom as a hidden source of all great and beautiful things yet unknown.

Homo Deus

Homo Deus is a book I would recommend to anyone who wants to refine their thinking about the future. Knowing his previous books already I knew what to expect, yet was surprised by the clarity and depth of his thinking. 

Harari has extended his evolutionary concepts to go beyond his “Sapiens” bestseller of 2016, and as a historian is doing it uncompromisingly. The concepts he’s coming out with are mind-boggling. As David Sexton wrote in a review published in the Evening Standard: “Compared with the subjects he (Harari) tackles, anything else we might read looks piffling and parochial.”

How else could you describe concepts where humans are framed as units of a giant computational algorithm, or religions as virtual reality games of our imagination with a scoring system to get you to next level in the afterlife?

His insights can come as blasphemous for those of us who are used to seeing the world through the lens of human superiority (usually called anthropocentrism). Harari states clearly that we’re biased by definition, as our narrative-self making sense of the world is incompatible with the very fabric of reality. The latter doesn’t come in the shape of a story. 

Quotes & concepts

Here’s what I’ve learned from my reading of the book:

(Tap to see the visual map of quotes & concepts)

Core concepts of the book:

  • Dataism. A belief in information as a supreme value and in data as a way to reduce cognitive biases. Algorithms will be so good at making decisions for us that it would be madness not to follow their advice.
  • Religion as a vast virtual reality game with imaginary rules that give life meaning by scoring points to get to a new level. After humans silenced the gods during the Scientific Revolutions, they became a one-man show and lost meaning in the process. Meaning might be regained in the virtual realities of the future.
  • Consciousness as a biologically useless by-product of certain brain processes (a mental pollution as carbon dioxide from breathing). 99% of bodily activities don’t require consciousness. Algorithms of the future (the “system”) won’t require consciousness to be superior. Superhumans (cognitively upgraded ones) will perform services to “the system” while the system could neither understand nor manage them.
  • Humans as masters of cognitive dissonance with their fictions of intersubjective reality. Sapiens rule the world thanks to an intersubjective web of meaning (law, forces, entities, places that exist only in our imagination). Our cooperation is dependent on a delicate balance between truth (reality) and fiction (distorting reality). Beliefs in the same stories make us follow the same rules, making it easy to predict behaviors. Fictions and stories in our heads give us meaning, not all bad, rather vital (we can’t play football unless everyone believes in the same made-up rules). Harrari goes so far to predict that the intersubjective reality (of fiction and stories) will swallow up the objective reality and he suggests to decipher the fictions to predict the future and meanings we’ll strive for.
  • The Cosmic data-processing system where humans as merely tools for creating the Internet-of-all-things, which may eventually spread out from planet Earth to pervade the whole galaxy or universe. Organisms are seen as algorithms, shaped by natural selection (algorithmic calculations are not affected by material from which the calculator is built). In this context freedom of information seems the greatest good of all – a completely new value, first to appear since 1789. The greatest sin is to block the flow of data, which for humans means not sharing or death (a condition in which information doesn’t flow).
  • Knowledge as a resource among Energy and raw materials. The stock of knowledge constantly increases with this rule: the more you use – the more you have. Data as a starting point for knowledge – in ancient times having power meant having access to data. Today having power means knowing what to ignore.
  • AI making people irrelevant. As humans, we do have 2 abilities (physical and cognitive). We gave up competition in physical abilities to machines already, now machines might outcompete us in cognitive abilities and there’s no third field. Migration between a low-skill job (farming) to another low-skill job (cashier) will not happen in future. Low-skill jobs will disappear and thus in a world of superhumans, our dreams and even fears will become irrelevant, creating a useless class with nothing more to contribute

Homo Deus 
by Yuval Noah Harari
⭐⭐⭐⭐⭐
Published: Sep 2016
Length: 460 pages

Time to read: 10h

Homo Deus

Related Concepts

No related concepts found


Related books

No posts found.