Social Europe

politics, economy and employment & labour

  • Projects
    • Corporate Taxation in a Globalised Era
    • US Election 2020
    • The Transformation of Work
    • The Coronavirus Crisis and the Welfare State
    • Just Transition
    • Artificial intelligence, work and society
    • What is inequality?
    • Europe 2025
    • The Crisis Of Globalisation
  • Audiovisual
    • Audio Podcast
    • Video Podcasts
    • Social Europe Talk Videos
  • Publications
    • Books
    • Dossiers
    • Occasional Papers
    • Research Essays
    • Brexit Paper Series
  • Shop
  • Membership
  • Ads
  • Newsletter

The Orwellian Danger Of Facebook

by Steven Hill on 9th April 2018

Share on TwitterShare on FacebookShare on LinkedIn
Steven Hill

Steven Hill

Virtually every month it seems, new controversies emerge swirling around Facebook, Google, Amazon, Twitter and other Silicon Valley companies. The latest controversy, which involved allies of Donald Trump swiping personal data from as many as 87 million Facebook users in the US presidential election, is yet another window into the nature of these companies. Before that there was the scourge of fake news and Russian propaganda bots that had spread across the Facebook platform like a metastasized cancer. And before that Google being fined €2.4 billion by the European Commission for manipulating its search results in favor of preferred companies.

In the case of Facebook, we are left with the daunting question of whether Mr. Zuckerberg and his computer geniuses really understand their own creation. Facebook’s AI has been built (or more accurately, cobbled together) over several years by hundreds of different developers and programmers. Professor Zeynep Tufekci from Harvard University describes the Facebook algorithm as “giant matrices, maybe millions of rows and columns, and not even the programmers understand anymore how exactly it is operating.” There are so many variables that go into its complex and proprietary sorting that Facebook cannot say with authority why something will or will not appear in a user’s news feed, or how and why suddenly Russian trolls and their bots were able to manipulate the algorithms to reach nearly half of all US voters with targeted fake news. (This included such whoppers as the Pope had endorsed Donald Trump for president, which received nearly 2m Facebook “engagements” (total number of shares, likes and comments) in the three months leading up to the U.S. election).

Nevertheless, a number of experts have been closely observing this company and have figured out a few of its behavioural patterns. Combined with recent revelations from a whistleblower, here’s what we have learned about how Facebook and its algorithms actually work. It is even more alarming than anyone thought.

AI is being aimed at users to affect not only advertising but also news and elections. Given Facebook’s widespread use and influence – with 2 billion global users, it is fast replacing television as the most dominant news, entertainment and commercial medium in the world — this manipulation strikes at the very heart of our democratic societies.

First, Facebook’s “engagement algorithms” use technological surveillance of our online behavior to capture our personal data in a way that would have made the Stasi drool with envy. The goal is to generate increasingly accurate, automated predictions of what advertisements we are most influenced by.

Recently Wired reported on a leaked Facebook memo which revealed that the company had offered advertisers the opportunity to target 6.4m younger users, some only 14 years old, during moments of psychological vulnerability. Facebook monitored posts, photos, and interactions in real time to track emotional lows, and the 23-page document actually highlighted Facebook’s ability to micro-target ads down to “moments when young people need a confidence boost.” As Dr Tufekci explains: “Humans are a social species…We are particularly susceptible to glimmers of novelty, messages of affirmation and belonging, and messages of outrage toward perceived enemies. These kinds of messages are to human community what salt, sugar, and fat are to the human appetite.”

Join our growing community newsletter!

"Social Europe publishes thought-provoking articles on the big political and economic issues of our time analysed from a European viewpoint. Indispensable reading!"

Polly Toynbee

Columnist for The Guardian

Thank you very much for your interest! Now please check your email to confirm your subscription.

There was an error submitting your subscription. Please try again.

Powered by ConvertKit

Feeding frenzy

So Facebook offers these to its users in a grand gluttony of feeding, creating what the company’s first president, Sean Parker, recently called “a social-­validation feedback loop.” The platform is specifically designed to keep users clicking, tapping, and scrolling down a bottomless feed, and in the process deliver us to various advertisers.

But that’s not all. Based on our individual profiles, the Facebook engagement algorithms are also designed to feed us sensationalist news (both fake and real) selected to provoke powerful emotions of anger and fear. By reacting to, clicking on and sharing these stories, users are herded by the Facebook “persuasion architecture” into hyper-partisan information ghettos of opinion and alternative facts, referred to as “cognitive bubbles”.

One outrageous example was the false conspiracy theory blasted around Facebook during the presidential campaign that Hillary Clinton and her former campaign chair ran a child sex ring in the basement of a pizzeria in Washington DC. Besides the fact that the restaurant, Comet Ping Pong, doesn’t even have a basement, the restaurant’s staff and its owner were hit with a fusillade of abuse and death threats on social media. Matters went from alarming to dangerous when a man walked into Comet Ping Pong with an assault rifle and began shooting (fortunately no one was injured). That was just one of dozens of fake news stories, all of them with absurd storylines. Other stories claimed that Hillary Clinton sold weapons to Isis, and that an FBI agent linked to Clinton’s email leaks had been mysteriously found dead.

A BuzzFeed News analysis found that 17 of the 20 top-performing false election stories were overtly pro-Donald Trump or anti-Hillary Clinton. In the last three months of the presidential campaign, top fake election news stories generated nearly 9m Facebook engagements, which was 20 percent greater than the number received by election stories from 19 major news outlets combined.


We need your help! Please join our mission to improve public policy debates.


As you may know, Social Europe is an independent publisher. We aren't backed by a large publishing house or big advertising partners. For the longevity of Social Europe we depend on our loyal readers - we depend on you. You can support us by becoming a Social Europe member for less than 5 Euro per month.

Thank you very much for your support!

Become a Social Europe Member

Choosing the target

But the impacts go even deeper than fake news. Whistleblower Christopher Wylie revealed to the New York Times and UK’s Observer how his former company, Cambridge Analytica, used personal information swiped from 87 million Facebook users to build a system that created psychological-political profiles of most US voters via online questionnaires. Cambridge Analytica was headed by Trump’s key adviser Steve Bannon, from the alt-right media outlet Breitbart. For the 2016 US presidential election, the Guardian reports that Cambridge Analytica deployed a set of techniques that were adopted from the US Department of Defense and UK Ministry of Defence, in particular their “psychological operations,” or psyops. Those methods were focused on changing people’s minds, not through persuasion but through “informational dominance” that relies on disinformation, fake news, rumor and “psychographic messaging.”As the New York Times pointed out, a voter found to be neurotic might be shown a gun-rights commercial featuring burglars breaking into a home, rather than a dry legal defense of the Second Amendment; voters troubled by anxiety would be targeted with ads warning of the dangers posed by the Islamic State, but such ads would be presumed ineffective with those identified as ‘optimistic.’

Cambridge Analytica’s precursor, called SCL Elections, claims that it has used a similar suite of tools in more than 200 elections around the world, including in Italy, Ukraine, Romania, South Africa, Nigeria, Kenya, India, Indonesia, Thailand and many other democracies. When the Facebook data breach first occurred back in 2014, it included a third of active North American users, and nearly a quarter of potential US voters. Wylie told the newspapers; “We exploited Facebook…and built models to exploit what we knew about [their users] and target their inner demons.” Paul-Olivier Dehaye, a data expert and academic based in Switzerland, who published some of the first research into Cambridge Analytica’s processes, says it’s become increasingly apparent that Facebook is “abusive by design.”

Even if the Cambridge Analytica techniques were not wholly influential in swaying voters, as some pundits have claimed, that misses an important point. Left to their own devices, these companies are writing the rules of our collective digital future. And we are just at the beginning stage of what these technologies eventually will be capable of. The linkage of powerful emotive responses that have been digitally stimulated to orchestrate a kind of partisan groupthink is chillingly reminiscent of George Orwell’s Two Minutes of Hate in his novel 1984. Dr Tufekci says that “the core business model underlying the Big Tech platforms—harvesting attention with a massive surveillance infrastructure to allow for targeted and mostly automated advertising at a very large scale—is far too compatible with authoritarianism, propaganda, misinformation, and polarization.”

Beyond social networks

With its 2bn users worldwide, Facebook has grown from a pet project started in Zuckerberg’s Harvard dorm to become far more than a social networking platform. It has morphed into a huge news, entertainment and advertising platform that is viewed by more people than any US or European television network, any newspaper or magazine and any online news outlet. It also reaches hundreds of millions of users in the developing world, where the company has tailored its app for low-bandwidth connections and less expensive Android phones. Many grey- and black market entrepreneurs in the developing world use a Facebook app as their eBay-like commercial gateway for buying and selling.

Google also has mastered these kinds of architectures of engagement, and Amazon is well on its way. In so doing, these companies have become three of the most valued companies in the world. Together Google and Facebook now account for a whopping 73% of all global online advertising revenue (84% outside China) and 25% of all ad sales (online or off). Amazon is now slowly playing catch up in the advertising game. But this growing duopoly is crowding out other media outlets, forcing even Twitter and Snapchat to fight for the advertising scraps needed to survive.

In other words, we the public are the guinea pigs for these platform monopolies’ algorithmic experiments. The power of algorithms is being put to work for very questionable ends, and has a propensity to result in unforeseen consequences.  Viktor Mayer-Schönberger, Professor at Oxford University and co-author of Reinventing Capitalism in the Age of Big Data, says; “The algorithms and datasets behind them will become black boxes that offer us no accountability, traceability, or confidence.” In the past, he says, most computer code could be opened and inspected, making it effectively transparent. But with AI and its enormous datasets enhanced by “machine learning,” the human ability to monitor these technological puzzles is declining.

Europe has long operated by the “precautionary principle,” which is like the Hippocratic oath in medicine that says, “First, do no harm.” The products and services being created by these Silicon Valley companies have enjoyed widespread access to European markets and consumers. Europeans have great faith in an open Internet, but the pitfalls of this over-optimism are becoming more and more apparent. Now that Facebook has grown into a large global monopoly, a major media platform for the entire planet, it has become less benign and is raising more alarm bells.

A European model platform?

Many people have long lamented “Where is the European Facebook and Google?” But the emperor no longer has any clothes; the digital leadership of Silicon Valley platform companies has been shown to be sinisterly irresponsible and teetering on being dangerous. Now is the time for some European start-ups to come together, with seed money from the EU and/or individual governments, and create a new version of Facebook (and Google, and Amazon) that incorporates European values. Call it Facebook 2.0. China has accomplished this – why can’t Europe?

At this point, a kind of renationalization of the Internet seems natural and almost inevitable. Nations and regional blocs like the EU and China must each re-configure the Net in ways that work for their populations, their values and their future needs. Currently these platform companies seem to exist everywhere and nowhere, growing into global behemoths. One idea that has been discussed is that of turning these kinds of services into public utilities. Another is that of breaking them up as overly big monopolies. Yet another option is that of requiring digital licenses that map out the rules and regulations of operation for Internet-based platforms, much in the way that traditional brick-and-mortar companies must be granted business permits and licenses.

The evolution of the Digital Age is proceeding rapidly, and just as in bygone eras when oil, phone and Microsoft monopolies eventually needed to be yoked, it is time to figure out the right digital harness for these platform companies. The alternative is to leave the standards and norms that will rule the future to be defined by these Frankenstein companies from Silicon Valley.

Share on TwitterShare on FacebookShare on LinkedIn
Home ・ The Orwellian Danger Of Facebook

Filed Under: Politics

About Steven Hill

Steven Hill is the former policy director at the Center for Humane Technology and author of seven books, including Raw Deal: How the Uber Economy and Runaway Capitalism Are Screwing American Workers and The Startup Illusion: How the Internet Economy Threatens Our Welfare.

Partner Ads

Most Popular Posts

Thomas Piketty,capital Capital and ideology: interview with Thomas Piketty Thomas Piketty
sovereignty Brexit and the misunderstanding of sovereignty Peter Verovšek
China,cold war The first global event in the history of humankind Branko Milanovic
centre-left, Democratic Party The Biden victory and the future of the centre-left EJ Dionne Jr
Covid 19 vaccine Designing vaccines for people, not profits Mariana Mazzucato, Henry Lishi Li and Els Torreele

Most Recent Posts

European Pillar of Social Rights,social pillar EU credibility as a people’s union rests on the social pillar Liina Carr
vaccine nationalism,Big Pharma Vaccine nationalism won’t defeat the pandemic Sharan Burrow
Can we change the climate on climate change? Karin Pettersson
adaptation strategy Managing the unavoidable impact of climate change Ludovic Voet
platform,crowdworker Germany adds to recognition of platform workers Roman Kormann

Other Social Europe Publications

US election 2020
Corporate taxation in a globalised era
The transformation of work
The coronavirus crisis and the welfare state
Whither Social Rights in (Post-)Brexit Europe?

ETUI advertisement

ETUI/ETUC (online) conference Towards a new socio-ecological contract 3-5 February 2021

The need to effectively tackle global warming puts under pressure the existing industrial relations models in Europe. A viable world of labour requires a new sustainability paradigm: economic, social and environmental.

The required paradigm shift implies large-scale economic and societal change and serious deliberation. All workers need to be actively involved and nobody should be left behind. Massive societal coalitions will have to be built for a shared vision to emerge and for a just transition, with fairly distributed costs, to be supported. But this is also an opportunity to redefine our societal goals and how they relate to the current focus on (green) growth.


REPLAY ALL SESSIONS

To access the videos, click on the chosen day then click on the ‘video’ button of your chosen session (plenary or panel). It will bring you immediately to the corresponding video. To access the available presentations, click on the chosen day then click on the ‘information’ button. Check the links to the available presentations.

Eurofound advertisement

Industrial relations: developments 2015-2019

Eurofound has monitored and analysed developments in industrial relations systems at EU level and in EU member states for over 40 years. This new flagship report provides an overview of developments in industrial relations and social dialogue in the years immediately prior to the Covid-19 outbreak. Findings are placed in the context of the key developments in EU policy affecting employment, working conditions and social policy, and linked to the work done by social partners—as well as public authorities—at European and national levels.


CLICK FOR MORE INFO

Foundation for European Progressive Studies Advertisement

FEPS Progressive Yearbook

Twenty-twenty has been an extraordinary year. The Covid-19 pandemic and the multidimensional crisis that it triggered have boosted existing trends and put forward new challenges. But they have also created unexpected opportunities to set a new course of action for the European Union and—hopefully—make a remarkable leap forward in European integration.

The second edition of the Progressive Yearbook, the yearly publication of the Foundation for European Progressive studies, revolves around the exceptional events of 2020 and looks at the social, economic and political impact they will have in 2021. It is a unique publication, which aims to be an instrument for the progressive family to reflect on the recent past and look ahead to our next future.


CLICK HERE

Social Europe Publishing book

With a pandemic raging, for those countries most affected by Brexit the end of the transition could not come at a worse time. Yet, might the UK's withdrawal be a blessing in disguise? With its biggest veto player gone, might the European Pillar of Social Rights take centre stage? This book brings together leading experts in European politics and policy to examine social citizenship rights across the European continent in the wake of Brexit. Will member states see an enhanced social Europe or a race to the bottom?

'This book correctly emphasises the need to place the future of social rights in Europe front and centre in the post-Brexit debate, to move on from the economistic bias that has obscured our vision of a progressive social Europe.' Michael D Higgins, president of Ireland


MORE INFO

Hans Böckler Stiftung Advertisement

Renewing labour relations in the German meat industry: an end to 'organised irresponsibility'?

Over the course of 2020, repeated outbreaks of Covid-19 in a number of large German meat-processing plants led to renewed public concern about the longstanding labour abuses in this industry. New legislation providing for enhanced inspection on health and safety, together with a ban on contract work and limitations on the use of temporary agency employees, holds out the prospect of a profound change in employment practices and labour relations in the meat industry. Changes in the law are not sufficient, on their own, to ensure decent working conditions, however. There is also a need to re-establish the previously high level of collective-bargaining coverage in the industry, underpinned by an industry-wide collective agreement extended by law to cover the entire sector.


FREE DOWNLOAD

About Social Europe

Our Mission

Article Submission

Legal Disclosure

Privacy Policy

Copyright

Social Europe ISSN 2628-7641

Find Social Europe Content

Search Social Europe

Project Archive

Politics Archive

Economy Archive

Society Archive

Ecology Archive

.EU Web Awards