Why Facebook’s New ‘Reputation Scores’ Could Be a Freedom Killer

August 25, 2018 Topic: Technology Region: Americas Blog Brand: The Buzz Tags: Big BrotherNSANational SecurityChinaSocial Media

Why Facebook’s New ‘Reputation Scores’ Could Be a Freedom Killer

What should we do about it?

China’s modern surveillance state would make even George Orwell blush. In a move that

surpasses the Big Brother tactics found in the pages of “1984,” Chinese President Xi Jinping has finally amassed seemingly unlimited power and information over his people, and technology has helped him do it. Given recent developments in the social media sphere, it is not unimaginable that the United States could follow a similar path—and that should terrify Americans.

China has implemented a frighteningly holistic social credit score system . The system evaluates the online behavior of Chinese citizens, monitors their banking and social media information, criminal record, religious beliefs and countless other factors the government doesn’t publicly disclose. These behaviors are used to calculate a score that dictates whether a Chinese citizen can travel within or outside of China, where they can live, and what jobs they can hold—among other things. Liberty in China is set only to diminish as the technological instrumentalities for such policing continue to improve.

The South China Morning Post notes that China’s technology and data accumulation abilities are quickly expanding. The government tracks dissidents through China-based social media companies, facial recognition technology, and even through the roving eyes of Hunger Games-style robotic doves—used by over thirty government agencies in more than five provinces in China. In short, there is nowhere to hide from the prying eyes of government in modern China.

Elizabeth Economy, a senior fellow at the Council on Foreign Relations, writes in her book “ The Third Revolution ” that many Chinese citizens aren’t opposed to these tactics. In fact, according to the Chinese people she interviewed, many citizens consider the social credit score system a good method of achieving a social good through the policing of bad behavior by their neighbors. This might also be the case in part because reporting bad behavior of neighbors can improve one’s social score. This parallels a similar attitude to the post-9/11 PATRIOT Act mentality of Americans, accepting massive infringements on civil liberties and justifying it by telling themselves there one has nothing to fear if one has nothing to hide.

 

Yet what happens when the behaviors considered “bad” by the government are not clearly defined?

This is where the West is at risk of the same collapse of liberty we’ve seen in China. As I noted in The Hill , the attitudes for policing speech and some instrumentalities are already in place for a full American adoption of a similar social scoring system. But, until now, tech companies’ willingness to police online behavior has been limited to small infractions: an occasional ban of a high profile figure or small, limited admissions by Twitter and Facebook that their algorithms discriminate unfairly against conservatives.

That has now changed.

The Washington Post reports that Facebook has begun assigning individuals a “reputation score” designed to measure the “credibility of users.” This adds concern to an already discomforting environment where a person who has their YouTube channel demonetized and gets banned from Twitter has been all but silenced and is thus unable to meaningfully contribute to public discourse. Imagine a scenario where companies refuse to do business with individuals deemed “malicious actors,” as Facebook described it. This is clear thought policing coming from a surprising source: private enterprise.

The U.S. government has not yet commandeered data companies and social media to threaten American's liberty to the extent the government has in China. But, there certainly ought to be a concern for two reasons. First, while some states are considering more expansive data protection laws , there are not many current regulations or mechanisms in place protecting consumer data from unauthorized use by tech companies and nothing to stop from this data ending up in the hands of the government. Furthermore, the idea that four to five companies have enough dominance in the modern marketplace to—if they so decided—effectively make perceived “malicious actors” irrelevant in the public sphere is foreboding enough on its own.

The concern over censorship in tech even attracted the attention of the American Civil Liberties Union (ACLU) recently. The outspoken liberal organization stepped into the conversation to denote the censorship of highly controversial conspiracy theorist Alex Jones on several social media platforms as “worrisome .” Even the ACLU likely recognizes that there is no alternative for mass communication when your living is made on the Internet. There is no real Twitter competitor. There’s no viable substitute to YouTube. This goes, too, for the other social media giants. Therefore, these titanic companies now shoulder the great responsibility to curate a free market space for ideas, even if they are not technically bound by the First Amendment.

The evolution of technology brings about positive good—but also unintended privacy abuses. Amazon’s Rekognition software is already available to many police departments across the country, granting governments the ability to match faces to identities of Americans in real time.