May 9, 2019

Hany Farid Says Facebook’s Artificial Intelligence System is Failing

From The New York Times

Facebook Auto-Generates Videos Celebrating Extremist Images

By The Associated Press

WASHINGTON — The animated video begins with a photo of the black flags of jihad. Seconds later, it flashes highlights of a year of social media posts: plaques of anti-Semitic verses, talk of retribution and a photo of two men carrying more jihadi flags while they burn the stars and stripes.

It wasn't produced by extremists; it was created by Facebook. In a clever bit of self-promotion, the social media giant takes a year of a user's content and auto-generates a celebratory video. In this case, the user called himself "Abdel-Rahim Moussa, the Caliphate."

"Thanks for being here, from Facebook," the video concludes in a cartoon bubble before flashing the company's famous "thumbs up."

Facebook likes to give the impression it's staying ahead of extremists by taking down their posts, often before users even see them. But a confidential whistleblower's complaint to the Securities and Exchange Commission obtained by The Associated Press alleges the social media company has exaggerated its success. Even worse, it shows that the company is inadvertently making use of propaganda by militant groups to auto-generate videos and pages that could be used for networking by extremists...

Hany Farid, a digital forensics expert at the University of California, Berkeley, who advises the Counter-Extremism Project, a New York and London-based group focused on combatting extremist messaging, says that Facebook's artificial intelligence system is failing. He says the company is not motivated to tackle the problem because it would be expensive.

"The whole infrastructure is fundamentally flawed," he said. "And there's very little appetite to fix it because what Facebook and the other social media companies know is that once they start being responsible for material on their platforms it opens up a whole can of worms."

Read more...

Professor Hany Farid has a joint appointment at UC Berkeley in the School of Information and EECS.

Last updated:

May 15, 2019