Social Networks and the Challenge of Hate Disguised as Fear and Politics
Keywords:Social Media, Fear Speech, Identity Politics, Shooter Manifestos, Hate Crimes
This case study examines social networks as the modern intersections of radical discourse and political extremism. But, as this research will show, extremist content in social networks, even that which has telegraphed violent hate crimes, is seldom communicated in textbook forms bigotry or provocations of violence. Today, the true challenge for social networks like Facebook and Twitter is addressing hate speech that reads more like fear mongering and identity politics, and thus, does not get flagged by monitors. From accounts dedicated to inciting fear over the “threat of immigrants” or “black crime,” to groups that form around hashtags declaring that a “#whitegenocide” is underway. These narratives represent the more ubiquitous versions of hate culture that permeate these popular spaces and radicalize cultural discourses happening there. This case study explores how such rhetoric has the same capacity to deliver messages of hate, and even incite violence, by investigating six hate crimes from 2019 that were preceded by social media diatribes. The comparative analysis will show how these examples mostly featured nonviolent expressions of cultural paranoia, rather than avowals of violence or traditional hate speech, thus making them harder to detect by programs seeking out such threats in plain sight. The research then examines the user policies of leading social networks to assess whether their guidelines on hateful and violent content are purposed to address the kinds of language that were espoused by these violent extremists. The study considers the strategies being employed by social networks to expose hateful content of all forms, and the need for more prominent counter narratives.
Alexander, A. (2017). Digital Decay: Tracing Change Over Time Among English-Language
Islamic State Sympathizers on Twitter. The George Washington University Program on Extremism. Retrieved February 14, 2021, from https://extremism.gwu.edu/sites/g/files/zaxdzs2191/f/DigitalDecayFinal_0.pdf
Alexander, H. (2016, June 16). Omar Mateen searched for Facebook posts about Orlando shooting while he was carrying it out. The Telegraph. Retrieved May 1, 2020, from https://www.telegraph.co.uk/news/2016/06/16/omar-mateen-searched-for-facebook-posts-about-orlando-shooting-w/
Allen, N. (2019, December 7). Saudi gunman called US 'nation of evil' before Florida shooting, monitoring group says. The Telegraph. Retrieved June 1, 2020, from https://www.telegraph.co.uk/news/2019/12/07/saudi-soldier-kills-four-wounds-eight-us-naval-base-shooting/
Anti-Defamation League (n.d.). Mainstreaming Hate: The Anti-Immigrant Movement in the U.S.. Retrieved May 1, 2020, from https://www.adl.org/the-anti-immigrant-movement-in-the-us
Ayad, M. (2019). 'The Baghdadi Net': How A Network of ISIL-Supporting Accounts Spread Across Twitter. London: Institute for Strategic Dialogue.
Berger, J.M. (2016). Nazis vs. ISIS on Twitter: A comparative study of White nationalist and ISIS online social media networks. George Washington University Program on Extremism. Retrieved May 1, 2020, from https://www.extremism.gwu.edu/sites/g/files/zaxdzs2191/f/downloads/Nazis%20v.%20ISIS.pdf
Bliuc, A.-M., Betts, J., Vergani, M., Iqbal, M., & Dunn, K. (2019). Collective identity changes in far-right online communities: The role of offline intergroup conflict. New Media & Society, 0(0). doi:10.1177/1461444819831779
Boulard, G. (1991, June 13). Former KKK Leader Duke Attacks Affirmative Action. Christian Science Monitor. Retrieved May 1, 2020, from https://www.csmonitor.com/1991/0613/13072.html
Brown, A. (2018). What is so special about online (as compared to offline) hate speech? Ethnicities, 18(3), 297–326. doi:10.1177/1468796817709846.
Buyse, A. (2014). Words of Violence: “Fear Speech,” or How Violent Conflict Escalation Relates to the Freedom of Expression. Human Rights Quarterly, 36(4), 779–797.
Byman, D. (2019). The Threat From Within. National Interest, 162, 52–60.
Caren, N., Jowers, K., & Gaby, S. (2012). A social movement online community: Stormfront and the white nationalist movement. Research in Social Movements, Conflicts and Change, 33, 163-193.
CBS News (2020, September 3). “Mark Zuckerberg: Flagging misinformation about mail-in- voting “will apply to the president.” Retrieved October 1, 2020, from
Comerford, M. (2020). Confronting the Challenge of Post-Organisational Extremism. Retrieved October 1, 2020, from https://www.orfonline.org/expert-speak/confronting-the-challenge-of-post-organisational-extremism/
Community Guidelines (n.d.). Instagram. Retrieved February 22, 2021, from https://help.instagram.com/477434105621119
Community Standards (n.d.). Facebook. Retrieved February 22, 2021, from https://www.facebook.com/communitystandards/hate_speech
Croucher, S. (2019, August 6). Twitter Account Linked to Connor Betts Suggests Dayton Shooter was Democrat-Supporting Satanist. Newsweek. Retrieved May 1, 2020,
Deem, A. (2019). The Digital Traces of #whitegenocide and Alt-Right Affective Economies of Transgression. International Journal of Communication, 13, 3183–3202.
Dwoskin, E. (2021, January 17). Misinformation dropped dramatically the week after Twitter banned Trump and some allies. Washington Post. Retrieved February 20, 2021, from https://www.washingtonpost.com/technology/2021/01/16/misinformation-trump-twitter/
Edwards-Levy, A. (2018). Most People Say Social Media Sites Should Crack Down On Harassment, Fake News: Poll. Huffington Post. Retrieved August 1, 2020, from https://www.huffpost.com/entry/social-media-harassment-fake-news-poll-alex-jones_n_5b7b1c53e4b0a5b1febdf30a
Ekins, E. (2017, November 8). 82% say it’s hard to ban hate speech because people can’t agree what speech is hateful. CATO Institute. Retrieved May 1, 2020, from https://www.cato.org/blog/82-say-its-hard-ban-hate-speech-because-people-cant-agree-what-speech-hateful
Feffer, J. (2019, October 21). Far Right Extremism Has Gone Mainstream. Retrieved June 1,
Ganesh, B. (2020). Weaponizing white thymos: flows of rage in the online audiences of the alt-right. Cultural Studies. doi: 10.1080/09502386.2020.1714687.
Gerbner, G. (1998). Cultivation Analysis: An Overview. Mass Communication & Society,1(3), 175–194. doi:10.1080/15205436.1998.9677855.
Giles, M., & Buckner, M. (1993). David Duke and Black Threat: An Old Hypothesis Revisited. The Journal of Politics, 44(3), 702–713.
Grady, C. (2019, August 5). The Dayton, Ohio, Shooter Reportedly Kept a ‘Rape List’ of Potential Victims. Vox. Retrieved August 1, 2020, from https://www.vox.com/identities/2019/8/5/20754918/dayton-ohio-shooter-rape-list-mass-shootings-misogyny-link.
Hartzell, S. L. (2020). Whiteness feels good here: interrogating white nationalist rhetoric on Stormfront. Communication and Critical/Cultural Studies, 17(2), 129-148. doi:10.1080/14791420.2020.1745858
Hutchinson, A. (2021, January 8). Will the Capitol riots prompt a re-think as to how social
platforms address free speech? Retrieved February 20, 2021, from https://www.socialmediatoday.com/news/will-the-capitol-riots-prompt-a-re-think-as-to-how-social-platforms-address/593092/
Johnson, N. F., Leahy, R., Restrepo, N. J., Velasquez, N., Zheng, M., Manrique, P., Wuchty,
S. (2019). Hidden resilience and adaptive dynamics of the global online hate ecology. Nature. doi:10.1038/s41586-019-1494-7
Maley, P. (2019, September 6). Christchurch shooter ‘a role model for extremists.’ The Australian, p. 6.
Maraniss, D. (1990, July 1). Campaigning in Code. Retrieved May 1, 2020, from https://www.washingtonpost.com/archive/politics/1990/07/01/campaigning-in-code/54d423af-21de-4a98-b5aa-4bb82775b63a/
Meleagrou-Hitchens, A., & Kaderbhai, N. (2017). Research perspectives on Online Radicalisation: A Literature Review 2006-2016. Retrieved May 1, 2020, from http://icsr.info/2017/05/icsr-vox-pol-paper-research-perspectives-online-radicalisation-literature-review-2006-2016/
McArdle, M. (2018, April 10). Sasse Grills Zuckerberg: If You’re Going to Police Hate Speech, Can You Define It? National Review. Retrieved August 1, 2020, from https://www.nationalreview.com/news/ben-sasse-mark-zuckerberg-hate-speech-policy-definitions/
McBride, J. (2019, December 12). David Anderson Social Media: He Was Likely ‘Dawada Maqabath.’ Heavy. Retrieved June 1, 2020, from https://heavy.com/news/2019/12/david-anderson-social-media-dawada-maqabath/
Morgan, M. (2010). Mean World Syndrome. Media Education Foundation. Retrieved June 1,
Müller, K., & Schwarz, C. (2018). Fanning the Flames of Hate: Hate Crimes and Social Media. The University of Warwick. Retrieved August 1, 2020, from https://warwick.ac.uk/fac/soc/economics/research/centres/cage/manage/publications/373-2018_schwarz.pdf.
Pane, L.M., & Dazio, S. (2019, September 21). US police assess rise in threat tips after 3 mass
killings. AP News. Retrieved May 1, 2020, from https://apnews.com/dd054d08eb904d3a92d9c46cb65c489b
Parvini, S. (2019, April 28). Poway synagogue shooting suspect linked to anti-Semitic Internet manifesto. Los Angeles Times. Retrieved June 1, 2020, from https://www.latimes.com/local/lanow/la-me-ln-synagogue-shooting-john-earnest-san-diego-20190428-story.html
Perrigo, B. (2019, March 15). 'A Game of Whack-a-Mole.' Why Facebook and Others Are Struggling to Delete Footage of the New Zealand Shooting. Time Magazine. Retrieved June 1, 2020, from https://time.com/5552367/new-zealand-shooting-video-facebook-youtube-twitter/
Phillips, J., & Yi, J. (2018). Charlottesville Paradox: The ‘Liberalizing’ Alt-Right, ‘Authoritarian’ Left, and Politics of Dialogue. Society, 55(3), 221–28.
Pickert, K. (2014). A Murderous Spree. Time Magazine, 183(22), 14.
Pohjonen, M. (2019). A Comparative Approach to Social Media Extreme Speech: Online Hate Speech as Media Commentary. International Journal of Communication, 13, 3088–3103.
Quinn, M. (2020, March 22). Mark Zuckerberg: 'Optimistic' AI tools to flag, remove hate speech on Facebook will be developed in 5-10 years. Washington Examiner. Retrieved May 1, 2020, from https://www.washingtonexaminer.com/news/mark-zuckerberg-optimistic-ai-tools-to-flag-remove-hate-speech-on-facebook-will-be-developed-in-5-10-years
Roose, K (2018, October 28). On Gab, an Extremist-Friendly Site, Pittsburgh Shooting Suspect Aired His Hatred in Full. New York Times. Retrieved May 1, 2020, from https://www.nytimes.com/2018/10/28/us/gab-robert-bowers-pittsburgh-synagogue-shootings.html
Sayimer, I., & Derman, M. (2017). Syrian Refugees as Victims of Fear and Danger Discourse in Social Media: A YouTube Analysis,” Global Media Journal: TR Edition 8(15) 384–403.
Scrivens, R., Gill, P., & Conway, M. (2020). In The Role of the Internet in Facilitating Violent Extremism and Terrorism: Suggestions for Progressing Research. In T.J. Holt & A.M. Bossler (Eds.), The Palgrave Handbook of International Cybercrime and Cyberdeviance (pp. 1-20). Cham: Springer International Publishing.
Simon Wiesenthal Center 2019 Digital Terrorism and Hate Report Card (2019, March 14).
Retrieved June 1, 2020, from http://www.wiesenthal.com/about/news/2019-digital-report-card.html
Twitter Rules and Policies (n.d.). Twitter. Retrieved February 22, 2021, from https://help.twitter.com/en/rules-and-policies/hateful-conduct-policy.
Von Behr, I., Reding, A., Edwards, C., & Gribbon, L. (2013). Radicalisation in the digital era. The use of the internet in 15 cases of terrorism and extremism. Brussels: RAND Europe.
Warner, B. (2010). Segmenting the electorate: The effects of exposure to political extremism online. Communication Studies, 61(4), 430-444. doi:10.1080/10510974.2010.497069
Wojcieszak, M. (2009). “Carrying online participation offline”: Mobilization by radical online groups and politically dissimilar offline ties. Journal of Communication, 59(3), 564–586.
Youngblood, M. (2020). Extremist ideology as a complex contagion: the spread of far-right radicalization in the United States between 2005 and 2017. Humanities and Social Sciences Communications, 7(1), 49. doi:10.1057/s41599-020-00546-3
YouTube Policies (n.d.). YouTube. Retrieved February 22, 2021, from https://support.google.com/youtube/answer/2801939?hl=en
Zannettou, S., Bradlyn, B., De Cristofaro, E., Kwak, H., Sirivianos, M., Stringini, G., & Blackburn, J. (2018). What is gab: A bastion of free speech or an alt-right echo chamber. Presented at the Companion Proceedings of the Web Conference 2018.
The JD Journal for Deradicalization uses a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND) Licence. You are free to share - copy and redistribute the material in any medium or format under the following conditions:
Attribution — You must give appropriate credit, provide a link to the license, andindicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
NonCommercial — You may not use the material for commercial purposes.
NoDerivatives — If you remix, transform, or build upon the material, you may not distribute the modified material.