The Use of a Scenario-Based Nominal Group Technique to Assess P/CVE Programs: Development and Pilot Testing of a Toolkit
Keywords:
Countering Violent Extremism, Preventing Violent Extremism, Systems, Nominal-Group TechniqueAbstract
Preventing and countering violent extremism (P/CVE) requires coordination among multiple agencies, stakeholders and systems. The complexity of this task (compounded by the variety of P/CVE programming around the world) creates a challenge for those hoping to develop these initiatives. The purpose of this project was to develop a replicable process and corresponding toolkit to engage multiple stakeholders in consensus building around the efficacy and improvement of nascent, developing or mature systems-level P/CVE programs. As a method, we adapted the process of nominal group technique (NGT), a structured-brainstorming tool that provides an orderly procedure for obtaining qualitative and ranked information from heterogenous participant pools. The technique we developed is based on a case-study approach (“scenario”) which we then tested in three countries (USA, Sweden, and North Macedonia) with existing P/CVE initiatives at different stages of development. We conducted scenario-based NGT sessions in each location and then systematically analyzed the results using iterative qualitative coding based on a common framework. Results were analyzed to achieve consensus on the most common system-level challenges and system-level functions, necessary to overcome those challenges, in each location. Practitioners in each local jurisdiction were then able to utilize the results derived from the NGT for their own purposes, such as advocacy to policy makers, strategic regional P/CVE planning, and ongoing stakeholder engagement.
Acknowledgments:
This project was funded by the NATO Science for Peace and Security Programme under the award entitled "Evaluation Support for CVE at the Local Level" SPS.MYPG5556, the Swedish Contingency Agency (MSB), and the U.S. Department of Homeland Security (DHS), Science and Technology Directorate (Cooperative Agreement Number: 2015-ST-108-FRG005). The content of this manuscript as well as the views and discussions expressed are solely those of the authors and do not necessarily represent the official views of any of the above institutions, nor does mention of trade names, commercial practices, or organizations imply endorsement by the U.S. government.
References
Savoia, E., et al., Assessing the Impact of the Boston CVE Pilot Program: A Developmental Evaluation Approach. Homeland Security Affairs, 2020. 16.
National Strategy for Counterterrorism of the United States of America. 2018: Office of the Director of National Intelligence.
CONTEST: The United Kingdom’s Strategy for Countering Terrorism. 2018: United Kingdom Home Office.
Indonesia and the Counter-Terrorism Efforts. 2019: Ministry of Foreign Affairs of the Republic of Indonesia.
Holdaway, L. and R. Sumpson, Improving the impact of preventing violent extremism programming: A toolkit for design, monitoring, and evaluation. 2018, International Alert: United Nations Development Programme & International Alert.
Holmer, G. and P. Bauman, Taking Stock: Analytic Tools for Understanding and Designing P/CVE Programs. 2018: United States Institute of Peace.
Designing Countering Violent Extremism Programs: A Strategic Overview. 2016: Seefar.
Mazerolle, L., et al., PROTOCOL: Police programs that seek to increase community connectedness for reducing violent extremism behaviour, attitudes and beliefs. Campbell Systematic Reviews, 2020. 16(1): p. e1076.
De Jong, J.T.V.M., A public health framework to translate risk factors related to political violence and war into multi-level preventive interventions. Social Science & Medicine, 2010. 70(1): p. 71-79.
Petrosino, A., et al., Cross-sector, multi-agency interventions to address urban youth firearms violence: A Rapid Evidence Assessment. Aggression and Violent Behavior, 2015. 22: p. 87-96.
Morrel-Samuels, S., et al., Community Engagement in Youth Violence Prevention: Crafting Methods to Context. J Prim Prev, 2016. 37(2): p. 189-207.
Multi-Agency Approach to Domestic Violence: New Opportunities, Old Challenges?, ed. N. Harwin, G. Hague, and E. Malos. 1999, London, England: Whiting & Birch Ltd.
Williams, M.J. and S.M. Kleinman, A utilization-focused guide for conducting terrorism risk reduction program evaluations. Behavioral Sciences of Terrorism and Political Aggression, 2014. 6(2): p. 102-146.
Khalil, J. and m. zeuthen, Countering Violent Extremism and Risk Reduction: A Guide to Programme Design and Evaluation. Whitehall Papers, 2016.
Harris-Hogan, S., How to evaluate a program working with terrorists? Understanding Australia’s countering violent extremism early intervention program. Journal of Policing, Intelligence and Counter Terrorism, 2020. 15(2): p. 97-116.
Horgan, J. and K. Braddock, Rehabilitating the Terrorists?: Challenges in Assessing the Effectiveness of De-radicalization Programs. Terrorism and Political Violence, 2010. 22(2): p. 267-291.
Beaghley, S., et al., Development and Pilot Test of the RAND Program Evaluation Toolkit for Countering Violent Extremism. 2017: RAND Corporation.
Fink, A., et al., Consensus Methods: Characteristics and Guidelines for Use. 1991: RAND Corporation.
Claxton, J.D., J.R.B. Ritchie, and J. Zaichkowsky, The Nominal Group Technique: Its Potential for Consumer Research. Journal of Consumer Research, 1980. 7(3): p. 308-313.
Collison, B.B. and S.F. Dunlap, Nominal Group Technique: A Process for In-Service and Staff Work. The School Counselor, 1978. 26(1): p. 18-25.
Søndergaard, E., et al., Using a modified nominal group technique to develop general practice. BMC Fam Pract, 2018. 19(1): p. 117.
Rankin, N.M., et al., Adapting the nominal group technique for priority setting of evidence-practice gaps in implementation science. BMC Med Res Methodol, 2016. 16(1): p. 110.
Aspinal, F., et al., What is important to measure in the last months and weeks of life?: A modified nominal group study. Int J Nurs Stud, 2006. 43(4): p. 393-403.
Dening, K.H., L. Jones, and E.L. Sampson, Preferences for end-of-life care: a nominal group study of people with dementia and their family carers. Palliat Med, 2013. 27(5): p. 409-17.
Paraskevas, A., Aligning strategy to threat: A baseline anti-terrorism strategy for hotels. International Journal of Contemporary Hospitality Management, 2013. 25.
Human Trafficking: Monitoring and Evaluation of International Projects Are Limited, but Experts Suggest Improvements. 2007: GAO - US Government Accountability Office.
2019 Hate Crime Statistics. 2019, Federal Bureau of Investigation Uniform Crime Reporting Program.
ADL, Hate crimes in 2019 reached highest level in a decade, FBI report shows, ADL Los Angeles, Editor. 2020, Anti-Defamation League: Anti-Defamation League - Los Angeles.
Rostami, A., et al., The Swedish Mujahideen: An Exploratory Study of 41 Swedish Foreign Fighters Deceased in Iraq and Syria. Studies in Conflict & Terrorism, 2020. 43(5): p. 382-395.
Gustafsson, L. and M. Ranstorp, Swedish Foreign Fighters in Syria and Iraq : An Analysis of open-source intelligence and statistical data. 2017: Stockholm: Försvarshögskolan (FHS). p. 135.
Swedish Security Service Yearbook 2019. 2019: Stockholm: Säkerhetspolisen.
Ranstorp, M., et al., Between Salafism and Salafi-Jihadism : Influence and Challenges for Swedish Society. 2019: Stockholm: Försvarshögskolan (FHS). p. 50.
Bjarnefors, S., Nazis want to be acquitted after the bombings, in Göteborgs-Posten. 2017.
Stojkovski, F. and N. Kalajdziovski, Extremism Research Forum – Macedonia Report. 2018, Western Balkans Extremism Research Forum, British Council: Western Balkans Extremism Research Forum, British Council.
Stojkovski, F. and N. Kalajdziovski, Community Perspectives on the Prevention of Violent Extremism in Macedonia. 2018: Berghof Foundation.
Azinović, V., Between Salvation and Terror: Radicalization and the foreign fighter phenomenon in the Western Balkans. 2017: Atlantic Initiative - Center for Security and Justice Research.
National Counterterrorism Strategy of the Republic of Macedonia (2018-2022). 2018: Government of the Republic of Macedonia - National Committee for Countering Violent Extremism and Countering Terrorism.
Downloads
Published
Issue
Section
License
Copyright (c) 2021 Rachael Piltch-Loeb, Megan K. McBride, Anna Ekström, Metodi Hadji-Janev, Rachel Nielsen, Richard Legault, Nigel Walsh Harriman, Elena Savoia
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
The JD Journal for Deradicalization uses a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND) Licence. You are free to share - copy and redistribute the material in any medium or format under the following conditions:
Attribution — You must give appropriate credit, provide a link to the license, andindicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
NonCommercial — You may not use the material for commercial purposes.
NoDerivatives — If you remix, transform, or build upon the material, you may not distribute the modified material.
