Competitive champions versus cooperative advocates Understanding advocates for evaluation
Article Sidebar
Main Article Content
Abstract
Background: Evaluation offers non-profit organizations an opportunity to improve their services, demonstrate achievements, and be accountable. The extant literature identifies individuals who can enhance the uptake of evaluation as evaluation champions. However, a paucity of detail is available regarding how to identify them and the support they require.
Purpose: This research investigated the characteristics and motivations of evaluation champions and examined how they promoted and embedded evaluation in an organizational system.
Setting: Australian human and social service non-profit organizations.
Research design: Drawing upon the literature and social interdependence theory, the research took an interpretivist perspective to collaboratively generate knowledge about evaluation champions. The aim was to understand and develop a reconstruction of the characteristics of individuals. This article constitutes a component of a larger research project.
Data Collection and Analysis: This research used purposive sampling to recruit champions working in Australian non-profit organizations, who were identified via descriptive criteria gleaned from a literature review. The research involved interviewing 17 champions, four of whom also participated in organizational case studies. Analysis of the semi-structured interviews and case studies generated information about the activities, strategies, motivations, and attributes of individuals who championed and advocated for evaluation.
Findings: This article argues that evaluation advocates is a preferable descriptor when attempting to embed evaluation by cultivating mutually beneficial interactions and cooperative working relationships. This research defines evaluation advocates as individuals who motivate others and provide energy, interest, and enthusiasm by connecting evaluation with colleagues’ personal aspirations and the organizational goals to make judgements about effectiveness. This article includes a field guide to facilitate evaluation advocates’ identification, recruitment, support, and development.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright and Permissions
Authors retain full copyright for articles published in JMDE. JMDE publishes under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY - NC 4.0). Users are allowed to copy, distribute, and transmit the work in any medium or format for noncommercial purposes, provided that the original authors and source are credited accurately and appropriately. Only the original authors may distribute the article for commercial or compensatory purposes. To view a copy of this license, visit creativecommons.org
References
Alaimo, S. (2008). Nonprofits and evaluation: Managing expectations from the leader’s perspective. New Directions for Evaluation, 119, 73–92. https://doi.org/10.1002/ev.269
Australian Taxation Office. (2019). Is your organisation not-for-profit? Australian Government. https://www.ato.gov.au/Non-profit/Getting-started/What-type-of-NFP-is-your-organisation-/
Bach-Mortensen, A. M., Lange, B. C. L., & Montgomery, P. (2018). Barriers and facilitators to implementing evidence-based interventions among third sector organisations: A systematic review. Implementation Science, 13(1), 1–19. https://doi.org/10.1186/s13012-018-0789-7
Benner, P. (2008). The SAGE encyclopedia of qualitative research methods. Sage Publications. https://doi.org/10.4135/9781412963909
Benton, A. D., Santana, A., Vinklarek, A. J., Lewis, C. M., Sorensen, J. M., & Hernandez, A. (2020). Peer-led sexual health education: Multiple perspectives on benefits for peer health educators. Child and Adolescent Social Work Journal, 37(5), 487–496. https://doi.org/10.1007/s10560-020-00661-9
Bourgeois, I. (2008). Understanding the dimensions of organizational evaluation capacity. [Doctoral Dissertation, University of Ottawa.] https://doi.org/10.20381/ruor-19808
Bourgeois, I., Whynot, J., & Thériault, T. (2015). Application of an organizational evaluation capacity self-assessment instrument to different organizations: Similarities and lessons learned. Evaluation and Program Planning, 50, 47–55. https://doi.org/10.1016/j.evalprogplan.2015.01.004
Brandon, P. R., Smith, N. L., & Hwalek, M. (2011). Aspects of successful evaluation practice at an established private evaluation firm. American Journal of Evaluation, 32(2), 295–307. https://doi.org/10.11771098214011401369
Bryman, A. (2012). Social research methods (4th ed.). Oxford University Press.
Buckley, J., Archibald, T., Hargraves, M., & Trochim, W. M. (2015). Defining and teaching evaluative thinking: Insights from research on critical thinking. American Journal of Evaluation, 36(3), 375–388. https://doi.org/10.1177/1098214015581706
Campbell, D. A., & Lambright, K. T. (2017). Struggling to get it right: Performance measurement challenges and strategies for addressing them among funders of human services. Nonprofit Management and Leadership, 27(3), 335–351. https://doi.org/10.1002/nml.21249
Carman, J. G., & Fredericks, K. A. (2010). Evaluation capacity and nonprofit organizations: Is the glass half-empty or half-full? American Journal of Evaluation, 31(1), 84–104. https://doi.org/10.1177/1098214009352361
Chaudhary, A. K., Diaz, J., Jayaratne, K. S. U., & Assan, E. (2020). Evaluation capacity building in the nonformal education context: Challenges and strategies. Evaluation and Program Planning, 79, 1–8. https://doi.org/10.1016/j.evalprogplan.2019.101768
Chubinski, J., Adcock, K., & Sprigg, S. (2019). Challenges and opportunities in philanthropic organizational learning: Reflections from fellow grantmakers. The Foundation Review, 11(1), 62–80. https://doi.org/10.9707/1944-5660.1454
Coakes, E., & Smith, P. (2007). Developing communities of innovation by identifying innovation champions. The Learning Organization, 14(1), 74–85. https://doi.org/10.1108/09696470710718366
Denzin, N. K. (2001). Interpretive interactionism (2nd ed.). Sage Publications.
Denzin, N. K., & Lincoln, Y. S. (2005). Introduction: The discipline and practice of qualitative research. In N. K. Denzin & Y. S. Lincoln (Eds.), The SAGE handbook of qualitative research (3rd ed., pp. 1–33). Sage Publications.
Deutsch, M. (2011). Cooperation and competition. In P. T. Coleman (Ed.), Conflict, interdependence, and justice: The intellectual legacy of Morton Deutsch (pp. 23–40). Springer. https://doi.org/10.1007/978-1-4419-9994-8_2
Doherty, B., Eccleston, R., Hansen, E., Natalier, K., & Churchill, B. (2015). Building evaluation capacity in micro community organisationsmore burden than benefit? Evaluation Journal of Australasia, 15(4), 29–37. https://doi.org/635481615176642
Donaldson, S. I., Gooler, L. E., & Scriven, M. (2002). Strategies for managing evaluation anxiety: Toward a psychology of program evaluation. American Journal of Evaluation, 23(3), 261–273. https://doi.org/10.1177/109821400202300303
Eisenhardt, K., & Graebner, M. (2007). Theory building from cases: Opportunities and challenges. Academy of Management Journal, 50(1), 25–32. https://doi.org/10.5465/amj.2007.24160888
Flodgren, G., O’Brien, M. A., Parmelli, E., & Grimshaw, J. M. (2019). Local opinion leaders: Effects on professional practice and healthcare outcomes (Review). Cochrane Database of Systematic Reviews, CD000125(6). https://doi.org/10.1002/14651858.CD000125.pub5
Fournier, D. M. (2005). Evaluation. In S. Mathison (Ed.), Encyclopedia of evaluation (p. 140). Sage Publications. https://doi.org/10.4135/9781412950558
Freddolino, P. P., Moxley, D. P., & Hyduk, C. A. (2004). A differential model of advocacy in social work practice. Families in Society, 85(1), 119–128. https://doi.org/10.1606/1044-3894.241
Gattiker, T. F., & Carter, C. R. (2010). Understanding project champions’ ability to gain intra-organizational commitment for environmental projects. Journal of Operations Management, 28(1), 72–85. https://doi.org/10.1016/j.jom.2009.09.001
Gay, B., & Weaver, S. (2011). Theory building and paradigms: A primer on the nuances of theory construction. American International Journal of Contemporary Research, 1(2), 24–32. https://doi.org/10.30845/aijcr
Gilchrist, D., & Butcher, J. (2016). Introduction. In J. Butcher & D. Gilchrist (Eds.), The three sector solution: Delivering public policy in collaboration with not-for-profits and business (pp. 3–22). ANU Press. https://doi.org/10.22459
Greenhalgh, T., Robert, G., Macfarlane, F., Bate, P., & Kyriakidou, O. (2004). Diffusion of innovations in service organizations: Systematic review and recommendations. Milbank Quarterly, 82(4), 581–629. https://doi.org/10.1111/j.0887-378X.2004.00325.x
Guerra-López, I., & Hicks, K. (2015). The participatory design of a performance oriented monitoring and evaluation system in an international development environment. Evaluation and Program Planning, 48, 21–30. https://doi.org/10.1016/j.evalprogplan.2014.09.003
Howell, J. M. (2005). The right stuff: Identifying and developing effective champions of innovation. The Academy of Management Executive, 19(2), 108–119. https://doi.org/10.5465/ame.2005.16965104
Johnson, D. W., & Johnson, R. (2003). Training for cooperative group work. In M. A. West, D. Tjosvold, & K. G. Smith (Eds.), International handbook of organizational teamwork and cooperative working (pp. 167–184). John Wiley & Sons. https://doi.org/10.1002/9780470696712.ch9
Johnson, D. W., & Johnson, R. (2015). Cooperation and competition. In J. D. Wright (ed.), International encyclopedia of the social & behavioral sciences (2nd ed., vol. 2, pp. 856–861). Elsevier. https://doi.org/10.1016/B978-0-08-097086-8.24051-8
King, J. A. (2005). A proposal to build evaluation capacity at the Bunche-Da Vinci Learning Partnership Academy. New Directions for Evaluation, 106, 85–97. https://doi.org/10.1002/ev.153
King, J. A. (2007). Developing evaluation capacity through process use. New Directions for Evaluation, 116, 45–59. https://doi.org/10.1002/ev.242
King, J. A., & Stevahn, L. (2013). Interactive evaluation practice: Mastering the interpersonal dynamics of program evaluation. Sage Publications. https://doi.org/10.4135/9781452269979
King, J. A., & Volkov, B. B. (2005). A framework for building evaluation capacity based on the experiences of three organizations. CURA Reporter, 3(35), 10–16.
Knight, J. (2017). Academic librarians as change champions: A framework for managing change. Library Management, 38(6/7), 294–301. https://doi.org/10.1108/lm-03-2017-0031
Labin, S. (2014). Developing common measures in evaluation capacity building: An iterative science and practice process. American Journal of Evaluation, 35(1), 107–115. https://doi.org/10.1177/1098214013499965
Macquarie Dictionary. (2016). Macquarie Dictionary Online. Macquarie Dictionary Publishers, Pan Macmillan Australia Pty Ltd. https://www.macquariedictionary.com.au.
Markham, S. K. (1998). A longitudinal examination of how champions influence others to support their projects. Journal of Product Innovation Management, 15(6), 490–504. https://doi.org/10.1111/1540-5885.1560490
Mason, S., & Hunt, A. (2018). So what do you do? Exploring evaluator descriptions of their work. American Journal of Evaluation, 40(3), 395–413. https://doi.org/10.1177/1098214018767049
Mayne, J. (2010). Building an evaluative culture: The key to effective evaluation and results management. The Canadian Journal of Program Evaluation, 24(2), 1–30.
Mintrom, M. (2019). So you want to be a policy entrepreneur? Policy Design and Practice, 2(4), 307–323. https://doi.org/10.1080/25741292.2019.1675989
Nielsen, S., Lemire, A., & Skov, M. (2011). Measuring evaluation capacityResults and implications of a Danish study. American Journal of Evaluation, 32(3), 324–344. https://doi.org/10.1177/1098214010396075
Norton, S., Milat, A., Edwards, B., & Giffin, M. (2016). Narrative review of strategies by organizations for building evaluation capacity. Evaluation and Program Planning, 58, 1–19. https://doi.org/10.1016/j.evalprogplan.2016.04.004
Pascale, R., & Sternin, J. (2005). Your company’s secret change agents. Harvard Business Review, 83(5), 72–81.
Patton, M. (2002). Qualitative evaluation and research methods (3rd ed.). Sage Publications.
Preskill, H., & Boyle, S. (2008a). A multidisciplinary model of evaluation capacity building. American Journal of Evaluation, 29(4), 443–459. https://doi.org/10.1177/1098214008324182
Preskill, H., & Boyle, S. (2008b). Insights into evaluation capacity building: Motivations, strategies, outcomes, and lessons learned. The Canadian Journal of Program Evaluation, 23(3), 147–174.
Preskill, H., & Torres, R. T. (1998). Evaluative inquiry for learning in organizations. Sage Publications.
Rogers, A., & Gullickson, A. (2018). Evaluation champions: A literature review. The Journal of MultiDisciplinary Evaluation, 14(30), 46–63.
Rogers, A., Kelly, L., & McCoy, A. (2019). Evaluation literacy: Perspectives of internal evaluators in non-government organizations. Canadian Journal of Program Evaluation, 34(1), 1–20. https://doi.org/10.3138/cjpe.42190
Rogers, P. J., & Williams, B. (2006). Evaluation for practice improvement and organizational learning. In I. Shaw, J. Greene, & M. Mark (Eds.), The SAGE handbook of evaluation: Policies, programs and practices (pp. 76–97). Sage Publications. https://doi.org/10.4135/9781848608078
Ronalds, P. (2016). The challenge of change. In J. Butcher & D. Gilchrist (Eds.), The three sector solution: Delivering public policy in collaboration with not-for-profits and business (pp. 337–352). ANU Press. https://doi.org/10.22459
Salamon, L. M., & Anheier, H. K. (1992). In search of the non-profit sector. I: The question of definitions. Voluntas: International Journal of Voluntary and Nonprofit Organizations, 3(2), 125–151. https://doi.org/10.1007/bf01397770
Schön, D. A. (1963). Champions for radical new inventions. Harvard Business Review, 41(2), 77–86.
Shaw, I., & Faulkner, A. (2006). Practitioner evaluation at work. American Journal of Evaluation, 27(1), 44–63. https://doi.org/10.1177/1098214005284968
Silliman, B., Crinion, P., & Archibald, T. (2016a). Evaluation champions: What they do, why they do it, and why it matters to organizations. Journal of Human Sciences and Extension, 4(3), 1–21.
Silliman, B., Crinion, P., & Archibald, T. (2016b). Evaluation champions: What they need and where they fit in organizational learning. Journal of Human Sciences and Extension, 4(3), 22–44.
Solitander, N., Fougère, M., Sobczak, A., & Herlin, H. (2012). We are the champions: Organizational learning and change for responsible management education. Journal of Management Education, 36(3), 337–363. https://doi.org/10.1177/1052562911431554
Stake, R. E. (1995). The art of case study research. Sage Publications.
Stake, R. E. (2006). Multiple case study analysis. Guilford Press.
Stockdill, S., Baizerman, M., & Compton, D. (2002). Toward a definition of the ECB process: A conversation with the ECB literature. New Directions for Evaluation, 93, 7–26. https://doi.org/10.1002/ev.39
Taylor, A., Cocklin, C., Brown, R., & Wilson-Evered, E. (2011). An investigation of champion-driven leadership processes. The Leadership Quarterly, 22(2), 412–433. https://doi.org/10.1016/j.leaqua.2011.02.014
Taylor-Powell, E., & Boyd, H. H. (2008). Evaluation capacity building in complex organizations. New Directions for Evaluation, 120, 55–69. https://doi.org/10.1002/ev.276
Volkov, B. B. (2011). Beyond being an evaluator: The multiplicity of roles of the internal evaluator. New Directions for Evaluation, 132, 25–42. https://doi.org/10.1002/ev.394
Wandersman, A. (2014). Moving forward with the science and practice of evaluation capacity building (ECB): The why, how, what, and outcomes of ECB. American Journal of Evaluation, 35(1), 87–89. https://doi.org/10.1177/1098214013503895
Warrick, D. D. (2009). Developing organization change champions. OD Practitioner, 41(1), 14–19.
Whitehall, A. K., Hill, L. G., & Koehler, C. R. (2012). A comparison of participant and practitioner beliefs about evaluation. American Journal of Evaluation, 33(2), 208–220. https://doi.org/10.1177/1098214011423803
Wiede, L. R. (2011). Characteristics of advocates: An exploration of skills and skill development used in the performance of advocacy work in the mental health profession. [Doctoral Dissertation, Loyola University Chicago] https://ecommons.luc.edu/cgi/viewcontent.cgi?article=1096&context=luc_diss.