Competitive champions versus cooperative advocates Understanding advocates for evaluation

Main Article Content

Alison Frances Rogers
Amy M Gullickson, Associate Professor
Jean A King, Professor Emerita
Elizabeth McKinley, Professor

Abstract

Abstract

Background: Evaluation offers non-profit organizations an opportunity to improve their services, demonstrate achievements, and be accountable. The extant literature identifies individuals who can enhance the uptake of evaluation as evaluation champions. However, a paucity of detail is available regarding how to identify them and the support they require.


Purpose: This research investigated the characteristics and motivations of evaluation champions and examined how they promoted and embedded evaluation in an organizational system.


Setting: Australian human and social service non-profit organizations.


Research design: Drawing upon the literature and social interdependence theory, the research took an interpretivist perspective to collaboratively generate knowledge about evaluation champions. The aim was to understand and develop a reconstruction of the characteristics of individuals. This article constitutes a component of a larger research project.


Data Collection and Analysis: This research used purposive sampling to recruit champions working in Australian non-profit organizations, who were identified via descriptive criteria gleaned from a literature review. The research involved interviewing 17 champions, four of whom also participated in organizational case studies. Analysis of the semi-structured interviews and case studies generated information about the activities, strategies, motivations, and attributes of individuals who championed and advocated for evaluation.


Findings: This article argues that evaluation advocates is a preferable descriptor when attempting to embed evaluation by cultivating mutually beneficial interactions and cooperative working relationships. This research defines evaluation advocates as individuals who motivate others and provide energy, interest, and enthusiasm by connecting evaluation with colleagues’ personal aspirations and the organizational goals to make judgements about effectiveness. This article includes a field guide to facilitate evaluation advocates’ identification, recruitment, support, and development.

Downloads

Download data is not yet available.

Article Details

How to Cite
Rogers, A. F., Gullickson, A. M., King, J. A., & McKinley, E. (2022). Competitive champions versus cooperative advocates: Understanding advocates for evaluation. Journal of MultiDisciplinary Evaluation, 18(42). Retrieved from https://journals.sfu.ca/jmde/index.php/jmde_1/article/view/721
Section
Articles

References

Alaimo, S. (2008). Nonprofits and evaluation: Managing expectations from the leader’s perspective. New Directions for Evaluation, 119, 73–92. https://doi.org/10.1002/ev.269

Australian Taxation Office. (2019). Is your organisation not-for-profit? Australian Government. https://www.ato.gov.au/Non-profit/Getting-started/What-type-of-NFP-is-your-organisation-/

Bach-Mortensen, A. M., Lange, B. C. L., & Montgomery, P. (2018). Barriers and facilitators to implementing evidence-based interventions among third sector organisations: A systematic review. Implementation Science, 13(1), 1–19. https://doi.org/10.1186/s13012-018-0789-7

Benner, P. (2008). The SAGE encyclopedia of qualitative research methods. Sage Publications. https://doi.org/10.4135/9781412963909

Benton, A. D., Santana, A., Vinklarek, A. J., Lewis, C. M., Sorensen, J. M., & Hernandez, A. (2020). Peer-led sexual health education: Multiple perspectives on benefits for peer health educators. Child and Adolescent Social Work Journal, 37(5), 487–496. https://doi.org/10.1007/s10560-020-00661-9

Bourgeois, I. (2008). Understanding the dimensions of organizational evaluation capacity. [Doctoral Dissertation, University of Ottawa.] https://doi.org/10.20381/ruor-19808

Bourgeois, I., Whynot, J., & Thériault, T. (2015). Application of an organizational evaluation capacity self-assessment instrument to different organizations: Similarities and lessons learned. Evaluation and Program Planning, 50, 47–55. https://doi.org/10.1016/j.evalprogplan.2015.01.004

Brandon, P. R., Smith, N. L., & Hwalek, M. (2011). Aspects of successful evaluation practice at an established private evaluation firm. American Journal of Evaluation, 32(2), 295–307. https://doi.org/10.11771098214011401369

Bryman, A. (2012). Social research methods (4th ed.). Oxford University Press.

Buckley, J., Archibald, T., Hargraves, M., & Trochim, W. M. (2015). Defining and teaching evaluative thinking: Insights from research on critical thinking. American Journal of Evaluation, 36(3), 375–388. https://doi.org/10.1177/1098214015581706

Campbell, D. A., & Lambright, K. T. (2017). Struggling to get it right: Performance measurement challenges and strategies for addressing them among funders of human services. Nonprofit Management and Leadership, 27(3), 335–351. https://doi.org/10.1002/nml.21249

Carman, J. G., & Fredericks, K. A. (2010). Evaluation capacity and nonprofit organizations: Is the glass half-empty or half-full? American Journal of Evaluation, 31(1), 84–104. https://doi.org/10.1177/1098214009352361

Chaudhary, A. K., Diaz, J., Jayaratne, K. S. U., & Assan, E. (2020). Evaluation capacity building in the nonformal education context: Challenges and strategies. Evaluation and Program Planning, 79, 1–8. https://doi.org/10.1016/j.evalprogplan.2019.101768

Chubinski, J., Adcock, K., & Sprigg, S. (2019). Challenges and opportunities in philanthropic organizational learning: Reflections from fellow grantmakers. The Foundation Review, 11(1), 62–80. https://doi.org/10.9707/1944-5660.1454

Coakes, E., & Smith, P. (2007). Developing communities of innovation by identifying innovation champions. The Learning Organization, 14(1), 74–85. https://doi.org/10.1108/09696470710718366

Denzin, N. K. (2001). Interpretive interactionism (2nd ed.). Sage Publications.

Denzin, N. K., & Lincoln, Y. S. (2005). Introduction: The discipline and practice of qualitative research. In N. K. Denzin & Y. S. Lincoln (Eds.), The SAGE handbook of qualitative research (3rd ed., pp. 1–33). Sage Publications.

Deutsch, M. (2011). Cooperation and competition. In P. T. Coleman (Ed.), Conflict, interdependence, and justice: The intellectual legacy of Morton Deutsch (pp. 23–40). Springer. https://doi.org/10.1007/978-1-4419-9994-8_2

Doherty, B., Eccleston, R., Hansen, E., Natalier, K., & Churchill, B. (2015). Building evaluation capacity in micro community organisationsmore burden than benefit? Evaluation Journal of Australasia, 15(4), 29–37. https://doi.org/635481615176642

Donaldson, S. I., Gooler, L. E., & Scriven, M. (2002). Strategies for managing evaluation anxiety: Toward a psychology of program evaluation. American Journal of Evaluation, 23(3), 261–273. https://doi.org/10.1177/109821400202300303

Eisenhardt, K., & Graebner, M. (2007). Theory building from cases: Opportunities and challenges. Academy of Management Journal, 50(1), 25–32. https://doi.org/10.5465/amj.2007.24160888

Flodgren, G., O’Brien, M. A., Parmelli, E., & Grimshaw, J. M. (2019). Local opinion leaders: Effects on professional practice and healthcare outcomes (Review). Cochrane Database of Systematic Reviews, CD000125(6). https://doi.org/10.1002/14651858.CD000125.pub5

Fournier, D. M. (2005). Evaluation. In S. Mathison (Ed.), Encyclopedia of evaluation (p. 140). Sage Publications. https://doi.org/10.4135/9781412950558

Freddolino, P. P., Moxley, D. P., & Hyduk, C. A. (2004). A differential model of advocacy in social work practice. Families in Society, 85(1), 119–128. https://doi.org/10.1606/1044-3894.241

Gattiker, T. F., & Carter, C. R. (2010). Understanding project champions’ ability to gain intra-organizational commitment for environmental projects. Journal of Operations Management, 28(1), 72–85. https://doi.org/10.1016/j.jom.2009.09.001

Gay, B., & Weaver, S. (2011). Theory building and paradigms: A primer on the nuances of theory construction. American International Journal of Contemporary Research, 1(2), 24–32. https://doi.org/10.30845/aijcr

Gilchrist, D., & Butcher, J. (2016). Introduction. In J. Butcher & D. Gilchrist (Eds.), The three sector solution: Delivering public policy in collaboration with not-for-profits and business (pp. 3–22). ANU Press. https://doi.org/10.22459

Greenhalgh, T., Robert, G., Macfarlane, F., Bate, P., & Kyriakidou, O. (2004). Diffusion of innovations in service organizations: Systematic review and recommendations. Milbank Quarterly, 82(4), 581–629. https://doi.org/10.1111/j.0887-378X.2004.00325.x

Guerra-López, I., & Hicks, K. (2015). The participatory design of a performance oriented monitoring and evaluation system in an international development environment. Evaluation and Program Planning, 48, 21–30. https://doi.org/10.1016/j.evalprogplan.2014.09.003

Howell, J. M. (2005). The right stuff: Identifying and developing effective champions of innovation. The Academy of Management Executive, 19(2), 108–119. https://doi.org/10.5465/ame.2005.16965104

Johnson, D. W., & Johnson, R. (2003). Training for cooperative group work. In M. A. West, D. Tjosvold, & K. G. Smith (Eds.), International handbook of organizational teamwork and cooperative working (pp. 167–184). John Wiley & Sons. https://doi.org/10.1002/9780470696712.ch9

Johnson, D. W., & Johnson, R. (2015). Cooperation and competition. In J. D. Wright (ed.), International encyclopedia of the social & behavioral sciences (2nd ed., vol. 2, pp. 856–861). Elsevier. https://doi.org/10.1016/B978-0-08-097086-8.24051-8

King, J. A. (2005). A proposal to build evaluation capacity at the Bunche-Da Vinci Learning Partnership Academy. New Directions for Evaluation, 106, 85–97. https://doi.org/10.1002/ev.153

King, J. A. (2007). Developing evaluation capacity through process use. New Directions for Evaluation, 116, 45–59. https://doi.org/10.1002/ev.242

King, J. A., & Stevahn, L. (2013). Interactive evaluation practice: Mastering the interpersonal dynamics of program evaluation. Sage Publications. https://doi.org/10.4135/9781452269979

King, J. A., & Volkov, B. B. (2005). A framework for building evaluation capacity based on the experiences of three organizations. CURA Reporter, 3(35), 10–16.

Knight, J. (2017). Academic librarians as change champions: A framework for managing change. Library Management, 38(6/7), 294–301. https://doi.org/10.1108/lm-03-2017-0031

Labin, S. (2014). Developing common measures in evaluation capacity building: An iterative science and practice process. American Journal of Evaluation, 35(1), 107–115. https://doi.org/10.1177/1098214013499965

Macquarie Dictionary. (2016). Macquarie Dictionary Online. Macquarie Dictionary Publishers, Pan Macmillan Australia Pty Ltd. https://www.macquariedictionary.com.au.

Markham, S. K. (1998). A longitudinal examination of how champions influence others to support their projects. Journal of Product Innovation Management, 15(6), 490–504. https://doi.org/10.1111/1540-5885.1560490

Mason, S., & Hunt, A. (2018). So what do you do? Exploring evaluator descriptions of their work. American Journal of Evaluation, 40(3), 395–413. https://doi.org/10.1177/1098214018767049

Mayne, J. (2010). Building an evaluative culture: The key to effective evaluation and results management. The Canadian Journal of Program Evaluation, 24(2), 1–30.

Mintrom, M. (2019). So you want to be a policy entrepreneur? Policy Design and Practice, 2(4), 307–323. https://doi.org/10.1080/25741292.2019.1675989

Nielsen, S., Lemire, A., & Skov, M. (2011). Measuring evaluation capacityResults and implications of a Danish study. American Journal of Evaluation, 32(3), 324–344. https://doi.org/10.1177/1098214010396075

Norton, S., Milat, A., Edwards, B., & Giffin, M. (2016). Narrative review of strategies by organizations for building evaluation capacity. Evaluation and Program Planning, 58, 1–19. https://doi.org/10.1016/j.evalprogplan.2016.04.004

Pascale, R., & Sternin, J. (2005). Your company’s secret change agents. Harvard Business Review, 83(5), 72–81.

Patton, M. (2002). Qualitative evaluation and research methods (3rd ed.). Sage Publications.

Preskill, H., & Boyle, S. (2008a). A multidisciplinary model of evaluation capacity building. American Journal of Evaluation, 29(4), 443–459. https://doi.org/10.1177/1098214008324182

Preskill, H., & Boyle, S. (2008b). Insights into evaluation capacity building: Motivations, strategies, outcomes, and lessons learned. The Canadian Journal of Program Evaluation, 23(3), 147–174.

Preskill, H., & Torres, R. T. (1998). Evaluative inquiry for learning in organizations. Sage Publications.

Rogers, A., & Gullickson, A. (2018). Evaluation champions: A literature review. The Journal of MultiDisciplinary Evaluation, 14(30), 46–63.

Rogers, A., Kelly, L., & McCoy, A. (2019). Evaluation literacy: Perspectives of internal evaluators in non-government organizations. Canadian Journal of Program Evaluation, 34(1), 1–20. https://doi.org/10.3138/cjpe.42190

Rogers, P. J., & Williams, B. (2006). Evaluation for practice improvement and organizational learning. In I. Shaw, J. Greene, & M. Mark (Eds.), The SAGE handbook of evaluation: Policies, programs and practices (pp. 76–97). Sage Publications. https://doi.org/10.4135/9781848608078

Ronalds, P. (2016). The challenge of change. In J. Butcher & D. Gilchrist (Eds.), The three sector solution: Delivering public policy in collaboration with not-for-profits and business (pp. 337–352). ANU Press. https://doi.org/10.22459

Salamon, L. M., & Anheier, H. K. (1992). In search of the non-profit sector. I: The question of definitions. Voluntas: International Journal of Voluntary and Nonprofit Organizations, 3(2), 125–151. https://doi.org/10.1007/bf01397770

Schön, D. A. (1963). Champions for radical new inventions. Harvard Business Review, 41(2), 77–86.

Shaw, I., & Faulkner, A. (2006). Practitioner evaluation at work. American Journal of Evaluation, 27(1), 44–63. https://doi.org/10.1177/1098214005284968

Silliman, B., Crinion, P., & Archibald, T. (2016a). Evaluation champions: What they do, why they do it, and why it matters to organizations. Journal of Human Sciences and Extension, 4(3), 1–21.

Silliman, B., Crinion, P., & Archibald, T. (2016b). Evaluation champions: What they need and where they fit in organizational learning. Journal of Human Sciences and Extension, 4(3), 22–44.

Solitander, N., Fougère, M., Sobczak, A., & Herlin, H. (2012). We are the champions: Organizational learning and change for responsible management education. Journal of Management Education, 36(3), 337–363. https://doi.org/10.1177/1052562911431554

Stake, R. E. (1995). The art of case study research. Sage Publications.

Stake, R. E. (2006). Multiple case study analysis. Guilford Press.

Stockdill, S., Baizerman, M., & Compton, D. (2002). Toward a definition of the ECB process: A conversation with the ECB literature. New Directions for Evaluation, 93, 7–26. https://doi.org/10.1002/ev.39

Taylor, A., Cocklin, C., Brown, R., & Wilson-Evered, E. (2011). An investigation of champion-driven leadership processes. The Leadership Quarterly, 22(2), 412–433. https://doi.org/10.1016/j.leaqua.2011.02.014

Taylor-Powell, E., & Boyd, H. H. (2008). Evaluation capacity building in complex organizations. New Directions for Evaluation, 120, 55–69. https://doi.org/10.1002/ev.276

Volkov, B. B. (2011). Beyond being an evaluator: The multiplicity of roles of the internal evaluator. New Directions for Evaluation, 132, 25–42. https://doi.org/10.1002/ev.394

Wandersman, A. (2014). Moving forward with the science and practice of evaluation capacity building (ECB): The why, how, what, and outcomes of ECB. American Journal of Evaluation, 35(1), 87–89. https://doi.org/10.1177/1098214013503895

Warrick, D. D. (2009). Developing organization change champions. OD Practitioner, 41(1), 14–19.

Whitehall, A. K., Hill, L. G., & Koehler, C. R. (2012). A comparison of participant and practitioner beliefs about evaluation. American Journal of Evaluation, 33(2), 208–220. https://doi.org/10.1177/1098214011423803

Wiede, L. R. (2011). Characteristics of advocates: An exploration of skills and skill development used in the performance of advocacy work in the mental health profession. [Doctoral Dissertation, Loyola University Chicago] https://ecommons.luc.edu/cgi/viewcontent.cgi?article=1096&context=luc_diss.