Main Article Content
The study examines the transnational influence of American evaluation theorist Jennifer Greene’s ideas. Using mixed methods citation analysis, we investigate how Greene’s work in program evaluation theory on equity, democracy, and values engagement has impacted the field across countries. Rather than investigating theorist influence in a strictly quantitative way, we sought a contextualized, richer understanding of the contexts in which Greene’s ideas were being used to observe the imprint of her work on evaluators theorizing and practicing outside of the United States. To achieve this depth of knowledge required both quantitative and qualitative strategies as well as attention to geographical and cultural locations and translations. This study details a distinct methodological strategy for conducting research on evaluation theory.
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright and Permissions
Authors retain full copyright for articles published in JMDE. JMDE publishes under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY - NC 4.0). Users are allowed to copy, distribute, and transmit the work in any medium or format for noncommercial purposes, provided that the original authors and source are credited accurately and appropriately. Only the original authors may distribute the article for commercial or compensatory purposes. To view a copy of this license, visit creativecommons.org
Alkin, M. C. (2013). Evaluation roots: A wider perspective of theorists’ views and influences. Sage.
Arvidson, M., & Kara, H. (2013, October). Putting evaluations to use: From measuring to endorsing social value (Report no. 110). Third Sector Research Centre.
Blewden, M. B. (2014). Why do evaluators intentionally seek process use? Exploring meaning and reason as explanation [Doctoral dissertation, Massey University]. Massey University Archive.
Cavino, H. M. (2013). Across the colonial divide: Conversations about evaluation in Indigenous contexts. American Journal of Evaluation, 34(3), 339–355.
Chilisa, B., Major, E. T., Gaotlhobogwe, M., & Mokgolodi, H. (2016). Decolonizing and indigenizing evaluation practice in Africa: toward African relational evaluation approaches. Canadian Journal of Program Evaluation, 30(3), 313–328.
Chilisa, B., & Mertens, D. (2021). Indigenous made in Africa evaluation frameworks: Addressing epistemic violence and contributing to social transformation. American Journal of Evaluation, 42(2), 241–253.
Christie, C. A. (2003). What guides evaluation? A study of how evaluation practice maps onto evaluation theory. New Directions for Evaluation, 97, 7–35.
Cram, F., Pipi, K., & Paipa, K. (2018). Kaupapa Māori evaluation in Aotearoa New Zealand. New Directions for Evaluation, 159, 63– 77.
Datta, L. E. (1999). The ethics of evaluation neutrality and advocacy. New Directions for Evaluation, 82, 77–88.
Emerson, R. O. (2020). Evaluation use and evaluator competencies in low-income countries: A three article dissertation (Publication No. 27671557) [Doctoral Dissertation, University of Massachusetts Lowell]. ProQuest.
Goodnight, M. R. (2017). Learning to “measure what affects their lives”: Ethnography of a citizen-engaged evaluation of primary education in India (Publication No. 10599943) [Doctoral dissertation, University of California Los Angeles]. ProQuest.
Goodnight, M. R., & Avent, C. M. (2023). In pursuit of democratic values: Transnational influences on Jennifer Greene. In J. N. Hall, A. Boyce, & R. Hopson (Eds.), Disrupting program evaluation and mixed methods research for a more just society: The contributions of Jennifer C. Greene (pp. 165–180). Information Age Publishing.
Goodnight, M. R., Avent, C. M. & Kumaran, R. (2022). Employing mixed methods citation analysis to investigate transnational influence in evaluation theory [Manuscript submitted for publication]. University of Illinois at Urbana-Champaign, Department of Educational Psychology, Champaign, Illinois.
Greene J. C. (1997) Evaluation as advocacy. American Journal of Evaluation, 18(1), 25–35.
Greene, J. C. (2007). Mixed methods in social inquiry. John Wiley & Sons, Inc.
Greene, J. C. (2012). Values-engaged evaluation. In M. Segone (Ed.), Evaluation for equitable development results (pp. 192–206). UNICEF.
Greene, J. C. (2013). Making the world a better place through evaluation. Evaluation roots: A wider perspective of theorists’ views and influences (2nd ed., pp. 208–217). Sage.
Greene, J. C. (2015a). Culture and evaluation: From a transcultural Belvedere. In S. Hood, R. Hopson, & H. Frierson (Eds.), Continuing the journey to reposition culture and cultural context in evaluation theory and practice (pp. 91–107). Information Age Publishing.
Greene, J. C. (2015b). The emergence of mixing methods in the field of evaluation. Qualitative Health Research, 25(6), 746–750.
Greene, J. C. (2016). Advancing equity: Cultivating an evaluation habit. In S. Donaldson & R. Picciotto (Eds.), Evaluation for an equitable society (pp. 49–66). Information Age Publishing.
Greene, J. C., DeStefano, L., Burgon, H., & Hall, J. (2006). An educative, values-engaged approach to evaluating STEM educational programs. New Directions for Evaluation, 109, 53–71. https://doi.org/10.1002/ev.178
Greene, J. C., Millett, R. A., & Hopson, R. K. (2004). Evaluation as a democratizing practice. In M. T. Braverman, N. Constantine, & J. K. Slater (Eds.), Foundations and evaluation: Contexts and practices for effective philanthropy (pp. 96–118). Jossey-Bass.
Greenseid, L. O., & Lawrenz, F. (2011). Using citation analysis methods to assess the influence
of science, technology, engineering, and mathematics education evaluations. American Journal of Evaluation, 32(3), 392–407.
Hall, J. N., Boyce A., & Hopson, R. (2023). Disrupting program evaluation and mixed methods research for a more just society: The Contributions of Jennifer C. Greene. Information Age Publishing.
Heberger, A. E., Christie, C. A., & Alkin, M. C. (2010). A bibliometric analysis of the academic influences of and on evaluation theorists’ published works. American Journal of Evaluation, 31(1), 24–44.
Hood, S. (1998). Responsive evaluation Amistad style: Perspectives of one African American evaluator. In R. Davis (Ed.), Proceedings of the Stake Symposium on Educational Evaluation (pp. 101–112). University of Illinois.
Hood, S. (2001), Nobody knows my name: In praise of African American evaluators who were responsive. New Directions for Evaluation, 92, 31–44.
Hood, S., Hopson, R. K., & Kirkhart, K. E. (2015). Culturally responsive evaluation: Theory, practice, and future implications. In K. Newcomer, H. Hatry, & J. Wholey (Eds.), Handbook of practical program evaluation (4th ed., pp. 281–317). Wiley.
Izurieta, A., Sithole, B., Stacey, N., Hunter-Xenie, H., Campbell, B., Donohoe, P., Brown, J., & Wilson, L. (2011). Developing indicators for monitoring and evaluating joint management effectiveness in protected areas in the Northern Territory, Australia. Ecology and Society, 16(3).
Kim, H., & Cervero, R. M. (2007). How power relations structure the evaluation process for HRD programmes. Human Resource Development International, 10(1), 5–20.
King, J. (2003). The Challenge of studying evaluation theory. New Directions for Evaluation, 97, 57–67.
Kwok, W. L. (2013). Evaluating preventing violence against women initiatives: A participatory and learning-oriented approach for primary prevention in Victoria. Victorian Health Promotion Foundation, Melbourne, Australia.
LaFrance, J. (2004). Culturally competent evaluation in Indian Country. New Directions for Evaluation, 102, 39–50.
LaFrance, J. & Nichols, R. (2010). Reframing evaluation: Defining an indigenous evaluation framework. The Canadian Journal of Program Evaluation, 23(2), 13–31.
Lemire, S., Whynot, J., & Montague, S. (2019). How we model matters: A manifesto for the next generation of program theorizing. Canadian Journal of Program Evaluation, 33(3), 414–433.
Mathie, A., & Greene, J. C. (1997). Stakeholder participation in evaluation: How important is diversity? Evaluation and Program Planning, 20(3), 279–285.
Meho, L. I., & Yang, K. (2007). Impact of data sources on citation counts and rankings of LIS
faculty: Web of Science versus Scopus and Google Scholar. Journal of the American Society for Information Science and Technology, 58(13), 2105–2125.
Mertens, D. M., & Wilson, A. T. (2019). Program evaluation theory and practice: A comprehensive guide (2nd ed.). Guilford Press.
Moed, H. F. (2005). Citation analysis in research evaluation (Vol. 9). Springer Science & Business Media.
Nehaus, C. & Daniel, H. (2008). Data sources for performing citation analysis: An overview. Journal of Documentation, 64(2), 193–210.
Noruzi, A. (2005). Google Scholar: The new generation of citation indexes. LIBRI, 55(4), 170–180.
Quiedeville, S. (2017). Ex-post assessment of impacts of research on innovations for organic farming: Issues, methods, tools and instruments [Doctoral dissertation, Université De Montpellier. https://www.cairn.info/revue-journal-of-innovation-economics-2017-1-page-145.htm&wt.src=pdf.]
Pino, M. (2014) Los valores que sustentan el SIMCE: Pensando en un sistema de evaluación más allá de una medición estandarizada [The values that support SIMCE: Thinking about an evaluation system beyond a standardized measurement]. Politica Educativa, Chile.
Roseland, D., Greenseid, L. O., Volkov, B. B., & Lawrenz, F. (2011). Documenting the impact of multisite evaluations on the science, technology, engineering, and mathematics field. New Directions for Evaluation, 129, 39–48.
Shadish, W. R. (1998). Evaluation theory is who we are. American Journal of Evaluation, 19(1), 1–19.
Shadish, W. R., Cook, T. D., & Leviton, L. C. (1991). Foundations of program evaluation. SAGE.
Smith, N. L., & Brandon, P. R. (2008). Fundamental issues in evaluation (1st ed.). Routledge.
Streatfield, D., & Markless, S. (2011) Impact evaluation, advocacy and ethical research: Some issues for national strategy development? Library Review, 60(4), 312–327.
Thomas, V. G., & Campbell, P. B. (2021). Evaluation in today’s world: Respecting diversity, improving quality, and promoting usability. Sage.
Vallin, L. M., Philippoff, J., Pierce, S., & Brandon, P. R. (2015). Research-on-evaluation articles published in the American Journal of Evaluation, 1998–2014. New Directions for Evaluation, 148, 7–15.
Walters, W. H. (2016). Information sources and indicators for the assessment of journal reputation and impact. The Reference Librarian, 57(1), 13–22.