The Evaluation of Equity-Focused Community Coalitions: A Review of the Empirical Literature
Article Sidebar
Main Article Content
Abstract
Conducting evaluation and research with community coalitions involved in health equity initiatives is inherently complex. In this paper we provide a review and synthesis of the empirical literature on the evaluation of equity-focused community coalitions. We explore issues, challenges, and barriers experienced by evaluators, as well as techniques and approaches that were considered beneficial. Our review identified 11 peer reviewed articles, from which we identified seven overlapping themes: (1) framing equity in the evaluation process, (2) use of multiple theoretical frameworks, (3) use of systems-focused approaches, (4) strategic use of intersectoral partnerships and collaborations, (5) intentional communication and building trusting relationships, (6) challenges dedicating purposeful time to the work, and (7) issues of cultural and contextual clarity and responsiveness. Our findings point to a significant focus on context, history, learning, communication, relationships, and power. The cultural complexity and historical scope of each context, diversity of stakeholders, and enormity of the systemic issues involved, shape and challenge the evaluation and research process in fundamental ways, requiring a creative and kinetic thinking -- a shifting from methodological certainty to an acknowledged uncertainty, where mixing, blending and the innovative use of approaches and theories becomes a way of moving beyond the colonizing past.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright and Permissions
Authors retain full copyright for articles published in JMDE. JMDE publishes under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY - NC 4.0). Users are allowed to copy, distribute, and transmit the work in any medium or format for noncommercial purposes, provided that the original authors and source are credited accurately and appropriately. Only the original authors may distribute the article for commercial or compensatory purposes. To view a copy of this license, visit creativecommons.org
References
Backer, T.E. (2003). Evaluating community coalitions. NY, NY: Springer Publishing Company.
Braveman, P. (2006). Health disparities and health equity: Concepts and measures. Annual Review of Public Health, 27(167), 194. DOI: https://doi.org/10.1146/annurev.publhealth.27.021405.102103
Braveman, P. (2014). What is health equity: And how does a life-course approach take us further toward it? Maternal and Child Health Journal, 18(2), 366–372. DOI: https://doi.org/10.1007/s10995-013-1226-9
Braveman, P., & Gruskin, S. (2003). Defining equity in health. Journal of Epidemiology in Community Health, 57, 254–258. DOI: https://doi.org/10.1136/jech.57.4.254
Brown, K. K., Wolfe, S. M., & Price, A. W. (2020). New directions for the evaluation of coalitions and collaboratives. New Directions for Evaluation, 165, 181–185. DOI: https://doi.org/10.1002/ev.20396
Brown, L. D., Wells, R., Jones, E. C., & Chilenski, S. M. (2017). Effects of sectoral diversity on community coalition processes and outcomes. Prevention Science, 18(5), 600–609. DOI: https://doi.org/10.1007/s11121-017-0796-y
Bryan, V., Brye, W., Hudson, K., Dubose, K., Hansberry, S., & Arrieta, M. (2014) Investigating health disparities through community-based participatory research: Lessons learned from a process evaluation, Social Work in Public Health, 29(4), 318–334. DOI: https://doi.org/10.1080/19371918.2013.821356
Butterfoss, F. D. (2006). Process evaluation for community participation. Annual Review of Public Health, 27, 323–340. DOI: https://doi.org/10.1146/annurev.publhealth.27.021405.102207
Butterfoss, F. D., & Francisco, V. T. (2004). Evaluating community partnerships and coalitions with practitioners in mind. Health Promotion Practice, 5(2), 108–114. DOI: https://doi.org/10.1177/1524839903260844
CDC (Centers for Disease Control and Prevention). (2007). Racial and ethnic approaches to community health (REACH) U.S.: Finding solutions to health disparities. CDC.
Cacari-Stone, L., Wallerstein, N., Garcia, A. P., & Minkler, M. (2014). The promise of community-based participatory research for health equity: A conceptual model for bridging evidence with policy. American Journal of Public Health, 104, 1615–1623. DOI: https://doi.org/10.2105/AJPH.2014.301961
Christens, B.D., Butterfoss, F.D., Minkler, M., Wolff, T., Francisco, V.T., & Kegler, M.C. (2019). Learning from coalitions’ efforts to promote equity and justice. Health Education & Behavior, 46(1S), 110S-114S. DOI: https://doi.org/10.1177/1090198119871551
Dean-Coffey, J. (2018). What’s race got to do with it? Equity and philanthropic evaluation practice. American Journal of Evaluation, 39(4), 527–542. DOI: https://doi.org/10.1177/1098214018778533
Domlyn, A. M., & Coleman, S. (2019). Prioritizing equity: Exploring conditions impacting community coalition efforts. Health Equity, 3(1), 417–422. DOI: https://doi.org/10.1089/heq.2019.0061
Equitable Evaluation Project. (2017). The project: Project overview. Retrieved from https://www.equitableeval.org/project.
Fawcett, S., Schultz, J., Watson-Thompson, J., Fox, M., & Bremby, R. (2010). Building multisectoral partnerships for population health and health equity. Preventing Chronic Disease: Public Health Research, Practice, and Policy, 7(6), 1–7.
Gergen, K. J. (2015). From mirroring to world‐making: Research as future forming. Journal for the Theory of Social Behaviour, 45(3), 287–310. DOI: https://doi.org/10.1111/jtsb.12075
Goodman, R. M., Wandersman, A., Chinman, M., Imm, P., & Morrisey, E. (1996). An ecological assessment of community based interventions for prevention and health promotion: Approaches to measuring community coalitions. American Journal of Community Psychology, 24(1), 33–61. DOI: https://doi.org/10.1007/BF02511882
Granner, M. C., & Sharpe, P. A. (2004). Evaluating community coalition characteristics and functions: A summary of measurement tools. Health Education Research, 19(5), 514–532. DOI: https://doi.org/10.1093/her/cyg056
Greene, M. (1994). Epistemology and educational research: The influence of recent approaches to knowledge (Chapter 10). Review of Research in Evaluation, 20, 423–464. DOI: https://doi.org/10.3102/0091732X020001423
Haluza-DeLay, R. (2003). When the topic is racism: Research and advocacy with a community coalition. Social Justice, 30(4), 77–90.
Hilgendorf, A. E., Moore, T. R., Wells, A., & Stanley, J. (2020). Positioning health equity within a systems thinking framework to evaluate coalitions and collaborative initiatives. New Directions for Evaluation, 165, 91–102. DOI: https://doi.org/10.1002/ev.20403
Hopson R. K. (2003). Overview of multicultural and culturally competent program evaluation: Issues, challenges and opportunities. Social Policy Research Associates, The California Endowment.
Horvat, L., Horey, D., Romios, P., & Kis-Rigo, J. (2014). Cultural competence education for health professionals. The Cochrane Library, 5. DOI: https://doi.org/10.1002/14651858.CD009405.pub2
House, E. R., & Howe, D. (2000). Deliberative democratic evaluation. New Directions for Evaluation, 85, 3–12. DOI: https://doi.org/10.1002/ev.1157
Horowitz, C., & Lawlor, E. F. (2008). In Institute of Medicine (Ed.) Challenges and successes in reducing health disparities: Workshop summary. Jennifer A. Cohen, Rapporteur. The National Academies Press.
Kreuter, M. W., Lezin, N. A., & Young, L. A. (2000). Evaluating community-based collaborative mechanisms: Implications for practitioners. Health Promotion Practice, 1(1), 49–63. DOI: https://doi.org/10.1177/152483990000100109
Lo, C. C., & Cheng, T. C. (2011). Racial/ethnic differences in access to substance abuse treatment. Journal of Health Care for the Poor and Underserved, 22, 621–637. DOI: https://doi.org/10.1353/hpu.2011.0054
Maskill, C., & Hodges, I. (2001). Intersectoral initiatives for improving the health of local communities: A literature review. Ministry of Health.
McAfee, M., Blackwell, A.G., & Bell, J. (2015). Equity: The goal of collective impact. Policy Link: Oakland, CA.
Minkler, M., Rebanal, R. D., Pearce, R., & Acosta, M. (2019). Growing equity and health equity in perilous times: Lessons from community organizers. Health Education & Behavior, 46 (1S), 9S–18S. DOI: https://doi.org/10.1177/1090198119852995
McGuire, T. G., & Miranda, J. (2008). New evidence regarding racial and ethnic disparities in mental health: Policy implications. Health Affairs, 27, 393–403. DOI: https://doi.org/10.1377/hlthaff.27.2.393
Price-Haygood, E. G., Burton J., Fort, D., & Seoane, L. (2020). Hospitalization and mortality among Black patients and white patients with Covid-19. New England Journal of Medicine, 382(26), 2534–2543. DOI: https://doi.org/10.1056/NEJMsa2011686
Reid, A., Abraczinskas, M., Scott, V., Stanzler, M., Parry, G., Scaccia, J., Wandersman, A., & Ramaswamy, R. (2019). Using collaborative coalition processes to advance community health, well-being, and equity: A multiple-case study analysis from a national community transformation initiative. Health Education & Behavior, 46(1S), 100S-109S. DOI: https://doi.org/10.1177/1090198119838833
Scarcini, I.C., Moore, A., Benjamin, R., Vickers, S., Chikany, J. & Fouad, M. (2017). A participatory evaluation framework in the establishment and implementation of transdisciplinary collaboration centers for health disparities research. Evaluation & Program Planning, 60, 37-45. DOI: https://doi.org/10.1016/j.evalprogplan.2016.08.020
Schwandt T. A. (2002) Traversing the terrain of role, identity and self. In K. E. Ryan K.E. & T. A. Schwandt (Eds.), Exploring evaluator role and identity (pp. 193–207). Information Age Publishing.
Sen, A. (2002). Why health equity? Health Economics, 11(659), 666. DOI: https://doi.org/10.1002/hec.762
Sirdenis, T. K., Harper, G. W., Carrillo, M. D., Jadwin-Caknak, L., Loveluck, J., Pingel, E. S., Benton, A., Peterson, A., Pollard, R., & Bauermeister, J. A. (2019). Toward sexual health equity for gay, bisexual, and transgender youth: An intergenerational, collaborative, multisector partnerships approach to structural change. Health Education & Behavior, 46(1S), 88S–99S. DOI: https://doi.org/10.1177/1090198119853607
Substance Abuse and Mental Health Services Administration [SAMHSA]. (2011). Results from the 2010 National Survey on Drug Use and Health: Summary of national findings (NSDUH Series H-41, HHS Publication No. (SMA) 11-4658).
Substance Abuse and Mental Health Services Administration [SAMHSA]. (2015). Behavioral health barometer, United States, 2015 (HHS Publication No. SMA-16-Baro-2015).
Whitehead, M. (1991). The concepts and principles of equity and health. Health Promotion International, 6(3), 217–228 DOI: https://doi.org/10.1093/heapro/6.3.217
Whitehead, M. (1992). The concepts and principles of equity and health. International Journal of Health Services. 22(3), 429-445. DOI: https://doi.org/10.2190/986L-LHQ6-2VTE-YRRN
Williams, J., & Marxer, S. (2014, September 4). Bringing an equity lens to collective impact. Collective Impact Forum. http://collectiveimpactforum.org/resources/bringing-equity-lenscollective-impact
Wolfe, S. M., Long, P. D., & Brown, K. K. (2020). Using a principles-focused evaluation DOI: https://doi.org/10.1002/ev.20404
approach to evaluate coalitions and collaboratives working toward equity and social justice. New Directions for Evaluation, 165, 45–65.
Wolff, T., Minkler, M., Wolfe, S. M., Berkowitz, B., Bowen, L., Butterfoss, F. D., & Lee, K. S. (2016, Winter). Collaborating for equity and justice: Moving beyond collective impact. Nonprofit Quarterly, 42–53.