This core textbook explores public health program evaluation through an equity-focused and social justice lens. While providing fundamental knowledge, tools, practical skills, methods and theory, authors Patricia B. Campbell and Veronica G. Thomas challenge the dominant paradigm in planning and implementing health evaluation programs and examine the impact of power and privilege in evaluation.
Patricia B. Campbell, PhD, is the president of Campbell-Kibler Associates, Inc. She has been involved in research and evaluation with a focus on issues of race/ethnicity, gender, and disability for many years. Formerly an associate professor of research, measurement and statistics at Georgia State University, Dr. Campbell is an Association for Women in Science (AWIS) Fellow and was awarded the Willystine Goodsell Award by the American Educational Research Association (AERA) and the Betty Vetter Award by the Women in Engineering ProActive Network (WEPAN). Dr. Campbell has authored more than 120 publications including coauthoring, with Veronica Thomas, Evaluation in Today's World: Respecting Diversity, Improving Quality, and Promoting Usability. Her other publications include Building Evaluation Capacity: Guide I Designing A Cross Project Evaluation and Guide II Collecting and Using Data in Cross-Project Evaluations; A Framework for Evaluating Impacts of Informal Science Education Projects, Good Schools in Poor Neighborhoods: Defying Demographics; Achieving Success" and The AAUW Report: How Schools Shortchange Girls. Her current research interests focus on supports and barriers to biomedical researcher success, pathways to effective multidisciplinary research and the complexities of student engagement. Dr. Campbell's websites are www.BeyondRigor.org, which provides easy to use tips to improve the quality of evaluations with diverse populations, www.FairerScience.org which provides researcher and evaluators with tips and tools to more effectively communicate their diversity related research and evaluation findings to the media and the public and www.Campbell-Kibler.com, which provides free access to a number of her publications. Veronica G. Thomas, PhD, is a professor in the Department of Human Development and Psychoeducational Studies at Howard University. She also serves as the Evaluation and Continuous Improvement (ECI) director for the Georgetown-Howard Universities Center for Clinical and Translational Science (GHUCCTS). Dr. Thomas's research interests include culturally responsive evaluation, the physical and psychological well-being of Black families, with a particular focus on women and girls, and the academic and professional development of students of color. Her work has been funded by the National Science Foundation, the National Institutes of Health, the U.S. Department of Education, and the Women's College Coalition. In addition to co-authoring, with Patrica B. Campbell, Evaluation in Today's World: Respecting Diversity, Improving Quality, and Promoting Usability, over the years, Dr. Thomas has published numerous book chapters and refereed journals in outlets such as the American Journal of Evaluation, New Directions for Evaluation, Women and Health, the Journal of the National Medical Association, Journal of Community Genetics, Journal of Black Psychology, International Journal for the Advancement of Counselling, Family Relations, Adolescence, Journal of Adult Development, just to name a few. She has also served as an evaluator or evaluation training consultant for organizations and projects, including the Centers for Disease Control and Prevention OD2A (Overdose Data to Action), the National Alliance of State and Territorial AIDS Directors (NASTAD), Gaston & Porter Health Improvement Center (Prime Time Sister Circle Program), Northern Virginia Urban League (Resource Mothers' Program), Center for Substance Abuse Treatment (CSAT), and the Center for Substance Abuse Prevention (CSAP).
Preface Acknowledgements About The Authors Chapter 1: Using Evaluation as a Tool to Improve Health Programs and Reduce Health Disparities Introduction Overview of the Book's Focus, Framework and Structure An Overview of Evaluation and Related Concepts Evaluation Based on a Culturally Responsive, Racialized, and Social Justice Framework Rethinking Health and Health Disparity Program Evaluation Mistrust in Health Care and Government Chapter Reflection and Application Supplemental Resources Chapter 2: Bias, Discrimination, and Racism in Health and Health Programs: Implications for Evaluation Introduction Defining Race and Ethnicity in the United States Health Disparities, Health Inequities, and Health Equity Health Disparities, Health Inequities, and Health Equity Behind the Disparities Behind the Disparities Implications for Health Disparity Programs and their Evaluations The Deficit Model Medical Trust and Mistrust Chapter Reflection and Application Supplemental Resources Chapter 3: Theories of Health Behaviors and Program Evaluation Introduction What is Theory and Why is it Important? What is Theory and Why is it Important? Major Theories of Health Behaviors and Outcomes Major Theories of Health Behaviors and Outcomes Major Theories of Health Behaviors and Outcomes Major Theories of Health Behaviors and Outcomes Chapter Reflection and Application Supplemental Resources Chapter 4: Culturally Responsive and Equity-Focused Health Program and Evaluation Planning Introduction Importance of Needs Assessment in the Planning Process Key Issues and Questions Prior to Health Program Planning Integrating Health Program Planning and Evaluation Planning Health Planning Models Planning from a Culturally Responsive and Equity-Oriented Perspective Faulty Assumptions During the Program and Evaluation Planning Process Practical Steps in Health Program Planning and Evaluation Planning Tools to Guide Program and Evaluation Planning Chapter Reflection and Application Supplemental Resources Chapter 5: Ethics, Standards, and Social Justice Evaluation Approaches Introduction Ethics: Definition, Core Components, and Types Critical Thinking and Ethics Interplay Between Evaluation Ethics, Standards, and Social Justice Conflicts of Interest in Health Evaluations Culture, Ethics, and Evaluation Ethical Principles, Program Evaluation Standards, and Social Justice Evaluation Approaches with Ethical and Social Justice-Focus Ethics and Social Justice Considerations in Using AI in Health Program Evaluation Chapter Reflection and Application Supplemental Resources Chapter 6: Engaging with Priority Populations and Communities in Health Program Evaluations Introduction Engagement with Priority Populations: An Overview Social Justice Foundations for Engaging with Priority Communities The Value of Engagement and Examples Throughout the Evaluation Process Using Engagement to Increase Cultural Understandings and Equity Identifying Key Audiences for Engagement Activities Continuum of Engagement for Different Purposes and Potential Results Barriers to Engagement and Ways to Minimize Them Chapter Reflection and Application Supplemental Resources Chapter 7: Asking Evaluative Questions to Understand Program Outcomes and Advance Equity Introduction Distinguishing between Evaluation Questions and Research Questions Learning About the Program and Its Context Meaningful Evaluation Questions: Sources Beyond Project Goals Mitigating Power Dynamics When Identifying Evaluation Questions Characteristics of Good Evaluation Questions Types of Evaluation Questions AI and Generating Evaluation Questions Crosswalk of Evaluation Questions with Project Goals and Logic Model Chapter Reflection and Application Supplemental Resources Chapter 8: Selecting Measures and Collecting Data Introduction An Equity Based Framework for Selecting Measures and Collecting Data Criteria Behind Selecting and/or Developing Measures Using Existing Data Using Existing Measures Developing Measures for Health Program Evaluations Data Collection Building Trust Response Rates and Hard-to-Reach Groups Chapter Reflection and Application Supplemental Resources Chapter 9: Selecting and Using the Best Designs Introduction Evaluation Designs Complex Evaluation Designs Adapted from Health Research and Clinical Studies Comparison and Control Groups Rigor Expanding Concepts of Rigor Selecting An Evaluation Design Chapter Reflection and Application Supplemental Resources Chapter 10: Analyzing Health Program Data Introduction Deductive and Inductive Reasoning Analyzing Quantitative and Qualitative Data Inferential Statistics and Statistical Significance Qualitative Data Analysis Intersectionality, Disaggregation and Data Analysis Data Visualization Using Artificial Intelligence (AI) in Data Analysis Interpreting the Data Chapter Reflection and Application Supplemental Resources Chapter 11: Reporting and Disseminating Evaluation Findings that are Usable and Used Introduction Reporting Evaluation Results Types of Evaluation Reports Visual Representation of Data Universal Design Helping Audiences Engage with Evaluation Findings Using Artificial Intelligence Disseminating Results Making Results Usable and Used Chapter Reflection and Application Supplemental Resources Chapter 12: Moving Forward While Pushing Back Introduction The Framework Cross-Cutting Themes Underlying the Framework Defining Success Benefits and Barriers of Engagement Doing Evaluation in a Politicalized World Chapter Reflection and Application Supplemental Resources Appendix A: American Evaluation Association Evaluators' Ethical Principles Appendix B: Program Evaluation Standards Appendix C: Culturally Responsive and Equity-Focused Evaluations of Public Health Programs: Six Checklists References
This book is a very good resource for evaluation and health education specialists who work with diverse populations and need a cultural and inclusivity lens for conducting evaluations. -- Amar Kanekar The authors successfully bring a critical lens to program evaluation while maintaining plain language explanations, as well as opportunities for practice and reflection. The use of interviews with health practitioners models the authors' message to engage and co-create with the people who are most impacted by evaluation work. -- Kimberley Freire Campbell and Thomas's text is responsible and refreshing, inviting students into the world of evaluation that centers culture and DEI. This text does its part in helping to shift the culture of evaluation toward equity for the next generation of evaluators. -- Natalie E. Cook
