Pushing Thinking

deepen your practice

 

Systems Thinking, Evaluation, and Social Justice. Critical Issues Forum, 3 Powell, J., 2010

This paper recommends a systems approach to racial evaluation that examines not only the attitudes and behaviors of individuals, but also the policies and practices of organizations that contribute to a dynamic and interconnected system of advantage and disadvantage for certain groups. It suggests that racial justice evaluation frameworks should be designed to work in a dynamic context.

Considerations for Conducting Evaluation Using A Culturally Responsive And Racial Equity Lens Public Policy Associates, 2015

This guidebook prepared by Public Policy Associates is the result of more than three years of research to develop a new, more culturally responsive evaluation approach using a racial equity lens. This guide is intended to provide foundations with the tools to assemble more culturally competent teams, unlock insights from marginalized communities, and understand the impact of equity investments.

 

Evaluation with a Diversity Lens: Exploring its Function and Utility to Inform Philanthropic Effectiveness Millet, R.A., 2008

This article is the fifth in a series of Diversity in Philanthropy case studies that introduces the Evaluation with a Diversity Lens (EDL) approach. EDL is a tool to increase effectiveness and enhance racial justice goals by incorporating diverse voices throughout the evaluation including problem recognition, program design, implementation, and data analysis.

The Importance of Culture in Evaluation: A Practical Guide for Evaluators Lee, K., 2012

This report, prepared for The Colorado Trust, builds on a larger body of work regarding cultural competency in evaluation. It suggests that evaluators can begin conducting effective cross-cultural evaluations by concentrating on three dimensions of validity: culture, social identity and group membership, and privilege and power. It also provides example questions and strategies for evaluators to incorporate cultural competency in their work.

 

American Evaluation Association Public Statement on Cultural Competence in Evaluation American Evaluation Association, 2011, Fairhaven, MA: Author

This statement from the American Evaluation Association emphasizes the importance of incorporating cultural competence in every aspect of evaluation. It lays out essential practices for evaluators to conduct multiculturally valid evaluations.

How Do We Know When We See It? Critical Issues Forum, 3 - Leiderman, S., 2010

This paper discusses the challenge evaluators face to identify the impact of efforts to address structural racism. It provides perspective and guidance on how to engage in and apply a racial equity lens to research, analysis, and discussion. It includes examples of what indicators of “success” look like for various DEI outcomes.

 

Evaluation to Accelerate Progress Towards Equity, Social Justice, and Human Rights In Evaluation for Equitable Development Results (Part 1 Evaluation and Equity); Segone, M., 2012

This paper defines equity-focused evaluation and demonstrates it can be used to enhance and accelerate progress of equity policies and interventions.

Embracing Equity: 7 Steps to Advance and Embed Race Equality and Inclusion Within Your Organization Annie E. Casey Foundation, 2014

This tool introduces a seven step framework to approach the complex task of advancing and incorporating racial equity work into every area of an organization. It demonstrates how an organization working with systems, technical assistance providers, and communities can adopt a racial equity lens.

 

Raising the Bar – Integrating Cultural Competence and Equity: Equitable Evaluation The Foundation Review: Vol. 6: Iss. 2, Article 8. DOI: Dean-Coffey, J., Casey, J., and Caldwell, L. D., 2014

This article discusses the next step in advancing equity in the philanthropic sector by using the principles introduced by AEA’s statement on culturally competent evaluation to align an organizational mission with an equitable evaluation framework.  

Commissioning Multicultural Evaluation: A Foundation Resource Guide Inouye, T.E., Yu, H.C., and Adefuin, J., 2005

This resource guide was developed to support foundations in their shift to and commission of multicultural evaluation. Multicultural evaluation has the potential to produce more valid results, more accurate analysis, and to increase impact of racial justice programs by incorporating diverse voices in the evaluation framework.

 

Evaluation and the Framing of Race

A provocative piece by Dr Ernie House reflecting on his own racial framing and its history. House is an American academic specializing in program evaluation and education policy. His recent writings speak to the hidden bias in evaluation practice and ask that evaluators explore the ways in which white racial framing has created the evaluation we predominantly practice in the United States. 

Transformative Mixed Methods: Addressing Inequities

The framing offered here by Dr. Donna Mertens is central to the Equitable Evaluation and it introduces the importance of axiology and the need to make explicit what it is (or isn’t).

 

Raising the Bar- Integrating Culturally Responsive Evaluation and Equity: Equitable Evaluation

jdcPartnerships developed this article as a first step in opening a discussion of how philanthropy can use an equitable evaluation approach to apply the principles of the AEA statement. The belief being that in doing so program and evaluation efforts can be more aligned and in service of equity.  Research efforts are currently underway to explore in practice the ways in which philanthropy is using evaluation in service of its program aims, which focus on equity or social justice.

Considerations for Conducting Evaluation Using A Culturally Responsive And Racial Equity Lens   

Public Policy Associates spent more than three years developing a new approach to evaluation that is culturally responsive and addresses racial equity issues.  The guide provides practical insights on how to build teams and establish practices that yield greater insights and seek to ensure that programs are fair and equitable.

 

Equity-Focused Evaluations

This website is a resource center for evaluators to access selected material on how to design and manage Equity-focused evaluations. In each section, you will find a text presenting and explaining the content and additional technical resources for in-depth consultation.

In addition, a series of webinars on equity-focused evaluations gives you the opportunity to interact live with world-level evaluators. You can also download, free of charge, the book “How to design and manage equity focused evaluations”.

How to Design and Manage Equity–Focused Evaluations

This guide from UNICEF is divided into two parts. It begins by defining equity and its importance and relevance today. It then unpacks the concept that is equity-focused evaluation, explaining what its purpose should be and highlights potential challenges in its promotion and implementation. It is available in multiple languages.

 

The Battle of Narratives

During this one hour conversation between Haas Institute Director John Powell and Christina Livingston, the Executive Director of the Alliance of Californians for Community Empowerment (ACCE),the two delve into the power of stories, the influence of the dominant narrative in the US, and the challenge for social justice organizers to tell a different story that changes people’s hearts and minds.

Evaluation with a Racial Equity Lens

This slide deck by Sally Leiderman and Stephanie Leiderman of the Center for Assessment and Policy Development was developed for the Washington Area Women’s Foundation. It offers some of the big ideas and tensions around evaluation and its role as political tool (intended or not) in today’s society.

 

Reframing Evaluation: Defining an Indigenous Evaluation Framework

This paper by Joan LaFrance, Ed.D. and Richard Nichols introduces a framework that synthesizes Indigenous ways of knowing (key principles and four core values) common to tribal communities and Western evaluation practice.

American Evaluation Association Statement On Cultural Competence In Evaluation

Approved by AEA Membership in 2011, this statement affirms the significance of cultural competence in evaluation. It also informs the public of AEA’s expectations concerning cultural competence in the conduct of evaluation.

 

Beyond Rigor

Although focused on evaluations improve the quality, quantity and diversity of the STEM workforce, it has applicability more broadly. It is built on the premise that methodological rigor is not sufficient to learn about what works for different groups of people. By not having evaluation methods targeted toward the needs, issues, and goals of different subgroups, the results can be incomplete and even inaccurate.

Continuing the Journey to Reposition Culture and Cultural Context in Evaluation Theory and Practice (Evaluation and Society)

This book states that the shift from "simple" linear cause-effect models and reductionist thinking requires more holistic and culturally-responsive approaches in evaluation. This social science researchers and evaluators must engage culturally-responsive approaches in their work and mainstream university evaluation programs, philanthropic agencies, training institutes sponsored by federal agencies, professional associations, and other entities to promote professional evaluation practices that attend to CRE.

 

Handbook of Practical Program Evaluation

Chapter 12 starting on page 281 reflects current thinking and practice related to Culturally Responsive Evaluation (CRE) while also providing a historical record of its development, the theory that drives CRE - and sharing how practice and application informs CRE theory.

Considerations for Conducting Evaluation with a Culturally Responsive and Racial Equity Lens

This guide is designed to support evaluators to: assemble more culturally competent teams; craft more culturally-responsive evaluation designs; gain valuable perspectives from people who have previously been silent, ignored, or misunderstood; and more fully understand the reach, effectiveness, and impact of social investments.