We know from history that change is challenging and evaluation practice in philanthropy will be no different. For that reason, the EE Team is dedicating time to develop an Impact, Influence, Leverage, and Learning agenda (thanks ORS Impact) which will help us determine the who, the how and the what which will advance this work. A new website live in the Spring will be an element of a more robust communication strategy. Generous funding from Ford and CalEndowment is resourcing EE to move from an idea to a multi-year initiative.
We likely all agree - 2017 was a challenging year for many reasons, but we were delighted to learn that the National Center for Responsible Philanthropy (NCRP) thinks that Equitable Evaluation was one reason for optimism. NCRP highlighted EE in its “Speaking Truth to Power” section, describing we are taking on the “sacred cows of research and evaluation to challenge how foundations measure performance and impact.” It’s true and we have our work cut out for us, but we are up for the challenge.
It’s great to see other people talking about Equitable Evaluation. In the Aspen Institute’s December 17 bi-weekly “So What?” they offered a recap of an end of year conversation around effectiveness and who defines it with perspectives from Vu Lee and Kathleen Enright. The entry ended with “we salute the like-minded funders and evaluators teaming up to define and promote Equitable Evaluation.” We agree.
We are THRILLED to share that the journey towards Equitable Evaluation will continue in 2018 with new and returning funding partners and a growing team of practice partners.
The timing of this conversation and the implications for evaluation practice is resonating with foundations, consultants, evaluators, and funded partners reflecting various geographic and issue areas of focus, sizes, and ages of maturity. In early 2018 we will share more leaving you in suspense for the remainder of the year.
On behalf of the team and even more importantly, for the world we all hope we get to live in. Thank you!
In Fall 2017, the Creative Measurement Lab (CML) pilot at Arizona State University launched. At the request of Dr. Maria R Jackson who leads the CML, Dr. Chera Reid of The Kresge Foundation provided an overview of Equitable Evaluation.
The CML Summit hosted a wide variety of participants -- national institutions, researchers, students, local community development organizations, and community organizers interested in comprehensive place-based strategies in vulnerable communities. A participant shared “I believe it gave a really important framing to something we were all hungry for, and contributed to a space in which folks were not only getting creative about the ways we might measure community expression of things like agency, narrative of place, social cohesion, etc., but also about the ways we might creatively and productively turn our gaze on systems and institutions that impact community planning and development.”
These are exactly the types of opportunities and experiences we want to hear about and influence. We look forward to learning from ASU.
Last fall after the Roundtable, The Nonprofit Institute at Portland State University reached out to the EE Team wanting to highlight the work to date and our aspirations in their blog The Nonprofit Nerd. Of course, we said yes. Read the full interview here.
We are exploring what might be possible with the Nonprofit Institute because we know that an integral partner in moving towards EE are non profit leaders and the communities they represent and serve.
We have been to CREA since its inaugural convening in 2013. We attend because it has been a place where we evaluation is situated within context and culture. There is vibrant and honest conversation about colonialism, imperialism and how that has affected people, communities, systems and countries. Values are front and center.
The draw for us this year was Dr. Ernie House whose paper Evaluation and The Framing of Race in AJE earlier this year was a provocative contribution to the conversation about race and evaluation. If you have not read it yet, do so. This conversation is in its early stages and will continue at this year’s American Evaluation Association annual conference, “Continuing the Dialogue Evaluation’s Call to Action, 21st Century Perspectives in Addressing Race.”* Our team member Jara Dean-Coffey will be on that panel.
This is all new territory. It will take time and patience to get it right but at least efforts are being made to bring it to the forefront.
* To see the panel abstract, you'll need to use the search function. For example, type "Race" into the Title area, or "Jara" into the Presenter area.
In September, the EE Team got around. We spread the word about equitable evaluation in multiple venues all of which were primarily focused on philanthropic practice and purpose. In general, people were intrigued, inspired, and interested in learning more and curious about how to seed the conversation in their organizations. We think we might be onto something.
Here is a quick overview:
New Grantmakers Institute - Introduced EE to a group of 70+ new grantmakers as one of the big ideas influencing strategy and evaluation in foundations.
Unity Summit - Attended by primarily philanthropic serving organizations and their funding partners, EE was introduced as part of a panel on how consultants can support DEI efforts.
Kresge Foundation - We had the opportunity to introduce EE to the Program Team as a part of a launch of a larger effort with Kresge around this work. More on that in a later post.
If you don’t know about CREA, you should. The Culturally Responsive Evaluation and Assessment conference hosted by the University of Illinois at Urbana-Champaign is where you go when you want to center evaluation and assessment in culture and context. EE team members have never missed a conference and the next one is September 27-29 in Chicago, IL.
This year Ernest R. House, PhD will be speaking to and about his paper “Evaluation and the Framing of Race.” It’s a thought provoking and personally revelatory piece that explains how racial framing influences evaluation practice.
Additionally the 3rd American Evaluation Association Race and Class Dialogue will take place during the conference. This series hosted by AEA is a series of national dialogues designed to reflect and promote positive actions on the deeply rooted, and structurally intertwined issues behind the headlines that propel racial, ethnic, and class disparities in our society.
On August 1st, 30+ learning and evaluation staff from foundations and consultants from across the country came together in Detroit at The Johnson Center to explore three paradigm shifting questions:
- How can our evaluation mindset and practices better reflect and advance the principles and values of equity?
- What does it take for foundations to build their organizational capacity, will, and wherewithal to engage in equitable evaluation?
- What can we do at a field level to ensure that more evaluators are prepared to practice equitable evaluation?
Starting with reviewing the 3 Equitable Evaluation Principles and unpacking the 9 Orthodoxies we quickly moved to naming additional orthodoxies before we shifted to identifying strategies to undo habits preventing equitable evaluation. The group was engaged and eager to begin to move practice forward in their own foundations/places of work as well as how to elevate this conversation in philanthropy more broadly.
See our working documents:
- Graphic Agenda
- Participant List
- Framing Paper for Participants
- EE Principles and 9 Orthodoxies
- Roundtable Summary Report
The EE Team was invited as a guest discussant for “Inside Out: Doing Race, Equity, Diversity, and Inclusion Work Internally” session moderated by Edward Jones from ABFE and focusing on the research by Putnam Consulting Group (see full paper or brief). A key finding was that foundations are interrogating the ways in which equity is influencing practice, internally and externally. However, as Jara Dean-Coffey shared with the audience both the “The Road to Achieving Equity: Findings and Lessons from a Field Scan of Foundations That Are Embracing Equity and the EE Project Framing Paper” revealed that “ few if any are looking at the ways in which equity is influencing the framing, purpose and practice of evaluation.” The audience reaction was primarily that of unrealized opportunity which suggests there is a readiness and willingness to deepen this work.
See the Agenda here.
We are excited to share our Framing Paper to set the stage for further conversation around equity in philanthropy and evaluation. It reflects briefly on the current “state of practice” of equity in both philanthropy and evaluation, and poses questions to consider. The content is based on a combination of a year-long research process that included a thorough review of philanthropic and evaluation literature, environmental scanning of equity work in philanthropy, and interviews with foundations and evaluators, as well as our own experiences in the field and conversations with other practitioners.
In a packed session, a group of 75 (standing room) foundation staff delved into the challenges of evaluation programs focused on promoting equity, explored how evaluation practices can advance racial equity goals, and discussed how equitable evaluation related to their own work. It was a lively discussion with quite a bit of activity on Twitter suggesting that the core principles of Equitable Evaluation resonated strongly. This was evident in being invited to submit a session for GEO 2018.
See the session materials here:
- Handout 1: World Cafe Equitable Evaluation Questions
- Handout 2: Equitable Evaluation Capacity Building Questions
- Handout 3: Equitable Evaluation Resources
The session was led by Teresa Behrens, Dorothy A. Johnson Center for Philanthropy, Jara Dean-Coffey, Luminare Group and Tom Kelly, Hawai’i Community Foundation.
At an invitational gathering in Detroit at The Johnson Center, we will discuss findings from research shared through a Framing Paper and explore examples of equitable evaluation principles, opportunities, and challenges to practices and recommendations for how to advance practice in philanthropy.
Dr. Teri Behrens, Jara Dean-Coffey, and Tom Kelly will facilitate a world cafe session delving into the challenges of evaluating programs focused on promoting equity, exploring how evaluation practices can advance racial equity goals, and how equitable evaluation relates to foundation work.
A set of 1-hour interviews were conducted with staff from foundations who had 1) explicitly named equity (or inequality) as an institutional focus and 2) a culture of evaluation (mature or developing).
A group of evaluation theorists, practitioners, foundation staff, and others engaged in equity work came together for dinner to learn about the project and offer words of wisdom. The dinner was graciously hosted by The Colorado Trust.
Through a Presidents’ Grant, Kresge is supporting the development and early stage implementation of a communication strategy. We will also facilitate a working session with Kresge staff to discuss our findings and potential implications for the foundation.
The Team conducts a literature review identifying more than 50+ papers with relevance to equity and evaluation practice in philanthropy and beyond. This informs a revised typology for understanding current ways in which foundations integrate equity from which we prepared a landscape scan to identify interview candidates. Note: The literature review and typology will be available Winter 2017.
The EE Project Team comes together to review timeline and the research begins.