Evaluation for Planetary Health
2.5 A transformative approach
The field of evaluation offers many avenues to make positive change, and it is up to evaluators both individually and collectively to design their approaches to create as much positive change as possible. As Patton says, this is where one can put their skin in the game (Patton, 2020). In particular, the elements below can be kept in mind for shaping your evaluation project.
Positive transformation can be enhanced by:
- Working at the nexus of natural and human systems, considering the broader context in our evaluations, locally and globally (Patton, 2020; Rowe, 2021; Uitto, 2021). Considering the evaluand into its own context matters (Uitto, 2021), while also considering interactions and dynamic relationships, which highlight the importance of system thinking (Magro et al., 2021; Magro & van den Berg, 2019; Patton, 2021b).
- Redefining accountability (Rodriguez-Bilella et al., 2021, p. 164).
“Evaluators should assume ‘some moral fiduciary responsibility’, not towards commissioners, but by defending the interests of those less able to do so for themselves, as stated by House (House, 2020, p. 32), yet also to be a voice for nature, elements and living species” (Brousselle, Bemner, et al., 2024).
Evaluators should be accountable towards other living species, nature, youth, and towards future generations (Brousselle et al., 2024a). This involves adopting a futurist/prospective reading of the challenges instead of focusing on the past only, as most evaluations do (Patton, 2021a). It is also an invitation to revisit who should be invited to participate in the evaluation project (Montrosse-Moorhead et al., 2019).
- Addressing the root causes of discrimination and giving voice to marginalized, colonized and oppressed people and communities (Mertens, 2023, 2024). Consider human rights violations, racism, discrimination and oppression based on sex and gender, color, religion, culture and origin, age, etc.
A transformative lens acknowledges that there are multiple perspectives, each expressing a different reality, where some voices are heard, and some are not. It is this inequality of whose voice matters that underpins our discussion about transformative evaluation. (Rodriguez-Bilella et al., 2021, p. 162)
- Revisiting the role of the evaluator.
“The role of the transformative evaluator is facilitative rather than directive – being in charge of the evaluation process and making judgements as an expert evaluator” (Rodriguez-Bilella et al., 2021, p. 163).
This is particularly true when working on Indigenous lands and with Indigenous people (see Exhibit 2.1). Evaluators should support self-determination and encourage Indigenous-led projects. That’s the only way to be as responsive as possible to local community cultures and principles. Where can we start?
A transformative evaluation design begins with a stage of building relationships as a first step to understand who needs to be included and how they can be included in ways that are culturally respectful (Mertens, 2018; Mertens & Wilson, 2019). (as cited in Mertens & Catsambas, 2021, p. 169)
Advocating for a more inclusive approach to evaluation—socially, by including a diversity of groups, and environmentally, by systematically integrating consideration of the environmental impacts of human activity—requires the evaluator to go beyond the traditional role of “knowledge creator” and to embrace the role of “social change agent” (Mertens, 2024).
Exhibit 2.1: Guiding principles for Indigenous evaluations
While recognizing that each Indigenous community possesses unique views, involving unique cultural, political and historical contexts, the four subject matter experts highlighted the following broad guiding principles as especially important to Indigenous approaches to evaluation and research. This list is not exhaustive, and additional detail with respect to the guiding principles presented here are included in the four papers appended to the report.
Relationships are central
Relationships are central to Indigenous approaches to evaluation and research practices. This includes relationships with the land, culture, community, people, ancestors, and spirituality.
Culturally responsive and community driven
Culturally responsive means that programs and services are respectful and relevant to the beliefs, practices, culture, and linguistic needs of diverse client populations and communities. It also requires the knowledge and capacity to respond to these needs. A culturally responsive evaluation or research study recognizes the need to bring to the forefront the land, language and cultural practices that are specific to those involved.
Elders, knowledge keepers, and healers
Developing partnerships with Elders, Indigenous knowledge keepers, and healers is essential because it ensures that their insights guide the work of the evaluation or research. It also allows for the inclusion of ceremonies and the sharing of medicines or sacred objects that are appropriate given the community context (Johnston, 2019; Rowe, 2019), and ensures that knowledge and sacred stories shared are not given away without permission.
Sharing personal experiences
Holding and honouring the stories of participants, communities and organizations is sacred and not to be taken lightly in Indigenous methods. How a community’s stories are used and presented is crucial to being accountable to the relationships established during the process. Evaluators and researchers have a responsibility to ensure that personal experiences and stories are represented accurately. This can be done by sharing preliminary findings with participants and asking that they review the draft report to validate the findings.
Strengths-based perspectives
Indigenous approaches to evaluation and research use strengths-based perspectives rather than deficit-based ones. A strengths-based perspective focuses on identifying the resources available to address problems in a positive way. Whereas, deficit-based perspectives focus on problems with outcomes, without taking into account the social or structural issues underpinning the conditions for Indigenous peoples. Evaluation must focus on strengths, recognize challenges, but also consider individual and community resilience. Strengths-based perspectives look for opportunities for growth, emphasize a community’s assets, and identify solutions to issues.
Decolonized approach
Indigenous approaches and methodologies to evaluation and research must take a decolonized approach that recognizes the intergenerational impacts of colonization on Indigenous peoples, their families and their communities. These approaches must consider the historical trauma and cultural repression experienced by Indigenous people.
Trauma-informed approach
Evaluators and researchers need to be aware of and understand a community’s history and understand the intergenerational impact of colonization and its associated negative impacts on the lives of Indigenous people. This will help to ensure that evaluation and research approaches or processes that have alienated Indigenous peoples in the past can be avoided. When a trauma-informed approach is used, the process can contribute to the well-being of the community decolonization, and reconciliation.
Ensuring appropriate timelines and resources
Indigenous approaches to evaluation and research cannot be rushed. It takes time to understand the context of a community or program; build meaningful, respectful and trusting relationships and approaches; allow for community engagement, hosting and attending ceremony; undertake meaningful data collection and analysis of results; and fulfil the need for reciprocity not only of the results but also for capacity-building. There also needs to be a sufficient budget to allow for relationship building, food, cultural protocol items, knowledge keeper and Elder gifts as well as travel.
Source: Bremner, L. K., Johnston, A. L. K., G., R., Sasakamoose, J., & Evans, J. (2020). Exploring Indigenous Approaches to Evaluation and Research in the Context of Victim Services and Supports. Summary by Jane Evans. Papers Submitted to the Department of Justice Canada by Larry K. Bremner, Andrea L.K. Johnston, Gladys Rowe, JoLee Sasakamoose, Department of Justice Canada/ Ministères de la Justice Canada (last accessed online on Aug 20, 2024), p. 6-8: https://www.justice.gc.ca/eng/rp-pr/jr/eiaer-eaame/docs/rsd_rr2020-indigenous-approaches-to-evaluation-and-research-eng.pdf.