*1.3. Application of Analytical Framework*

How this analytical framework might usefully reveal social learning's plural forms and even strengthen TD coproduction efforts is discussed in the context of a real-world case: a Toronto-based TD coproduction effort that took place over 2018–2019. This effort convened researchers from the University of Toronto, representatives of key funders (The Atmospheric Fund (TAF) and City of Toronto) and leaders of neighbourhood-scale interventions drawn from the region's climate action space, many of which carried out community engagements in their climate actions, campaigns and social change work. Their aim was to codevelop an evaluation framework that assesses the ongoing processes, short- to medium-term outcomes and longer and/or deeper sustainability impacts of small-scale sustainability-oriented interventions. This effort responded to the fact that much assessment of climate

action and community engagement interventions looks primarily at process issues (e.g., numbers of participants), and to some extent, at direct and indirect outcomes (e.g., short- to medium-term results such as reports and changes in organizational or individual behaviour as well as new policies and programs), but rarely at sustainability impacts (e.g., deeper, long-term results that contribute to sustainability transitions). By looking at a full suite of results, framework users (e.g., funders like TAF as well as intervention leaders) get a better sense of the individual and collective impact such climate interventions are having as well as the progress being made on implementing TransformTO, the City of Toronto's climate action plan [53,54]. Such a framework also provides a critical tool for project managers, who are asked to perform evaluations of their projects but who typically have few resources and little expertise in doing so.

The result of this TD coproduction effort was a multipronged (assessing projects at different stages), light-touch (cost-effective and easy to use), utilization-focused [55] (the results are valuable to intervention leaders as well as just funders) evaluation framework that enables assessment of a broad suite of results, namely, the processes, outcomes and sustainability impacts, of neighbourhoodor smaller-scale climate change interventions (see Figure 2). The primary method of evaluation consisted of a self-evaluation questionnaire, which may have been supplemented with a document analysis and/or an interview with an intervention affiliate (someone who was aware of the intervention but was at arm's length to it). The results of these methods were probing questions, insights and recommendations customized to the evaluation needs of framework users. The framework also functions as a knowledge-sharing platform—a mechanism for generating and sharing lessons learned by projects and facilitating peer-to-peer coaching and learning—in support of a learning community comprised of people working throughout the Greater Toronto and Hamilton Area's climate action and community engagement spaces. Although evaluation was the explicit focus of this group, social learning was deeply embedded in both the process of developing the framework and the framework itself.

**Figure 2.** Evaluation framework for neighbourhood-scale climate interventions.

From left to right, Figure 2 displays three evaluative tiers (left column): the first (top row) assesses ongoing intervention processes (including external community engagement processes and internal project management processes), the second (middle row) assesses short- to medium-term outcomes of an intervention and the third (bottom row) assesses contributions to deep or long-term sustainability impacts. For each tier, principles have been identified (middle column)—drawn from the literature and from the input of coproducers—that climate action interventions might strive to realize along

with assessment criteria for intervention leaders to self-evaluate the degree to which those principles are deemed important and apparent in their interventions, as evidenced by criteria (right column). Options for adding additional criteria and for stating that a criterion is not relevant are provided in the survey and interview instruments. Respondents' answers are checked and additional information is gleaned through a document analysis and interview with an arm's-length project affiliate.
