Lista de talleres

La lista de talleres está organizada de manera poco estricta en orden cronológico. Todos los talleres se llevarán a cabo en Zoom a través de la plataforma de conferencias PheedLoop.

Evaluation Leaders Event: Leading Evaluation During Times of Change

Shawn Kanungo, Stephen Harrington, and federal deputy minister panelists

Viernes 30 de abril de 13:00 a 16:00

Nivel avanzado — Inglés

The past year has brought an extraordinary level of change to both the nature of evaluation work as well as how we carry that work out. As the world transforms, is evaluation keeping pace? What should evaluation leaders be thinking about to ensure our contributions are making a difference? This virtual symposium, aimed at both current as well as future leaders in evaluation, will broaden participants’ awareness and adaptability in this rapidly evolving environment, and equip them to maintain and bolster the relevance and timeliness of the evaluation function! Highlights include: keynote address by noted disruption strategist, Shawn Kanungo, on challenges in an age of innovation, transformation, and experimentation; a conversation with Deloitte’s National Lead – Workforce Strategy, Stephen Harrington, on transformative leadership; a dynamic panel featuring current and former federal deputy ministers, focusing on how to leverage change to fully realize the value of evaluation. The ELE will be an opportunity to get engaged in thinking about positioning evaluation now and for the future.

Shawn Kanungo
La estrategia en un mundo de disrupción

Shawn Kanungo es un estratega de la innovación mundialmente reconocido que opera en la intersección de la creatividad, los negocios y la tecnología. Ha estado en la base, trabajando estrechamente con cientos de organizaciones en su viaje hacia la transformación digital, y ha adoptado los conceptos de la economía del comportamiento, el diseño centrado en el usuario, el crowdsourcing, la inteligencia artificial, los drones y el cine para ayudar a crear experiencias de primera clase para los clientes. Kanungo es socio de Queen & Rook, donde asesora a organizaciones y ejecutivos líderes en tendencias disruptivas, e invierte en empresas en fase inicial. Su trabajo y sus entrevistas han aparecido en Forbes, The Globe and Mail, The Guardian, CBC y CTV. En 2016, fue reconocido como parte del «Top 40 Under 40» (Los mejores 40 menores de 40) de Avenue Magazine. Participó en TEDx en 2017, fue nombrado entre los «100 oradores de liderazgo más innovadores» de Inc en 2018, y en 2021, fue nombrado en Forbes como el «Mejor orador de conferencia virtual que he visto».

Stephen Harrington
Líder nacional de Deloitte – Estrategia de personal

Stephen es escritor y presentador sobre el futuro del trabajo y el lugar de trabajo del futuro desde 2011. Con 20 años de experiencia en consultoría, Stephen lidera transformaciones en la estrategia de talento que permiten a los clientes de Deloitte sentir el propósito personal y el impacto, mientras el negocio impulsa la mejora de los resultados. Stephen es coautor de Intelligence Revolution (La revolución de la inteligencia), un documento reciente sobre la cuarta revolución industrial y sus implicaciones para Canadá, en colaboración con la Asociación de Profesionales de Recursos Humanos de Ontario.

A Hands-On Introduction to Arts-Based Data Collection Tools for Evaluators

*LLENO*

Jennica Nichols, Maya Lefkowich

Lunes 3 de mayo y martes 4 de mayo de 11:00 a 14:30

Nivel intermedio — Inglés

Evaluators need diverse tools to engage with stakeholders and measure impacts. Arts-based methods are effective tools for promoting accessibility, engagement, and flexibility — creating new opportunities to answer evaluation questions in interesting ways. This workshop provides a window into how arts-based data collection can be used in evaluation. First, facilitators will introduce foundational concepts and unique aspects of arts-based methods (e.g. project design, creditability, ethics). Then, participants will engage in hands-on exercises to gain practical experience using two arts-based tools (drawing and photo elicitation). To build transferable skills, we will collectively explore real-world contexts and complementary arts-based tools (Photovoice, bodymapping, digital storytelling, and creative non-fiction). Finally, facilitators will share strategies to integrate arts into evaluation practice by addressing perceived barriers (funding, use, interest, client expectations).

Prerrequisitos: Participants should have a firm understanding of creating evaluation questions and designing evaluations. This will enable them to understand how arts-based data collection tools integrate into broader evaluation practice. Participants should have previous experience with quantitative and/or qualitative data collection and analysis. A passion for meaningful end user engagement and reciprocal evaluation practice is encouraged. No skills, experiences, or training with arts are required!

Objetivos

• You will be able to describe the unique opportunities and potential risks of using arts-based data collection tools in evaluation.
• You will be able to design your evaluation to include art-based data collection methods.
• You will be able to select between arts-based data collection methods depending on the evaluation question, context, and intended evaluation use.

Evaluating Coalitions and Community Collaboratives

Susan Wolfe, Ann Price

Lunes 3 de mayo y martes 4 de mayo de 11:00 a 14:30

Nivel intermedio — Inglés

This workshop provides practical steps for conducting community-based participatory evaluation, using data, and facilitating evaluation use with coalitions and collaboratives. We stress the importance of employing a utilization focused approach. The goal is to provide attendees with frameworks, information, techniques, and tools that will guide and support their work. Content includes an introduction to collaboratives; frameworks, models, and principles; the basics for evaluating collaboratives (approaches, methods, levels of evaluation, stages of development, measures and tools); overcoming collaborative evaluation challenges, using evaluation results with collaborative members, best practices to ensure success, and resources. The workshop will include cultural humility guidance and guidelines for incorporating measures of equity and justice into their evaluation, as well as guidance for developing genuine partnerships with communities for the evaluation processes.

Prerrequisitos: Basic evaluation knowledge and some evaluation experience.

Objetivos

• Apply models, frameworks, guiding principles, key concepts, and approaches to evaluation with collaboratives.
• Select and use available measures and tools to evaluate collaboratives and share findings and other data to facilitate planning and evaluation with collaborative members.
• Overcome challenges associated with evaluating coalitions and collaboratives while applying best practices and cultural humility to promote evaluation use.

Intro to Statistics for Better Decision-Making Discussions

*LLENO*

Carolyn Hoessler

Lunes 3 de mayo y martes 4 de mayo de 11:00 a 14:30

Nivel principiante — Inglés

With better statistical conversations and designs comes better-informed decision-making. Join for a practical professional workshop to brush up on what statistics is really about. This workshop focuses on a basic introduction to what statistics can be used for and can’t be used for, and how to discuss, raise and address concerns about the quality of statistical designs based on a four-part alignment framework that will help you to better describe and feel empowered to discuss statistics. Evaluators and partnering organizations often need to read and interpret reports and engage in dialogue, critique designs, and engage in decision-making discussions where statistics is held accurately or not as decisive evidence. This workshop will help you to better engage in these discussions and have an informed approach to addressing the quality of a statistical design for greater utilization of meaningful results.

Prerrequisitos: No prior knowledge of statistics is required. Some experience in evaluation contexts and discussions would be helpful as we will be discussing how to engage in conversations about statistics in those contexts.

Objetivos

• Describe the limits of statistics and appropriate uses
• Evaluate an evaluation design for alignment to determine good quality statistical use
• Feel empowered in their ability to discuss, explain and facilitate decision-making based on a statistical design

Indigenous Evaluation: Foundations, Relationships, Application, and Situational Responsiveness

*LLENO*

Carolee Dodge Francis, Nicole Bowman

Lunes 3 de mayo y martes 4 de mayo de 11:00 a 14:30

Nivel principiante — Inglés

Indigenous evaluation (IE) is a member of the culturally responsive evaluation family and thus framed within an Indigenous intersectionality as it relates to western evaluation. This practical and interactive workshop will facilitate learning and understanding of theories and methodologies associated with Indigenous evaluation for applied practice. Workshop participants will be shown strategies to build authentic relationships, professional practice matrices, and examples of how to co-design effective systems, programs, or collaborative project evaluation studies. Specifically, workshop participants will be instructed on how to conduct with (not on) Tribal nations and Indigenous communities. This session is based upon the four directions contained within the Lunaape Medicine Wheel. This pedagogical style aligns and integrates theoretical, methodological and traditional knowledge, along with cultural and community protocols for applied Indigenous evaluation.

Prerrequisitos: Participants are encouraged to bring their own case study if they want feedback for an evaluation design.

Objetivos

• Learn and understand what Culturally Responsive Indigenous Evaluation (CRIE) represents and where/how CRIE relates and is situated within Culturally Responsive Evaluation (CRE) along with the broader western context and history of evaluation.
• Understand the relationship of CRE and CRIE as essential scientific and cultural competencies and how to intertwine these skills in becoming professional, responsive, and ethical evaluation practitioners.
• Recognize why there is a critical need for capacity building for CRE and CRIE in order to bridge gaps and address needs within the evaluation profession, scientific literature, and evaluation practice.

Economic Foundations of Theories of Change

*LLENO*

Gregory Mason

Lunes 3 de mayo y martes 4 de mayo de 15:00 a 18:30

Nivel intermedio — Inglés

Economics can enrich and inform the theory of change and create more informative results chains. The economics covered in this session reach back to Adam Smith and the classic Wealth of Nations and move forward to the most recent developments in behavioural economics and game theory. Using ideas as public goods, sunk costs, market failure, moral hazard, externalities asymmetric information, and prospect theory, participants will gain insight into the economic foundation of the interventions used by government to guide the invisible hand. The workshop combines lectures with Socratic style seminar interactions. Two examples anchor the main ideas: 1) a vaccination program starts with the 1968 Axnick study on measles and continuing to current HPV vaccination programs; and 2) implementing a basic income using the Ontario Basic Income Pilot as the example. Participants need no prior knowledge of economics, and Lecture with Socratic seminar will be the teaching tools of choice.

Prerrequisitos: Evaluation theory and exposure to the design of program evaluations. Knowledge of the language of evaluation and its main tools. Understanding of the forms of government interventions. Courses in psychology and sociology would be an advantage.

Objetivos

• Apply an economic lens to the development of program theory, logic models, and results chains.
• Create more effective evaluation questions that probe program implementation and explore causal connections between interventions and outcomes.
• Critically assess proposed interventions using modern economics to support the creation/revision of programs and their implementation.

Consulting Boot Camp: What You Need to Know to Get Started

Gail Vallance Barrington

Lunes 3 de mayo y martes 4 de mayo de 15:00 a 18:30

Nivel intermedio — Inglés

Are you dreaming about becoming an independent consultant? For many, this prospect is both exciting and daunting. You ask: How do I get started? What kind of business skills do I need? Will there be enough work? Can I afford to do this? These and other unanswered questions may be holding you back. Join Gail Barrington, an independent consultant with more than 30 years experience, for this two-part workshop. Explore important start-up issues and reflect on your own consulting skills. Determine if consulting is an appropriate career choice for you and come away with an understanding of the skills you need to be successful. Key topics include personal characteristics; marketing; business planning; setting up shop; managing fees, time, and getting paid; and maintaining work-life balance. Valuable examples, worksheets, and stories will be shared. Through mini-lectures, small group discussion, interactive games, and personal reflection, participants will plan a start-up strategy.

Prerrequisitos: As a participant in this workshop, you need to have some evaluation experience and an understanding of the critical relationship between an evaluator and a client. The material presented is practical in nature and you will be asked to relate to relevant experiences in the field.

Objetivos

• Determine if consulting is an appropriate career choice.
• Define your competitive edge and consider appropriate marketing strategies for a complex world.
• Understand and plan for the basic skills needed to establish a small consulting practice.

Intégrer l’analyse comparative entre les sexes plus (ACS+) dans le processus d’évaluation : l’essentielle progression de la théorie à la pratique

François Dumaine

Lunes 3 de mayo, de 11:00 a 14:30

Nivel intermedio — Francés

On s’attend de toutes les évaluations fédérales à ce qu’elles considèrent l’analyse comparative entre les sexes plus (ACS+). À l’extérieur du cadre fédéral, beaucoup d’organismes s’intéressent également aux questions d’équité, de diversité et d’inclusion. Cet atelier vise deux objectifs. D’abord, permettre aux participants-es d’explorer l’interaction entre l’ACS+ et l’évaluation de programme. À bien des égards, il s’agit de deux processus d’analyse. Il faut maintenant comprendre là où ils peuvent se rejoindre et se compléter. Deuxièmement, les participants-es auront l’occasion d’explorer des stratégies pratiques leur permettant d’intégrer l’ACS+ dans leurs études évaluatives. Si l’intégration de l’ACS+ soulève d’importants défis, elle offre aussi de précieuses pistes permettant à l’évaluation de programme de s’acquitter de son rôle fondamental visant à comprendre toutes les dimensions de l’impact d’un programme.

Prerrequisitos: Il est hautement recommandé que les participants-es consultent l’information sur l’ACS+ contenue dans le site web de Condition féminine Canada et, si possible, de compléter le cours qui s’y trouve. Il serait également utile que les participants-es aient une certaine connaissance des théories de l’évaluation, particulièrement celles axées sur la justice sociale.

Objetivos

• Les participants-es apprendront comment intégrer l’ACS+ dans leur pratique de l’évaluation.
• Les participants-es élargiront leur connaissance des théories de l’évaluation axées sur la justice sociale.

Facilitating for Evaluation Using Zoom

Kylie Hutchinson

Lunes 3 de mayo, de 15:00 a 18:30

Nivel principiante — Inglés

Uh oh…Zoom fatigue! What’s an evaluator to do? In these times of pandemic, the usual participatory aspects of the evaluation process such as evaluation planning, data parties, and capacity-building have had to move online. But that doesn’t mean they have to be one-way and boring. In this fun and interactive workshop, we’ll look at: (1) basic and advanced Zoom features to make meetings more interactive; (2) other tools to promote online collaboration; (3) easy facilitation tips for keeping participants engaged; (4) simple techniques to promote equity, inclusion, and diversity online.

Prerrequisitos: None

Objetivos

• Participants will be able to describe how to use Zoom polls, chat, breakout rooms, whiteboards and annotation to increase engagement.
• Participants will be able to explain how sites such as Google Docs, Google Slides, Padlet and others can facilitate collaborative work online.
• Participants will be able to list three additional tips for keeping participants engaged.

Engaging Audiences Through Slide Design and Interaction: Your New Presentation Superpower!

*LLENO*

Sheila Robinson

Martes 4 de mayo y miércoles 5 de mayo, de 11:00 a 14:30

Nivel principiante — Inglés

Presentations are about audience learning. The goal is for participants to walk away with new understandings and abilities they can use in their own professional practice. Successful presenters work in service to this goal, whether presenting an evaluation report, giving a keynote, facilitating a workshop, or even running a meeting with stakeholders. In this immersive session, participants will learn and practice audience engagement and effective slide design. They will learn about more than a dozen ways to engage audiences and even more slide design techniques to enhance visual communication (there will be hands-on practice) – all to enable audiences to put new knowledge into practice in their own contexts. These are skills easily learned, guided by simple principles, but with the powerful potential to influence key connections between presenter and audience. The guiding principle here is, «Every presentation worth doing has just one purpose: To make change happen» -Seth Godin

Prerrequisitos: Participants should be comfortable using basic functions of PowerPoint to create slide presentations. Participants are strongly encouraged to engage in hands-on practice on their own computers. Instructor will send a practice PPT file with exercises to complete during the workshop. It will be ideal for participants to have two screens in use with the presentation on one and practice slides on the other, but they can use one screen and resize windows to see both if needed.

Objetivos

• Apply fundamental principles of audience engagement, facilitation, public speaking and slide design that inform presentation design and why these elements matter.
• Use design principles (intentional use of arrangement, balance, unity, hierarchy, color, size) to guide slide design, easily locate and incorporate visuals (images, graphics, icons) into slides, and reduce reliance on text-based slides.
• Effectively integrate audience engagement strategies (e.g., public speaking techniques, interactive activities) in various types of presentations for maximum participant satisfaction and learning.

Sustainability-Ready Evaluation: For young and emerging evaluators

Andy Rowe, Francois Dumaine, Debbie DeLancey

Martes 4 de mayo, de 15:00 a 18:30

Nivel principiante — Inglés

The world is facing unprecedented environmental threats yet evaluation with its focus on human systems is paying scant attention to sustainability and climate, and contributing little to efforts to forestall the climate and sustainability crises. A recent CES stock-taking indicates that the field of evaluation is ill prepared to incorporate natural systems into our work. However, this is changing, as CES is mainstreaming sustainability, and other national evaluation associations and global evaluation organisations are also moving in this direction. A lack of guidance, standards, training materials, and conceptual framings, as well as existing deep habits and practices that focus almost exclusively on human system impacts, present significant barriers to mainstreaming sustainability in evaluation theory and practice. This workshop will provide an overview of currently recognised core elements for evaluating sustainability and climate, and work with participants in small groups to identify how they might implement these as young and emerging evaluators. Changing well entrenched practices is itself challenging. Consequently, a goal of the workshop is to also identify strategies and actions that participants feel would assist them in engaging as valued contributors to this urgent need for sustainability-ready evaluators.

Prerrequisitos: All young and emerging evaluators who have some practical experience in evaluation are invited to this workshop.

Objetivos

• Young and emerging evaluators gain knowledge of core elements for evaluating sustainability and climate, and enhance their capacity to apply the critical elements to their work.
• Strategies, actions and practices will be identified to enable young and emerging evaluators to contribute to mainstreaming sustainability in evaluation in Canada and more widely.

Les niveaux d’analyse évaluative utilisés dans le domaine du développement international

Jean Serge Quesnel

Martes 4 de mayo, de 15:00 a 18:30

Nivel principiante — Francés

Les interventions de développement sont réalisées de façons interreliées et multi-dimensionnelles. Elles comprennent des initiatives simples et complexes qui obligent à chaque niveau une application de concepts singuliers aux fins d’une utilisation appropriée de l’évaluation. Nous aurons recours à six niveaux utilisés dans le domaine de l’évaluation du développement international. Le premier niveau d’analyse est celui des activités reliées aux transfert d’intrants de développement et le second niveau, celui des interventions ciblées que sont les projets. Le troisième niveau est celui des programmes réalisés en partenariat. Le quatrième niveau concerne l’efficacité des acteurs de développement. Le cinquième niveau est celui des stratégies d’intervention et le sixième, celui des politiques. Durant l’atelier on examinera les outils permettant l’analyse évaluative à chaque niveau et les liens entre les niveaux pour une meilleur utilisation de l’évaluation.

Prerrequisitos: Une connaissance générale de l’évaluation

Objetivos

• Les participants apprendront l’ensemble systémique de la fonction d’évaluation dans le domaine du développement international.
• Les participants apprendront les singularités de l’analyse évaluative aux divers niveaux d’intervention internationale.

Learning as You Go in Becoming Part of the Solution as a Blue Marble Evaluator (BME) in the Public Sector

Keiko Kuji-Shikatani

Miércoles 5 de mayo y jueves 6 de mayo, de 11:00 a 14:30

Nivel intermedio — Inglés

For evaluators both internal and external working directly/indirectly for/or with the social innovators in the public/not-for-profit sector who find themselves dealing with problems, trying out strategies, and striving to achieve goals that emerge from their engagement with the change process. BME is a global initiative focused on training the next generation of evaluators, urging us to know and face the realities of the Anthropocene & act accordingly. Various levels of governments in countries such as Canada are by far the largest stakeholders in transformative engagements where public servants, guided by principles of Democracy, Respect for People, Integrity, Stewardship & Excellence are entrusted to serve the people. Hands-on learning will show how BME can provide a framework for developing, adapting and evaluating major system change initiatives and transformation involving complex networks while rooted in utilization-focused, developmental, and principles-focused evaluation.

Prerrequisitos: This course is at the intermediate level and requires at minimum an intermediate understanding of program evaluation terms and methodology. Participants are encouraged to read about Developmental Evaluation, Principles-focused evaluation, Blue Marble Evaluation and familiarize themselves with the BME website https://bluemarbleeval.org/principles

Objetivos

• Participants will learn how to embed evaluative thinking to enable learning as you go by using iterative logic modeling to empower those who are working together toward common goals based on shared principles.
• Participants will learn how to zoom in and out to provide timely, meaningful, relevant, credible, and actionable information in support of systems change and, ultimately, transformation.
• Participants will learn how to be a BME and be part of the solution, utilizing principles-focused developmental evaluation as an intervention that informs innovative and adaptive development in complex realities of the Anthropocene.

Evaluative Thinking: Principles and Practices to Enhance Evaluation Capacity, Quality, and Utilization

*LLENO*

Thomas Archibald, Jane Buckley

Miércoles 5 de mayo y jueves 6 de mayo, de 11:00 a 14:30

Nivel principiante — Inglés

How does one «think like an evaluator»? How can program implementers learn to think like evaluators? Recent years have witnessed an increased use of the term «evaluative thinking,» yet this particular way of thinking, reflecting, and reasoning is not always well understood. Patton warns that as attention to evaluative thinking has increased, we face the danger that the term «will become vacuous through sheer repetition and lip service» (2010, p. 162). This workshop can help avoid that pitfall. Drawing from our research and practice in evaluation capacity building, in this workshop we use discussion and hands-on activities to address: (1) What evaluative thinking (ET) is and how it pertains to your context; (2) How to promote and strengthen ET among individuals and organizations with whom you work; and (3) How to use ET to identify assumptions, articulate program theory, and conduct evaluation with an emphasis on learning and adaptive management.

Prerrequisitos: None. Some familiarity with evaluation and/or evaluation capacity building is beneficial.

Objetivos

• Describe what evaluative thinking (ET) is and how it pertains to their context.
• Promote and strengthen ET among individuals and organizations with whom they work.
• Use ET to identify assumptions, articulate program theory, and conduct evaluation with an emphasis on learning, adaptive management, and overall enhanced utilization.

Designing for Impact: How to Apply Design Thinking for Better Programs and Evaluations

*LLENO*

Cameron Norman, John Gargani

Miércoles 5 de mayo y jueves 6 de mayo, de 15:00 a 18:30

Nivel intermedio — Inglés

This workshop is based on four years of experience introducing evaluators to design in the Design Loft, a part of the annual conference of the American Evaluation Association. In this workshop, you will: learn how design is both a way of thinking and a strategy for collaboration, apply practical tools and techniques to the design programs and evaluations, and discover how to harness feedback, teamwork, and iteration to create better programs and evaluations. We believe in hands-on learning in a studio format. So from the start, you and other participants will be challenged to work on design problems that evaluators commonly face, such as· describing programs in ways that make them more reliable and evaluable, basing programs and evaluations on a deep understanding of the people who are affected, and integrating evaluative thinking into program design, and integrating design thinking into evaluation.

Prerrequisitos: Participants do not require any advanced understanding of design methods, tools, or theory, however, a basic understanding of evaluation fundamentals is required. Participants must have some experience with planning and conducting evaluations to get the most from this workshop.

Objetivos

• Participants will learn how to apply design thinking to evaluation problems and situations.
• Participants will develop skills in using a variety of techniques, tools, and strategies from design to evaluation problems and situations.
• Participants will learn ways to enhance program and evaluation designs using design theory and related frameworks.

Effective Digital Reporting and Briefing

*LLENO*

John Burrett

Miércoles 5 de mayo, de 11:00 a 14:30

Nivel intermedio — Inglés

With a shift to digital communication as presently occurring, it is worthwhile to re-examine the briefing and reporting formats that we use, and look for variants that will work well on-screen. This workshop will: help you understand the limits of traditional briefing and reporting vehicles in the digital world; become aware of alternatives that you can easily adapt to your needs; and finally, how to actually produce clear and compelling digital reports and briefing materials. The last component will be achieved by guided practice, in groups, at producing digital reports from supplied story lines and charts. Among other key lessons learned, besides technical skills, are the skills of deciding on what to present, to whom, what narrative flows through the successive points, and what set of visuals most strongly and clearly support that narrative.

Prerrequisitos: Participants should have a basic knowledge of MS Excel and PowerPoint, and have those software packages on their computer.

Objetivos

• Understand the limits of traditional briefing and reporting, particularly when digital document distribution and meetings/briefings are the norm.
• Understand some alternative reporting and briefing materials, from the recent literature and practice, that could supplement or even replace current methods.
• Actually conceptualize, design and build several key forms of digital documents, working with others as a group, using common software tools.

User-Focused Content Analysis using NVivo: A “how-to” so you can improve the efficiency and effectiveness of your qualitative data analysis

*LLENO*

Allysa Olding, Stéphanie Jolette

Miércoles 5 de mayo, de 11:00 a 14:30

Nivel intermedio — Inglés

When analysing qualitative data evaluators face the challenge of being faithful to indicators established at the outset while remaining responsive to emerging themes in our data and changes in the information needs of our clients over time. In this expert tutorial, participants will learn how to harness the power of NVivo software to respond to these challenges and get the information your clients need from qualitative data. This workshop will demonstrate a flexible theme-based coding approach to sort and analyse interview data using NVivo software. Using this method, participants will be able to quickly and efficiently analyse interview responses, allowing them to respond effectively to the needs of their program partners. At this workshop, participants will learn how to use an evaluation matrix to develop an efficient node structure which can be flexibly applied to qualitative data to quickly recall different types of information.

Prerrequisitos: A basic understanding of the functions of NVivo will help ensure that participants get the most out of this workshop. At a minimum, participants should be familiar with how to “code” written texts in NVivo using an existing node hierarchy.

Objetivos

• After completing our workshop, participants will be able to use their evaluation matrix to develop a comprehensive node structure in NVivo.
• After completing our workshop, participants will be able to understand and apply the query functions in NVivo to recall key information from qualitative data.
• After completing our workshop, participants will be able to accurately describe the frequency and characteristics of key informants speaking about key findings in evaluation projects.

Sustainability-Ready Evaluation: Moving from Theory to Practice

Andy Rowe, Francois Dumaine, Debbie DeLancey

Miércoles 5 de mayo, de 15:00 a 18:30

Nivel avanzado — Inglés

The world is facing unprecedented environmental threats yet evaluation is not achieving its potential. We focus on human systems, paying little attention to natural systems or the impact of human activities. A recent stock-taking indicates that evaluation is unprepared to incorporate natural systems into our work. This workshop will provide a brief overview of the current state of sustainability-ready evaluation, and engage participants in working to adapt existing evaluations to nexus evaluations by incorporating natural system effects and contributions to the evaluation approach. Small group and plenary sessions will identify challenges, resources and opportunities including client/political challenges, identifying appropriate methods and approaches and working with multiple types of knowledge and worldviews. The workshop will set the stage for a community of practice to generate guidance documents and publications to continue development of best practices and approaches.

Prerrequisitos: Participants should be experienced evaluators, with several years working directly in a field related to evaluation — e.g. designing and conducting evaluations, commissioning evaluations, and/or implementing evaluation findings. They should be familiar with evaluation methods and approaches, at a level equivalent to completion of a graduate program and/or achievement of the CE designation; and aware of the urgency of the environmental crisis.

Objetivos

• Evaluate at the nexus of human and natural systems.
• Incorporate natural system effects and contributions to human system interventions.
• Contribute to building a body of knowledge about sustainability-ready evaluation in Canada and join an on-going community of practice to advance this field.

The Ins and Outs of Utilization-focused Developmental Evaluation.

*LLENO*

Ricardo Ramirez, Dal Broadhead

Miércoles 5 de mayo, de 15:00 a 18:30

Nivel intermedio — Inglés

The goal of the workshop is to illustrate the ‘practical wisdom’ that is needed to design and manage utilization-focused developmental evaluation (UFDE). Participants will enhance or gain competencies associated mainly with situational practice, as well as associated management and interpersonal practice. We will cover the main steps of UFE and the variations needed to embed developmental elements within it. We will review the mentoring strategies that we use in coaching primary interested users through the process. We will review the types of projects and evaluation uses, for which UFDE turned out to be the best approach. We will offer several case studies and a couple of published articles illustrating recent examples. Participants will be encouraged to engage actively in responding to real cases through facilitated group discussions. We will include an option to review current or upcoming evaluation assignments that the participants are preparing for and assist them in preparation.

Prerrequisitos: Experience conducting or managing utilization-focused evaluations would be ideal, combined with a familiarity with developmental evaluation. In addition, experience mentoring or facilitating evaluations where the primary intended users take on an active role in the design process, and in the facilitation of use. Experience working in the evaluation of research projects, and complex projects where logical frameworks or results-based management tools is less relevant.

Objetivos

• Participants will review and learn how to gauge the readiness of a project or initiative for utilization-focused, developmental evaluation.
• Participants will learn how to mentor primary evaluation users in the process of defining evaluation USES that are developmental and thereby to formulate Key Evaluation Questions.
• Participants will learn how to balance feedback loops for strategy course-correction with the preparation of final evaluation products.

Integrating Gender Approaches in Evaluation [MEAL]: Best practices, challenges and tips for making evaluation meaningful and using data to drive decision-making

*LLENO*

Deborah Simpson, Anna Du Vent, Leanne BaumungElaine Stavnitzky, Andres Goulsborough

Jueves 6 de mayo y viernes 7 de mayo, de 11:00 a 14:30

Nivel intermedio — Inglés

With an increased demand to incorporate GBA+ into our evaluative work and a renewed mandate from the Feminist International Assistance Policy, development and non-development actors are challenged to ensure that evaluations provide intersectional analysis incorporating a feminist lens. This workshop will introduce methods and tips for carrying out gender-sensitive evaluations (that allows application of GBA+ analysis) and gender-transformative evaluations (i.e. changing power relations through the process of evaluation itself); and explore how these approaches influence who benefits from the purpose, collection and use of data. The workshop will introduce case studies of feminist evaluative practices of Oxfam, MEDA, ADRA Canada, Salanga, and Plan International; explore real-life examples; and catalyze collaborative discussion for participants to dive into their own organizational practices and apply best practices, with a focus on improving utilization of findings for all stakeholders.

Prerrequisitos: An interest in learning about gender-sensitive evaluation and how to move forward to feminist evaluation to allow evaluation findings to be better utilized by all key stakeholders, especially end beneficiaries. A willingness to participate in a facilitated discussion of development NGO case studies and share and contribute openly. The ability to be self-reflective, and bring an evaluation idea, plan or approach to consider options for using a feminist lens.

Objetivos

• Understand the challenges and opportunities within gender-sensitive and feminist evaluation approaches, with a focus on how these relate to the utilization of data and findings.
• Learn best practices, challenges and key tips on how to apply a feminist lens to evaluations through case studies shared by ADRA Canada, Oxfam Canada, MEDA, Plan International, and Salanga.
• Apply the knowledge gained to build your skills in designing gender-sensitive and feminist evaluations for your own organizational evaluation plans.

Diversity of Use: Understanding How Evaluation Utilization Priorities Influence Evaluation Scope

Betty Onyura

Jueves 6 de mayo, de de 11:00 a 14:30

Nivel intermedio — Inglés

This stimulating, interactive, workshop positions evaluation utilization as a driver of evaluation scope, rather than as an outcome of evaluation practice. It is designed to mobilize both research- and practice-based knowledge. The workshop begins with a theoretically-informed review of diverse forms of evaluation utilization, exploring how different evaluation methodologies prioritize different forms of use. Simultaneously, it prompts participants to reflect on (i) pros/cons of various utilization priorities, (ii) the value different stakeholders seek to gain from evaluation, and (iii) the misuse and marginalization that may occur in relation to certain utilization priorities. Through vignettes and case-based learning, participants will explore how considering evaluation utilization a priori can illuminate intersecting issues of ethics, methodological fit, and adequacy of scope. Approaches to negotiating contentious issues related to competing utilization priorities will be explored.

Prerrequisitos: Participants should have one-to-two years of experience in working on evaluation projects in ways that require direct engagement with evaluation commissioners and other stakeholders. The workshop will draw on evaluators’ experiential knowledge, with a view to mobilize both research- and practice-informed knowledge in ways that can enhance evaluators’ practice. Participants should be open to sharing applicable, practice-relevant experiences as they engage with the facilitator and each other.

Objetivos

• Examine the pros and cons of prioritizing various forms of evaluation utilization in diverse contexts
• Identify the ways in which different evaluation methods prioritize diverse forms of evaluation utilization
• Navigate conflict and contentious issues about evaluation scope as they relate to evaluation utilization

Reflective Practice and Innovation: Making Creativity Part of Your Life

Gail Vallance Barrington

Jueves 6 de mayo, de 15:00 a 18:30

Nivel intermedio — Inglés

Reflective Practice bridges theory and practice. It helps us interpret the complexity, uncertainty, unpredictability, and disruption we encounter every day. If we think creatively, we can allow ourselves to experiment, innovate, and refocus, expanding our skills and adding value to our work. This workshop will explore how we can incorporate reflection more fully into our working lives. What barriers and issues stand in the way of innovation? What questions should we be asking? What reflective strategies can we use, and if we use them, what are the implications? Five reflective strategies will be described, and participants will have an opportunity to experiment with several of them and discuss their experiences. We will reflect on the links between reflection, innovation, and action and will leave with a personal strategy to incorporate more creativity into our daily lives.

Prerrequisitos: You can be an evaluation practitioner at any level of experience but should be aware of some of the problems and challenges encountered in the field. You enjoy reflecting and writing about your experiences. Because you wish to be more innovative, you are open to developing fresh and creative solutions to your practice and your life.

Objetivos

• Clarify what reflective practice is, how it relates to innovation, and how it can lead to personal resilience, improved practice, and transformative change.
• Explore some of the barriers that limit your creativity and use of reflective practice in both your personal life and your work.
• Consider some practical reflective strategies,experiment with several, and plan your personal strategy to incorporate more reflection in your life and work.

Policy Evaluation Using Simulation

*LLENO*

Gregory Mason

Jueves 6 de mayo, de 15:00 a 18:30

Nivel intermedio — Inglés

Program evaluation is typically ex-post, or after the fact. This can date advice on program design and implementation, leading to under utilization. Ex-ante evaluation methods, notably cost-benefit, experiments, and simulations offer evaluators an opportunity to get out in front of programs and policies.This workshop explores policy simulations using Excel. Participants will review the main ideas of policy simulation using two case studies: vaccination programs and modelling the impact of electricity rate increases on household incomes. Starting from first principles, the workshop will build each case study to become a functioning policy evaluation study. Key assumptions anchor the development of policy models, and the workshop will demonstrate techniques to validate model results. Participants will download the models in advance of the workshop and will have an opportunity to run simulations and alter the assumptions underlying the simulations.

Prerrequisitos: Participants should remember their high school math and have an understanding of the potential for expressing policy abstractly using mathematics and logic. A working knowledge of Excel (construction and use of formulas) is obviously beneficial as is access to a laptop to work the simulations as part of the workshop.

Objetivos

• Appreciate the potential for simulations to explore policy and program outcomes.
• Express policies abstractly.
• Develop user-oriented models to allow clients to explore the implications of alternative policy features.

Analyzing Qualitative Data Using Qualitative and Quantitative Analysis Techniques

*LLENO*

Simon Roy, Leah Simpkins

Viernes 7 de mayo, de 11:00 a 14:30

Nivel intermedio — Inglés

This intermediate level workshop presents qualitative and quantitative analysis techniques of textual data such as interview findings. At the end of the workshop, participants will be able to conduct and present the analyses in a clear and systematic fashion. The workshop makes a clear distinction between both techniques and begins with a review of the qualitative analysis techniques using Excel, followed by quantitative analysis techniques using computer-assisted qualitative analysis software. The presenters will demonstrate, in a step-by-step process, how to conduct qualitative analyses using a live case. The pros and cons of quantifying the evidence using percentages and proportions will be discussed. In the second hour, participants will learn the main steps involved in the quantitative analysis of qualitative findings, including the steps involved in identifying key codes and word clusters. A discussion will also be held about the strengths and limitations of such analyses.

Prerrequisitos: Basic knowledge of Excel.

Objetivos

• Identify the strengths and limitations of qualitative and quantitative analyses of textual evaluation data.
• Properly enter, organize, code and sort the information to prepare the data for traditional qualitative analyses that focusses on meaning.
• Use codes organized in a tree structure and how to conduct a coding frequency analysis using a popular qualitative research software package.

Knowledge Translation and Dissemination: the End of the Research and Evaluation Cycle — or Is It? Evaluation of Knowledge Uptake and Utilization

*LLENO*

Kelly Skinner, Jasmin Bhawra, Steve Montague

Viernes 7 de mayo, de 11:00 a 14:30

Nivel principiante — Inglés

Knowledge transfer and exchange (KTE) has become an integral part of organizational practice, whereby knowledge generated through research and other activities is synthesized and disseminated to relevant stakeholders in the form of reports, workshops, and other knowledge products. However, knowledge products and processes are seldom evaluated. Given the vast amount of resources, money, and effort that organizations and researchers spend on knowledge translation and dissemination, it seems an obvious question to ask — what is the uptake and utilization of your work? To meet this need, Skinner developed a 44-item Knowledge Uptake and Utilization Tool (KUUT) in 2007. Over the past decade, the KUUT has been used by numerous governmental and non-profit organizations to assess knowledge uptake and utilization of a range of knowledge products (i.e., reports, websites) and KTE processes (i.e., workshops, training events). This workshop will explore utilization measurement using the KUUT.

Prerrequisitos: Participants should have a basic understanding of the concept of knowledge transfer and exchange (KTE). Participants do not need to have specific experience with utilization measurement, however interest in or experience with knowledge translation in a research or evaluation setting will help participants apply learnings from the workshop topic.

Objetivos

• Identify and distinguish various dimensions of «utilization» in order to navigate the literature and purposefully apply evaluation and measurement tools.
• Apply the Knowledge Uptake and Utilization Tool to their own evaluation work in a range of settings.
• Adapt the Knowledge Uptake and Utilization Tool for their specific projects.

Facilitating for Evaluation using Zoom

Kylie Hutchinson

Viernes 7 de mayo, de 11:00 a 14:30

Nivel principiante — Inglés

Uh oh…Zoom fatigue! What’s an evaluator to do? In these times of pandemic, the usual participatory aspects of the evaluation process such as evaluation planning, data parties, and capacity-building have had to move online. But that doesn’t mean they have to be one-way and boring. In this fun and interactive workshop, we’ll look at: (1) basic and advanced Zoom features to make meetings more interactive; (2) other tools to promote online collaboration; (3) easy facilitation tips for keeping participants engaged; (4) simple techniques to promote equity, inclusion, and diversity online.

Prerrequisitos: None

Objetivos

• Participants will be able to describe how to use Zoom polls, chat, breakout rooms, whiteboards and annotation to increase engagement.
• Participants will be able to explain how sites such as Google Docs, Google Slides, Padlet and others can facilitate collaborative work online.
• Participants will be able to list three additional tips for keeping participants engaged.

Pratique réflexive en évaluation : comment négocier la place de l’évaluateur dans son milieu de pratique en temps de crise ?

Lara Gautier, Sherri Bisset, Jana MarticJean Henri Sagne

Viernes 7 de mayo, de 11:00 a 14:30

Nivel intermedio — Francés

En ces temps de crise sanitaire, l’évaluation des interventions et services de santé est plus que jamais essentielle. Les évaluateurs sont particulièrement sollicités à travers le monde entier. Cette demande en constante augmentation est accompagnée d’enjeux importants en termes d’interactions dans les milieux de pratique. Pour les évaluateurs émergents, ces enjeux se traduisent par la nécessité de négocier sa place en tant qu’évaluateur, dans un contexte où l’évaluation attendue est toujours plus urgente, et/ou elle mobilise des enjeux interculturels. Nous proposons un atelier de renforcement sur la négociation en temps de crise et en interculturalité. Nous offrirons d’abord un rappel théorique sur les enjeux de l’interaction avec les milieux de pratique. Nous passerons ensuite à une table ronde à laquelle deux étudiants présenteront leurs expériences en tant qu’évaluateurs émergents. Enfin, deux cas pratiques seront proposés afin d’appliquer les connaissances acquises.

Prerrequisitos: Les participants doivent avoir reçu une formation de base en évaluation et avoir appliqué, ou s’apprêter à appliquer cette formation dans le cadre d’une évaluation. De plus, les participant.e.s doivent avoir été sensibilisés au processus de négociation. En tant qu’évaluateur, il convient de négocier sa position et son plan d’évaluation non seulement en amont de l’évaluation, mais tout le long du processus. Ceci permet par la suite d’assurer un meilleur rapport demandeur-évaluateur.

Objetivos

• Les participants-es apprendront les théories et des stratégies pratiques pour améliorer les chances d’utilisation des connaissances par leurs milieux de pratique.
• Les participants-es apprendront comment négocier leur place dans un milieu de pratique qui requiert des résultats d’évaluation rapides.
• Les participants-es apprendront comment mieux interagir avec leur milieu de pratique qui soulève des enjeux interculturels.