ANR CE Program Evaluation

Trainings

UCCE Program Development and Evaluation Capacity Building Trainings 2025

WHAT: Online interactive trainings to help with planning your programs/projects, engaging California communities, civil rights compliance, and evaluating your programs and assessing their impact. These trainings highlight UCCE examples. For 2025, we have added a few brown bag sessions to showcase tech tools and best practices for evaluation planning. This is a 15-part series offered a la carte, select whichever interests you or take the complete series!  

HOSTED by:  UC ANR Program Planning and Evaluation; UCCE Evaluation Specialist Vikram Koundinya; UC ANR Climate Smart Academic Coordinator Samuel Ikendi; the UC ANR Office of Diversity & Inclusion; UC Master Gardener Program Evaluation Coordinator Jocelyn Mobley; and UC ANR Informatics and GIS Program (IGIS) Analyst Priyanka Vyas.

We are pleased to share we received the 2024 American Evaluation Association Extension Education Evaluation Team Award for Evaluation Capacity Building!

WHEN: Tuesdays and some Thursdays August 5th through October 7th. See dates and times below! 

WHO should attend:  CE academics, community educators, and other program staff. NEW CE Advisors, academics, County Directors, and regional program supervisors are highly encouraged; taking the entire series can build overall program development competencies and is encouraged.

Register here!

TOPICDATEPRESENTERSPARTICIPANTS WILL GAIN... 
Conducting a Needs Assessment 8/5 (10AM-12PM)

Katherine Webb-Martinez 

Vikram Koundinya

Guest Speakers: Hedmon Okello 4-H Animal Science Youth Advisor, Domena Agyeman Agriculture and Natural Resources Economics Advisor, and Priyanka Vyas from IGIS

  • Understanding of needs assessments basics (why, what, how, when)
  • Understanding of how to write good needs assessment questions
  • Understanding of how to use the findings to inform how you focus and develop your program
  • Feedback on your needs assessment approach or on your draft instrument/questions 
Using Delphi Method for Needs Assessment8/12 (10AM - 12PM)

Vikram Koundinya

Katherine Webb-Martinez

Guest Speakers:  Colby Silvert (Assistant Professor and Extension Specialist, University of Maryland), Parmveer Singh (Postdoctoral Fellow, University of Saskatchewan), and Julia Van Soelen-Kim (UCCE Advisor) & Yulia Lamoureaux (PhD Candidate, Geography Graduate Group, UC Davis)

  • Understand how Delphi method can be used in needs assessment
  • Understand how Delphi method can be adapted for different situations
  • Learn how Delphi method was used in three research and evaluation studies
Brown Bag: GIS Methods for Needs Assessment8/14 (12PM-1PM)

Priyanka Vyas

Andy Lyons

  • Skills to apply spatial thinking in conducting their needs assessment
  • Understanding of tools to obtain secondary data for a geographic area of interest
  • Ability to create a custom map of a geographic area with relevant layers of interest
Practical Methods to Measuring Outcomes 8/19
(10AM-noon)

Katherine Webb-Martinez 

Vikram Koundinya 

Guest Speakers: Justin Valliere UCCE Specialist Invasive Weed & Restoration Ecology

  • Understanding of how to define program theory and connect to UC ANR’s condition changes and public values
  • Experience defining outcomes and measurable indicators and using a program logic model
  • Understanding of options for evaluation data collection methods to measure program participant outcomes
  • A draft evaluation plan
Brown Bag: Best Practices for Writing Strong Evaluation Plans for Grant Proposals8/21
(Noon-1PM)

Vikram Koundinya

Samuel Ikendi

Greta Landis (Evaluation Specialist, University of Wisconsin-Madison Division of Extension), Guest Speaker

  • Understanding of the importance of developing a strong evaluation plan in a grant proposals
  • Understanding of best practices for writing evaluation plans in grant proposals
  • Understanding of real life examples for the shared best practices
  • Understanding of how a strong evaluation plan is written and implemented
Navigating Institutional Review Board (IRB)8/26
(10AM-noon)

Jennifer Sedell

Katherine Webb-Martinez

Kit Alviz 

With UCCE Advisor guest speakers

  • Understanding what the IRB is
  • Understanding of how to locate and navigate IRB decision-making tools
  • Understanding of common forms and processes
  • Understanding the basic steps of navigating required trainings
  • Awareness of common experiences UC ANR academics across different program areas and position types
  • Practical tips from UC ANR peers on navigating IRB submissions and reviews
Defining Clientele & Civil Rights Compliance Planning9/2 (10AM-noon)

Kit Alviz 

David White

Priyanka Vyas

Jocelyn Mobley

With recorded examples from UCCE professionals

  • Understanding of how-to define clientele groups and strategies for collecting baseline data
  • Understanding of civil rights compliance goal examples
  • Hands on experience using Project Board or Statewide Program data to track annual progress against goals.
  • Understanding of examples of how to collect race, ethnicity and gender data from program participants
Improving All Reasonable Effort and Engagement with New Audiences9/4
(10AM-noon)
 

Kit Alviz 

David White

Guest speaker: Elizabeth Moon 

  • Understanding of programmatic strategies to conduct All Reasonable Effort
  • Understanding of how to demonstrate compliance via All Reasonable Effort documentation
  • Understanding of programmatic strategies UCCE employs to increase opportunities for program participation
  • Understanding how to tally and report audience attendance and demographics into an online reporting system
  • Understanding of policy changes related to contact reporting (e.g., collecting race/ethnicity/gender using self-identification forms only, gender category changes) 
Best Practices in Developing and Running Focus Groups9/9 (10AM-noon)

Jen Sedell

Christina Becker

Vikram Koundinya

Samuel Ikendi

  • Understanding when and why to conduct focus groups as part of needs assessments and evaluations
  • Understanding of the best practices for designing focus groups for needs assessments and evaluations
  • Hands-on experience developing a focus group protocol
  • Practical tips on conducting focus groups
Best Practices for Developing Surveys & Basics of Sampling Methods9/11
(10AM-noon)

Vikram Koundinya

Samuel Ikendi

Kit Alviz

Jocelyn Mobley

Guest Speakers: To be confirmed

  • Understanding of the best practices for designing online and paper surveys
  • Hands on experience developing good survey questions
  • Understanding of some online survey bot mitigation and detection methods
  • Understanding of different outcome measurement survey designs
  • Understanding of different survey sampling methods and when to use them
Using Ripple Effects Mapping (REM) Method in Program Evaluation9/16 (10AM-noon)

Vikram Koundinya

Kit Alviz

Guest Speakers: Yu Meng (UCCE Advisor), Greta Landis (Evaluation Specialist, University of Wisconsin-Madison Division of Extension), Devii Rao (UCCE Advisor)

  • Understanding of how to use REM in assessing the impact of extension programs
  • Hands-on experience of REM method using an example case
Brown Bag: GIS Methods for Outcome Evaluation9/18 (Noon-1PM)

Priyanka Vyas

Andy Lyons

  • Skills to apply spatial techniques to evaluate program outcomes
  • Understanding of factors driving geographic variation in program outcomes
  • Ability to identify different sources of spatial and contextual data to evaluate program outcomes
Methods to Analyze Surveys: Continuous Quantitative Data (Analyzing and Presenting Pre-Post Evaluation Survey Data)9/23 (10AM-noon)

Samuel Ikendi

Kit Alviz

  • Understanding of measures of central tendency and variability
  • Hands-on experience analyzing and reporting frequency distribution in pre/post tests using Excel
  • Understanding of different types of mean difference tests
  • Hands-on experience running a paired or dependent samples t-test in Excel, interpreting the results, and reporting the findings
  • Understanding of levels of quantitative data (e.g., nominal, ordinal, interval, ratio)
Methods to Analyze Surveys: Qualitative Data9/30 (10AM-noon)

Jennifer Sedell

Christina Becker

  • Understanding of types of qualitative analysis that can be done on open-ended survey data for program evaluation
  • Hands-on experience of coding qualitative data and extracting themes using Excel, and reporting the findings
  • Practice identifying a mixed methods design to evaluate a program
Writing Strong Impact Statements10/7 (10AM-noon)

Katherine Webb-Martinez

Christina Becker

Representative from Academic Assembly Council Personnel Committee

  • Experience organizing your program activities into themes using condition changes
  • Experience connecting your project/program outcomes to condition changes and public values
  • Understanding of how to write strong impact statements

Looking for recordings of previous trainings? Check out the videos for all the 2024 trainings