Mastering Measurement and Evaluation Certificate:
Less Stress, More Success in Creating Level 1-4 Evaluations

A Series of 4 Online Sessions Starting October 21, 2024

 

Hurry, space is limited!

Certificate Overview

No matter how well learning is designed and delivered within your organization, you are probably experiencing increased demands to demonstrate its value. Regrettably, many Learning and Development (L&D) professionals struggle with providing this type of data because they are uninformed in the art and science of evaluation design and thus are unable to provide business executives with the evidence they want. This highly interactive course equips you with practical tips and specific guidelines for creating valid, scientifically sound Level 1, 2, 3, and 4 evaluations. The emphasis is on creating evaluations that produce credible data with high perceived value in the eyes of business executives and L&D professionals alike.

Bonus Items: 

• A comprehensive participant workbook covering all the information taught in the training program. You can use it for note-taking and to elaborate on things you want to refer to post-program.
• Nine articles Ken has written on the various levels of evaluation.
• An ebook titled The Sad State of Measurement and Evaluation. The articles and ebook elaborate on the material covered during the program.
• A Mastering M&E Project Implementation Guide. The guide provides a road map for implementing the four evaluation levels and includes a series of job aids providing in-depth information about implementing each.
• Two voluntary 60-minute post-program virtual coaching sessions. The first session follows modules one and two, and session two follows modules three and four. These sessions aim to answer questions about the four levels; help create your data collection tools, and provide support and encouragement in your M&E journey. You can also contact Ken directly by phone or email if you wish.

Course Objectives:

After attending this comprehensive, "hands-on" course, you will be able to:

• Use the five-level evaluation model to build a “chain of evidence” demonstrating training program value.
• Create Level 1 evaluations that produce valuable data and can be used to predict participant post-training behavior.
• Create scientifically sound Level 2 multiple-choice quizzes and tests that prove whether
• participant learning occurred.
• Identify the difference between quiz and test questions that measure job application versus mere recall.
• Create scientifically sound Level 3 evaluation surveys that measure on-the-job behavior change.
• Use the Level 3 “evaluations made simple” methodology to collect credible, actionable, on-the-job application data.
• Use a two-phase eight-guideline process for conducting Level 4 evaluations that connect a learning program with business results.
• Use statistics to summarize quantitative and qualitative evaluation data
• Interpret and draw conclusions from the results.

Course Details:

This program emphasizes not just the "what to do" but also the "how to do it." Specifically, during each session and between the sessions, time is included for hands-on creation of your own Level 1, 2, 3, and 4 evaluations you can immediately start using back on the job. You'll also have an opportunity to share what you have created with a group of other participants and receive valuable feedback and new ideas from them and Ken..

Important: Attending all four (4) live sessions and creating your own Level 1, 2, 3, and 4 evaluations within 30 days post-program is necessary to receive your certificate of completion and eBadge.

Prerequisites:
No prerequisites are required to attend this program. However, a strong desire to conduct Level 1-4 evaluations that produce credible data regarding the training you provide is essential.

Who Should Attend:
This certificate program is for any L&D professional interested in learning how to implement the four-level evaluation model.

Course Methods:
Each of the online sessions contains small group activities, presentations, and facilitated discussions. Your responsibility is to participate actively in all the activities. Also, to gain maximum benefit from the program, please make a concerted effort to create Level 1-4 evaluations you can use back on your job during the time provided. While you may not have time to create final versions of your evaluations, getting a solid start will enable you to apply the tips and guidelines you learn.

Course Materials:

• A pre-workshop materials packet. It provides information about the workshop, the learning objectives, business outcomes, and the schedule. It also contains a self-assessment to help you identify your current level of expertise in conducting valid, scientifically sound Level 1, 2, 3, and 4 evaluations.
• A comprehensive participant workbook. It contains all the information taught in the training program, including outlines of all the presentations and descriptions of all the individual and small-group activities you will engage in during the course.
• Nine articles and an ebook written by Ken titled The Sad State of Measurement and Evaluation. These resources reinforce and elaborate on the material covered in the program and serve as ready references for reviewing specific program content.
• A Mastering M&E Project Implementation Guide. This resource serves as a place to record your observations and plans for using the information you learned on the job. It also provides a road map for implementing each of the four evaluation levels and includes a series of job aids providing in-depth details on implementing each.

Sessions

Session 1:

• Why Measurement & Evaluation?
• The 5-Level Evaluation Model
• Building a Chain of Evidence
• Creating a Data Collection Plan
• Add muscle to your Level 1 Evaluation with predictive questions

Session 2:

• Writing scientifically sound Level 2 test questions that distinguish between those who learned the program material from those who did not
• Creating Level 2 test questions that measure job application and not the mere recall of facts
• Using simple statistics to assess the validity of your test questions

Session 3:

• Capturing elusive Level 3 data: the secrets of survey design
• Writing behavioral statements that measure on-the-job behavior change
• Using three questions and the expert estimation technique to calculate Level 3 training transfer

Session 4:

• Level 4 business results made visible: connecting the content of a training program with an existing business metric
• Using three methods to isolate the effects of a training program on improved business results
• Going the distance: making sense of your collected evaluation data and formulating improvement recommendations

*Time is included for hands-on creation of your own evaluations, followed by sharing with the group. You’ll gain valuable feedback and new ideas from the instructor and from other participants.

Instructor

Ken Phillips, CPTD
Ken delivers all programs and workshops in his signature style: professional, engaging, and approachable. He is the founder and CEO of Phillips Associates and the creator and chief architect of the Predictive Learning Analytics (PLA) learning evaluation methodology. He has more than 30 years of experience designing learning instruments and assessments. Also, to his credit are more than two dozen published learning instruments and articles. Ken also authored the recently released ATD TD at Work publication titled: "Evaluate Learning With Predictive Learning Analytics."

Course Dates

OCTOBER 2024 DATES:
Session 1:  Monday, October 21, 2024
Session 2:  Wednesday, October 23, 2024
Session 3:  Monday, October 28, 2024
Session 4: Wednesday, October 30, 2024

Each session is 3 hours in length

All sessions start at 1:00 pm Eastern Time (New York time). Here is the time of the sessions listed in various time zones:
10:00 am - 1:00 pm Pacific Time (PT)
11:00 am - 2:00 pm Mountain Time (MT)
12:00 pm - 3:00 pm Central Time (CT)
1:00 pm - 4:00 pm Eastern Time (ET)

For times in other cities, visit Time and Date Converter. All sessions are recorded. In order to earn your Certificate of Completion, you must log in for and participate in each live course and successfully complete any homework assignments by specified deadlines. Recordings of sessions are intended for review purposes only.

Course Rates

Early-Bird Registration 30+ days prior to course start date: $795

Registration within 30 days of course start date: $945

Train as a Team and Save!
For questions on group discounts, please visit fees and discounts.

Course Equipment

IMPORTANT - You'll participate in online and collaborative activities in a number of ways, each designed to provide a unique means to interact and learn from experts and colleagues. All course delivery software operates at Internet connection speeds of 56.6 kbps or better, on PC, Mac and Unix platforms. Programs will use teleconferencing or VoIP (voice over Internet Protocol.) The login instructions emailed to you approximately one week prior to the start of the course will outline platform use as well as any headset requirements or suggestions. Each registrant must provide their own laptop or desktop computer and other equipment (such as a headset, if noted in your login instructions) in order to fully and successfully participate in the course. Please test your login information a minimum of 48 hours in advance on your course start date on the computer you will be using for the course.

What Others Are Saying

Hear what past attendees have to say about this and other Certificate Courses. Read the testimonials.  
 

ATD Initial Eligibility and Recertification

Training Magazine Certificates have been pre-approved by the ATD Certification Institute to offer educational programs that can be used towards initial eligibility and recertification of the Certified Professional in Talent Development (CPTD) and Associate Professional in Talent Development (APTD) credentials.  For questions on initial eligibility and recertification, visit the ATD Certification Institute. 

This program has been approved for a maximum of 12 points.