Mastering Measurement and Evaluation Certificate:
Less Stress, More Success in Creating Level 1-4 Evaluations

A Series of 4 Online Sessions
 

There are no remaining dates in 2023. To be informed of 2024 dates for this course, visit stay informed and we will get back to you when dates are available. 

 

Hurry, space is limited!

Certificate Overview

No matter how well learning is designed and delivered within your organization, you are probably experiencing increased demands to demonstrate its value. Regrettably, many Learning and Development (L&D) professionals struggle with providing this type of data because they are uninformed in the art and science of evaluation design and thus are unable to provide business executives with the evidence they want. This highly interactive course equips you with practical tips and specific guidelines for creating valid, scientifically sound Level 1, 2, 3, and 4 evaluations. The emphasis is on creating evaluations that produce credible data with high perceived value in the eyes of business executives and L&D professionals alike.

Bonus Items: 

• You’ll receive a job aid covering each of the four levels of evaluation. Each job aid contains an outline of all the information covered in the training program regarding a particular evaluation level. Thus, they serve as a great place to take notes to elaborate on things you want to remember and refer back to post-program. They also contain specific tips and guidelines, together with examples, for creating scientifically sound Level 1 to 4 evaluations, which also serve as a handy reference.
• Seven articles written by Ken on the various levels of evaluation.
• An ebook titled The Sad State of Measurement and Evaluation. Like the job aids mentioned above, the articles are a handy reference and further explain much of the material covered during the program.
• M&E Project Implementation Guide. The guide provides a roadmap outlining the steps required to implement the four evaluation levels successfully. It starts with selecting an appropriate training program for implementing the four levels and includes a series of job aids providing in-depth information about the levels and how to implement them.
• Voluntary post-program 90-minute virtual coaching session to answer questions you have about any of the levels; offer suggestions for creating and implementing data collection tools you are developing; amd provide support and encouragement in your M&E journey. 

Course Objectives:

After attending this comprehensive, "hands-on" course, you will be able to:

• Use the five-level evaluation model to build a "chain of evidence" demonstrating program value.
• Create Level 1 evaluations that produce valuable data and can be used to predict participant post-training behavior.
• Create scientifically sound multiple-choice, true/false, matching, and fill-in-the-blank Level 2 quizzes and tests that prove whether participant learning occurred.
• Write multiple-choice test questions that measure job application, not the mere recall of facts and information.
• Create scientifically sound Level 3 participant surveys that measure on-the-job behavior change.
• Use a two-phase eight-guideline process for conducting Level 4 evaluations that connect a learning program with business results.
• Use statistics to summarize quantitative and qualitative evaluation data to interpret and draw conclusions from the results.

Course Details:

This program emphasizes not just the "what to do" but also the "how to do it." Specifically, during each session and between the sessions, time is included for hands-on creation of your own Level 1, 2, 3, and 4 evaluations you can immediately start using back on the job. You'll also have an opportunity to share what you have created with a group of other participants and receive valuable feedback and new ideas from them and Ken..

Important: Attending all four (4) live sessions and creating your own Level 1, 2, 3, and 4 evaluations within 30 days post-program is necessary to receive your certificate of completion and eBadge.

Prerequisites:
No prerequisites are required to attend this program. However, a strong desire to conduct Level 1-4 evaluations that produce credible data regarding the training you provide is essential.

Who Should Attend:
This certificate program is for any L&D professional interested in learning how to implement the four-level evaluation model.

Course Methods:
Each of the online sessions contains small group activities, presentations, and facilitated discussions. Your responsibility is to participate actively in all the activities. Also, to gain maximum benefit from the program, please make a concerted effort to create Level 1-4 evaluations you can use back on your job during the time provided. While you may not have time to create final versions of your evaluations, getting a solid start will enable you to apply the tips and guidelines you learn.

Course Materials:

• A pre-workshop materials packet. It provides information about the workshop, the learning objectives, business outcomes, and the schedule. It also contains a self-assessment to help you identify your current level of expertise in conducting valid, scientifically sound Level 1, 2, 3, and 4 evaluations.
• A comprehensive participant workbook. It contains all the information taught in the training program, including outlines of all the presentations and descriptions of all the individual and small-group activities you will engage in during the course.
• Nine articles and an ebook written by Ken titled The Sad State of Measurement and Evaluation. These resources reinforce and elaborate on the material covered in the program and serve as ready references for reviewing specific program content.
• A Mastering M&E Project Implementation Guide. This resource serves as a place to record your observations and plans for using the information you learned on the job. It also provides a road map for implementing each of the four evaluation levels and includes a series of job aids providing in-depth details on implementing each.

Sessions

Session 1:

• Why Measurement & Evaluation?
• The 5-Level Evaluation Model
• Building a Chain of Evidence
• Creating a Data Collection Plan
• Add muscle to your Level 1 Evaluation with predictive questions

Session 2:

• Writing scientifically sound Level 2 test questions that distinguish between those who learned the program material from those who did not
• Creating Level 2 test questions that measure job application and not the mere recall of facts
• Using simple statistics to assess the validity of your test questions

Session 3:

• Capturing elusive Level 3 data: the secrets of survey design
• Writing behavioral statements that measure on-the-job behavior change
• Using three questions and the expert estimation technique to calculate Level 3 training transfer

Session 4:

• Level 4 business results made visible: connecting the content of a training program with an existing business metric
• Using three methods to isolate the effects of a training program on improved business results
• Going the distance: making sense of your collected evaluation data and formulating improvement recommendations

*Time is included for hands-on creation of your own evaluations, followed by sharing with the group. You’ll gain valuable feedback and new ideas from the instructor and from other participants.

Instructor

Ken Phillips, CPTD
Ken delivers all programs and workshops in his signature style: professional, engaging, and approachable. He is the founder and CEO of Phillips Associates and the creator and chief architect of the Predictive Learning Analytics (PLA) learning evaluation methodology. He has more than 30 years of experience designing learning instruments and assessments. Also, to his credit are more than two dozen published learning instruments and articles. Ken also authored the recently released ATD TD at Work publication titled: "Evaluate Learning With Predictive Learning Analytics."

Course Dates

2023 COURSE DATES There are no remaining 2023 course dates. To be informed of 2024 dates for this course, visit stay informed and we will get back to you when dates are available.
Session 1:  Coming in 2024!
Session 2:  Coming in 2024!
Session 3:  Coming in 2024!
Session 4:  Coming in 2024!

Each session is 3 hours in length

All sessions start at 1:00 pm Eastern Time (New York time). Here is the time of the sessions listed in various time zones:
10:00 am - 1:00 pm Pacific Time (PT)
11:00 am - 2:00 pm Mountain Time (MT)
12:00 pm - 3:00 pm Central Time (CT)
1:00 pm - 4:00 pm Eastern Time (ET)

For times in other cities, visit Time and Date Converter. All sessions are recorded. In order to earn your Certificate of Completion, you must log in for and participate in each live course and successfully complete any homework assignments by specified deadlines. Recordings of sessions are intended for review purposes only.

Course Rates

Early-Bird Registration 30+ days prior to course start date: $745

Registration within 30 days of course start date: $895

Train as a Team and Save!
For questions on group discounts, please visit fees and discounts.

Course Equipment

IMPORTANT - You'll participate in online and collaborative activities in a number of ways, each designed to provide a unique means to interact and learn from experts and colleagues. All course delivery software operates at Internet connection speeds of 56.6 kbps or better, on PC, Mac and Unix platforms. Programs will use teleconferencing or VoIP (voice over Internet Protocol.) The login instructions emailed to you approximately one week prior to the start of the course will outline platform use as well as any headset requirements or suggestions. Each registrant must provide their own laptop or desktop computer and other equipment (such as a headset, if noted in your login instructions) in order to fully and successfully participate in the course. Please test your login information a minimum of 48 hours in advance on your course start date on the computer you will be using for the course.

What Others Are Saying

Hear what past attendees have to say about this and other Certificate Courses. Read the testimonials.  
 

ATD Initial Eligibility and Recertification

Training Magazine Certificates have been pre-approved by the ATD Certification Institute to offer educational programs that can be used towards initial eligibility and recertification of the Certified Professional in Talent Development (CPTD) and Associate Professional in Talent Development (APTD) credentials.  For questions on initial eligibility and recertification, visit the ATD Certification Institute. 

This program has been approved for a maximum of 12 points.