Mastering Measurement and Evaluation Certificate:
Less Stress, More Success in Creating Level 1-4 Evaluations

There are no additional 2022 course dates scheduled at this time. To be informed of 2023 dates, go here. 

 

Register Early! Course size is limited.

Certificate Overview

No matter how well learning is designed and delivered within your organization, you are probably experiencing increased demands to demonstrate its value. Regrettably, many learning departments struggle with providing this type of data because they are uninformed in the art and science of evaluation design and thus are unable to provide business executives with the evidence they want. This highly interactive course equips you with practical tips and specific guidelines for creating valid, scientifically sound Level 1, 2, 3, and 4 evaluations. Evaluations that produce credible data with high perceived value in the eyes of business executives and L&D professionals alike.

Bonus Items: 

• You’ll receive a job aid covering each of the four levels of evaluation. Each job aid contains an outline of all the information covered in the training program regarding a particular evaluation level. Thus, they serve as a great place to take notes to elaborate on things you want to remember and refer back to post-program. They also contain specific tips and guidelines, together with examples, for creating scientifically sound Level 1 to 4 evaluations, which also serve as a handy reference.
• Seven articles written by Ken on the various levels of evaluation.
• An ebook titled "The Sad State of Measurement and Evaluation." Like the job aids mentioned above, the articles are a handy reference and further explain much of the material covered during the program.
• M&E Project Implementation Guide. The guide provides a roadmap outlining the steps required to implement the four evaluation levels successfully. It starts with selecting an appropriate training program for implementing the four levels and includes a series of job aids providing in-depth information about the levels and how to implement them.
• Voluntary post-program 90-minute virtual coaching session to answer questions you have about any of the levels; offer suggestions for creating and implementing data collection tools you are developing; amd provide support and encouragement in your M&E journey. 

Course Objectives:

After attending this comprehensive, "hands-on" course, you will be able to:

• Use the five-level evaluation model to build a "chain of evidence" demonstrating program value.
• Create Level 1 evaluations that produce valuable data and can be used to predict participant post-training behavior.
• Create scientifically sound multiple-choice, true/false, matching, and fill-in-the-blank Level 2 quizzes and tests that prove whether participant learning occurred.
• Write multiple-choice test questions that measure job application, not the mere recall of facts and information.
• Create scientifically sound Level 3 participant surveys that measure on-the-job behavior change.
• Use a two-phase eight-guideline process for conducting Level 4 evaluations that connect a learning program with business results.
• Use statistics to summarize quantitative and qualitative evaluation data to interpret and draw conclusions from the results.

Course Details:

This program emphasizes not just the "what to do" but also the "how to do it." Specifically, during each session and between the sessions, time is included for hands-on creation of your own Level 1, 2, 3, and 4 evaluations you can immediately start using back on the job. You'll also have an opportunity to share what you have created with a group of other participants and receive valuable feedback and new ideas from them and Ken..

Important: Attending all four (4) live sessions and creating your own Level 1, 2, 3, and 4 evaluations within 30 days post-program is necessary to receive your certificate of completion and eBadge.

Prerequisites:
No prerequisites are required to attend this program. However, a strong desire to conduct Level 1-4 evaluations that produce credible data regarding the training you provide is essential.

Who Should Attend:
This certificate program is for any L&D professional interested in learning how to implement the four-level evaluation model.

Course Methods:
Each of the online sessions contains small group activities, presentations, and facilitated discussions. Your responsibility is to participate actively in all the activities. Also, to gain maximum benefit from the program, please make a concerted effort to create Level 1-4 evaluations you can use back on your job during the time provided. While you may not have time to create final versions of your evaluations, getting a solid start will enable you to apply the tips and guidelines you learn.

Course Materials:

• You’ll receive a job aid covering each of the four levels of evaluation. Each job aid contains an outline of all the information covered in the training program regarding a particular evaluation level. Thus, they serve as a great place to take notes to elaborate on things you want to remember and refer back to post-program. They also contain specific tips and guidelines, together with examples, for creating scientifically sound Level 1 to 4 evaluations, which also serve as a handy reference.
• Seven articles written by Ken on the various levels of evaluation.
• An ebook titled "The Sad State of Measurement and Evaluation." Like the job aids mentioned above, the articles are a handy reference and further explain much of the material covered during the program.
• M&E Project Implementation Guide. The guide provides a roadmap outlining the steps required to implement the four evaluation levels successfully. It starts with selecting an appropriate training program for implementing the four levels and includes a series of job aids providing in-depth information about the levels and how to implement them.

Sessions

Session 1:

• Why Measurement & Evaluation?
• The 5-Level Evaluation Model
• Build a Chain of Evidence
• Create a Data Collection Plan
• Power Up Your Level 1 Evaluations & Gain Surprisingly Useful, Valued Data
• Create a Level 1 Evaluation for your target training program*

Session 2:

• Create Level 2 Quizzes & Tests That Measure Application Not Mere Recall
• Create a Level 2 Knowledge Test for your target training program*

Session 3:

• The Holy Grail: Capturing Elusive Level 3 Evaluation Data
• Write Behavioral Statements That Measure On-The-Job Behavior Change
• Create a Level 3 Participant Survey for your target training program*

Session 4:

• Business Results Made Visible: Design Proof Positive Level 4 Evaluations
• Create a Level 4 Evaluation Plan for your target training program*
• Going the Distance: Making Sense Out of Evaluation Data

*Time is included for hands-on creation of your own evaluations, followed by sharing with the group. You’ll gain valuable feedback and new ideas from the instructor and from other participants.

Instructor

Ken Phillips, CPTD
Ken delivers all programs and workshops in his signature style: professional, engaging, and approachable. He is the founder and CEO of Phillips Associates and the creator and chief architect of the Predictive Learning Analytics (PLA) learning evaluation methodology. He has more than 30 years of experience designing learning instruments and assessments. Also, to his credit are more than two dozen published learning instruments and articles. Ken also authored the recently released ATD TD at Work publication titled: "Evaluate Learning With Predictive Learning Analytics."

Course Dates

COURSE DATES: There are no additional 2022 dates scheduled for this course. To be informed of 2023 course dates, go here. 

Session 1: Coming in 2023!
Session 2: Coming in 2023!
Session 3: Coming in 2023!
RAIN DATE: Coming in 2023!
The "Rain Date" is a date to reserve on your calendar. It will be used in the unlikely event that an earlier session can not run as planned due to technical difficulties or a speaker emergency.

Each session is 3 hours in length

All sessions start at 1:00 pm Eastern Time (New York time). Here is the time of the sessions listed in various time zones:
10:00 am - 1:00 pm Pacific Time (PT)
11:00 am - 2:00 pm Mountain Time (MT)
12:00 pm - 3:00 pm Central Time (CT)
1:00 pm - 4:00 pm Eastern Time (ET)

For times in other cities, visit visit this link. All sessions are recorded. In order to earn your Certificate of Completion, you must log in for and participate in each live course and successfully complete any homework assignments by specified deadlines. Recordings of sessions are intended for review purposes only.

Course Rates

Early-Bird Registration 30+ days prior to course start date: $745

Registration within 30 days of course start date: $895

Train as a Team and Save!
For questions on group discounts please go here.

Course Equipment

IMPORTANT - You'll participate in online and collaborative activities in a number of ways, each designed to provide a unique means to interact and learn from experts and colleagues. All course delivery software operates at Internet connection speeds of 56.6 kbps or better, on PC, Mac and Unix platforms. Programs will use teleconferencing or VoIP (voice over Internet Protocol.) The login instructions emailed to you approximately one week prior to the start of the course will outline platform use as well as any headset requirements or suggestions. Each registrant must provide their own laptop or desktop computer and other equipment (such as a headset, if noted in your login instructions) in order to fully and successfully participate in the course. Please test your login information a minimum of 48 hours in advance on your course start date on the computer you will be using for the course.

What Others Are Saying

Hear what past attendees have to say about this and other Certificate Courses. Read the testimonials.  
 

ATD Initial Eligibility and Recertification

Training Magazine Certificates have been pre-approved by the ATD Certification Institute to offer educational programs that can be used towards initial eligibility and recertification of the Certified Professional in Talent Development (CPTD) and Associate Professional in Talent Development (APTD) credentials.  For questions on initial eligibility and recertification, visit this link. 
This program has been approved for a maximum of 12 points.