Learning Measurement & Data Analytics

Learning Measurement and data analytics are essential tools in the instructional designer’s toolkit.

male person working at laptop displaying a dashboard

The Importance of Measurement and Data Analytics

Measuring the impact of learning is about more than just “completion rates”—it is about proving value and driving performance. I approach learning measurement through the lens of the Kirkpatrick Model, ensuring that learning solutions are is evaluated not just on learner satisfaction (Level 1), learning transfer (Level 2) but also on its ability to shift behaviors (Level 3).  I also have experience measuring business results (Level 4), but the amount of time required to completing a Level 4 evaluation should be reserved for the highest priority projects.

My methodology is deeply influenced by the Six Disciplines (6Ds) of Breakthrough Learning, which allows me to bridge the gap between training and application. By treating learning as a continuous process rather than a one-time event, I design data-driven strategies that align educational outcomes with organizational goals, ensuring the interventions I build provides a tangible return on investment.

Kirkpatrick Level 4 Experience: the impact of webinar attendance on sales prodution

Hypothesis: Sales agents who attend three or more company sales webinars in a year sell more than agents who attend less than three webinars in a year.

Methodology:

  • Gathered data:
    • year over year training data
    • year over year sales agent-business relationship manager interactions
    • agent years of experience
    • year over year market specific sales data to eliminate differences between markets
    • gathered additional data to account for as many variables as possible
  • Completed a regression analysis using MS Excel
  • My analysis was reviewed by company data scientists for accuracy.

Result: Hypothesis proven! My analysis showed that attending sales webinars was positively correlated to sales production, proving that my training team’s efforts were having an impact on sales.