Measuring corporate e-learning success: beyond completion rates

Completion is not learning

The completion rate measures that an employee reached the end of the course. They may have finished it by clicking quickly through the slides. So treat it as an initial indicator, not a final result.

Kirkpatrick's four levels

The well-known Kirkpatrick model measures training at four levels. The platform serves levels one and two directly, while levels three and four need data from outside it, so it helps to plan for them from the start of the program.

• Reaction

  Was the trainee satisfied, and did they find it useful? A short survey at the end of the course.

• Learning

  Did they gain the knowledge? A pre-test and post-test.

• Behavior

  Are they applying what they learned at work weeks later? Manager observation or a performance review.

• Results

  Did a business metric improve: fewer errors, higher sales, fewer complaints?

What Moodle offers

According to Moodle's documentation, completion is tracked at the activity level (view, grade, or submission) and at the course level. You can set course completion criteria such as: completing specific activities, achieving a course grade, manual sign-off by a given role, or other criteria available in your version. From there you pull completion reports and trigger certificates. Practical tip: don't base completion on merely "viewing the page". Tie it to a quiz grade or an assignment submission so it means something.

Useful metrics

• Completion rate by department

  Which departments are lagging

• Time to completion

  Is the course too long or complex?

• Pre-test vs. post-test difference

  How much learning actually happened

• Questions most people get wrong

  Gaps in the content or in the question

• Drop-off point

  Where trainees stop following along

• Trainee rating of the course

  Course quality from the trainee's point of view

• Linked business metric

  The real impact on performance

Linking training to a business metric

Before launch, choose one metric tied to the course. For example, a customer service course might link to the complaint rate, and a safety course to the number of incidents. Then compare before and after training, or between a trained group and one not yet trained. This alone doesn't prove causation, since other factors change too, but it is far stronger than a completion rate.

Reports that help management

• One page with three or four metrics, not twenty

• Comparison with the previous period and the target

• A clear recommendation at the end

  What we will change in the next course.

• A breakdown by department or team for those who need it

Common mistakes

• Relying on the completion rate alone

• Not defining what to measure before building the course

• Long surveys nobody answers

• Ignoring trainee drop-off data

• Collecting more personal data than needed, which harms privacy

Frequently asked questions

• What's the minimum I need to start measuring?

  A short pre-test and post-test, a three-question survey, and a completion rate tied to the passing grade.

• Do I need xAPI?

  Not if the training happens inside the platform. See the standards article.

• How long until real results show?

  The behavior and results levels take weeks or months depending on the work. Set the measurement date in advance.

Sources

• Moodle documentation

  Course completion.

• The Kirkpatrick model of training evaluation