Picture a compliance course that hits 98% completion. The dashboard is green, the audit trail is clean, and everyone moves on. Then a field team has to set up a small educational meeting for local HCPs, and many of them are unsure whether the registration page needs a privacy notice. Nothing in that LMS report could have told you.
This is not an argument against the LMS. It is an argument about what we ask it to prove. Completion measures activity. What Commercial Excellence, Medical and compliance leaders actually need to know is whether people remember and can apply what they learned, weeks later, in front of a customer. You do not get there by replacing the LMS. You get there by building the missing layer around it.
The LMS is the foundation, and it does that job well
It is worth being fair to the LMS before criticising how it is used. For a pharma or MedTech organisation with thousands of employees across dozens of markets, it is indispensable infrastructure. It holds the approved courses, manages learning paths and certifications, assigns mandatory training by role and country, and gives auditors a record of who completed what and when. In a regulated industry, that record is not optional.
The trouble starts when completion quietly becomes the definition of success. A dashboard can tell you 95% of the field completed the new product module. In many LMS set-ups, that is where the reporting stops: there is an end-of-module quiz score, but no view of how much people remember weeks later, which concepts they understood, or which ones they now hold slightly wrong. Some platforms can do more than they are configured to do. The useful question is not what an LMS could do in theory, but what yours shows today.
And knowledge is what people carry into the car park before a call.
When a knowledge gap becomes a business gap
Picture a rep three weeks after a launch training. The LMS shows her as fully trained. In the visit, the specialist asks how the new data applies to patients with a particular comorbidity. She hesitates. Maybe she has forgotten the subgroup, confused it with a competitor's result, or never quite understood the difference between the primary endpoint and a secondary one.
That is not a lack of effort. It is a gap, and it showed up at the worst possible moment. She sounds less sure, the specialist's trust dips a little, and the next visit is harder to get. In Life Sciences, the consequences can be worse than a lost opportunity: a rep who gives outdated or incorrect information is a compliance problem, and a medical information problem, and a brand problem.
So the business question is not whether someone completed a course. It is whether they know what they need to know when they need to use it. Being trained is not the same as being ready, and most learning dashboards only measure the first.
Completing a course does not mean remembering it
Everyone has lived this. You finish a course, the material feels familiar, you feel confident. A few weeks pass and some of it is simply gone.
The forgetting curve is one of the oldest findings in psychology. Ebbinghaus described it in the 1880s, and Murre and Dros replicated it in 2015, with a single participant relearning lists of nonsense syllables: most of the loss came within the first day, and after 31 days the savings on relearning were about 4%. That doesn't tell you how much of a product course a rep forgets; real work material is far more meaningful than nonsense syllables. What it does show is that unrehearsed material fades fast and that spacing helps, which matters most when people are asked to absorb the most: onboarding, launches, label updates, new compliance rules.
Familiarity makes it worse. Having seen something feels like knowing it. That is why a quick knowledge check a week after a course so often surprises the people who designed it.
Having seen something feels like knowing it. That is why a quick knowledge check a week after a course so often surprises the people who designed it.
So how do you upgrade an LMS? Not with more courses
The instinct, when knowledge looks weak, is to add content: a refresher module, a longer version, a new learning path. That rarely works, because the problem is rarely a shortage of content. It is usually the absence of anything that happened after the course.
The upgrade is a layer around the LMS that does four things most LMS implementations we see are not set up to do:
- Asks people to retrieve key concepts regularly, in short bursts, after the course ends.
- Measures what each person knows, question by question, instead of whether they finished.
- Sends each person reinforcement for their own gaps, not the whole course again.
- Shows leaders where knowledge is weak by team, country and topic, early enough to act.
Short, regular retrieval
Once a course is complete, the key concepts should come back through short interactions: a question on a product feature, a compliance scenario, a challenge on the differentiators, a refresher before a visit. Answering a question forces active retrieval, and retrieval is what strengthens memory. Re-reading or re-watching creates familiarity; answering creates knowledge. A minute is enough, if it is the right minute.
Built for how the field actually works
Field teams do not have long blocks at a desk. They have a few minutes before a meeting, a wait in a hospital corridor, a train between cities. That is too short for a traditional module and long enough for five questions. Reinforcement has to live on the phone and fit the gaps in the day, or it will not happen. Some teams also add short audio summaries for time in the car, which work well as long as they are followed by a question; listening alone is still passive.
From activity data to knowledge data, and from knowledge to gaps
Once you measure knowledge instead of activity, something more useful appears: people do not share the same gaps. One rep knows the clinical data well but struggles with access and pricing questions. Another handles pricing easily but forgets the key patient types. A completion rate hides both. So does an average score.
That is where knowledge measurement earns its place. By analysing each person's answers, question by question, you can see precisely where the gaps sit across individuals and teams, and how they change over time. You can also see something most completion reports don't show: when many people are wrong in the same way, which usually means the training material was ambiguous or an old message is still circulating.
Targeted reinforcement, and a strict definition of "fixed"
Finding a gap only helps if you act on it, and sending someone back through a 40-minute module is rarely the answer. They may already know 90% of it. What they need is help with the 10% they do not.
This is how our Gap Fixing works: each person receives a short fix for the specific questions they got wrong, and is asked again later. A critical gap counts as closed only when the same person answers 5 of 5 later check questions on the same concept correctly. It is a stricter standard than a single retest, deliberately, though still an assessment rule: it makes a lucky guess unlikely, and it shows knowledge, not what someone does in a call. The loop is simple and continuous: identify, reinforce, test again, measure.
To give a sense of what that looks like in practice: in a compliance programme we ran in 2021 for a pharma affiliate in Spain, around 250 people from the field, medical and marketing played 180 questions on their own code and procedures over four days. The questions reflected the company's own code and procedures, and the league ran alongside the mandatory training rather than replacing it. Readiness went from 82% at first attempt to 88% at last attempt, and the remaining gaps were concentrated in a handful of process details where many people shared the same wrong answer. The design sent those into a following wave.
From knowledge data to business impact
For years, L&D has been asked to prove its value with completion, attendance, training hours and satisfaction. Those have their place. But a Commercial Excellence director or a country manager wants to know something else: what did the training change?
Knowledge data lets you get closer to that question. You can show which messages the field answers correctly across markets, how many people still hold outdated information, how quickly new hires close their gaps, and where managers should spend ride-alongs. Those are still knowledge measures, not proof of behaviour or sales, but they are much nearer to the risks and opportunities the business cares about than a completion rate.
A fair objection is that connecting knowledge to sales is hard, and that many things move sales at once. True. We would not claim a clean causal line from a quiz score to market share. But the argument does not need one. If you know, by territory, that half the team cannot state the key differentiator correctly, you do not need a regression to know that is a problem worth fixing before the next cycle.
LMS plus a knowledge layer: what it looks like in a normal week
In practice the two work together without much ceremony. An employee completes a product course in the LMS. A few days later, a short challenge brings back the key concepts, played against colleagues. The answers show where knowledge is solid and where it is not. The weak points get targeted fixes. The person is asked again later. The manager sees the team's readiness by topic before the next field visit. And the LMS keeps doing what it does best: holding the courses, the paths and the audit trail.
How the data moves between the two depends on your set-up, and it is worth being concrete before you buy anything. At a minimum, the knowledge layer needs a list of people with their team, country and role, and it produces per-person, per-question results. In many programmes those move as scheduled file exports; some organisations integrate more tightly. Ask any vendor, us included, exactly which connection exists for your LMS today rather than assuming one.
Two further points decide whether this works. The first is content governance. Every question and every fix has to come from approved material and go through the same medical-legal review as the course itself, otherwise you have simply created a second, unreviewed channel to the field. The second is ownership. Someone has to read the gap data every week and decide what happens next, whether that is a targeted fix, a manager conversation or a correction to the course. Without an owner, knowledge data becomes one more dashboard nobody opens.
You do not need to replace your LMS. You need to finish the job it started.
For organisations that have invested heavily in an LMS, replacement would be expensive, disruptive and mostly pointless. The LMS is not the problem. The problem is that, in many set-ups, the learning experience stops when someone clicks "complete", and the knowledge starts fading the same afternoon.
At Atrivity, we build the layer that comes after: gamified challenges on the phone, knowledge measurement per person and per question, Gap Fixing, and readiness views for managers. It sits alongside your LMS and uses your approved content. If you want to test it, pick one course your field completed recently and ask ten questions about it next week. The answers will tell you whether the upgrade is worth it.