Lesson 7 of 8 · 9 min
Measuring adoption without monitoring
Track usage and value through team indicators and conversation, never through individual monitoring.
Measuring adoption tells you whether the effort is paying off and where to help. Done badly, it becomes monitoring, and the trust built during the launch collapses. The rule is simple: you measure the team, never people one by one.
- Usage: how many team members used the first case this month, how many requests were shared in the library.
- Value: the time saved on the chosen case, the perceived quality, the errors avoided or introduced.
Usage is easy to read, value requires talking to people. A short monthly questionnaire is enough: what saved you time, what cost you time, what worries you? The answers tell you where to help, far better than a number.
A study carried out in a customer support centre observed an average productivity gain of about 14% with an AI assistant, and much more for novice agents. That is good news for equality within the team. It is also a point to watch: a beginner must keep learning their job, and not only follow the suggestions.
References
- Brynjolfsson, Li, Raymond (2023). Generative AI at Work. NBER Working Paper 31161. www.nber.org/papers/w31161