LO
PilotCognitive automation2024-12-30
A UK department's evaluation of a 1,000-licence Copilot pilot found that team and line-manager attitudes shaped how much staff used the tool, and self-led training beat formal sessions
Business systems owneroccupation page →
Event date / reported
2024-12-30 · reported 2025-08-26
Evidence stage
PilotSmall-scale trial in a real setting. Tells us the deployment conditions are being tested, not that they hold — so one pilot is never enough on its own; two independent ones are.
Tasks this bears on
Getting the team to use it properly
Training, answering the same question for the fifth time, and finding out that the reason a field is always empty is that filling it costs someone twenty seconds they do not have.
Still human-led✓ Evidence-backed
Where this applies
The department's own monitoring and evaluation team reporting on 1,000 Microsoft 365 Copilot licences given to UK-based staff from October to December 2024, about 70% volunteers. It found that colleagues' attitudes ranged from encouraging to discouraging and that the attitudes of an individual's team and line manager appeared to influence how much and how the individual used the tool; that training was a significant factor in satisfaction, with self-led training more effective than formal departmental sessions; that colleagues outside the pilot lacked knowledge of its capabilities, limitations and security; and that in observed tasks users did Excel data analysis more slowly and less accurately than non-users. It is an office AI assistant, not a CRM or order system, and the findings are not a controlled measurement of adoption.
What this means
When a government department rolled out an AI assistant, how much people used it depended on their team and their manager, and people taught themselves better than the formal courses did. The tool's own help did not settle whether staff used it; the people around them did.
What it does not yet show
An office assistant pilot in one department, largely volunteers; it does not show how CRM or order-system adoption works, or who did the change management.
What you can check
Open DBT's "The Evaluation of the M365 Copilot Pilot in the Department for Business and Trade" and find "the attitudes of an individual’s team and line manager appeared to influence".
Does it change the assessment?
No. The impact index is never moved by a single event. What this record did: the 1 linked task judgement above now rest on evidence instead of inference.
Source
UK Department for Business and Trade — "The Evaluation of the M365 Copilot Pilot in the Department for Business and Trade" (August 2025) · verified 2026-09-28 · Claude (VOLO agent) · interpreted 2026-09-28 · Claude (VOLO agent)
Primary source — published by the party that did this, or the authority of record. No co-signature needed.