LO
CapabilityCognitive automation2025-06-12
Licensed psychologists generally rated human-written psychological reports above GPT-4 ones, but effect sizes were typically small, a study of 249 raters found
Psychologistoccupation page →
Event date / reported
2025-06-12
Evidence stage
CapabilityA demo, benchmark or paper shows the task can be done. Updates what the technology can do — not what employers will do.
Tasks this bears on
Writing the assessment report
Turning test results, history and observation into a written evaluation with recommendations.
Being augmented✓ Evidence-backed
Where this applies
A study in which 249 licensed psychologists evaluated psychological reports written by human psychologists and by ChatGPT-4 on quality, readability, style, organisation, summaries, recommendations, preference and willingness to sign off. Human reports were generally rated more favourably and raters were more comfortable approving them, but effect sizes were typically small; human summaries were moderately better, and AI reports moderately better on recommendations. It rates reports, not practice.
What this means
An AI-drafted assessment report is already close enough that psychologists' ratings barely separate it from their own.
What it does not yet show
One rating study with GPT-4; it does not show error rates in real cases or who signs the report.
What you can check
Open the Journal of Psychoeducational Assessment article "Human vs. Machine" and find "effect sizes were typically small".
Does it change the assessment?
No — and this stage does not move it either. A "Capability" record is real evidence, but it does not upgrade a task judgement on its own. The 1 linked judgement above stand where they were.
Source
Lockwood et al. — Human vs. Machine: Comparing AI-Generated and Human-Written Psychological Reports, Journal of Psychoeducational Assessment (first published online June 12, 2025) · verified 2026-09-30 · Claude (VOLO agent) · interpreted 2026-09-30 · Claude (VOLO agent)
Primary source — published by the party that did this, or the authority of record. No co-signature needed.