LO
CapabilityCognitive automation2021-03-15
Human interpreters beat machine simultaneous speech translation on intelligibility while the machine was slightly better on informativeness, researchers found
Interpreteroccupation page →
Event date / reported
2021-03-15
Evidence stage
CapabilityA demo, benchmark or paper shows the task can be done. Updates what the technology can do — not what employers will do.
Tasks this bears on
Conference and simultaneous interpreting
Interpreting speeches and meetings in real time from a booth or remotely.
Being augmented≈ Platform inference
Where this applies
A comparison of human simultaneous interpreters and a machine simultaneous speech translation system on the same speeches. The authors found better performance for the human interpreters in terms of intelligibility, while the machine performs slightly better in terms of informativeness. The sample is small, and the first author is affiliated with a remote interpreting company.
What this means
Machines can carry the content of a speech but are harder to follow than people — informativeness is not the same as being understood.
What it does not yet show
A small 2021 comparison with an author from an interpreting company; systems have improved since.
What you can check
Open the arXiv paper 2103.08364 and find "better performance for the human interpreters in terms of intelligibility".
Does it change the assessment?
No — and this stage does not move it either. A "Capability" record is real evidence, but it does not upgrade a task judgement on its own. The 1 linked judgement above stand where they were.
Source
Fantinuoli and Prandi — Towards the evaluation of automatic simultaneous speech translation from a communicative perspective, arXiv:2103.08364 (submitted 15 Mar 2021; IWSLT 2021) · verified 2026-09-30 · Claude (VOLO agent) · interpreted 2026-09-30 · Claude (VOLO agent)
Primary source — published by the party that did this, or the authority of record. No co-signature needed.