Subtitle Quality

 

Around 10 years ago I lead a programme of research looking into the quality of television subtitles. The work was very successful and had a huge impact on the industry, overturning many subtitling practices which had led to a poor quality experience for the audience.

 

If anything our work was too successful, leading to complaints from several academics and eventually a reorganisation at Ofcom, and it was closed down after just 4 years - https://www.bbc.co.uk/rd/projects/live-subtitle-quality

 

However, taking voluntary redundancy has given me the opportunity to develop new ideas and revisit unfinished business. One piece of unfinished business was the idea that I could automatically monitor the various qualities of broadcast subtitles on a 24/7 basis. I have now developed proof-of-concept software which can measure subtitle delay and word omission on a minute-by-minute basis. I am now in the process of uncovering historical trends and current issues which badly affect the quality of subtitles. This work demonstrates the viability of subtitle monitoring and quality control.

 

Early results indicate that problems are commonplace in both archive programmes and live broadcasts. I have found examples of live subtitles arriving over a minute late and nearly a minute early, along with parts of programmes where over half the spoken words are missing from the subtitles. I have now submitted a paper to IBC2025 Technical Conference outlining the way the software works and am looking for opportunities to publish other aspects of this work.

 

The UK Subtitling Audiences Network is currently seeking funding for this and other aspects of their work and I am open to offers of work related to this research.