SlideShare a Scribd company logo
Presentation by
Alex Varley

 Does measuring subtitle quality
 really make any difference?
Welcome to the Future
SubtitHAL 9000
Automatic scanning result:

Reading speed = 182 wpm
91.87% accuracy
This is your second offence.

Your broadcast license will
be suspended for 20 hours.
You will be automatically
fined €40,000.
Metrics are much better.

                                  Easy to
      Clear rules
                                  measure




 Easy to                                Easy to
regulate                              understand



                    Easy to see
                      errors
This type of approach works best for
       everyone but the viewer



                       Viewer




          Regulator,
           supplier,
         broadcaster
Different countries = different rules
Everybody agrees on some rules

  Subtitles should be accurate

  Non-live subtitles should be
  synchronised

  Subtitles must not cover on-screen
  information
Accuracy



               100%-75%
What does accuracy mean?
Delay

        Time lag for live subtitles:

                      3-7 seconds
           Or delay the broadcast
A live program is
                           1 hour


              ?                          4 hours


                      Before broadcast


           96 hours                  24 hours


                          72 hours
Reading speed



120 wpm – no limits




                180 wpm used to be popular
If you make everything
measurable then people
focus only on the metrics
In Australia quality will be measured by:

• Readability
• Synchronisation
• Accuracy

The key outcome is can the viewer
comprehend the program?
In Australia we recognise that:

Live subtitling is where all of the errors and
problems usually occur

So live subtitles should be a last resort,

Even for “Live” programs
Live sport will have live scrolling subtitles
News should have a mix of block
and scrolling subtitles.
These all impact on quality of live subtitles

                Market
                                       Training
                pricing




                                            Preparation
        Regulation
                                               time



                          Complexity
                           of output
As a regulator it is better to focus on:

•   Do viewers know what to expect?
•   Are quality errors repeated?
•   Is every supplier doing the same thing?
•   Are you acting consistently?
•   Do you work with suppliers to fix issues?
•   Is the market working?
Punishing one-off errors is a waste of time
But letting cowboys into the market means
that everybody has to be a cowboy.
Contact:
alex.varley@mediaaccess.org.au
www.mediaaccess.org.au

   Thanks to Chris Mikul who sits
   through the hours of regulator
   meetings and helped research this
   presentation.

More Related Content

PPTX
Menterjemah sari kata
PPT
字幕Key in easy 學
PPTX
Subtitle Translation
PPTX
Audiovisual Translation for Foreign Language Learning: New Multimodal Approaches
PPT
Introduction to audiovidual translation by adriana serban
PPTX
Audiovisual journalism
PPTX
AUDIO VISUAL TRANSLATION
PDF
There's a fix for that: Top 5 OTT challenges & how to resolve them
Menterjemah sari kata
字幕Key in easy 學
Subtitle Translation
Audiovisual Translation for Foreign Language Learning: New Multimodal Approaches
Introduction to audiovidual translation by adriana serban
Audiovisual journalism
AUDIO VISUAL TRANSLATION
There's a fix for that: Top 5 OTT challenges & how to resolve them

Similar to Languages and media presentation alex varley slide share (20)

PDF
Streaming Reliability Engineering
PDF
ZT: It's Not the Cost, It's the Quality
PPTX
See How You Can Do More with 3Play Media (1).pptx
PDF
Conviva at Inter BEE 2017
PPTX
Perceptual Video Metrics, a New Vocabulary for QoE
PDF
Top IPTV Providers & Why a Reliable Service Matters.pdf
PDF
The power of personalised video experiences in a challenging advertising land...
PDF
LiveBurst slides ENG
PPTX
OSDC 2014: Fernando Hönig - New Data Center Service Model: Cloud + DevOps
PPTX
SWINDON Silicon System - All Your ASIC Answers
PPTX
Integrating GPS, Pool Service and the Customer
PDF
Seattle Video Tech: The Future of SSAI on OTT Devices
PDF
Optec Brochure
PPTX
Video Testing Best Practices: How to Guarantee High-Quality Video for your Cu...
PDF
Cheshire AV 1.21.10
PDF
LATINON - Media kit
PDF
How to quickly and easily reduce streaming costs
PPTX
HyperScale India OTT Operators and Right KPIs
PPTX
The Art of Documentary Film Editing.pptx
Streaming Reliability Engineering
ZT: It's Not the Cost, It's the Quality
See How You Can Do More with 3Play Media (1).pptx
Conviva at Inter BEE 2017
Perceptual Video Metrics, a New Vocabulary for QoE
Top IPTV Providers & Why a Reliable Service Matters.pdf
The power of personalised video experiences in a challenging advertising land...
LiveBurst slides ENG
OSDC 2014: Fernando Hönig - New Data Center Service Model: Cloud + DevOps
SWINDON Silicon System - All Your ASIC Answers
Integrating GPS, Pool Service and the Customer
Seattle Video Tech: The Future of SSAI on OTT Devices
Optec Brochure
Video Testing Best Practices: How to Guarantee High-Quality Video for your Cu...
Cheshire AV 1.21.10
LATINON - Media kit
How to quickly and easily reduce streaming costs
HyperScale India OTT Operators and Right KPIs
The Art of Documentary Film Editing.pptx
Ad

More from Media Access Australia (12)

PPTX
How we’re going and new frontiers: Blind Citizens Australia Conference 2015
PPTX
Digital Accessibility - The Quick Wins
PPTX
Excerpts from ANZCED 2013: Beyond access – using captions to teach skills and...
PPTX
Empathy training & the accessible web experience
PPTX
Supporting employment with accessible communications
PPTX
Web accessibility: it’s everyone’s responsibility
PPTX
2015 Presentation: Front End Meetup
PPTX
Accessible consumer technologies and the cloud - Dr Scott Hollier, VisAbility...
PPTX
Accessibility & the Cloud: Current & Future Trends - Dr Scott Hollier at the ...
PPTX
The NDIS: a role-based ICT approach - Dr Scott Hollier at the Disability Empl...
PPT
The Path to WCAG 2.0 Through Industry Based Training
PPT
Professional Certificate in Web Accessibility case study
How we’re going and new frontiers: Blind Citizens Australia Conference 2015
Digital Accessibility - The Quick Wins
Excerpts from ANZCED 2013: Beyond access – using captions to teach skills and...
Empathy training & the accessible web experience
Supporting employment with accessible communications
Web accessibility: it’s everyone’s responsibility
2015 Presentation: Front End Meetup
Accessible consumer technologies and the cloud - Dr Scott Hollier, VisAbility...
Accessibility & the Cloud: Current & Future Trends - Dr Scott Hollier at the ...
The NDIS: a role-based ICT approach - Dr Scott Hollier at the Disability Empl...
The Path to WCAG 2.0 Through Industry Based Training
Professional Certificate in Web Accessibility case study
Ad

Recently uploaded (20)

PDF
NewMind AI Weekly Chronicles - August'25-Week II
PPTX
Tartificialntelligence_presentation.pptx
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Accuracy of neural networks in brain wave diagnosis of schizophrenia
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PPTX
SOPHOS-XG Firewall Administrator PPT.pptx
PDF
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
PPTX
Group 1 Presentation -Planning and Decision Making .pptx
PPTX
MYSQL Presentation for SQL database connectivity
PDF
Encapsulation theory and applications.pdf
PDF
Machine learning based COVID-19 study performance prediction
PPTX
Spectroscopy.pptx food analysis technology
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
PPTX
Machine Learning_overview_presentation.pptx
PDF
Electronic commerce courselecture one. Pdf
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
NewMind AI Weekly Chronicles - August'25-Week II
Tartificialntelligence_presentation.pptx
“AI and Expert System Decision Support & Business Intelligence Systems”
Diabetes mellitus diagnosis method based random forest with bat algorithm
Digital-Transformation-Roadmap-for-Companies.pptx
Accuracy of neural networks in brain wave diagnosis of schizophrenia
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
Reach Out and Touch Someone: Haptics and Empathic Computing
SOPHOS-XG Firewall Administrator PPT.pptx
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
Group 1 Presentation -Planning and Decision Making .pptx
MYSQL Presentation for SQL database connectivity
Encapsulation theory and applications.pdf
Machine learning based COVID-19 study performance prediction
Spectroscopy.pptx food analysis technology
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
Machine Learning_overview_presentation.pptx
Electronic commerce courselecture one. Pdf
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf

Languages and media presentation alex varley slide share