Voice Dubbing Automation
- 1. Presented by: Utkarsh Agrawal Presented to: Prof. Michael Frank Automated Movie Dubbing System (A-Dubb) MIS-730: Integrating Information Systems
- 2. ● Introduction ● Corporate Strategy ● Problem Statement ● Problem Scenario ● Solution Statement ● Solution Scenario ● Technological Aspect ● Current situation sequence Diagram ● Proposed situation Sequence Diagram ● Current situation structure Diagram ● Proposed structure Diagram ● Cost Analysis ● Marketing Plan ● Success Metrics Agenda for tonight’s presentation
- 3. Introduction ● Everyone likes to watch a movie without subtitles. Even better if the movie is in the language of their choice. ● A - Dubb is software that gives you an experience to enjoy a movie in your regional language. It will not only eliminate the pain to dub a movie/video in different languages but also saves a lot of time and money. ● What makes A - Dubb different from other softwares is that it will dub in the same voice of the original artist rather than a regional artist.
- 4. Corporate Strategy Mission: To provide best in class quality voice dubbing in multiple languages in original voice. Vision: To provide service not only to production houses but also make it available for low budget producers so that they can release their videos online with an ease in multiple languages.
- 5. Problem Statement ● Watching movies in regional language is no fun when the voice of the original artist is dubbed into some regional artist. ● Because of the delay in dubbing, all movies are not released at the same time worldwide.
- 6. ● Watching a movie in other language than the original language can be lesser the fun if the dialogues are dubbed in the voice of regional artist because the dialogue delivery and the punch lines are one of the features that makes a movie blockbuster. ● Due to delay in dubbing and releasing movie on different dates in different continents causes a huge loss in terms of box office collections because of piracy. ● Different release dates also puts out the spoilers. ● If movies has many actors, then dubbing company should cast more artists for dubbing. It costs money and time too. ● Of all, if the production house wants some changes whole/partly process should begin from first. Problem Scenario
- 9. The current (as-is) process..
- 10. Competitors who follow as is: (Dubbing studios) 1. GMD linguistics : https://gmdlinguistics.com/our-services/dubbingvoiceover/ 2. Media Movers : http://www.media-movers.com/index1.htm 3. VSI : http://www.vsi.tv/ 4. JBI : https://www.jbistudios.com/entertainment-localization-services 5. The Kitchen : https://www.thekitchen.tv
- 11. Solution Statement ● Provide end-to-end translated movies/clips. ● The translated clips will retain the voices of original artists. ● Companies can save a lot of money by not hiring local artists. ● Also, auto-dubbing will save a lot of time and effort. ● The validations of translated/dubbed scripts will be done by professionals. Few advantages : ● Decreases time taken for dubbing from 17 weeks to 18 days. ● Production houses can convert dubbing for multiple languages at one place only. ● Decreases cost for making the dubbing.
- 15. Technological Aspect 8 9 10 ODAF with BM
- 16. PROTOTYPE
- 17. Original Video
- 18. Dubbed Video
- 19. Technological Aspect Synchronize DAF with ODAF based on: ● Speed : speed of speaking ● Tempo : speed or pace of a given piece of music. (30 types) ● Distortion : to identify fuzzy, growling or gritty tone ● Echo : repetition of a certain passage or word ● Starting point ● Ending point ● Silence recognition
- 21. Current scenario Structure diagram
- 23. Solution scenario Structure diagram
- 24. Cost / Revenue Analysis A-DUBB Software Budget estimations:
- 25. Cost/Revenue Analysis ● A-Dubb will provide services on per video basis, the software would be deployed on a website so the video file would have to be uploaded to get a dubbed version. ● Before getting the movie or the series dubbed a certain amount would have to paid. ● There will not be any cost associated with hiring of local artists for dubbing. ● So depending on the length of the movie, the service charge would be calculated. ● Per Minute rate will be around 5 dollars, so for a movie with a run time of 161 minutes it will cost 80.5 dollars for the customers. ● We’ll have a tie-up with Entertainment Companies such as Netflix, Amazon Prime and Production houses such as Universal Studios, Warner Bros etc and we will dubb the movies/series for them in as many languages as they want before releasing it worldwide and as this will be millions of dollars contract with the studios it will be lucrative for the business
- 26. Importance of Marketing Plan ● It helps a Business to identify the Target customers and understanding their needs. ● It helps to map out a strategy to reach your target audience, including the messages, channels and tools you will use. ● It helps to set specific, measurable goals and timeframes for your marketing activities. ● To understand how do our competitors meets the needs of our target customers. ● It helps allocating budgets and resources.
- 27. Product Benefits ● Best in class quality voice dubbing with original voice for Production Houses & Customers. ● Low cost software. ● Shortest Service Cycle ● Releasing movies in multiple languages at the same time world-wide. ● Increase in Revenue for Production Houses. ● Less Production Efforts. ● Pay per Minute and not per Session ● No hidden costs
- 29. Target Audience Domestic Grosses http://www.boxofficemojo.com/yearly/chart/?yr=2017 http://www.boxofficemojo.com/studio/
- 30. Competitors ● Video Dubber- http://videodubber.com/ ● Wavepad - http://www.nch.com.au/wavepad/index.html ● Voice Q- https://www.voiceq.com/ ● AberCap- https://www.abercap.com/services/language/voice-dubbing/
- 31. Promotions Types of Promotions, discounts and couponS ● Percentage based discount ● Dollar value discount ● Free gift ● Free trial ● Money back guarantee ● 24/7 Customer Support ● Referral offers Places to Promote ● Social Media ● Production House Events ● Theatres ● Netflix ● Radio ● TV
- 32. Metrics of Success Performance Metrics: ● Website: Website Crash Rate is defined as average crashes per Website load. ● Response Time: The average latency time from a request to response. General thumb of rule is 1 second time. ● Network Errors: Network errors are typically the service provider or HTTP errors seen by the Website when the website is interfacing to a networked service. Network errors can lead to crashes or slow response time
- 33. User and Usage Metrics: ● Monthly Active User: MAU highlights the user base of the Website. It keeps track of MAU’s and the trends (growing/shrinking/uniform). This metric is particularly important since our revenue model depends on a large user base is required in order to be successful. ● Demographic Metrics: Tracking the usage according to location of users is very useful. This kind of data will enable to identify issues faster.
- 34. Engagement Metrics: ● Translation efficiency: Translation of the audio in accordance to the original language would be the translation efficiency. Gibberish audio would indicate an erroneous translation. Audio indicating sentiments, such as vehement speeches should exhibit angry sentiments ● Audio and Video Synchronization: Video and audio should be synchronized, there shouldn’t be any time lapse between the video and audio clips.
- 35. Engagement Metrics ● Retention Rate: Retention is measured as the percentage of users who return to website based on the date of their first visit. Retention highlights the most engaged and valuable users, creating better targeting opportunities and personalization of the website experience. ● User Rating: This is one of the most important metrics since it is visible to current and prospective customers.
- 36. Future Scope ● Image Rendering- This technique will be applied to match lip syncing with voices ● Application- An application similar to google translator, with their own voices ● Live Translation- Auto Dubb live speeches, news, commentaries ● Advertisement- Auto Dub for advertisements, that’ll increase the market reach, as it’ll cover a lot many demographics.
- 37. References 1. http://www.slate.com/business/2018/05/blockbuster-shows-like-kusama-and-bowie-ruining-art- museums.html 2. https://www.quora.com/How-do-the-companies-that-dub-live-action-movies-and-TV-shows-into- different-languages-dub-them-in-a-way-that-ensures-that-the-new-dialogue-matches-the-lip- movements-as-closely-as-possible 3. https://www.daytranslations.com/blog/2015/06/the-main-aspects-of-film-translation-6292/ 4. https://www.independent.co.uk/arts-entertainment/films/features/how-to-dub-a-film-2365083.html 5. https://ccm.net/faq/1266-extract-audio-from-any-video-using-vlc 6. https://lyrebird.ai/ 7. https://en.wikipedia.org/wiki/List_of_Italian_musical_terms_used_in_English 8. Neural Voice Cloning with a Few Samples Sercan O. Arık ¨ * 1 Jitong Chen * 1 Kainan Peng * 1 Wei Ping * 1 Yanqi Zhou 1