Mediamixer – Community set-up and networking for the reMIXing of online MEDIA fragments
Download as PPT, PDF1 like377 views
The document discusses MediaMixer, a project focused on enhancing online learning through video content creation, sharing, and monetization. It highlights trends in online education and multimedia technology, addressing challenges in finding and reusing digital media effectively. Additionally, it explores the use of metadata and annotations for improved video fragment management and retrieval.
Mediamixer – Community set-up and networking for the reMIXing of online MEDIA fragments
- 1. 1 A Media Mixer for online learning Lyndon Nixon MODUL University lyndon.nixon@modul.ac.at OCWC Global 2014 Ljubljana, Slovenia 24-April-2014 Making learning materials more valuable for their owner and more useful for their consumer
- 2. 14.02.13 Slide 2 of 30 Structure of the talk • What is MediaMixer? • Trends on the Web and in e-learning: more creation and consumption of video • Required multimedia technology • Media fragment creation, description and re-mixing in a case study: VideoLecturesMashup • The MediaMixer offer for your content 2
- 3. 14.02.13 Slide 3 of 30 Introducing…. 3
- 4. 14.02.13 Slide 4 of 30 MediaMixer is a group of research and industry experts 4
- 5. 14.02.13 Slide 5 of 30 MediaMixer is the adoption of years of media R&D innovation 5
- 6. 14.02.13 Slide 6 of 30 MediaMixer is the promotion of innovative media technology 6
- 7. 14.02.13 Slide 7 of 30 Trends on the Web and in e-learning 7
- 8. 14.02.13 Slide 8 of 30 Online video is growing 8 • 78 hours of video is uploaded to YouTube per minute • Online mobile video viewing Video streaming accounts for 37% of all mobile traffic Of all video streaming traffic, YouTube accounts for 45% A Cisco study on mobile traffic growth expects • 66% of all traffic by 2014 will be video • having increased 66-fold from 2009 to 2014
- 9. 14.02.13 Slide 9 of 30 Online education is growing 9 • Learners & teachers are using the Internet both as a complement and a replacement to traditional learning – 60 million downloads of Open University materials at iTunes U in 4 years – “classroom flipping”: watch the lecture at home, spend time in class on the exercises
- 10. 14.02.13 Slide 10 of 30 Online video based learning 10 • Open content: Open CourseWare (20 000 courses) • Massive lecture capture system: Opencast Matterhorn project (700 universities) • Online portals specialised in video lectures: – Polimedia – VideoLectures.NET • 25 000 academic videos
- 11. 14.02.13 Slide 11 of 30 What about sharing & monetarizing content? 11 • Huge & growing amounts of valuable AV material but unable to effectively re-distribute or re-sell it. • Media owners & platforms would like to continue to benefit from the (online) availability of (older, long tail) content – currently content to make a free distribution (cf. open video) or use ad-supported hosting (eg. YouTube, own platform)
- 12. 14.02.13 Slide 12 of 30 Stock footage 12 Stock footage market: $2.88 billion global revenue „It is growing at more than 20% per annum, fuelled by increased demands for new programming and the huge saving it represents compared with shooting new footage. Interactive technology and the Internet will further contribute to the growth of the market as it makes stock footage cheaper and easier to locate and license.“ - http://moneyam.uk-wire.com/cgi-bin/articles/200201020827103514P.html
- 13. 14.02.13 Slide 13 of 30 Media asset re-use 13 • Getty Images ...While it started out providing expensive images for limited use to a small group of customers, now it also provides cheaper images for broad use to a big group of customers...
- 14. 14.02.13 Slide 14 of 30 Media re-mixing 14 Harlem Shake – Originally a free track – Went viral on YouTube – >100000 spin off videos with >400mil views (3/13) – Music owners can „claim“ use of their IP on YouTube videos – Revenue sharing up to 55% on every ad click in a video https://www.youtube.com/watch?v=Bfuh3JOSfSg Billboard, ‚Harlem Shake‘ – The Making and Monetarizing of Bauuer‘s Viral Hit
- 15. 14.02.13 Slide 15 of 30 The rise of MOOCs 15 • MOOCs: Massive Open Online Courses – 3 million user accounts, over 400 000 students registered within 4 months at edX – fixed course structures – require registration (if free or fee) – differing approaches to “open” licensing
- 16. 14.02.13 Slide 16 of 30 The re-use of MOOCs? 16 A learning „offer“ may be a remix of different content sources • Cost saving against recording new material • Tailored learning course for each learner • Multiple value from a single learning unit Mike Caulfield, KEEP LEARNING blog http://learning.instructure.com /2012/12/reuse-not- production-is-key-to-positive- mooc-impact/
- 17. 14.02.13 Slide 17 of 30 Needed media technology
- 18. 14.02.13 Slide 18 of 30 Issues for media re-use • How easy is it to find again the digital media we produce and store? • Computers are good for search on visual and aural features but is that how others search over media? • Text search of media generally looks for matches on text associated to media or in its metadata (title, description) • Finding matching scenes or shots in video, or regions in image, requires more detailed descriptions of media (at fragment level) • Finding matches may need to overcome linguistic ambiguities, synonyms or multilingualism in a textual search term (semantics) Well annotated media at fragment level can be easier to retrieve & re-use
- 19. 14.02.13 Slide 19 of 30 Issues for media re-use • How easy is it to offer annotated media across organisational boundaries for retrieval and re-use, including monetarization and copyright management? • MAMS are typically closed, proprietary & monolithic • Open publication of annotations requires agreed standards for media description, search query and results format, if each media provider is not to be yet another silo • Access to media assets online needs to support payment mechanisms and rights management Well managed media provision can create new revenue and marketing opportunities
- 20. 14.02.13 Slide 20 of 30 Media metadata As video collections grow, how to find again a specific video part? • Computers can only automatically extract low level media features while humans tend to query with high level “concepts” or “events” – Query by Example(QBE) – Content based Media Retrieval – Computer Vision “Semantic gap” an ongoing research issue!
- 21. 14.02.13 Slide 21 of 30 Media metadata (2) http://www.techspot.com/news/49172-google-creates-neural-network-teaches-itself-to-recognize-cats.html
- 22. 14.02.13 Slide 22 of 30 Media metadata (3)
- 23. 14.02.13 Slide 23 of 30 Media metadata (4) • Textual metadata has long been a key factor in media collections – Dublin Core has summarized the main fields for indexing and retrieval; different industries have developed richer metadata models – Manual entry by collection experts, varying terminology and interpretation – Increasing automated production of metadata from all available input sources (e.g. ASR, OCR, subtitling, transcripts,
- 24. 14.02.13 Slide 24 of 30 Media metadata (5) • „Named entity recognition“ (NER) extracts distinct entities out of natural language text – Disambiguation & classification – Trend towards global unique identification
- 25. 14.02.13 Slide 25 of 30 Media metadata: trade-off • More metadata – better retrieval / computer supported re-use – More manual curation – more cost – More automated creation – less accuracy Pre-annotate Using automatic techniques Annotate Human oversight via intuitive tool
- 26. 14.02.13 Slide 26 of 30 Pre-annotation • Determine the fragments of the video material and their topics – Segmentation based on 'natural markers' – Concept detection in video – Topic identification from extracted text Pre-annotate Using automatic techniques Annotate Human oversight via intuitive tool
- 27. 14.02.13 Slide 27 of 30 Annotation • Model the video description in a structured and semantic way – Structured metadata format – Media fragment identification – Entities mapped into a knowledge domain Pre-annotate Using automatic techniques Annotate Human oversight via intuitive tool
- 28. 14.02.13 Slide 28 of 30 Storage and retrieval • Metadata store alongside the media repository – Query by topic • Effective retrieval needs good query formulation – Controlled / known vocabularies, normalize or map free text to vocabulary terms – System learning, query suggestion or drill- down search (iteratively improve)
- 29. 14.02.13 Slide 29 of 30 Storage and retrieval – Result set is a list of relevant video fragments –Follow metadata to the URL of the video –Playback can be ordered & grouped (http://www.mediamixer.eu/jukebox/)
- 30. 14.02.13 Slide 30 of 30 An example with video lectures
- 31. 14.02.13 Slide 31 of 30 MediaMixer use case: Video fragment creation Fragments were created based on the slide synchronisation timeline. Transcripts (auto-generated by speech-to-text technology where necessary) were parsed and split across fragments.… there are three Kingdoms of Life, Bacteria, Archaea and Eukaryota...
- 32. 14.02.13 Slide 32 of 30 MediaMixer use case: Video fragment annotation Fragments were then annotated by extracting topics from their textual metadata (slide OCR or speaker transcription). Topics are connected to a global knowledge model (DBPedia). Video Fragment (4:41-5:12) Archaea
- 33. 14.02.13 Slide 33 of 30 MediaMixer use case: Video fragment management Annotations are managed in a separate metadata store. The store provides a semantic query endpoint returning lists of video fragments matching a query topic (including semantically related topics) Archaea Acidiplas ma „type“ relation Video Fragment (4:41-5:12)
- 34. 14.02.13 Slide 34 of 30 MediaMixer use case: Video fragment playback The front end uses HTML5 or Flash. Both codebases are extended to support video fragment playout. Individual playback can be modified to linear or non- linear channels (for e.g. a TV or mobile video experience)
- 35. 14.02.13 Slide 35 of 30 The MediaMixer offer to you
- 36. 14.02.13 Slide 36 of 30 MediaMixer community portal Free sign-up for email when new materials are available Intro to all technology at community.mediamixer.eu/technology Updated with latest materials on all Media Mixer topics: Technology use cases Demonstrators Tutorials, cf. Core Technology Set Presentations Software Specifications http://community.mediamixer.eu
- 37. 14.02.13 Slide 37 of 30 MediaMixer Webinars ALL Webinars are at http://mediamixer.eu/live They cover all technology areas and use cases (broadcasting, e-learning)
- 38. 38 Thank you for your attention! Contact us: Membership - http://community.mediamixer.eu Collaboration - email lyndon.nixon@modul.ac.at Say hello @project_mmixer