Towards Socially Intelligent Media Computing
0 likes176 views
The document presents an overview of the AXMEDIS project, highlighting its goals to improve content production and distribution across multiple channels while addressing interoperability and DRM challenges. It details the technical architecture, content processing capabilities, and the project’s focus on automating content lifecycle management for enhanced user engagement and personalization. Furthermore, it emphasizes the project's potential applications in various contexts, including entertainment and social networking.
Towards Socially Intelligent Media Computing
- 1. Towards Socially Intelligent Media Computing Keynote at KESS 2nd International Symposium on Intelligent Interactive Multimedia Systems and Services, IIMSS09 Mogliano Veneto, Venice, Italy, organized by University of Milan, July 2009 Paolo Nesi DISIT-DSI, Distributed Systems and Internet Technology Lab Department of Systems and Informatics, University of Florence nesi@dsi.unifi.it, paolo.nesi@unifi.it http://www.dsi.unifi.it/~nesi, http://www.disit.dsi.unifi.it version 2.7e 1
- 2. Overview O AXMEDIS aims and complexity O AXMEDIS model and tools O AXMEDIS DRM O Automated back office tools O Distribution Scenarios O Exploitation Activities 2
- 3. Project Goals O Costs Reduction for content production and distribution for multichannel O Better integration along the value chain O Interoperability among channels/devices taking into account DRM and formats O Large range of different scenarios: From VOD to DVB From mobile to TV From B2B to B2C trials, take ups actions, .. O Along the social network growing, UGC, UGE 3
- 4. Partners 4
- 5. Automating Content/Metadata Life-Cycle x multichannel customizations languages DVB (T, S.. GRID Internet Fingerprint Packaging P2P P2P Active Search MPEG-21 Mobile processing OMA Gathering CMS Protection Social Net workflow Adaptation UGC flexibility Ingestion Data Collect. plug-ins Storage Reporting tools Enrichment Cross media Interop. DRM databases Authoring Profiling Statistics standards Metadata Licensing Players webservices Content Accounting optimisation 5
- 6. Major points of complexity O Modeling a flexible framework with Different content formats/models Different distribution formats/models Different devices, platforms, players,.. Different distribution protocols: streaming, download, progressive download, multipath streaming DIS, P2P, progressive P2P, … Different business and transactions models Different standards along the several aspects Different life cycles and best practices for back office Etc. 6
- 7. Mapping Main AXTools on Life-Cycle customizations languages DVB (T, S.. GRID solutions Internet P2P P2P sharing Mobile processing Social Net workflow UGC flexibility plug-ins tools databases standards webservices optimisation 7
- 8. Points of Complexity O Content formats vs players high production costs for authoring tools and players Lack of intelligence on players Custom vs standard, limited vs interoperable Large variety of platforms, mobile foot print O Protection, DRM along the value chain, B2B2C Number of licenses processed for objects: O(MN) Millions of users are licensed for millions of objects !! Managing life cycle rights and business models/transactions O Automated content production Production on demand, real time processing on user needs Dynamic and static profiling Dynamic content adaptation and formatting (layouting) Processing profiles and descriptors in real time Management of UGC and professional content O Multichannel production vs distribution Flexibility in refactoring/scaling up the back office Processing in real time, managing multichannel back office Huge costs of integration, business models, trans. Models… 8
- 9. AXMEDIS Technical Architecture User Interaction and/or Automated Control via WSs Multidev. Player & Plugins AXMEDIS (CP) AXMEDIS Authoring Tools AXMEDIS manual and AXMEDIS MPEG-21 Administrative Tools Content Processing autom. content sharing AXMEDIS DRM Metadata Resources Reporting Tools and Distribution Tools AXMEDIS Script Editor X& Multimedia Styles AXEPTool B2B P2P and Debug Plug-ins DRM Licenses ….. AXMEDIA B2C P2P AXCP GRID Scheduler Protection information Programme and Pub Plug in DRM Protection Content Query Workflow Content Manager Support Support Adaptation Support Support Descriptors Content Packaging Content Content Database Communic Metadata Crawling Support Processing Formatting Support Support Support AXMEDIS Model Supports and Plug-ins including support for XML, XSLT, WSDL, OS, etc. WS, https, AXMEDIS, Traditional and P2P AXMEDIS FTP, Webdav, MPEG-21 Distribution etc. DRM Servers Channels and servers CMSs Databases 9
- 10. Overview O AXMEDIS aims and complexity O AXMEDIS model and tools Lack of intelligence on players Custom vs standard, limited vs interoperable Large variety of platforms, mobile foot print High complexity of authoring tools and player High production costs O AXMEDIS DRM O Automated back office tools O Distribution Scenarios O Exploitation Activities 10
- 11. Interactive and intelligent Final users Browse, search O New content formats User generated O New TV formats proactive O integrated media info Multichannel O proactive with the users O attractive experience User generated O personalized O multichannel Saving experience interoperable O device interoperable 11
- 12. Examples: Intelligent Content O Single Files: audio, video, documenti, immages, etc.. O Interactive Content: HTML or SMIL as technology of User interaction Guids, games, etc. Valoriz. of Cultural Heritage content Educational Content O Proactive Wizard: Video messg. Recording, UGC Assisted upload Production of licenses User profile processing Taking decision Local indexing/searching Local assistant …. 12
- 13. AXMEDIS Object/Package Model unique mandatory content description identification special B2B metadata AxOID + …. AxInfo AxDublinCore AxMetadata AxMetadata AxMetadata AxObject AxMetadata AxMetadata AxContent AxResource MPEG21 AxMetadata Digital Item AxMetadata AxMethods AxObject resource embedding AxReferred hierarchical composition Object external content referencing Intelligent, logic & behaviour AxMethods 13
- 14. An example to wrap it all up Music Album Backstage AxInfo DublinCore Q Rights Owner Q Title Q Other Video Descriptions Q Producer Q Genre Q Rights Owner Q Video (e.g. MPEG7) Q Distributor Q Authors Q Producer Q Genre Album Cover Bonus Q Distributor Q Authors Q Rights Owner Q Image Resource video Q Producer Q Author Q Subtitles Languages Q Distributor Q Size JPG image Playing time Referred Q Object Resolution Album Lyrics (printable) Q Q Doc Resource Q Q Rights Owner Producer Q Authors Resource Q Distributor Q Format PDF MPEG2 Video Album Tracks track track track track track Q… Q… Q… Q… Q… Q Rights Owner Q Audio collection O Metadata will be Q Producer Q Time mp3 mp3 mp3 mp3 mp3 always accessible Q Distributor length for indexing and querying 14
- 15. AXMEDIS Cross Media Content O Any content inside a package: Mix of: HTML, SMIL, MPEG-4, video, audio, text, Documents, images, actions, games, animations, etc. Additional content and interactivity for the end users compliant and extending MPEG-21 O AXMEDIS Intelligent content allow user/producers to create content for other devices: ringtones, mobiles, … support social activity annotations user generated content personal collections internal query customized for culture and language 15
- 16. Interoperable Players 16
- 17. Overview O AXMEDIS aims and complexity O AXMEDIS model and tools O AXMEDIS DRM Standards de facto, lack of acceptance, … Millions of users are licensed for millions of objects !! Number of licenses processed for objects: O(MN) Managing life cycle rights and business models/transactions Lack of agreements about the meaning of rights and ontology O Automated back office tools O Distribution Scenarios O Exploitation Activities 17
- 18. market solutions viz AXMEDIS Business Models Larger number of Business Models B2C DRM B2B, B2C, B2B2C DRM solution Proprietary / Standard DRM and model Standard DRM: MPEG-21, OMA, etc. Non interoperable DRM Allowed Interoperable DRM: MPEG-21, OMA, etc. Fixed/Flexible Protection Model Any Protection Model, key, algorithms, etc. Separation among Content and license Separation among Content and license Signed Content Header Signed Content AXINFO, any Metadata Channel distribution Multichannel with the same license Players and Devices Players and Devices: PC MS-Windows, PDA Windows Mobile, STB, Linux OS, Apple MAC (in progress), Java Mobiles License Proprietary: Licenses MPEG-21 REL: Expandable dictionary, any type of number of rights, domainss rights, licenses OMA, domains Authentication of Player Authentication of device, user, domain, etc. Revocation per Player Revocation per device, user, etc, Revocation per license Revocation per license Source code non accessible Source Code Accessible Limited Metadata Any metadata, custom metdata, any ID, any Descriptor Media content, simple content, not intelligent Any digital format, of any type: audio, video, image, games, doc, and Cross media: SMIL, HTML, MPEG-4,… INTELLIGENT content Customizable Tools Customizable Tools: servers and player clients 18
- 19. Managing License Chain, B2B and B2C Carl ALICE BOB O Alice states, “Bob has the right to issue a license to anyone to print the book in Italy” O Bob states, “Carl has the right to print the book in Italy” O To solve the SubSubLicense for Carl all the connected Licenses are needed O Licenses have to be accessible on Processing Engine O Alice can revoke the license to Bob 19
- 20. Cross media content and composition O AXMEDIS objects can be used as components for creating other added values AXMEDIS objects Allowing the production added value object for composition or integration of protected content Who is composing can add its own prot. and licensing Allowing the Rights Management of Composition, in the digital world similarly at what is performed in the physical world The shares along the value chain are de facto formalized 20
- 21. Managing License Chain and Protection Information Protection Protection Protection Protection Info Info Info Info Action log database Certifier and Supervisor Store Key License Server, Protection Manager Support DRM Processor use use Produce use License Produce Right Produce Produce Auth. License Auths to License Auth to License Content integrate distribute Digital provider Protected Content Content Metadata Integrator Distributor Resource Content Integrated Digital provider Digital Protected Protected Content Content 21
- 22. DRM and Domain Management O Users are strongly interested in acquiring a content to be used in their domain in which they have their Home devices, cars, mobiles, etc. O Media Centers and/or Home Servers are going to manage content and licenses for the whole domain One license for all devices and people ADSL Domain Server 22
- 23. Overview O AXMEDIS aims and complexity O AXMEDIS model and tools O AXMEDIS DRM O Automated back office tools Flexibility and scalability of back office, thousands of features, complex media processing language, programming grid Processing profiles and descriptors in real time Production on demand, real time processing on user needs Management of UGC and professional content Dynamic and static profiling Dynamic content adaptation and formatting (layouting) O Distribution Scenarios O Exploitation Activities 23
- 24. Enabling massive content production and processing Author Producer / Aggregator / Distributor / Facilitator User AX Editors AX P2P AXCP Tools AX Players O AXMEDIS GRID language and tools for Automated Content Ingestion and Gathering Automated Content Query and Retrieval Automated Content Load and Storage: databases and files Automated Content and Metadata Processing, enrichment Automated Content and Data processing Automated Content Filtering and Repurposing Automated Content Composition, Formatting Automated Content Protection and Licensing Automated Content Publication/Download on/from any channel Automated Content Distribution via Multichannel Automated Profiles management and processing Automated Production of Content on Demand Automated semantic processing, recc, taking decisions, etc.. ….. 24
- 25. AXMEDIS Content Processing GRID Workflow AXCP Front end Front end manager Visual Designer servers, servers, VOD, prod VOD, prod on demand on demand AXMEDIS Visual Elements Rule Editor and Rules AXCP Quick Scheduler Starter AXCP GRID Rules AXCP nodes Plug-in for content processing WS, FTP, Distribution AXMEDIS Channels etc. Your CMSs Database and servers 25
- 26. Some Snapshots from the examples shown 26
- 27. AXCP Visual Designer 27
- 28. AXCP for empowering Media Portals Users AXMEDIS Rule Editor User and Device profile Distributor front end Server Few Ready to Add use rules info Activate Rule Content Databases Scheduler Personalized Content on AXCP GRID Demand Content: Search, Selection, Acquisition, Production, Adaptation, Transcoding, Formatting, Packaging, Protection, AXMEDIS Publication and Licensing on Demand DRM APPLICATIONS: balancing, Other DRM UGC, repurposing, publication, YouTube, .. recommendations, integration P2P, …. with SN, redistribution, crawling 28
- 29. Cross media Content Adptation 29
- 30. Automated Formatting Engine 30
- 31. Examples of Cross media Adapation 31
- 32. Overview O AXMEDIS aims and complexity O AXMEDIS model and tools O AXMEDIS DRM O Automated back office tools O Distribution Scenarious Large range of possible applications: 3-play, 4-play, Multichannel, CH applications, mobile, etc. Flexibility in refactoring/scaling up the back office Processing in real time, managing multichannel back office Huge costs of integration, business models, transaction Models… O Exploitation Activities 32
- 33. Multichannel Distribution O VOD, Video or Content on Demand: Internet P2P, PC, mobile, IPTV streaming: STB Motorola Streaming of AXMEDIS MPEG-21, audio/video Progressive download of AXMEDIS MPEG-21, audio/video O Satellite data broadcast Distribution in Push, STB/PVR O DVB-T EPG + recording + intelligent content HD protection in stream O PDA and Kiosks Push on Kiosks, Download on PDA O Mobiles Interoperable MPEG-21 and OMA DRM production AXMEDIS/MPEG-21 player for mobiles Download and progressive download on mobiles, java O UGC, user generated or posted content Automated production, transcoding, licensing, etc. Multichannel support for social network XMF, social network, .. O P2P as support for the above channels B2B and/or B2C networks
- 34. AXMEDIS P2P network architecture AXMEDIA P2P Metadata Query Support AXTracker AXMEDIS DRM AXEPTool P2P AXEPTool AXCP P2P Control Distributor AXEPTool Download Distributor AXCP P2P Control AXEPTool AXEPTool AXMEDIS P2P Network 34
- 35. and VOD on PC with P2P Cross media Content, from video, audio to complex content Media Club Sale and CRM Accounting and service reporting Portal AXMEDIS issue license DRM Controlled P2P network 35
- 36. Push Distribution and AXMEDIS Technology AXMEDIS Content Processing AXMEDIS DRM EUTELSAT Broadcast Server Sale Manager 36
- 37. Content Production on the Consumer Side Cross media Cross media Content, Content, from from video, audio to complex content video, audio to complex content Added value content via ADSL Recording, added TV free value Content on air Package on site production and domain BBC Broadcasting management DVB-T Free on air transmission Accounting and reporting AXMEDIS DRM 37
- 38. Examples Content from AX4HOME 38
- 39. Overview O AXMEDIS aims and complexity O AXMEDIS model and tools O AXMEDIS DRM O Automated back office tools O Distribution Scenarios O Exploitation Activities DRM B2C solution for complex content Intelligent proactive content with DRM Cultural heritage content repurposing and distribution Social networking Smart mobile social enabled content, personal recommendations 39
- 40. Content Enrichment with final users O http://www.variazioniproject.org O Content Enrichment produced and reproduced on demand production with DRM AXMEDIS web player 40
- 41. Access to Open Archive resources In collaboration with FRD, Italy 41
- 42. AXMEDIS DRM with O AXMEDIS Hiding complexity O AXMEDIS AXCP protection packager O AXMEDIS Active X Player O AXMEDIS DRM registration License servers AXCS 42
- 43. Distribution of cultural content, AV guides O At MUSA: instrument museum at Accademia Nazionale di Santa Cecialia, Roma O Usable for AV guides, even with RFID O Production of content for continous formation, in medical area or for other interactive guides O Monitoring of the user activities AXCP Editors AXCP Quick Start, Your tools commands, Workflow systems,… AXCP GRID databases AXCP Scheduler WEB Server FTP, WS, etc. AXCP Node AX P2P Servers 43
- 44. DC Store, DC Channel O Distribution of large objects ISO of CD, DVD, etc. as protected intelligent content O Distribution via P2P, protection via AXDRM O The intelligent content played into the AXMEDIS player helps the user to make registration, certification … O The Intelligent content extract the ISO on the disk AXCP Quick Start, AXMEDIS Your tools commands, Workflow systems,… DRM Servers AXCP GRID databases AXCP Scheduler WEB Server FTP, WS, etc. AXCP Node AX P2P Servers 44
- 45. Mobile Medicine Social Network •PC….., i-Phone, Java, Back office Windows Media, …. automatico •MEDIA + flow, interactive, calculators, etc. Obj prof 45
- 46. Multichannel social integration AXCP GRID Content: Search, Selection, Acquisition, Production, Adaptation, Transcoding, Formatting, Packaging, Protection, Publication and Licensing on Demand User generated content Personalized Content on Demand 46
- 47. Recommendations: UU, OU, OO, ..
- 48. Personal Mobile Social Intelligence AxObjectFinder HTML & CSS Based Presentation Engine AxPDAPlayer Media Player Download/updateM Search Engine Local Browser User Behavior File Explorer PDF player information Contextual Taxonomy collection Browser anager ….. player Content Indexer, semantic ingestion/processing Local PDA SQLite DB files 48
- 49. O Thanks! O Tools can be download from web sites and on shareware sites O http://www.axmedis.org Tools, docs, etc. O http://mobmed.axmedis.org Mobile Medicine Social network O http://xmf.axmedis.org …. O …. 49