Sensory Effect Dataset and Test Setups
Download as PPTX, PDF1 like1,458 views
This document describes a sensory effect dataset and test setups for evaluating multimedia content enhanced with sensory effects like wind, vibration, and light. The dataset contains 76 video clips across different genres annotated with sensory effect metadata. Three test setups are proposed using ambient lighting and vibration chair systems. The goal is to provide a common set of multimedia content and testing environment for subjective quality assessments of sensory-enhanced experiences.
![OUTLINE
Motivation and Context
Sensory Effect Dataset
Sensory Effect Metadata Generation
Dataset Review Process
Test Setups
[Evaluations see prev. QoMEX papers]
Conclusion
15 July 2012 Sensory Effect Dataset 2](https://image.slidesharecdn.com/qomex2012dataset-120715095013-phpapp01/85/Sensory-Effect-Dataset-and-Test-Setups-2-320.jpg)
Sensory Effect Dataset and Test Setups
- 1. SENSORY EFFECT DATASET AND TEST SETUPS Markus Waltl, Christian Timmerer, Benjamin Rainer, Hermann Hellwagner Multimedia Communication (MMC) Research Group, Institute of Information Technology (ITEC) Alpen-Adria-Universität Klagenfurt, Klagenfurt, Austria E-mail: firstname.lastname@itec.uni-klu.ac.at Acknowledgments. This work was supported in part by the EC in the context of the ALICANTE (FP7-ICT-248652), SocialSensor (FP7-ICT-287975), and QUALINET (COST IC 1003) projects and partly performed in the Lakeside Labs research cluster at AAU.
- 2. OUTLINE Motivation and Context Sensory Effect Dataset Sensory Effect Metadata Generation Dataset Review Process Test Setups [Evaluations see prev. QoMEX papers] Conclusion 15 July 2012 Sensory Effect Dataset 2
- 3. MOTIVATION From traditional multimedia to sensory-enriched multimedia E.g., wind, vibration, and light effects Goal: increasing the Quality of Experience Lack of common test content for performing subjective quality assessments 15 July 2012 Sensory Effect Dataset 3
- 4. CONTEXT MPEG-V (ISO/IEC 23005): interoperability between virtual worlds and the real world Seven parts: (1) architecture, (2) control information, (3) sensory information, (4) virtual world object char., (5) data formats for interaction dev., (6) common types and tools, (7) conformance + ref. software Part 3 Sensory Information Sensory Effect Description Language (SEDL) Sensory Effect Vocabulary (SEV) Sensory Effect Metadata (SEM) May be associated to any kind of multimedia content (e.g., movies, music, Web sites, games) Steer sensory devices like fans, vibration chairs, lamps, etc. via an appropriate mediation device 15 July 2012 Sensory Effect Dataset 4
- 5. MPEG-V: MEDIAEFFECT DATASET SENSORY CONTEXT AND CONTROL Currently, no common content for evaluations of sensory effects available 76 video sequences from 5 genres 38 action 12 documentary 8 sports 5 news 13 commercial Enriched with light, wind, and vibration ~1.6GB, available under NDA 15 July 2012 Sensory Effect Dataset 5
- 6. SENSORY EFFECT METADATA GENERATION Video sequences enriched with sensory effects using the Sensory Effect Video Annotation (SEVino) tool Advantages Easy to use Platform independent Support all formats and codecs (from VLC) Create MPEG-V- compliant SEM descriptions 15 July 2012 Sensory Effect Dataset 6
- 7. DATASET REVIEW PROCESS 15 July 2012 Sensory Effect Dataset 7
- 8. TEST SETUPS Evaluations with sensory effects need special devices, e.g., ambient light, fans, vibration chairs Three setups using amBX system and Cyborg Gaming Lights Setups have been used in user studies or evaluated internally 15 July 2012 Sensory Effect Dataset 8
- 9. TEST SETUPS 15 July 2012 Sensory Effect Dataset 9
- 10. TEST SETUPS 15 July 2012 Sensory Effect Dataset 10
- 11. TEST SETUPS 15 July 2012 Sensory Effect Dataset 11
- 12. CONCLUSIONS Sensory effect dataset can be used to perform assessments with enriched multimedia content Provides a number of test sequences from various genres in different bit-rates and resolutions Most sequences from the dataset were already used in user studies Proposed a number of test setups that can be used for performing QoE evaluations accompanied by sensory effects 15 July 2012 Sensory Effect Dataset 12
- 13. SENSORY EXPERIENCE LAB http://selab.itec.aau.at/ Software and Services Standardization Publications Media Funding 15 July 2012 Sensory Effect Dataset 13
- 14. THANK YOU FOR YOUR ATTENTION 15 July 2012 Sensory Effect Dataset 14