Introduction to Zenitum's Vision based Mobile Augmented Reality Technology
3 likes708 views
Zenitum is introducing their zMART SDK for mobile augmented reality applications. The SDK uses Zenitum's zFT technology for precise vision-based tracking on both pre-defined and instantly generated targets. It supports rendering 2D, 3D, video and audio content onto tracked images and allows creation of augmented reality experiences across iOS and Android platforms. Zenitum aims to help grow the mobile AR market by providing developer tools and solutions to core technology and service firms.
Introduction to Zenitum's Vision based Mobile Augmented Reality Technology
- 1. Introduction to Vision based AR of ZenitumAlbertHeekwan Kim Founder & CEOmail : albertk@zenitum.comtwitter : @hkalbert
- 3. 3MarketMobile AR is popular, thanks to SmartphonesSuper popular in countries like Japan, Korea and US
- 4. 4MarketThe Future of Mobile AR will be BIG!say Research Firms around world Clearly,$350 million in 2014$732 million in 2014 $2.2 billion in 2015according to ABI Research (Oct. 22, 2009)according to Juniper Research (Nov. 24, 2009)The Gazillion Dollar Pie!according to ARC Chart (Nov. 8, 2010)
- 5. 5MarketFew Huddles to Overcomefor increasing the market even biggerFrom “ARC Chart”Before full augmented reality can be achieved, several technical hurdles must be overcome. 1. The availability of standardized visual content will be a significant hurdle in providing robust AR experiences2. Computer vision based object recognition and the accurate anchoring of content, must support real time processing- Peter Crocker, lead analyst of ARC ChartZenitum specializesSharable Standard AR ContentsHighly preciseVision basedTrackingHighly preciseVision basedTracking
- 6. 6TechnologyAR Technology Spectrumfocus on mobile platformsPre-define NFTInstant NFTSpace & DepthSquare MarkerstimeVision AR (Includes real-time tracking)GPS ARVisual Search (not AR)Service orientedCore technology oriented
- 7. 7TechnologyZenitum helps the market growinto a main stream industryMarketing FirmsCore Technology FirmsCore Tech. & Service FirmLicenseNew solutionsProviding Solution sApplying Existing solutionsProvides problem-specific solutions
- 8. Biased on proprietary HW products
- 9. More contract works than solutions
- 10. Provide proprietary AR technologies
- 11. License new solutions from Zenitum
- 12. Creating initial buzz is possible
- 13. Can’t provide actual solutions
- 14. Difficult to apply business models
- 15. Develop AR Apps based SDK
- 16. CreateAR content with AR Platforms
- 17. Create new AR paradigm
- 18. Own solutions to address the needs
- 19. Deploying multiple business modelsfor multiple industry domains
- 20. SDK to 3rd party developers
- 21. AR content publishing platforms8Zenitum - zMARTZenitum Mobile AR ToolMobile AR Software Developer KitzMARTzVAR SDK(Zenitum Vision AR)zGAR SDK(Zenitum GPS AR)zFT-1zFT-2GPSGyroAccelerometer
- 22. 9Zenitum - zMARTZenitum Mobile AR ToolMobile AR Software Developer Kit Android OS 2.1/2.2iOS 3.1+/4.x zMART ApplicationsContents Generation & Interaction Libraries (Custom Logic Support)Real-time AR Object Loader & Renderer (2D/3D/Video/Audio/Animated/Text)zMART Low-Level APIzVAR SDKforiOS (zFT)zVAR Pro SDKforAndroid (zFT2)zVAR SDKforAndroid (zFT)zVAR Pro SDKforiOS (zFT2)zNET for AR(Remote Data Accessing API)zGAR(Location-Based App. Logic)Platform-Independent AR Core Libraries (zFT / zFT2)Platform-Dependent I/O Libraries
- 23. 10Zenitum - zMARTOverview- Support rich AR experience using “zFT” core library based SDK- Platform-independent Natural-Feature Detecting & Tracking library- Platform-dependent input/output library for Core AR module- Dynamic 2D/3D contents loading & rendering with custom AR scene- Multiple platform supports (iOS, Android, WM, Symbian)- Compatible / Consistent features across platforms (including PCs)- APIs & Application Templates for developers
- 24. 11Zenitum - zMARTzVAR – zFT1Pre-defined image target trackingzFT-1Precise natural feature tracking engine
- 25. Pre-define target images ONLY
- 26. Up to 20 f/s tracking
- 27. Supports PC, Mac, iOS4, Android, WM, Symbian
- 28. Min. requirement: ARM 11 core with 500MhzUp to 20 f/s of AR tracking on pre-defined targetsLess than inch level of precise tracking available!zFT–1 AR Tracking Engine
- 29. 12Zenitum - zMARTzVAR – zFT1Pre-defined image target tracking- Texture/Image based Natural-Feature Detecting & Tracking : zFT Library + Natural marker generator (Off-line)- Support Video overlay or See-Through AR Object : OpenGL-ES + SceneGraph based renderer- Robust multiple tracking with pose estimation : Concurrent tracking with more than 5 targets- Robust tracking against rotation/moving/zooming/multi-resolution of natural target- Customizable contents definition for advanced scene rendering and interaction using XML and Lua script engine- Native AR Object format from conversion of various general 3D content format : 3DS, OBJ, MD2- Various audio format support for rich content interaction : MP3, WAV, OGG- Platform : iPhone 3GS/4G (iOS 4.x), Android (OS 2.1/2.2)- Fast target detecting time : less than 0.5 seconds (depends on natural features of target)- Maximum distance between device and target to detecting : 80 ~ 90 cm- Robust detecting against occlusion : more than 60% of target- Natural marker generation : multi-resolution of source image (at least 320x240 pixels), 10~20 minutes- Application development : Combination of zFT core library and application templates (for iOS and Android)
- 30. Zenitum - zMARTzVAR – zFT2Instant target information generationSnapshot & Tagging 3D contents in Real-timeI want to place an AR content on the logoInstant 3D AR contents tagged by usersand shared among userszFT-2Real-time target image generation
- 31. Precise natural feature tracking engine
- 32. Up to 20 f/s tracking
- 33. Supports PC, Mac, iOS4, Android, WM, Symbian
- 34. Min. requirement: ARM 11 core with 700MhzNo pre-defined targets needed. Just take photosInstant AR contents tagging and sharing is possible!zFT–2 AR Tracking Engine13
- 35. 14Zenitum - zMARTzVAR – zFT2Instant target information generation- Texture/Image based Natural-Feature Detecting & Tracking : zFT2 Library + Real-time natural marker generator- Integrated with powerful high level API for 2D/3D visualization engine- Support Video overlay or See-Through AR Object : OpenGL-ES + modular 2D/3D renderer- Robust multiple tracking with pose estimation : Concurrent tracking with more than 5 targets- Robust tracking against rotation/moving/zooming/multi-resolution of natural target- Advanced contents definition for AR scene rendering and interaction using XML- Support general 3D content formats for AR Object : .X, 3DS, OBJ, MD2 from general tool (e.g 3DS Max)- Animated 3D for AR Object using skinned-mesh type : .X format with advanced content engine- Various audio format support for rich content interaction : MP3, WAV, OGG- Platform : iPhone 3GS/4G (iOS 4.x), Android (OS 2.1/2.2)- Fast target detecting time : less than 0.5 seconds (depends on natural features of target)- Maximum distance between device and target to detecting : 80 ~ 90 cm- Robust detecting against occlusion : more than 60% of target- Natural marker generation : multi-resolution of source image (at least 320x240 pixels), instant generating & registration from device’s camera input
- 36. 15Zenitum - zMARTzMART ContentsSupported content types
- 37. 16Zenitum - zMARTclass CZFTENGINE{ void InitEngine(const unsigned int n=1); void GetProjectionMatrix(float pMatrix[16]);boolLoadMarker(const std::string &pFilename);boolFindMarker(const void* pSrcImage,floatfCameraMatrix[16]); void Render(); void Destroy(); …};Initialize EngineGet Camera Projection MatrixLoad MarkerFind MarkerRendering Object
- 38. 17Zenitum - zMARTThe basic flow of how to use zMART SDKStartInitialize Tracker
- 39. Marker
- 40. Object loader & rendererRendering 2D
- 41. 3D
- 42. Video, Audio. etcMarker Detecting & TrackingYesNoEnd
- 43. 18Zenitum - zMARTSupported Game EnginesFuture support
- 44. 19Zenitum - zMARTzMART Release ScheduleClosed beta (~ End of December)
- 45. Open Release (Jan. 2011 ~) - zFT-1
- 46. Ver. 2 Release (Mar. 2011 ~) - zFT-220Appendix – Demo VideoszFT (Zenitum Feature Tracker) - http://www.youtube.com/watch?v=YcgebgYeU5M - http://www.youtube.com/watch?v=O-myIJboPn0 - http://www.youtube.com/watch?v=OvLTOWoze0A - http://www.youtube.com/watch?v=AwBih_grEhU
- 47. D-Track (Space & Depth Tracker) - http://www.youtube.com/watch?v=ibWnY9ZXKzk - http://www.youtube.com/watch?v=7jUaxlS52tU
- 48. 2D Video AR Advertisement on ARAD- http://www.youtube.com/watch?v=O4QZv_RVtsc (on Newspapers) - http://www.youtube.com/watch?v=gMmCo2cX5lM (on Street Billboards) - http://www.youtube.com/watch?v=GfxcG-l8F64 (on Beer Cans) - http://www.youtube.com/watch?v=rf8-rP56wwg (on Streets and combination with GPS AR)