Teleimmersion
Download as PPT, PDF1 like2,457 views
The document discusses a novel tele-immersion framework facilitating remote 3D collaboration by enabling users to share a virtual environment and interact with both real and virtual objects. This technology aims to overcome limitations of traditional video conferencing, enhancing user interaction and communication effectiveness. Despite its potential applications in various fields such as remote medical diagnosis and education, the framework faces challenges like high bandwidth requirements and image quality issues that need to be addressed.
![Internet-Wide Multi-Party Tele-Immersion Framework for Remote 3D Collaboration RINU MARKS.P REG NO.73023 [email_address]](https://image.slidesharecdn.com/teleimmersion-111219120058-phpapp01/85/Teleimmersion-1-320.jpg)
![JPEG COMPRESSION Each block is defined as M[x,y] ( i -1) * d <= x < i * d , 0 <= i < w ( j -1) * d <= y < j * d , 0 <= j < h d is the size w width and h height.](https://image.slidesharecdn.com/teleimmersion-111219120058-phpapp01/85/Teleimmersion-23-320.jpg)
![For each M[i , j] If all M[x, y] == 0 , then M '[i, j] = N . If all M[x, y] == 1, then M '[i, j] = A . If exists any M[x, y] == 0 and any M[x, y] == 1 , then M '[i, j] = B](https://image.slidesharecdn.com/teleimmersion-111219120058-phpapp01/85/Teleimmersion-24-320.jpg)
Teleimmersion
- 1. Internet-Wide Multi-Party Tele-Immersion Framework for Remote 3D Collaboration RINU MARKS.P REG NO.73023 [email_address]
- 2. Tele-Immersion is a new technology that enables a user to share a virtual space with remote participants. WHAT IS TELE-IMMERSION ???
- 3. Existing System Video conferencing. Fails to keep eye to eye contact. User interaction is limitted. When no. of persons conferencing increases it will be hard to concentrate on person who is actually talking.
- 4. site 3 site 1 site 2 BASIC CONCEPT
- 5. Not merely the 3D reproduction of the human body. It also allows us to interact with virtual objects in the shared virtual environment
- 6. Interaction with virtual objects
- 7. Tele-immersion reconstructs the objects in the real world in real-time, and mixes the real objects with the virtual environment
- 9. Various operations on 3d virtual objects such as “move”, “rotate”, “select”, “change texture”, “expand”, “shrink”, “highlight” Helps in eye to eye communication in multi party enironment.
- 10. ARRANGEMENTS
- 11. ARRANGEMENTS B&W cameras are for stereo construction. The color camera is for extracting the appearance
- 12. ARRANGEMENT
- 14. 3D image construction
- 15. Stages in 3D conversion Acquisition stage Reconstruction stage
- 16. Acquisition stage capture a variable amount of camera feeds . image-based calculations and color silhouette extraction. Image compression.
- 17. Sterio based reconstruction stage
- 18. Sterio based reconstruction 1. Calculate initial matching cost and are the color intensities in the left and right images d is the disparity hypothesis. denotes pixel in the left image and denotes pixel in the right image
- 19. 2. Construct a square window of predefined size with p as centre. 3. For each pixel q in window calculate adaptive support weight. and denotes the color and euclidean distance between p and q. are constants.
- 20. 4. Calculate aggregated cost of each support window. 5. By using optimization technique we calculate depth of discontinuous areas and reconstruct the body.
- 21. The user whole body is extracted by taking the difference between the current video frame and the registered background image. BACK GROUND SUBTRACTION
- 22. Real time compression Reconstructed 3d model is very large in size. Real-time compression is essential for real-time delivery. Modified jpeg compression.
- 23. JPEG COMPRESSION Each block is defined as M[x,y] ( i -1) * d <= x < i * d , 0 <= i < w ( j -1) * d <= y < j * d , 0 <= j < h d is the size w width and h height.
- 24. For each M[i , j] If all M[x, y] == 0 , then M '[i, j] = N . If all M[x, y] == 1, then M '[i, j] = A . If exists any M[x, y] == 0 and any M[x, y] == 1 , then M '[i, j] = B
- 25. Multi-Party Tele-Immersion using internet
- 26. Server side The TI server provides a virtual environment and room model to divide the users into groups. The system information such as user login/logout and their manipulations are written in database. The portal provides user login and real-time status display through web browsers with the help of database
- 28. Hardware Requirements 4-core Intel Xeon W3530 processor 6GB DDR3 RAM 2*500GB 7200rpm SATA Hard disk NVIDIA Geforce GTX 470 display card
- 29. Time delays
- 30. Time cost of 3D reconstruction & encoding
- 31. Time cost of decoding & rendering
- 32. Remote interaction delay on 3D objects
- 34. Applications Remote medical diagnosis and therapy. Remote and distributed education. Distributed artistic performance and interaction. Virtual travel and tourism. Automobile Engineering
- 35. Challenges Quality of transmission affected by high packet loss Very Expensive High bandwidth requirement. High speed internet is required (min of 60 MBPS)
- 36. CONCLUSION Still in its early stages of development. Challenges are need to be met. 3d reconstruction technology needs to be improved since the reproduced images are jittering. Tele immersion technology can surely lead to great developments in the field of communication.
- 37. References Proposal of Multimodal Communications System Using Tele-Immersion Technology ; IEEE Conference Tele-Immersion Environment for Video Avatar Based CVE ; IEEE Conference Distance Learning in Tele-Immersion Environment; IEEE Conference http://tele-immersion.citris-uc.org http://graphics.cs.brown.edu/research/telei
- 38. THANK YOU