flexpad
- 1. JOURNAL:ACM, NEW YORK AUTHORS:JURGEN STEIMLE, ANDREAS JORDT, PATTIE MAES Presented by Aiswarya Gopal(P2ELT13002) Athira.L(P2ELT13023)
- 2. ďĄ Interactive system having a depth camera, projector, plain paper and hand-held displays
- 3. ďĄ Track deformed surfaces from depth images ďĄ Capture complex deformations and provide fine details ďĄ Prevents occlusions from fingers and hands ďĄ Avoids use of markers
- 4. ďĄ Manipulation of real world objects for interaction with computer systems ď§ Integration of physical and digital information ď§ Depth sensors ďĄ Degree o freedom ď§ People bend pages in book ď§ Bending interaction
- 5. ďĄ Two main contributions ď§ Algorithm for capture of complex deformations ď§ Detection of hands and fingers ďĄ Evaluation ď§ Two evaluation studies
- 6. ďĄ Deformation capturing ď§ Technologies used ⪠Light Space ⪠Kinect Fusion ⪠Omni touch ⪠Proxy particles ďĄ Disadvantages
- 7. ďĄ Flexible Display Interfaces ď§ Two types of work ⪠Deformable sheet or tape ⪠Deformation of handheld displays
- 8. ďĄ Components used ď§ Kinect camera ď§ Projector ď§ Sheet of paper ď§ Foam or acrylic ďĄ Flexible display material ďĄ Any sheet can be used as passive display ďĄ Two materials of sheet
- 9. ďĄ Kinect depth sensors ďĄ Looks at ď§ Removal of hands and fingers ď§ Global deformation model ď§ How global deformation model
- 10. Figure 3: Detection of skin by analyzing the point pattern in the Kinect infrared image. Center: Input. Right: Classification
- 11. Figure 4: Dimensions of the deformation model (left) and examples of deformations it can express (right).Figure 4: Dimensions of the deformation model (left) and examples of deformations it can express (right).Figure 4: Dimensions of the deformation model (left) and examples of deformations it can express (right).Figure 4: Dimensions of the deformation model (left) and examples of deformations it can express (right).Figure 4: Dimensions of the deformation model (left) and examples of deformations it can express (right).Figure 4: Dimensions of the deformation model (left) and examples of deformations it can express (right).Figure 4: Dimensions of the deformation model (left) and examples of deformations it can express (right).
- 12. ďĄ Trap deformations directly observed directly from Kinect sensors ďĄ Trade-off between tracking stability and set of detectable deformations
- 13. ďĄ High flexibility ďĄ 1:1 mapping
- 14. Figure 5: Exploring curved cross-sections (a), flattening the view (b), comparing contents across layers (c)Figure 5: Exploring curved cross-sections (a), flattening the view (b), comparing contents across layers (c)Figure 5: Exploring curved cross-sections (a), flattening the view (b), comparing contents across layers (c)Figure 5: Exploring curved cross-sections (a), flattening the view (b), comparing contents across layers (c)
- 15. Figure 6: Animating virtual paper characters
- 16. Figure 7: Slicing through time in a video by deformation
- 17. ďĄ Two evaluations are done ď§ Tracking performance ď§ User performance of deformation
- 18. Figure 9: Classification of skin. Top: depth input. Center: infrared input. Bottom: depth image after classification with skin parts removed.
- 19. RMS90: 2.10 mm (1.1) RMS90: 1.91 mm (1.2) RMS90: 2.67 mm (1.6) RMS150: 2.64 mm (1.3) RMS150: 3.07 mm (1.7) RMS150: 6.1 mm (4.2) RMS90: 4.58 mm (1.9) RMS90: 4.82 mm (2.2) RMS90: 4.93 mm (2.1) RMS150: 5.45 mm (2.7) RMS150: 5.15 mm (2.5) RMS150: 6.38 mm (3.8) RMS90: 4.58 mm (1.9) RMS90: 4.82 mm (2.2) RMS90: 4.93 mm (2.1) RMS150: 5.45 mm (2.7) RMS150: 5.15 mm (2.5) RMS150: 6.38 mm (3.8)
- 20. ďĄ Figure 11: Average trial completion time in seconds. Error bars show the standard deviation.
- 21. ďĄ Summary of study findings ď§ Highly flexible displays ď§ Single and dual deformations obtained with high precision level of +/-6 degrees ď§ High accuracy ď§ Average error was below 7mm
- 22. ďĄ Touch input on deformable displays ď§ Desired touch area is at the center ďĄ Active flexible displays ďĄ Available displays are limited ďĄ Smart materials ď§ Need for deformable and stretchable