SlideShare a Scribd company logo
Temporary Coherent
3D Animation
Akshat Singh
B.Tech IV year
Table of Content
» Defination
» Method
» Steps Involved
» Acquisition System
» Data Acquisition
» Unified Skeletal Animation Reconstruction
» Temporally Coherent 3d Animation Reconstruction
» SIFT features
» Merging of three cameras
» Bone-length Variation
» Evaluation
Defination
Method for capturing human motion
over 360 degrees by the fusion of
multi-view RGB-D video data from
Kinect sensors using feature point
sampling
Method
» Capture real-world objects and technique ranging
from shape matching to deformation toward
coherent animation
» Use RGB data,3D reconstruction for deapth
reconstruction
» Background segmentation dealing with RGB color
space
Steps Involved
Acquisition
System
» frame of input RGB and Depth
images
» separately resampled in a 3D
point cloud
» point clouds are merged in a
unified global coordinate system
» RGB frames from three cameras
» Frontal and profile faces are
detected in two cameras
» depth data with the overlaid
skeleton from Kinect
» unified skeleton from the two
cameras towards which the actor's
face is oriented
Data Acquisition
Merging of three cameras
» unified two point clouds black and red
» corresponding two skeletons after the extrinsic calibration
» Unified skeleton reconstructed
Unified Skeletal Animation
Reconstruction(Still)
» unified two point clouds black
and red
» corresponding two skeletons
after the extrinsic calibration
» Unified skeleton reconstructed
Unified Skeletal Animation
Reconstruction
Zoomed-out point cloud with feature
points shown in blue and green. Red
point at time-step t is to be matched,
and green points are the five nearest
feature points.
Shows the zoomed-in point cloud at t.
Motion vectors are calculated with
respect to the 5 nearest feature points.
These motion vectors are used to
calculate the matching point at t+1 ,not
centered on any point because the
matching is resolution independent
Temporally Coherent 3d Animation
Reconstruction
Estimating Optical
Feature Points
Estimating
Geometrical
Feature Points
Mapping
Unified
skeleton
reconstruct
from method
Alignment
using Motion
Vectors
SIFT features using a simple Euclidean
distance measure D
» Matching of optical feature
points between two RGB images
using SIFT.
» SIFT feature has a location
q(t) = (u, v, t)
» Optical feature points L(t)
» mapping between L(t) and
L(t + 1)
Bounding-box
and Skeleton
Overlap
Estimation
Bone-length
Variation
Evaluation
» Comparison against direct RGB-D SLAM
» Comparison against feature-based RGB-D
SLAM
» Evaluation of the residual configuration
» Depth vs inverse depth in the geometric
reprojection error
» Computational time
» Failure modes
» Qualitative results
Place your screenshot here
Code Link
» https://github.com/
alejocb/rgbdtam
» https://www.youtube.co
m/watch?v=sc-
hqtJtHD4
THANK you!
Any questions?
You can find me at
» Linkedin/akshat7497
» akshat7497@gmail.com

More Related Content

PDF
Remotesensingandgisapplications
PPTX
Urban 3D Semantic Modelling Using Stereo Vision, ICRA 2013
PPTX
Visual Saliency: Learning to Detect Salient Objects
PDF
3D mapping of a quarry
PPTX
Semantic Mapping of Road Scenes
PDF
論文紹介"DynamicFusion: Reconstruction and Tracking of Non-­‐rigid Scenes in Real...
PPT
Automatic Dense Semantic Mapping From Visual Street-level Imagery
PDF
Spatial station
Remotesensingandgisapplications
Urban 3D Semantic Modelling Using Stereo Vision, ICRA 2013
Visual Saliency: Learning to Detect Salient Objects
3D mapping of a quarry
Semantic Mapping of Road Scenes
論文紹介"DynamicFusion: Reconstruction and Tracking of Non-­‐rigid Scenes in Real...
Automatic Dense Semantic Mapping From Visual Street-level Imagery
Spatial station

What's hot (20)

PDF
POSTER_BUSTOS
PPT
Soft Shadow Maps for Linear Lights
PPTX
Colour Correction using Histogram Stretching
PDF
Vf sift
PDF
A Three-Dimensional Representation method for Noisy Point Clouds based on Gro...
PPT
witenberg-iit-research-poster-jul2015(1)
PDF
PPT
Self-dependent 3D face rotational alignment using the nose region
PDF
C42011318
PPT
9A_1_On automatic mapping of environmental data using adaptive general regres...
PPT
mathpsy2012 poster_Shweta_3(1)
PPT
Miniproject final group 14
PPTX
OpenStreetMap in 3D - current developments
PPTX
3D Laser Scanning for Oil & Gas Facilities
PDF
2018 GIS in the Rockies Vendor Showcase (Th): ERDAS Imagine What's New and Ti...
PDF
Modeling Count-based Raster Data with ArcGIS and R
PPTX
ICRA 2015 interactive presentation
PDF
PR-240: Modulating Image Restoration with Continual Levels via Adaptive Featu...
PPT
3D Analyst - Lake, Jatiluhur
PPTX
Real-Time Visual Simulation of Smoke
POSTER_BUSTOS
Soft Shadow Maps for Linear Lights
Colour Correction using Histogram Stretching
Vf sift
A Three-Dimensional Representation method for Noisy Point Clouds based on Gro...
witenberg-iit-research-poster-jul2015(1)
Self-dependent 3D face rotational alignment using the nose region
C42011318
9A_1_On automatic mapping of environmental data using adaptive general regres...
mathpsy2012 poster_Shweta_3(1)
Miniproject final group 14
OpenStreetMap in 3D - current developments
3D Laser Scanning for Oil & Gas Facilities
2018 GIS in the Rockies Vendor Showcase (Th): ERDAS Imagine What's New and Ti...
Modeling Count-based Raster Data with ArcGIS and R
ICRA 2015 interactive presentation
PR-240: Modulating Image Restoration with Continual Levels via Adaptive Featu...
3D Analyst - Lake, Jatiluhur
Real-Time Visual Simulation of Smoke
Ad

Recently uploaded (20)

PPTX
Geodesy 1.pptx...............................................
PPTX
CARTOGRAPHY AND GEOINFORMATION VISUALIZATION chapter1 NPTE (2).pptx
PPTX
Engineering Ethics, Safety and Environment [Autosaved] (1).pptx
PDF
BMEC211 - INTRODUCTION TO MECHATRONICS-1.pdf
PPTX
Lesson 3_Tessellation.pptx finite Mathematics
PPTX
Strings in CPP - Strings in C++ are sequences of characters used to store and...
PDF
Digital Logic Computer Design lecture notes
PDF
Mohammad Mahdi Farshadian CV - Prospective PhD Student 2026
PPTX
Lecture Notes Electrical Wiring System Components
DOCX
ASol_English-Language-Literature-Set-1-27-02-2023-converted.docx
PDF
SM_6th-Sem__Cse_Internet-of-Things.pdf IOT
PDF
The CXO Playbook 2025 – Future-Ready Strategies for C-Suite Leaders Cerebrai...
PDF
Operating System & Kernel Study Guide-1 - converted.pdf
PPTX
CH1 Production IntroductoryConcepts.pptx
PPTX
Welding lecture in detail for understanding
PPT
Mechanical Engineering MATERIALS Selection
PPTX
Internet of Things (IOT) - A guide to understanding
PDF
Structs to JSON How Go Powers REST APIs.pdf
PPT
Project quality management in manufacturing
PDF
Evaluating the Democratization of the Turkish Armed Forces from a Normative P...
Geodesy 1.pptx...............................................
CARTOGRAPHY AND GEOINFORMATION VISUALIZATION chapter1 NPTE (2).pptx
Engineering Ethics, Safety and Environment [Autosaved] (1).pptx
BMEC211 - INTRODUCTION TO MECHATRONICS-1.pdf
Lesson 3_Tessellation.pptx finite Mathematics
Strings in CPP - Strings in C++ are sequences of characters used to store and...
Digital Logic Computer Design lecture notes
Mohammad Mahdi Farshadian CV - Prospective PhD Student 2026
Lecture Notes Electrical Wiring System Components
ASol_English-Language-Literature-Set-1-27-02-2023-converted.docx
SM_6th-Sem__Cse_Internet-of-Things.pdf IOT
The CXO Playbook 2025 – Future-Ready Strategies for C-Suite Leaders Cerebrai...
Operating System & Kernel Study Guide-1 - converted.pdf
CH1 Production IntroductoryConcepts.pptx
Welding lecture in detail for understanding
Mechanical Engineering MATERIALS Selection
Internet of Things (IOT) - A guide to understanding
Structs to JSON How Go Powers REST APIs.pdf
Project quality management in manufacturing
Evaluating the Democratization of the Turkish Armed Forces from a Normative P...
Ad

Temporary Coherence 3D Animation

  • 2. Table of Content » Defination » Method » Steps Involved » Acquisition System » Data Acquisition » Unified Skeletal Animation Reconstruction » Temporally Coherent 3d Animation Reconstruction » SIFT features » Merging of three cameras » Bone-length Variation » Evaluation
  • 3. Defination Method for capturing human motion over 360 degrees by the fusion of multi-view RGB-D video data from Kinect sensors using feature point sampling
  • 4. Method » Capture real-world objects and technique ranging from shape matching to deformation toward coherent animation » Use RGB data,3D reconstruction for deapth reconstruction » Background segmentation dealing with RGB color space
  • 6. Acquisition System » frame of input RGB and Depth images » separately resampled in a 3D point cloud » point clouds are merged in a unified global coordinate system
  • 7. » RGB frames from three cameras » Frontal and profile faces are detected in two cameras » depth data with the overlaid skeleton from Kinect » unified skeleton from the two cameras towards which the actor's face is oriented Data Acquisition
  • 8. Merging of three cameras » unified two point clouds black and red » corresponding two skeletons after the extrinsic calibration » Unified skeleton reconstructed
  • 9. Unified Skeletal Animation Reconstruction(Still) » unified two point clouds black and red » corresponding two skeletons after the extrinsic calibration » Unified skeleton reconstructed
  • 10. Unified Skeletal Animation Reconstruction Zoomed-out point cloud with feature points shown in blue and green. Red point at time-step t is to be matched, and green points are the five nearest feature points. Shows the zoomed-in point cloud at t. Motion vectors are calculated with respect to the 5 nearest feature points. These motion vectors are used to calculate the matching point at t+1 ,not centered on any point because the matching is resolution independent
  • 11. Temporally Coherent 3d Animation Reconstruction Estimating Optical Feature Points Estimating Geometrical Feature Points Mapping Unified skeleton reconstruct from method Alignment using Motion Vectors
  • 12. SIFT features using a simple Euclidean distance measure D » Matching of optical feature points between two RGB images using SIFT. » SIFT feature has a location q(t) = (u, v, t) » Optical feature points L(t) » mapping between L(t) and L(t + 1)
  • 15. Evaluation » Comparison against direct RGB-D SLAM » Comparison against feature-based RGB-D SLAM » Evaluation of the residual configuration » Depth vs inverse depth in the geometric reprojection error » Computational time » Failure modes » Qualitative results
  • 16. Place your screenshot here Code Link » https://github.com/ alejocb/rgbdtam » https://www.youtube.co m/watch?v=sc- hqtJtHD4
  • 17. THANK you! Any questions? You can find me at » Linkedin/akshat7497 » akshat7497@gmail.com