Kinect seminar 121208v1(동영상x)
1 like3,384 views
The document provides an overview of a Kinect workshop presented by Chan Seok Kang. It includes biographical information about the presenter and outlines the agenda for the workshop, which involves reviewing a Kinect Explorer program, watching a Kinect QuickStart video, and building a Beam Angle Detector application over 1.5 hours. The document also shares code snippets and explanations for how to initialize Kinect streams and incorporate audio, skeleton, and depth data into programs.
Kinect seminar 121208v1(동영상x)
- 1. Kinect를 활용한 Chan Seok Kang 동작 인식 프로그래밍 KIST 2012.12.08 KINECT FOR WINDOWS
- 2. Biography 강찬석 (Chan Seok Kang) • 2011 Microsoft Student Partner 5기 • 2012 Imagine Cup 2012 : Kinect Fun Lab Semi-Finalist • KIST 실감교류 연구센터 위촉 연구원 Blog : 자신에 대한 고찰 ( http://talkingaboutme.tistory.com ) Facebook : http://www.facebook.com/kcsgoodboy KINECT FOR WINDOWS
- 3. Today`s Session • Review : Kinect Explorer(1h) • Kinect QuickStart 시청 및 질의 응답 ( 1h ) • Beam Angle Detector ( 1.5h ) KINECT FOR WINDOWS
- 4. 11th Project : Review – Kinect Explorer KINECT FOR WINDOWS
- 5. Review – Kinect Explorer • Add Reference File & namespace KINECT FOR WINDOWS
- 6. Review – Kinect Explorer • Split the Grid KINECT FOR WINDOWS
- 7. Review – Kinect Explorer • Insert the ImageControl & Canvas, Button KINECT FOR WINDOWS
- 8. Review – Kinect Explorer • XAML View KINECT FOR WINDOWS
- 9. Review – Kinect Explorer • Initialize Kinect & Enable Stream KINECT FOR WINDOWS
- 10. Review – Kinect Explorer • Fill out the ColorStream KINECT FOR WINDOWS
- 11. Review – Kinect Explorer • Fill out the DepthStream KINECT FOR WINDOWS
- 12. Review – Kinect Explorer • Fill out the Skeleton Stream KINECT FOR WINDOWS
- 13. Review – Kinect Explorer • #region Skeleton KINECT FOR WINDOWS
- 14. Review – Kinect Explorer • #endregion Skeleton KINECT FOR WINDOWS
- 15. Review – Kinect Explorer • Define the DrawBone KINECT FOR WINDOWS
- 16. Review – Kinect Explorer • Use the DrawBone KINECT FOR WINDOWS
- 17. Review – Kinect Explorer • test KINECT FOR WINDOWS
- 18. Review – Kinect Explorer • Make a Button Event KINECT FOR WINDOWS
- 19. Review – Kinect Explorer • Fill out the Button Event KINECT FOR WINDOWS
- 20. Review – Kinect Explorer • Result KINECT FOR WINDOWS
- 21. Review – Kinect Explorer • Insert Anything you want! (Near mode, Seated Mode, slider etc…) KINECT FOR WINDOWS
- 22. Kinect Studio • Test the Parameter (Depth Data , Position…) KINECT FOR WINDOWS
- 23. Break? Break! KINECT FOR WINDOWS
- 24. Kinect QuickStart - Audio Fundamentals KINECT FOR WINDOWS
- 25. Kinect QuickStart KINECT FOR WINDOWS
- 26. Kinect QuickStart • 4 –Array High Quality Microphone - Can get a direction of SoundSource KINECT FOR WINDOWS
- 27. Kinect Audio로 할 수 있는 것 • Audio Capture -> Recorder • Sound Information • Speech Recognition • Raw Voice Data Access (using Software-Filter) ->하지만 오디오컨트롤 자체가 하드웨어와 연관되어 있어서 세밀한 조절을 위해서는 궁극적으로 C++을 이용해야 함. KINECT FOR WINDOWS
- 28. C++에서 제공하는 API • KinectAudio DirectX Media Object(DMO) • Windows Audio Session API (WASAPI) KINECT FOR WINDOWS
- 29. SOUND POSITION • Sound Source Angle : 소리가 나는 방향 과 강도 • Beam Angle : 소리가 진행하는 방향 -50 0 +50 KINECT FOR WINDOWS
- 30. Recording • KinectAudioSource가 일종의 버퍼 역할 • Use Echo Cancellation to not record PC sound KINECT FOR WINDOWS
- 31. Attention!! • 반드시 AudioStream은 SkeletonStream을 활성화 시킨 후에 활성화시켜야 함 kinectSensor.Start(); kinectSensor.AudioSource.Start(); // --> this will create an audio stream kinectSensor.SkeletonStream.Enable(); // --> this will stop the audio stream as an undesired side effect 나쁜 예 KINECT FOR WINDOWS
- 32. Attention!! • 반드시 AudioStream은 SkeletonStream을 활성화 시킨 후에 활성화시켜야 함 Workaround #1 (start audio after skeleton): kinectSensor.Start(); kinectSensor.SkeletonStream.Enable(); kinectSensor.AudioSource.Start(); Workaround #2 (restart audio after skeleton): kinectSensor.Start(); kinectSensor.AudioSource.Start(); // --> this will create an audio stream kinectSensor.SkeletonStream.Enable(); // --> this will stop the audio stream as an undesired side effect kinectSensor.AudioSource.Start(); // --> this will create another audio stream 좋은 예 KINECT FOR WINDOWS
- 33. Break? Break! KINECT FOR WINDOWS
- 34. 12th Project : Beam Angle Detector KINECT FOR WINDOWS
- 35. Beam Angle Detector • Add Reference File & namespace KINECT FOR WINDOWS
- 36. Beam Angle Detector • Grid -> Canvas (Width:640 / Height: 480) KINECT FOR WINDOWS
- 37. Beam Angle Detector • Sound의 특성상 Thread 의 사용이 필요!! KINECT FOR WINDOWS
- 38. Beam Angle Detector • Sound Initialize (순서 유의) KINECT FOR WINDOWS
- 39. Beam Angle Detector • 탐지판 생성 KINECT FOR WINDOWS
- 40. BeamAngle • test KINECT FOR WINDOWS
- 41. Beam Angle Detector • Define DrawLine KINECT FOR WINDOWS
- 42. Beam Angle Detector • 탐지침 선언 KINECT FOR WINDOWS
- 43. Beam Angle Detector • 입력이 없을 때는 안보이게! KINECT FOR WINDOWS
- 44. Beam Angle Detector • 실효값 구하기 (SoundSourceAngle) KINECT FOR WINDOWS
- 45. Beam Angle Detector • 잠깐!! • SoundSourceAngle 자체는 키넥트를 기준으로 판단하기 때문에 사람이 잘 보려면 -1을 곱해줘야 함. KINECT FOR WINDOWS
- 46. Beam Angle Detector • RotateLine 정의 KINECT FOR WINDOWS
- 47. Beam Angle Detector • Add the Line Thickness KINECT FOR WINDOWS
- 48. Beam Angle Detector • 현재값 구하기 (BeamAngle) KINECT FOR WINDOWS
- 49. Beam Angle Detector • Fill out the BeamAngleChanged KINECT FOR WINDOWS
- 50. Beam Angle Detector • Result KINECT FOR WINDOWS
- 51. If you need help, Just visit in My blog http://talkingaboutme.tistory.com KINECT FOR WINDOWS