Takashi Yoshinaga
Institute of Systems, Information
Technologies and Nanotechnologies
(ISIT)
@ MTA SZTAKI, Hungary, Aug. 8th, 2018
• About Me
• Research
• Current Experiences with AR
• About Me
• Research
• Current Experiences with AR
Name:
Takashi Yoshinaga
Title:
Researcher
Affiliation:
Institute of Systems, Info. Tech. and Nanotech.
Works:
Daily life support with Augmented Reality (AR)
• About Me
• Research with AR for Echography
• Current Experiences with AR
 Medical image diagnosis technology using ultrasound.
 Real-time image of internal organ is obtained just by putting
probe on a patient’s body.
Probe
 Field of view of echogram is not wide.
 Spatial relationship between internal organ and cross
section must be understood by physician to get echogram.
Cross section
We have proposed 2 kinds of AR systems which
can visualize probe operation of skilled physician.
(1) Probe position/angle recorded in previous.
(2) Real-time instruction from remote expert.
Probe
AR Interface
Rotate
Move
Green plane is probe operation
recorded by skilled physician
Unskilled physician could acquire good echogram by referring
to superimposed position/angle of probe recorded in previous.
https://youtu.be/Dpuc243qCzw
Skilled Physician
Instruction via GUI
Patient’s Side
Non-verbal communication can help remote assistance.
https://youtu.be/WV99AmD-A0E
Using HoloLens & markerless tracking tech for AR echography.
https://youtu.be/zI8S49qpiOs
• About Me
• Research with AR for Echography
• Current Experiences with AR
 Interested in collaboration system among AR
devices and sensing devices.
 Now prototyping some kinds of systems.
Sensing Devices
Data
Server Machine
AR Devices
Data
Data
EMG(Electromyography) sensor is used for
adding gesture input to HoloLens content.
https://youtu.be/b0IcyAj3ag0
AR visualization remote environment scanned by Kinect
https://youtu.be/E9v58QAFfNg
 The same scene is shown in different devices.
 Operation of a user is shared with others.
https://youtu.be/W9fVF-aoc5w
Takashi Yoshinaga
Augmented Reality: R&D and Prototyping

More Related Content

PPTX
SPECT SCAN
PDF
NeuroPoly
PDF
SCT course
PPTX
The gamma camera ‫‬
PDF
Single photon emission computed tomography spect
PDF
HMRI - brain-prosthetic connections
PPTX
Spect technology
PDF
Presentation @AR Barcelona
SPECT SCAN
NeuroPoly
SCT course
The gamma camera ‫‬
Single photon emission computed tomography spect
HMRI - brain-prosthetic connections
Spect technology
Presentation @AR Barcelona

Similar to Augmented Reality: R&D and Prototyping (20)

PDF
AR & MR Experience
PDF
Introduction of augmented reality
PDF
Case Study of Augmented Reality Applications in Medical Field
PDF
Procedure and system for three-dimensional representation of an augmented rea...
PDF
AR is revolutionizing the healthcare industry
PPTX
EiTESAL eHealth Conference 14&15 May 2017
PDF
Augmented Reality (AR) for Education System
PDF
IRJET- Augmented Reality in Surgical Procedures
PDF
Augmented Reality : Future of Orthopedic Surgery
PPTX
Future Of Radiology
PDF
Transforming healthcare with augmented reality
PDF
Augmented reality
PDF
07 20278 augmented reality...
PPTX
Solez Yagi Farris Barisoni Digital transplant pathology white paper2
PPTX
Kim Solez Yukako Yagi Digital transplant pathology white paper1
DOCX
Final Year Projects Free Abstract in SLN Technologies
PDF
augmented reality in TM Presentation.pdf
PPT
Augmented reality in spine surgery
PPTX
Augmented reality
PPT
Augmented reality in spine surgery
AR & MR Experience
Introduction of augmented reality
Case Study of Augmented Reality Applications in Medical Field
Procedure and system for three-dimensional representation of an augmented rea...
AR is revolutionizing the healthcare industry
EiTESAL eHealth Conference 14&15 May 2017
Augmented Reality (AR) for Education System
IRJET- Augmented Reality in Surgical Procedures
Augmented Reality : Future of Orthopedic Surgery
Future Of Radiology
Transforming healthcare with augmented reality
Augmented reality
07 20278 augmented reality...
Solez Yagi Farris Barisoni Digital transplant pathology white paper2
Kim Solez Yukako Yagi Digital transplant pathology white paper1
Final Year Projects Free Abstract in SLN Technologies
augmented reality in TM Presentation.pdf
Augmented reality in spine surgery
Augmented reality
Augmented reality in spine surgery
Ad

More from Takashi Yoshinaga (20)

PPTX
HoloLens2とMeta QuestではじめるWebXR
PPTX
【準備編】OculusQuest/HoloLens2対応WebXR開発
PPTX
ARコンテンツ作成勉強会( #AR_Fukuoka )紹介
PPTX
AI x WebAR: MediaPipeのハンドトラッキングを使ってみよう
PPTX
iPad LiDARで エンジニアカフェを3Dスキャン
PPTX
AI x OpenCV x WebAR: Selfie Segmentationを使ってみよう
PPTX
Web技術ではじめようAR/VRアプリ開発
PPTX
MRTKをNreal Lightに対応させてみた
PPTX
Nreal Lightハンズオン
PPTX
【準備編!】HoloLens 2/Oculus Quest対応WebXRハンズオン
PPTX
A-Frameで始めるWebXRとハンドトラッキング (HoloLens2/Oculus Quest対応)
PPTX
Holo-SDKハンズオン:はじめようヘッドトラッキングを用いた3D表現
PPTX
FUKUOKA Engineers Day 2021 発表資料:AR Fukuoka & HoloBox紹介
PPTX
Voxon Photonics VX1 で遊んでみた
PPTX
AR-Frame x AR.js入門
PPTX
AI x WebXR: フェイストラッキングを用いた擬似3D表現を解説!
PPTX
コロナ禍中のコミュニティ活動
PPTX
Project HoloBox
PPTX
AR Fukuoka紹介2020
PPTX
iPad LiDARで作ってみた in AR Fukuoka 忘年会2020
HoloLens2とMeta QuestではじめるWebXR
【準備編】OculusQuest/HoloLens2対応WebXR開発
ARコンテンツ作成勉強会( #AR_Fukuoka )紹介
AI x WebAR: MediaPipeのハンドトラッキングを使ってみよう
iPad LiDARで エンジニアカフェを3Dスキャン
AI x OpenCV x WebAR: Selfie Segmentationを使ってみよう
Web技術ではじめようAR/VRアプリ開発
MRTKをNreal Lightに対応させてみた
Nreal Lightハンズオン
【準備編!】HoloLens 2/Oculus Quest対応WebXRハンズオン
A-Frameで始めるWebXRとハンドトラッキング (HoloLens2/Oculus Quest対応)
Holo-SDKハンズオン:はじめようヘッドトラッキングを用いた3D表現
FUKUOKA Engineers Day 2021 発表資料:AR Fukuoka & HoloBox紹介
Voxon Photonics VX1 で遊んでみた
AR-Frame x AR.js入門
AI x WebXR: フェイストラッキングを用いた擬似3D表現を解説!
コロナ禍中のコミュニティ活動
Project HoloBox
AR Fukuoka紹介2020
iPad LiDARで作ってみた in AR Fukuoka 忘年会2020
Ad

Recently uploaded (20)

PPTX
MicrosoftCybserSecurityReferenceArchitecture-April-2025.pptx
PDF
A review of recent deep learning applications in wood surface defect identifi...
PPTX
Chapter 5: Probability Theory and Statistics
PPT
Module 1.ppt Iot fundamentals and Architecture
PDF
Taming the Chaos: How to Turn Unstructured Data into Decisions
PPT
Galois Field Theory of Risk: A Perspective, Protocol, and Mathematical Backgr...
PPTX
AI IN MARKETING- PRESENTED BY ANWAR KABIR 1st June 2025.pptx
PPTX
2018-HIPAA-Renewal-Training for executives
PDF
UiPath Agentic Automation session 1: RPA to Agents
PPTX
Final SEM Unit 1 for mit wpu at pune .pptx
PDF
sbt 2.0: go big (Scala Days 2025 edition)
PPTX
Microsoft Excel 365/2024 Beginner's training
PDF
Convolutional neural network based encoder-decoder for efficient real-time ob...
PDF
Abstractive summarization using multilingual text-to-text transfer transforme...
PDF
From MVP to Full-Scale Product A Startup’s Software Journey.pdf
PDF
sustainability-14-14877-v2.pddhzftheheeeee
PDF
STKI Israel Market Study 2025 version august
PPT
Geologic Time for studying geology for geologist
PDF
A proposed approach for plagiarism detection in Myanmar Unicode text
PPTX
Modernising the Digital Integration Hub
MicrosoftCybserSecurityReferenceArchitecture-April-2025.pptx
A review of recent deep learning applications in wood surface defect identifi...
Chapter 5: Probability Theory and Statistics
Module 1.ppt Iot fundamentals and Architecture
Taming the Chaos: How to Turn Unstructured Data into Decisions
Galois Field Theory of Risk: A Perspective, Protocol, and Mathematical Backgr...
AI IN MARKETING- PRESENTED BY ANWAR KABIR 1st June 2025.pptx
2018-HIPAA-Renewal-Training for executives
UiPath Agentic Automation session 1: RPA to Agents
Final SEM Unit 1 for mit wpu at pune .pptx
sbt 2.0: go big (Scala Days 2025 edition)
Microsoft Excel 365/2024 Beginner's training
Convolutional neural network based encoder-decoder for efficient real-time ob...
Abstractive summarization using multilingual text-to-text transfer transforme...
From MVP to Full-Scale Product A Startup’s Software Journey.pdf
sustainability-14-14877-v2.pddhzftheheeeee
STKI Israel Market Study 2025 version august
Geologic Time for studying geology for geologist
A proposed approach for plagiarism detection in Myanmar Unicode text
Modernising the Digital Integration Hub

Augmented Reality: R&D and Prototyping

  • 1. Takashi Yoshinaga Institute of Systems, Information Technologies and Nanotechnologies (ISIT) @ MTA SZTAKI, Hungary, Aug. 8th, 2018
  • 2. • About Me • Research • Current Experiences with AR
  • 3. • About Me • Research • Current Experiences with AR
  • 4. Name: Takashi Yoshinaga Title: Researcher Affiliation: Institute of Systems, Info. Tech. and Nanotech. Works: Daily life support with Augmented Reality (AR)
  • 5. • About Me • Research with AR for Echography • Current Experiences with AR
  • 6.  Medical image diagnosis technology using ultrasound.  Real-time image of internal organ is obtained just by putting probe on a patient’s body. Probe
  • 7.  Field of view of echogram is not wide.  Spatial relationship between internal organ and cross section must be understood by physician to get echogram. Cross section
  • 8. We have proposed 2 kinds of AR systems which can visualize probe operation of skilled physician. (1) Probe position/angle recorded in previous. (2) Real-time instruction from remote expert. Probe AR Interface Rotate Move
  • 9. Green plane is probe operation recorded by skilled physician Unskilled physician could acquire good echogram by referring to superimposed position/angle of probe recorded in previous. https://youtu.be/Dpuc243qCzw
  • 10. Skilled Physician Instruction via GUI Patient’s Side Non-verbal communication can help remote assistance. https://youtu.be/WV99AmD-A0E
  • 11. Using HoloLens & markerless tracking tech for AR echography. https://youtu.be/zI8S49qpiOs
  • 12. • About Me • Research with AR for Echography • Current Experiences with AR
  • 13.  Interested in collaboration system among AR devices and sensing devices.  Now prototyping some kinds of systems. Sensing Devices Data Server Machine AR Devices Data Data
  • 14. EMG(Electromyography) sensor is used for adding gesture input to HoloLens content. https://youtu.be/b0IcyAj3ag0
  • 15. AR visualization remote environment scanned by Kinect https://youtu.be/E9v58QAFfNg
  • 16.  The same scene is shown in different devices.  Operation of a user is shared with others. https://youtu.be/W9fVF-aoc5w