SlideShare a Scribd company logo
Personal Identification using Gait Data
on Slipper-device with Accelerometer
2021 Asian CHI Symposium
M i y u F u j i , K e i o U n i v e r s i t y
K a h o K a t o , K e i o U n i v e r s i t y
C h e n g s h u o X i a , K e i o U n i v e r s i t y
Yu t a S u g i u r a , K e i o U n i v e r s i t y
• Personal identification in entry / exit checks of indoor
facilities (elderly housing with care, community centre,
etc.) is significant;
• Understand the facility usage
• Reducing the burden on staff and users
2
Background: People gathering
3
Background: Personal Identification
・Use face and appearance
for identification
・Actions for identification;
Look, touch, etc…
・ Use behavioural
characteristics to identify
・Identified in daily activities
Burden on the user is small
Physical biometrics Behavioural biometrics
Knowledge based Property based
Biometrics based
・Key,IC-Card…etc
・Risk of theft or loss
・ID,password…etc
・Risk of leakage and forgetting
• Wearable device measures walking movement in
the facility
• Identify individuals in consideration of privacy
→Incorporating a sensor in slippers
8
Methodology
 Daily used in indoor.
 Easy to wear.
→Do not invade users'
daily life
Slippers installed at the entrance of the facility
9
Experiment:System
Learning
phase
Predict
phase
Data
Walking Feature
SVM
Classifier
System overview
Person
Prediction
result
10
Experiment:Feature extraction
Window based
segment
Hamming window
applied
FFT
( FFT )
Cut out only half
feature quantity .
SVM classifier
Uniform the
segmented data
Workflow of classifier building
Cross-validation
11
Experiment:hardware
Device specifications
Mounted device and sensor arrangement and their direction (6-sensor)
Sensor 3-axis accelerometer
Wireless module Xbee
MCU Arduino Pro Mini
12
Evaluation Protocol
Experiment1:Validation of foot-based
indentation
• Personal identification with gait dataset
Experiment2:Single feet based
identification
• Single data used, and considered the
optimal sensor placement
• IMU(Inertial Measurement Unity)based walking
dataset[7] for identification
13
Experiment1:Overview
Participant 10(Male 5・Female 5)
Motion Walking
Sensor position Full body 17 places
Frame rate [fps] 60
Length[s] 90seconds
Number of point 5000
Samples 128
Window size 120
Dataset Overview
Sensor location
[7] C. Xia and Y. Sugiura, "Wearable Accelerometer Optimal Positions for Human Motion Recognition," 2020 IEEE 2nd Global Conference on Life Sciences and
Technologies (LifeTech), Kyoto, Japan, 2020, pp. 19-20
14
Result & Discussion
Sensor position and accuracy
• The closer to the leg, the
higher the accuracy is.
• Right feet 94.3 %,left feet
95.3 %,both foot 97.0 %
• Foot based personal
identification is possible
• Optimumal sensor position assessment using a
one-feet slipper device
15
Experiment2:Overview
Participant 5(Male 2・Female 3)
Motion
Walking
(Do not indicate the speed or
step)
Environment long flat corridor
Sensed data
6 accelerometers on the right
foot
(Same slipper on the left foot)
Frame rate[fps] 37.5
Length[s] 32
Data points 1200
Samples 128
Window size 100
Overview
Walking status
• Accuracy using all sensors (6 locations) is 95%
16
Result & Analysis:Accuracy from all
sensors
All six-sensor based confusion matrix[%]
Six-sensor
17
Result & Analysis : Accuracy for each
sensor
Sensor position and identification accuracy
Sensor position and
name
Toe
Inner
Front
(IF)
Outer
Front
(OF)
Inner
Back
(IB)
Outer
Back
(OB)
Heel
18
Result & Analysis:More sensors used
Sensor combination and accuracy
93.3 % 88.3 % 88.3 %
93.3 % 91.7 % 91.7 % 91.7 %
19
Result & Analysis : Frequency domain
Change in frequency used
• Low frequency components may be highly
dependent on walking speed
• Considering the high frequency components
• Calculating identification accuracy by continuously
reducing the frequency range used from the low frequency
side
Sensor placement
20
Result & Analysis : Frequency domain
. Comparison by the number of sensors of average identification accuracy
when the frequency range used is changed
→Combine the 3 sensors, better accuracy is
expected.
21
Limitation and Future work
• Only the person registered as a data set can be
identified.
• New users need to get data for learning
→Proposal of a method to register a person who does
not exist on the dataset
• Only for straight-line walking on a flat surface.
• Data is acquired even in a state other than walking .
• Cannot identify movements other than walking, such as
going up and down stairs .
→ Combination with motion identification
Thank you!
2021 Asian CHI Symposium

More Related Content

PDF
Human Movement Recognition Using Internal Sensors of a Smartphone-based HMD (...
PDF
FacialPen: Using Facial Detection to Augment Pen-Based Interaction - Asian CH...
PDF
From Virtual to Real World: Applying Animation to Design the Activity Recogni...
PDF
Exercise Recognition System using Facial Image Information from a Mobile Devi...
PPTX
Center of Pressure Estimation and Gait Pattern Recognition Using Shoes with P...
PPT
Simple and Complex Activity Recognition Through Smart Phones
PDF
Video-Based Hand Tracking for Screening Cervical Myelopathy (ISVC2021)
PDF
Cervical Spine Range of Motion Measurement Utilizing Image Analysis - VISAPP2022
Human Movement Recognition Using Internal Sensors of a Smartphone-based HMD (...
FacialPen: Using Facial Detection to Augment Pen-Based Interaction - Asian CH...
From Virtual to Real World: Applying Animation to Design the Activity Recogni...
Exercise Recognition System using Facial Image Information from a Mobile Devi...
Center of Pressure Estimation and Gait Pattern Recognition Using Shoes with P...
Simple and Complex Activity Recognition Through Smart Phones
Video-Based Hand Tracking for Screening Cervical Myelopathy (ISVC2021)
Cervical Spine Range of Motion Measurement Utilizing Image Analysis - VISAPP2022

What's hot (20)

PPTX
On the Development of A Real-Time Multi-Sensor Activity Recognition System
PPTX
Human Activity Recognition in Android
PDF
Activity recognition based on a multi-sensor meta-classifier
PDF
A benchmark dataset to evaluate sensor displacement in activity recognition
PDF
PDF
Recognition of Human Physical Activity based on a novel Hierarchical Weighted...
PPTX
Digital Image Correlation Presentation
PDF
Overview of behavioural understanding system with filtered vision sensor (Sua...
PPTX
Optical measurent Mitesh kumar
PDF
Handling displacement effects in on-body sensor-based activity recognition
PDF
Collecting big data in cinemas to improve recommendation systems - a model wi...
PPT
Introduction to Machine Vision
PPTX
ppt on image processing
PPTX
Vision system for robotics and servo controller
PPTX
Machine vision systems ppt
PDF
An Enhanced Computer Vision Based Hand Movement Capturing System with Stereo ...
PPTX
Seminar nov2017
PPTX
Machine Vision
PDF
ConfocalPoster
PPTX
Camera calibration technique
On the Development of A Real-Time Multi-Sensor Activity Recognition System
Human Activity Recognition in Android
Activity recognition based on a multi-sensor meta-classifier
A benchmark dataset to evaluate sensor displacement in activity recognition
Recognition of Human Physical Activity based on a novel Hierarchical Weighted...
Digital Image Correlation Presentation
Overview of behavioural understanding system with filtered vision sensor (Sua...
Optical measurent Mitesh kumar
Handling displacement effects in on-body sensor-based activity recognition
Collecting big data in cinemas to improve recommendation systems - a model wi...
Introduction to Machine Vision
ppt on image processing
Vision system for robotics and servo controller
Machine vision systems ppt
An Enhanced Computer Vision Based Hand Movement Capturing System with Stereo ...
Seminar nov2017
Machine Vision
ConfocalPoster
Camera calibration technique
Ad

Similar to Personal Identification using Gait Data on Slipper-device with Accelerometer - Asian CHI 2021 Symposium (20)

PPTX
Computer Vision for Measurement & FR
PDF
Behaviometrics: Behavior Modeling from Heterogeneous Sensory Time-Series
PDF
Development of Real-World Sensor Optimal Placement Support Software(AsianCHI2...
PDF
Converting Tatamis into Touch Sensors by Measuring Capacitance
PPTX
Elderly activity recognition and classification for application in assisted l...
PPTX
Iit kgp workshop
PPTX
GaitProjectProposal
PPT
Envisioning the future using iris scanning biometrics
PPTX
iris ppt for machine laernig and voting.pptx
PPTX
Development of wearable object detection system & blind stick for visuall...
PPTX
Predicting Human Count through Environmental Sensing in Closed Indoor Settings
PDF
Track 1 session 1 - st dev con 2016 - contextual awareness
PPTX
Behavioral biometrics
PPTX
Sparse Mat: A Tale of Devising A Low-Cost Directional System for Pedestrian C...
PPTX
Embedded system
PPTX
SkinRing: Ring-shaped Device Enabling Wear Direction-Independent Gesture Inp...
PDF
A PROJECT REPORT ON IRIS RECOGNITION SYSTEM USING MATLAB
PPTX
Fingerprint recognition system by sagar chand gupta
PPTX
sagarppt111111-150929182421-lva1-app6891.pptx
PDF
A survey paper on various biometric security system methods
Computer Vision for Measurement & FR
Behaviometrics: Behavior Modeling from Heterogeneous Sensory Time-Series
Development of Real-World Sensor Optimal Placement Support Software(AsianCHI2...
Converting Tatamis into Touch Sensors by Measuring Capacitance
Elderly activity recognition and classification for application in assisted l...
Iit kgp workshop
GaitProjectProposal
Envisioning the future using iris scanning biometrics
iris ppt for machine laernig and voting.pptx
Development of wearable object detection system & blind stick for visuall...
Predicting Human Count through Environmental Sensing in Closed Indoor Settings
Track 1 session 1 - st dev con 2016 - contextual awareness
Behavioral biometrics
Sparse Mat: A Tale of Devising A Low-Cost Directional System for Pedestrian C...
Embedded system
SkinRing: Ring-shaped Device Enabling Wear Direction-Independent Gesture Inp...
A PROJECT REPORT ON IRIS RECOGNITION SYSTEM USING MATLAB
Fingerprint recognition system by sagar chand gupta
sagarppt111111-150929182421-lva1-app6891.pptx
A survey paper on various biometric security system methods
Ad

More from sugiuralab (20)

PDF
AirHook: An Ear-based Display for Simulating the Surrounding Airflow in Virtu...
PDF
自由に移動する複数の⼈々に異なる映像を提⽰するディスプレイシステムについての基礎検討
PPTX
ユーザの自然なインタラクションに基づく操作ミス推測
PPTX
Interaction2025_handfatigability_tajima.pptx
PDF
Ambient Display Utilizing Anisotropy of Tatami
PDF
CradlePosture: Camera-Based Approach for Estimating Neonate’s Posture Based o...
PDF
空間オーディオを用いたヘッドパスワードの提案と音源提示手法の最適化
PDF
測距センサとIMUセンサを用いた指輪型デバイスにおける顔認証システムの提案
PDF
SoilSense : 土壌微生物燃料電池を用いた自発電型タンジブルインタフェースの構築
PPTX
PuzMaty: Supporting Puzzle Mats Design Creation
PDF
DetachableRobotThatMovesTheBabyBouncer.pdf
PPTX
GestEarrings: Developing Gesture-Based Input Techniques for Earrings
PDF
SoilSense: 土壌微生物燃料電池を活用したリアルタイム力覚フォードバックインタフェースの実現
PPTX
Wrist-worn Haptic Design for 3D Perception of the Surrounding Airflow in Virt...
PPTX
模擬患者データを用いた整形疾患スクリーニング手法の提案(Proposal for an Orthopedic Disease Screening Meth...
PPTX
ヒアラブルデバイスを活用した瞑想アプリの提案
PDF
Enchanted Clothes: Visual and Tactile Feedback with an Abdomen-Attached Robot...
PDF
Exploring User-Defined Gestures as Input for Hearables and Recognizing Ear-Le...
PDF
Lifestyle Computing Lab 2024年度研究室配属全体説明会ポスター
PDF
Lifestyle Computing Lab 2024年度研究室配属全体説明会資料
AirHook: An Ear-based Display for Simulating the Surrounding Airflow in Virtu...
自由に移動する複数の⼈々に異なる映像を提⽰するディスプレイシステムについての基礎検討
ユーザの自然なインタラクションに基づく操作ミス推測
Interaction2025_handfatigability_tajima.pptx
Ambient Display Utilizing Anisotropy of Tatami
CradlePosture: Camera-Based Approach for Estimating Neonate’s Posture Based o...
空間オーディオを用いたヘッドパスワードの提案と音源提示手法の最適化
測距センサとIMUセンサを用いた指輪型デバイスにおける顔認証システムの提案
SoilSense : 土壌微生物燃料電池を用いた自発電型タンジブルインタフェースの構築
PuzMaty: Supporting Puzzle Mats Design Creation
DetachableRobotThatMovesTheBabyBouncer.pdf
GestEarrings: Developing Gesture-Based Input Techniques for Earrings
SoilSense: 土壌微生物燃料電池を活用したリアルタイム力覚フォードバックインタフェースの実現
Wrist-worn Haptic Design for 3D Perception of the Surrounding Airflow in Virt...
模擬患者データを用いた整形疾患スクリーニング手法の提案(Proposal for an Orthopedic Disease Screening Meth...
ヒアラブルデバイスを活用した瞑想アプリの提案
Enchanted Clothes: Visual and Tactile Feedback with an Abdomen-Attached Robot...
Exploring User-Defined Gestures as Input for Hearables and Recognizing Ear-Le...
Lifestyle Computing Lab 2024年度研究室配属全体説明会ポスター
Lifestyle Computing Lab 2024年度研究室配属全体説明会資料

Recently uploaded (20)

PDF
Assigned Numbers - 2025 - Bluetooth® Document
PDF
gpt5_lecture_notes_comprehensive_20250812015547.pdf
PDF
WOOl fibre morphology and structure.pdf for textiles
PDF
Mushroom cultivation and it's methods.pdf
PPTX
TLE Review Electricity (Electricity).pptx
PDF
1 - Historical Antecedents, Social Consideration.pdf
PPTX
1. Introduction to Computer Programming.pptx
PPTX
Tartificialntelligence_presentation.pptx
PDF
NewMind AI Weekly Chronicles - August'25-Week II
PDF
Transform Your ITIL® 4 & ITSM Strategy with AI in 2025.pdf
PDF
Enhancing emotion recognition model for a student engagement use case through...
PDF
A comparative study of natural language inference in Swahili using monolingua...
PPTX
SOPHOS-XG Firewall Administrator PPT.pptx
PDF
DASA ADMISSION 2024_FirstRound_FirstRank_LastRank.pdf
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
A novel scalable deep ensemble learning framework for big data classification...
PPTX
Chapter 5: Probability Theory and Statistics
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Accuracy of neural networks in brain wave diagnosis of schizophrenia
PDF
Microsoft Solutions Partner Drive Digital Transformation with D365.pdf
Assigned Numbers - 2025 - Bluetooth® Document
gpt5_lecture_notes_comprehensive_20250812015547.pdf
WOOl fibre morphology and structure.pdf for textiles
Mushroom cultivation and it's methods.pdf
TLE Review Electricity (Electricity).pptx
1 - Historical Antecedents, Social Consideration.pdf
1. Introduction to Computer Programming.pptx
Tartificialntelligence_presentation.pptx
NewMind AI Weekly Chronicles - August'25-Week II
Transform Your ITIL® 4 & ITSM Strategy with AI in 2025.pdf
Enhancing emotion recognition model for a student engagement use case through...
A comparative study of natural language inference in Swahili using monolingua...
SOPHOS-XG Firewall Administrator PPT.pptx
DASA ADMISSION 2024_FirstRound_FirstRank_LastRank.pdf
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
A novel scalable deep ensemble learning framework for big data classification...
Chapter 5: Probability Theory and Statistics
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Accuracy of neural networks in brain wave diagnosis of schizophrenia
Microsoft Solutions Partner Drive Digital Transformation with D365.pdf

Personal Identification using Gait Data on Slipper-device with Accelerometer - Asian CHI 2021 Symposium

  • 1. Personal Identification using Gait Data on Slipper-device with Accelerometer 2021 Asian CHI Symposium M i y u F u j i , K e i o U n i v e r s i t y K a h o K a t o , K e i o U n i v e r s i t y C h e n g s h u o X i a , K e i o U n i v e r s i t y Yu t a S u g i u r a , K e i o U n i v e r s i t y
  • 2. • Personal identification in entry / exit checks of indoor facilities (elderly housing with care, community centre, etc.) is significant; • Understand the facility usage • Reducing the burden on staff and users 2 Background: People gathering
  • 3. 3 Background: Personal Identification ・Use face and appearance for identification ・Actions for identification; Look, touch, etc… ・ Use behavioural characteristics to identify ・Identified in daily activities Burden on the user is small Physical biometrics Behavioural biometrics Knowledge based Property based Biometrics based ・Key,IC-Card…etc ・Risk of theft or loss ・ID,password…etc ・Risk of leakage and forgetting
  • 4. • Wearable device measures walking movement in the facility • Identify individuals in consideration of privacy →Incorporating a sensor in slippers 8 Methodology  Daily used in indoor.  Easy to wear. →Do not invade users' daily life Slippers installed at the entrance of the facility
  • 6. 10 Experiment:Feature extraction Window based segment Hamming window applied FFT ( FFT ) Cut out only half feature quantity . SVM classifier Uniform the segmented data Workflow of classifier building Cross-validation
  • 7. 11 Experiment:hardware Device specifications Mounted device and sensor arrangement and their direction (6-sensor) Sensor 3-axis accelerometer Wireless module Xbee MCU Arduino Pro Mini
  • 8. 12 Evaluation Protocol Experiment1:Validation of foot-based indentation • Personal identification with gait dataset Experiment2:Single feet based identification • Single data used, and considered the optimal sensor placement
  • 9. • IMU(Inertial Measurement Unity)based walking dataset[7] for identification 13 Experiment1:Overview Participant 10(Male 5・Female 5) Motion Walking Sensor position Full body 17 places Frame rate [fps] 60 Length[s] 90seconds Number of point 5000 Samples 128 Window size 120 Dataset Overview Sensor location [7] C. Xia and Y. Sugiura, "Wearable Accelerometer Optimal Positions for Human Motion Recognition," 2020 IEEE 2nd Global Conference on Life Sciences and Technologies (LifeTech), Kyoto, Japan, 2020, pp. 19-20
  • 10. 14 Result & Discussion Sensor position and accuracy • The closer to the leg, the higher the accuracy is. • Right feet 94.3 %,left feet 95.3 %,both foot 97.0 % • Foot based personal identification is possible
  • 11. • Optimumal sensor position assessment using a one-feet slipper device 15 Experiment2:Overview Participant 5(Male 2・Female 3) Motion Walking (Do not indicate the speed or step) Environment long flat corridor Sensed data 6 accelerometers on the right foot (Same slipper on the left foot) Frame rate[fps] 37.5 Length[s] 32 Data points 1200 Samples 128 Window size 100 Overview Walking status
  • 12. • Accuracy using all sensors (6 locations) is 95% 16 Result & Analysis:Accuracy from all sensors All six-sensor based confusion matrix[%] Six-sensor
  • 13. 17 Result & Analysis : Accuracy for each sensor Sensor position and identification accuracy Sensor position and name Toe Inner Front (IF) Outer Front (OF) Inner Back (IB) Outer Back (OB) Heel
  • 14. 18 Result & Analysis:More sensors used Sensor combination and accuracy 93.3 % 88.3 % 88.3 % 93.3 % 91.7 % 91.7 % 91.7 %
  • 15. 19 Result & Analysis : Frequency domain Change in frequency used • Low frequency components may be highly dependent on walking speed • Considering the high frequency components • Calculating identification accuracy by continuously reducing the frequency range used from the low frequency side Sensor placement
  • 16. 20 Result & Analysis : Frequency domain . Comparison by the number of sensors of average identification accuracy when the frequency range used is changed →Combine the 3 sensors, better accuracy is expected.
  • 17. 21 Limitation and Future work • Only the person registered as a data set can be identified. • New users need to get data for learning →Proposal of a method to register a person who does not exist on the dataset • Only for straight-line walking on a flat surface. • Data is acquired even in a state other than walking . • Cannot identify movements other than walking, such as going up and down stairs . → Combination with motion identification
  • 18. Thank you! 2021 Asian CHI Symposium