SlideShare a Scribd company logo
Sarii Yamamoto1)
, Jia Jun Wang2)
, Liwei Chan2)
, Yuta Sugiura1)
1)
Keio University
2)
National Yang Ming Chiao Tung University
2025/01/23 The 2025 IEEE/SICE International Symposium on System Integrations (SII 2025)
PuzMaty: Supporting Puzzle Mats Design Creation
• Mat with puzzle-like uneven shapes made of cushioned
material
• Sound and shock absorption
• Prevention of injuries to children
• Noise reduction
• Global market size[1]
• 2022: USD 949.7 million
• 2029: USD 1,514.4 million
• CAGR ( Compound Annual Growth Rate ): 6.9%
• Used in a variety of environments, such as living rooms and
children's rooms
• Adjustable to suit the size and shape of the room
2
Puzzle Mat
[1]Baby Play Mats- Global Market Share and Ranking, Overall Sales and Demand Forecast 2025-2031, QY Research, https://www.qyresearch.co.jp/reports/432996/baby-play-mats (Accessed 2025/01/10)
3
Challenges
• At time of purchase
• Calculate the size and number of
mats suitable for the space
• At time of placing mats
• The pattern tends to be simple.
• To draw complex designs, the number
of pieces of each color needs to be
adjusted
• Simulate the design on a 3D model of the environment in which the mats
will be placed
• Check the number of mats required on the design drawings
• Use of mats as floor decor
4
Objectives and Proposed Methods
PuzMaty: Supporting Puzzle Mats Design Creation
5
Related Work: Design Support Tools
[2] Yuki Igarashi and Takeo Igarashi. 2009. Designing plush toys with a computer. Commun. ACM 52, 12 (December 2009),
[3] Yuki Igarashi, Takeo Igarashi, and Jun Mitani. 2012. Beady: interactive beadwork design and construction. ACM Trans. Graph. 31, 4, Article 49 (July 2012),
[4] Yuki Igarashi and Takeo Igarashi. 2022, Pixel Art Adaptation for Handicraft Fabrication. Computer Graphics Forum, 41: 489-494.
[5] Sheng-Jie Luo, Yonghao Yue, Chun-Kai Huang, Yu-Huan Chung, Sei Imai, Tomoyuki Nishita, and Bing-Yu Chen. 2015. Legolization: optimizing LEGO designs. ACM Trans. Graph. 34, 6, Article 222 (November 2015), 12 pages.
Easy creation of blueprints and products for
children and beginners
Plushie[2]
Beady[3]
Support during the creation
of handicraft blueprints
Support during production
of handicraft work
Pixel Art Adaptation[4]
Legolization[5]
6
Related Work: Research on Floor Coverings
[6] Yuta Sugiura, Koki Toda, Takayuki Hoshi, Youichi Kamiyama, Takeo Igarashi, and Masahiko Inami. 2014. Graffiti fur: turning your carpet into a computer display. In Proceedings of the 27th annual ACM symposium on User
interface software and technology (UIST '14). Association for Computing Machinery, New York, NY, USA, 149–156.
[7] Yijia An, Qinglei Bu, Jie Sun, Eng Gee Lim, Lijun Kong, Zhiqin Chen, and Roshan Devaraj. 2023. Interactive Rehabilitation Carpet for Children with Cerebral Palsy. In Proceedings of the Seventeenth International Conference on
Tangible, Embedded, and Embodied Interaction (TEI '23). Association for Computing Machinery, New York, NY, USA, Article 40, 1–5.
[8] Yulia Zhiglova. 2018. The Interactive Carpet - Smart Textile Interface for Children on Autism Spectrum Disorder. In Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '18).
Association for Computing Machinery, New York, NY, USA, 712–714.
Carpet design Interaction between
carpets and children
Graffiti Fur[6]
Making carpets into displays by
raising the pile
The Interactive Carpet[8]
Training to promote attention and
social skills in autistic children
Interactive Rehabilitation Carpet[7]
Rehabilitation support for children
with cerebral palsy
7
Flow of the Proposed Method
Scanning of
3D models
Design creation Mats placement
Place puzzle mats in the
actual environment
Scan a 3D model of the
environment and import
into ‘PuzMaty’
After pre-prosessing,
freely draw up the design
8
Design Creation ( 1/3 )
• Implementation
environment
• Unity
• Preprocessing
• Rotation of the 3D model
• Adjustment of mat placement
range
• Adjustment of mats size
9
Design Creation ( 2/3 )
• System configuration
(1) 3D model
(2) Mat layer: A layer composed of mats,
assumed to be puzzle mats
(3) Point cloud layer: A layer composed of
finer mats designed to detect the point
cloud density within a 3D model
• Furniture detection
• Mats that detect point clouds within the
point cloud layer are activated
• If more than 60% of the mats within the
point cloud layer contained in each mat of
the mat layer are activated, the position of
that mat is determined to contain furniture
System configuration
Point cloud layer A mat within the
mat layer
detected
undetected
Point cloud
60%
10
Design Creation ( 3/3 )
• Users who own puzzle mats
• Register the color and number of
mats they own
• Drawing a design not exceeding
the number of mats owned
• Users who don’t own puzzle mats
• Create colors while drawing
• After drawing, purchase the
required mats
11
Mat Placement
• Placement of mats in the real environment based on the created
design
Before After
Experimental Overview
• Freely design using the system and place mats in the real environment
• Puzzle mats (30 cm x 30 cm x 1.2 cm, polyethylene) were prepared
according to the experimental environment
• Experimental participants (6 males, 4 females, average: 23.8 ± 2.23 years)
• Time required ( unllimited )
• drawing : 20min
• placement : 30min Color Amount
Beige 84
Orange 40
Green 36
Yellow 28
Blue 28
Brown 8
Total 224
The color and number of mats used The experimental environment
12
Examples of Patterns Created by Experimental
Participants
13
Design
Actual mats
Design
Actual mats
14
Evaluation
• SUS(System Usability Scale) : Average Score 82.5 > 68
• Interview
• Satisfaction
• The designs created in the system matched the designs in the actual environment
• When registering the mat, a different color from the original mat was registered
• The opportunity to redecorate
• Simulation ensures no confusion when placing the mats
15
Future Work
• UI improvement
• Support to create a design in ‘PuzMaty’
• Construction of design datasets
• Images
• Keywords
• Image to pixel art conversion
• Suggest designs from color and number of mats
• Support during mat placement
• Presents the color of the mat to be placed at that location in AR
• Presents the order in which the mats are placed
16
Summary
Background
Puzzle mats used as a safety measure for children
The hassle of counting the number of mats that fit the
space, the difficulty of creating complex patterns
Related Works
Design Support Tools
Research on Floor Coverings
Proposed
Methods
Development and evaluation of a tool to support design
creation for puzzle mats
Implementatio
n
Scan the 3D models of real environments
Create designs in ‘PuzMaty’
Place mats in the real environment
Experiment
10 Experimental participants
Design with mats using the system and place in the real
environment
Evaluation SUS, Interview
Future Work
UI improvement
Support during design creation and mats placement
PuzMaty: Supporting Puzzle Mats Design Creation
Sarii Yamamoto , Jia Jun Wang, Liwei Chan, Yuta Sugiura
Appendix
18
Furniture Detection
• Detect furniture from point cloud
• Determine the presence or absence
of point clouds at a height of 60 cm
from the floor
• Mat Layer
• If at least 60% of the point cloud mats are
valid, furniture is present
• Pont Cloud Layer
• Mats are valid where the point cloud is
located
3D Model
Mat Layer
Point Cloud
Layer
Clip
Point cloud layer A mat within the
mat layer
detected
undetected
Point cloud
60%
• children aged 5-6 years and their parents
• They enjoyed to draw designs and place mats
• Possibilities
• Sense of achievement
• Linguistic competence
• Modifications
• Support during design creation and mat
placement
• A device to keep children occupied
19
Workshop
Designs and Actual Mats that participants created
• Optical Sensor
• Measuring the distance to an object and the shape from the time difference
between the incident and reflected light.
20
LiDAR ( Light Detection And Ranging )
21
Scanning a 3D Model
• LiDAR ( Light Detection And Ranging )
• Measures the distance to an object and the shape of the object using
a laser beam
• De used: iPhone 15 Pro
• App used: SiteScape
3D Model

More Related Content

PPT
Ci518 appletpp
PPTX
Tan pro kit
PDF
After Prototype Project
PDF
Snaps Business Proposal
PPTX
Designing The Classroom Environment
PDF
Skweezee: Soft Objects that Sense their Shape Shifting
PDF
Pres tei gsc-jw
PDF
Portfolio 2015 Fazil Akin
Ci518 appletpp
Tan pro kit
After Prototype Project
Snaps Business Proposal
Designing The Classroom Environment
Skweezee: Soft Objects that Sense their Shape Shifting
Pres tei gsc-jw
Portfolio 2015 Fazil Akin

Similar to PuzMaty: Supporting Puzzle Mats Design Creation (20)

PPTX
Promise of Zoomable User Interfaces
PPT
57 The Fabric Of An Industry Has Evolved With Technology
PDF
MusIM: Mobile Object Browsing for Museums
PPTX
Morris prototyping - oredev - share
PPT
EEE Project - Discovering the Campus 2012
PDF
Future Of Play (Keynote:MIT:2010:Sandbox Summit)
PDF
Future Of Play - Keynote MIT 2010 - Sandbox Summit
PPTX
Crafting the Immaterial Materiality
PDF
AUTO digital PROGETAZZIONE
PPTX
Libraries Thriving QR Code Seminar
PPT
Co-designing technology with children
PDF
SMART Seminar Series: Ozlab for the interactive prototyping of interactivity
PPTX
Proposal defense
PDF
EDUCON 2013
PPTX
Creativiy and creative teaching
PDF
Suave Lulu
PDF
Interaction design methods
PPTX
Interactive Paper 2014
PDF
Design doc
PDF
Supporting The Initial Stages of The Product Design Process: Towards Knowledg...
Promise of Zoomable User Interfaces
57 The Fabric Of An Industry Has Evolved With Technology
MusIM: Mobile Object Browsing for Museums
Morris prototyping - oredev - share
EEE Project - Discovering the Campus 2012
Future Of Play (Keynote:MIT:2010:Sandbox Summit)
Future Of Play - Keynote MIT 2010 - Sandbox Summit
Crafting the Immaterial Materiality
AUTO digital PROGETAZZIONE
Libraries Thriving QR Code Seminar
Co-designing technology with children
SMART Seminar Series: Ozlab for the interactive prototyping of interactivity
Proposal defense
EDUCON 2013
Creativiy and creative teaching
Suave Lulu
Interaction design methods
Interactive Paper 2014
Design doc
Supporting The Initial Stages of The Product Design Process: Towards Knowledg...
Ad

More from sugiuralab (20)

PDF
AirHook: An Ear-based Display for Simulating the Surrounding Airflow in Virtu...
PDF
自由に移動する複数の⼈々に異なる映像を提⽰するディスプレイシステムについての基礎検討
PPTX
ユーザの自然なインタラクションに基づく操作ミス推測
PPTX
Interaction2025_handfatigability_tajima.pptx
PDF
Ambient Display Utilizing Anisotropy of Tatami
PDF
CradlePosture: Camera-Based Approach for Estimating Neonate’s Posture Based o...
PDF
空間オーディオを用いたヘッドパスワードの提案と音源提示手法の最適化
PDF
測距センサとIMUセンサを用いた指輪型デバイスにおける顔認証システムの提案
PDF
SoilSense : 土壌微生物燃料電池を用いた自発電型タンジブルインタフェースの構築
PDF
DetachableRobotThatMovesTheBabyBouncer.pdf
PPTX
GestEarrings: Developing Gesture-Based Input Techniques for Earrings
PPTX
SkinRing: Ring-shaped Device Enabling Wear Direction-Independent Gesture Inp...
PDF
SoilSense: 土壌微生物燃料電池を活用したリアルタイム力覚フォードバックインタフェースの実現
PPTX
Wrist-worn Haptic Design for 3D Perception of the Surrounding Airflow in Virt...
PPTX
模擬患者データを用いた整形疾患スクリーニング手法の提案(Proposal for an Orthopedic Disease Screening Meth...
PPTX
ヒアラブルデバイスを活用した瞑想アプリの提案
PDF
Enchanted Clothes: Visual and Tactile Feedback with an Abdomen-Attached Robot...
PDF
Exploring User-Defined Gestures as Input for Hearables and Recognizing Ear-Le...
PDF
Lifestyle Computing Lab 2024年度研究室配属全体説明会ポスター
PDF
Lifestyle Computing Lab 2024年度研究室配属全体説明会資料
AirHook: An Ear-based Display for Simulating the Surrounding Airflow in Virtu...
自由に移動する複数の⼈々に異なる映像を提⽰するディスプレイシステムについての基礎検討
ユーザの自然なインタラクションに基づく操作ミス推測
Interaction2025_handfatigability_tajima.pptx
Ambient Display Utilizing Anisotropy of Tatami
CradlePosture: Camera-Based Approach for Estimating Neonate’s Posture Based o...
空間オーディオを用いたヘッドパスワードの提案と音源提示手法の最適化
測距センサとIMUセンサを用いた指輪型デバイスにおける顔認証システムの提案
SoilSense : 土壌微生物燃料電池を用いた自発電型タンジブルインタフェースの構築
DetachableRobotThatMovesTheBabyBouncer.pdf
GestEarrings: Developing Gesture-Based Input Techniques for Earrings
SkinRing: Ring-shaped Device Enabling Wear Direction-Independent Gesture Inp...
SoilSense: 土壌微生物燃料電池を活用したリアルタイム力覚フォードバックインタフェースの実現
Wrist-worn Haptic Design for 3D Perception of the Surrounding Airflow in Virt...
模擬患者データを用いた整形疾患スクリーニング手法の提案(Proposal for an Orthopedic Disease Screening Meth...
ヒアラブルデバイスを活用した瞑想アプリの提案
Enchanted Clothes: Visual and Tactile Feedback with an Abdomen-Attached Robot...
Exploring User-Defined Gestures as Input for Hearables and Recognizing Ear-Le...
Lifestyle Computing Lab 2024年度研究室配属全体説明会ポスター
Lifestyle Computing Lab 2024年度研究室配属全体説明会資料
Ad

Recently uploaded (20)

PDF
Univ-Connecticut-ChatGPT-Presentaion.pdf
PPTX
Chapter 5: Probability Theory and Statistics
PDF
DP Operators-handbook-extract for the Mautical Institute
PDF
A comparative analysis of optical character recognition models for extracting...
PDF
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
PDF
Encapsulation theory and applications.pdf
PDF
August Patch Tuesday
PDF
MIND Revenue Release Quarter 2 2025 Press Release
PDF
gpt5_lecture_notes_comprehensive_20250812015547.pdf
PDF
Encapsulation_ Review paper, used for researhc scholars
PPTX
A Presentation on Touch Screen Technology
PDF
Transform Your ITIL® 4 & ITSM Strategy with AI in 2025.pdf
PDF
A novel scalable deep ensemble learning framework for big data classification...
PPTX
A Presentation on Artificial Intelligence
PDF
Hindi spoken digit analysis for native and non-native speakers
PPTX
cloud_computing_Infrastucture_as_cloud_p
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
Assigned Numbers - 2025 - Bluetooth® Document
PPTX
1. Introduction to Computer Programming.pptx
PDF
Zenith AI: Advanced Artificial Intelligence
Univ-Connecticut-ChatGPT-Presentaion.pdf
Chapter 5: Probability Theory and Statistics
DP Operators-handbook-extract for the Mautical Institute
A comparative analysis of optical character recognition models for extracting...
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
Encapsulation theory and applications.pdf
August Patch Tuesday
MIND Revenue Release Quarter 2 2025 Press Release
gpt5_lecture_notes_comprehensive_20250812015547.pdf
Encapsulation_ Review paper, used for researhc scholars
A Presentation on Touch Screen Technology
Transform Your ITIL® 4 & ITSM Strategy with AI in 2025.pdf
A novel scalable deep ensemble learning framework for big data classification...
A Presentation on Artificial Intelligence
Hindi spoken digit analysis for native and non-native speakers
cloud_computing_Infrastucture_as_cloud_p
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
Assigned Numbers - 2025 - Bluetooth® Document
1. Introduction to Computer Programming.pptx
Zenith AI: Advanced Artificial Intelligence

PuzMaty: Supporting Puzzle Mats Design Creation

  • 1. Sarii Yamamoto1) , Jia Jun Wang2) , Liwei Chan2) , Yuta Sugiura1) 1) Keio University 2) National Yang Ming Chiao Tung University 2025/01/23 The 2025 IEEE/SICE International Symposium on System Integrations (SII 2025) PuzMaty: Supporting Puzzle Mats Design Creation
  • 2. • Mat with puzzle-like uneven shapes made of cushioned material • Sound and shock absorption • Prevention of injuries to children • Noise reduction • Global market size[1] • 2022: USD 949.7 million • 2029: USD 1,514.4 million • CAGR ( Compound Annual Growth Rate ): 6.9% • Used in a variety of environments, such as living rooms and children's rooms • Adjustable to suit the size and shape of the room 2 Puzzle Mat [1]Baby Play Mats- Global Market Share and Ranking, Overall Sales and Demand Forecast 2025-2031, QY Research, https://www.qyresearch.co.jp/reports/432996/baby-play-mats (Accessed 2025/01/10)
  • 3. 3 Challenges • At time of purchase • Calculate the size and number of mats suitable for the space • At time of placing mats • The pattern tends to be simple. • To draw complex designs, the number of pieces of each color needs to be adjusted
  • 4. • Simulate the design on a 3D model of the environment in which the mats will be placed • Check the number of mats required on the design drawings • Use of mats as floor decor 4 Objectives and Proposed Methods PuzMaty: Supporting Puzzle Mats Design Creation
  • 5. 5 Related Work: Design Support Tools [2] Yuki Igarashi and Takeo Igarashi. 2009. Designing plush toys with a computer. Commun. ACM 52, 12 (December 2009), [3] Yuki Igarashi, Takeo Igarashi, and Jun Mitani. 2012. Beady: interactive beadwork design and construction. ACM Trans. Graph. 31, 4, Article 49 (July 2012), [4] Yuki Igarashi and Takeo Igarashi. 2022, Pixel Art Adaptation for Handicraft Fabrication. Computer Graphics Forum, 41: 489-494. [5] Sheng-Jie Luo, Yonghao Yue, Chun-Kai Huang, Yu-Huan Chung, Sei Imai, Tomoyuki Nishita, and Bing-Yu Chen. 2015. Legolization: optimizing LEGO designs. ACM Trans. Graph. 34, 6, Article 222 (November 2015), 12 pages. Easy creation of blueprints and products for children and beginners Plushie[2] Beady[3] Support during the creation of handicraft blueprints Support during production of handicraft work Pixel Art Adaptation[4] Legolization[5]
  • 6. 6 Related Work: Research on Floor Coverings [6] Yuta Sugiura, Koki Toda, Takayuki Hoshi, Youichi Kamiyama, Takeo Igarashi, and Masahiko Inami. 2014. Graffiti fur: turning your carpet into a computer display. In Proceedings of the 27th annual ACM symposium on User interface software and technology (UIST '14). Association for Computing Machinery, New York, NY, USA, 149–156. [7] Yijia An, Qinglei Bu, Jie Sun, Eng Gee Lim, Lijun Kong, Zhiqin Chen, and Roshan Devaraj. 2023. Interactive Rehabilitation Carpet for Children with Cerebral Palsy. In Proceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '23). Association for Computing Machinery, New York, NY, USA, Article 40, 1–5. [8] Yulia Zhiglova. 2018. The Interactive Carpet - Smart Textile Interface for Children on Autism Spectrum Disorder. In Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '18). Association for Computing Machinery, New York, NY, USA, 712–714. Carpet design Interaction between carpets and children Graffiti Fur[6] Making carpets into displays by raising the pile The Interactive Carpet[8] Training to promote attention and social skills in autistic children Interactive Rehabilitation Carpet[7] Rehabilitation support for children with cerebral palsy
  • 7. 7 Flow of the Proposed Method Scanning of 3D models Design creation Mats placement Place puzzle mats in the actual environment Scan a 3D model of the environment and import into ‘PuzMaty’ After pre-prosessing, freely draw up the design
  • 8. 8 Design Creation ( 1/3 ) • Implementation environment • Unity • Preprocessing • Rotation of the 3D model • Adjustment of mat placement range • Adjustment of mats size
  • 9. 9 Design Creation ( 2/3 ) • System configuration (1) 3D model (2) Mat layer: A layer composed of mats, assumed to be puzzle mats (3) Point cloud layer: A layer composed of finer mats designed to detect the point cloud density within a 3D model • Furniture detection • Mats that detect point clouds within the point cloud layer are activated • If more than 60% of the mats within the point cloud layer contained in each mat of the mat layer are activated, the position of that mat is determined to contain furniture System configuration Point cloud layer A mat within the mat layer detected undetected Point cloud 60%
  • 10. 10 Design Creation ( 3/3 ) • Users who own puzzle mats • Register the color and number of mats they own • Drawing a design not exceeding the number of mats owned • Users who don’t own puzzle mats • Create colors while drawing • After drawing, purchase the required mats
  • 11. 11 Mat Placement • Placement of mats in the real environment based on the created design Before After
  • 12. Experimental Overview • Freely design using the system and place mats in the real environment • Puzzle mats (30 cm x 30 cm x 1.2 cm, polyethylene) were prepared according to the experimental environment • Experimental participants (6 males, 4 females, average: 23.8 ± 2.23 years) • Time required ( unllimited ) • drawing : 20min • placement : 30min Color Amount Beige 84 Orange 40 Green 36 Yellow 28 Blue 28 Brown 8 Total 224 The color and number of mats used The experimental environment 12
  • 13. Examples of Patterns Created by Experimental Participants 13 Design Actual mats Design Actual mats
  • 14. 14 Evaluation • SUS(System Usability Scale) : Average Score 82.5 > 68 • Interview • Satisfaction • The designs created in the system matched the designs in the actual environment • When registering the mat, a different color from the original mat was registered • The opportunity to redecorate • Simulation ensures no confusion when placing the mats
  • 15. 15 Future Work • UI improvement • Support to create a design in ‘PuzMaty’ • Construction of design datasets • Images • Keywords • Image to pixel art conversion • Suggest designs from color and number of mats • Support during mat placement • Presents the color of the mat to be placed at that location in AR • Presents the order in which the mats are placed
  • 16. 16 Summary Background Puzzle mats used as a safety measure for children The hassle of counting the number of mats that fit the space, the difficulty of creating complex patterns Related Works Design Support Tools Research on Floor Coverings Proposed Methods Development and evaluation of a tool to support design creation for puzzle mats Implementatio n Scan the 3D models of real environments Create designs in ‘PuzMaty’ Place mats in the real environment Experiment 10 Experimental participants Design with mats using the system and place in the real environment Evaluation SUS, Interview Future Work UI improvement Support during design creation and mats placement PuzMaty: Supporting Puzzle Mats Design Creation Sarii Yamamoto , Jia Jun Wang, Liwei Chan, Yuta Sugiura
  • 18. 18 Furniture Detection • Detect furniture from point cloud • Determine the presence or absence of point clouds at a height of 60 cm from the floor • Mat Layer • If at least 60% of the point cloud mats are valid, furniture is present • Pont Cloud Layer • Mats are valid where the point cloud is located 3D Model Mat Layer Point Cloud Layer Clip Point cloud layer A mat within the mat layer detected undetected Point cloud 60%
  • 19. • children aged 5-6 years and their parents • They enjoyed to draw designs and place mats • Possibilities • Sense of achievement • Linguistic competence • Modifications • Support during design creation and mat placement • A device to keep children occupied 19 Workshop Designs and Actual Mats that participants created
  • 20. • Optical Sensor • Measuring the distance to an object and the shape from the time difference between the incident and reflected light. 20 LiDAR ( Light Detection And Ranging )
  • 21. 21 Scanning a 3D Model • LiDAR ( Light Detection And Ranging ) • Measures the distance to an object and the shape of the object using a laser beam • De used: iPhone 15 Pro • App used: SiteScape 3D Model