RF-Compass:
Robot Object Manipulation Using RFIDs
Fadel Adib, Ross Knepper, Dina Katabi, Daniela Rus
Jue Wang
Limitation of Today’s Robotic Automation
Fixed-position, single-task robot
• Limited to large-volume production line
• Inability to change manufacturing process
Toyota has been slowly backing away from heavy automation.
The labor saved by robots was wasted most of all by
reprogramming robots.
This is the future. A new wave of robots, far more adept
than those now commonly used by automakers and other
heavy manufacturers.
The potential for much broader industrial acceptance is tied to
the development of robots that can absorb data, recognize
objects, and respond to information and objects in
their environment with greater accuracy.
Mobile Manipulation
Fetching, grasping, and manipulating objects
• Extend automation to small/medium factories
• Easy to reconfigure manufacturing process
• Centimeter-scale localization, e.g., 2cm
• Minimal instrumentation  portable
Requirements for Mobile Manipulation
Current Approaches
• Motion capture system, e.g., VICON
– Sub-centimeter accuracy
– Heavy instrumentation & Expensive
Current Approaches
• Motion capture system, e.g., VICON
– Sub-centimeter accuracy
– Heavy instrumentation & Expensive
• Imaging (e.g., optical camera, Kinect, LIDAR)
– Needs prior training
or ?
Current Approaches
• Motion capture system, e.g., VICON
– Sub-centimeter accuracy
– Heavy instrumentation & Expensive
• Imaging (e.g., optical camera, Kinect, LIDAR)
– Needs prior training
or ?
Can RF localization help?
Current RF localization schemes are too coarse
• State-of-the-art WiFi localization: 23cm
[ArrayTrack]
• State-of-the-art RFID localization: 11cm [PinIt]
BUT requires a dense grid of reference tags
How to get a few cm accuracy without
environment instrumentation?
RF-Compass
• Place RFID tags on both robot and objects
• No reference tags in the environment
Identifying the Object
• RFID: a passive sticker – no battery, low cost
• Reader shines RF signal on tags
 Each tag replies with its unique ID
 Works for up to 10 meters
How to get centimeter-scale accuracy?
• Compare distances between RFIDs
Which blue tag is closer to the red tag?
Tag 3
Tag 1
Tag 2
Distance ordering based on signal similarity
[SIGCOMM’13]
Building block: RF pairwise comparison
Basic building block 2cm accuracy

Basic Idea: Localization by Partitioning
Is the red tag closer to Tag 1 or Tag 2?
Basic Idea: Localization by Partitioning
Tag 1 is closer than Tag 2
Basic Idea: Localization by Partitioning
Tag 3 is closer than Tag 4
Basic Idea: Localization by Partitioning
Tag 4 is closer than Tag 1
Basic Idea: Localization by Partitioning
But not yet centimeter accuracy
Basic Idea: Localization by Partitioning
• Partitions can be iteratively refined
Iterative Refining via Robot Navigation
• Leveraging robot’s consecutive moves
Iterative Refining via Robot Navigation
• Every robot move gives a new set of partitions
Iterative Refining via Robot Navigation
• Lay new partitions over old partitions to refine
• Keep refining until reaching centimeter accuracy
Iterative Refining via Robot Navigation
• Keep refining until reaching centimeter accuracy
Iterative Refining via Robot Navigation
Formulation as an Optimization
2 𝑥2 − 𝑥1 2 𝑦2 − 𝑦1
𝑥0
𝑦0
≤ 𝑥2
2
+ 𝑦2
2
− 𝑥1
2
− 𝑦1
2
(𝑥1, 𝑦1)
(𝑥2, 𝑦2)
(𝑥0, 𝑦0)
Formulation as an Optimization
2(𝑥2 − 𝑥1) 2(𝑦2 − 𝑦1)
⋮ ⋮
𝑥0
𝑦0
≤ 𝑥2
2
+ 𝑦2
2
− 𝑥1
2
− 𝑦1
2
⋮
(𝑥0, 𝑦0)
Formulation as an Optimization
𝑨
𝑥0
𝑦0
≤ 𝒃
Works correctly even if randomly flipping 10% of
pairwise comparisons, shown in paper
(𝑥0, 𝑦0)
• A feasibility problem with
linear constraints
• Efficiently solved via convex
optimization
• Over-constrained system
↓
Robustness to errors & outliers
Problem: also need orientation for grasping
Solution:
• Multiple RFIDs on object
• Naïve approach: localize each RFID
independently and find orientation
• Our approach: joint optimization using
knowledge of their relative location
Orientation
Evaluation
• Used a robot to fetch IKEA furniture parts
• 9 tags on robot, 1 – 4 tags on object
Baseline
• VICON motion capture system
• Sub-centimeter accuracy
• Infrared cameras + infrared-reflective markers
VICON
Markers
Navigation Performance
CDF
CDF
Ratio to Optimal Path in LOS Ratio to Optimal Path in NLOS
Direct line-of-sight
RF-Compass enables effective navigation in NLOS
VICON does NOT
work in NLOS
Occlusion and NLOS
Only 6% longer than
optimal on average
Center Position Accuracy
4 cm
2.8 cm
1.9 cm
1.3 cm
0
1
2
3
4
5
6
1 Tag 2 Tags 3 Tags 4 Tags
Number of Tags on Furniture Part
ErrorinPositionEstimate(cm)
Number of Tags on Furniture Part
ErrorinOrientation(degree)
5.8˚
3.6˚ 3.3˚
0
1
2
3
4
5
6
7
2 Tags 3 Tags 4 Tags
Orientation Accuracy
Conclusion
• RF-Compass: accuracy of a few cm and degrees
• Iterative refining by leveraging robot’s navigation
• Opens up opportunities for bridging robot object
manipulation with RF localization

More Related Content

PPT
Human-Computer Interactive Systems
PDF
Rf survey
PPT
Microwave Antenna
PDF
IRJET- Simultaneous Localization and Mapping for Automatic Chair Re-Arran...
PDF
VLSI Implementation of CORDIC Based Robot Navigation Processor
PDF
RFID based mobile robot for indoor navigation
PDF
pin-Documentation
PDF
An Intelligent Mobile Robot Navigation Technique Using RFID Technology
Human-Computer Interactive Systems
Rf survey
Microwave Antenna
IRJET- Simultaneous Localization and Mapping for Automatic Chair Re-Arran...
VLSI Implementation of CORDIC Based Robot Navigation Processor
RFID based mobile robot for indoor navigation
pin-Documentation
An Intelligent Mobile Robot Navigation Technique Using RFID Technology

Similar to Rf compass (20)

PPTX
PSanthanam.pptx
PPTX
Muhammad rizwan aqeel rlp.ppt
PDF
Marvelmind indoor positioning technologies review
PPTX
Indoor Tracking System
PPTX
RFID based indoor tracking system
PDF
Optimized mapping and navigation of remote area through an autonomous robot
PPT
Oral Report Rev2
PDF
DESIGN AND VLSIIMPLEMENTATION OF ANTICOLLISION ENABLED ROBOT PROCESSOR USING ...
PDF
Research on automated guided vehicle (AGV) path tracking control based on la...
PDF
426 lecture3: AR Tracking
PDF
Top 10 cited Computer Networks & Communications Research Articles From 2017 I...
PPTX
Rfid based localization
PPTX
PPTX
SPARSH (Solar Powered Automated Route Sensing Hexapod)
PPTX
Localization Issues in a ZigBee based Internet of Things scenario
PPTX
Steam Turbine Alignment
PPT
Rfig Sig04 Presentation
PDF
UiA Slam (Øystein Øihusom & Ørjan l. Olsen)
PPT
Topgroup presentation 1
PSanthanam.pptx
Muhammad rizwan aqeel rlp.ppt
Marvelmind indoor positioning technologies review
Indoor Tracking System
RFID based indoor tracking system
Optimized mapping and navigation of remote area through an autonomous robot
Oral Report Rev2
DESIGN AND VLSIIMPLEMENTATION OF ANTICOLLISION ENABLED ROBOT PROCESSOR USING ...
Research on automated guided vehicle (AGV) path tracking control based on la...
426 lecture3: AR Tracking
Top 10 cited Computer Networks & Communications Research Articles From 2017 I...
Rfid based localization
SPARSH (Solar Powered Automated Route Sensing Hexapod)
Localization Issues in a ZigBee based Internet of Things scenario
Steam Turbine Alignment
Rfig Sig04 Presentation
UiA Slam (Øystein Øihusom & Ørjan l. Olsen)
Topgroup presentation 1
Ad

Recently uploaded (20)

PDF
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
PDF
Architecture types and enterprise applications.pdf
PPTX
The various Industrial Revolutions .pptx
PDF
A review of recent deep learning applications in wood surface defect identifi...
PPTX
Modernising the Digital Integration Hub
PDF
A contest of sentiment analysis: k-nearest neighbor versus neural network
PDF
Assigned Numbers - 2025 - Bluetooth® Document
PDF
WOOl fibre morphology and structure.pdf for textiles
PPTX
observCloud-Native Containerability and monitoring.pptx
PDF
Zenith AI: Advanced Artificial Intelligence
PDF
From MVP to Full-Scale Product A Startup’s Software Journey.pdf
PPTX
Chapter 5: Probability Theory and Statistics
PDF
DASA ADMISSION 2024_FirstRound_FirstRank_LastRank.pdf
PDF
August Patch Tuesday
PPTX
Benefits of Physical activity for teenagers.pptx
PDF
A comparative study of natural language inference in Swahili using monolingua...
PDF
Taming the Chaos: How to Turn Unstructured Data into Decisions
PPTX
MicrosoftCybserSecurityReferenceArchitecture-April-2025.pptx
PDF
TrustArc Webinar - Click, Consent, Trust: Winning the Privacy Game
PDF
Hybrid model detection and classification of lung cancer
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
Architecture types and enterprise applications.pdf
The various Industrial Revolutions .pptx
A review of recent deep learning applications in wood surface defect identifi...
Modernising the Digital Integration Hub
A contest of sentiment analysis: k-nearest neighbor versus neural network
Assigned Numbers - 2025 - Bluetooth® Document
WOOl fibre morphology and structure.pdf for textiles
observCloud-Native Containerability and monitoring.pptx
Zenith AI: Advanced Artificial Intelligence
From MVP to Full-Scale Product A Startup’s Software Journey.pdf
Chapter 5: Probability Theory and Statistics
DASA ADMISSION 2024_FirstRound_FirstRank_LastRank.pdf
August Patch Tuesday
Benefits of Physical activity for teenagers.pptx
A comparative study of natural language inference in Swahili using monolingua...
Taming the Chaos: How to Turn Unstructured Data into Decisions
MicrosoftCybserSecurityReferenceArchitecture-April-2025.pptx
TrustArc Webinar - Click, Consent, Trust: Winning the Privacy Game
Hybrid model detection and classification of lung cancer
Ad

Rf compass

  • 1. RF-Compass: Robot Object Manipulation Using RFIDs Fadel Adib, Ross Knepper, Dina Katabi, Daniela Rus Jue Wang
  • 2. Limitation of Today’s Robotic Automation Fixed-position, single-task robot • Limited to large-volume production line • Inability to change manufacturing process
  • 3. Toyota has been slowly backing away from heavy automation. The labor saved by robots was wasted most of all by reprogramming robots. This is the future. A new wave of robots, far more adept than those now commonly used by automakers and other heavy manufacturers. The potential for much broader industrial acceptance is tied to the development of robots that can absorb data, recognize objects, and respond to information and objects in their environment with greater accuracy.
  • 4. Mobile Manipulation Fetching, grasping, and manipulating objects • Extend automation to small/medium factories • Easy to reconfigure manufacturing process
  • 5. • Centimeter-scale localization, e.g., 2cm • Minimal instrumentation  portable Requirements for Mobile Manipulation
  • 6. Current Approaches • Motion capture system, e.g., VICON – Sub-centimeter accuracy – Heavy instrumentation & Expensive
  • 7. Current Approaches • Motion capture system, e.g., VICON – Sub-centimeter accuracy – Heavy instrumentation & Expensive • Imaging (e.g., optical camera, Kinect, LIDAR) – Needs prior training or ?
  • 8. Current Approaches • Motion capture system, e.g., VICON – Sub-centimeter accuracy – Heavy instrumentation & Expensive • Imaging (e.g., optical camera, Kinect, LIDAR) – Needs prior training or ?
  • 10. Current RF localization schemes are too coarse • State-of-the-art WiFi localization: 23cm [ArrayTrack] • State-of-the-art RFID localization: 11cm [PinIt] BUT requires a dense grid of reference tags How to get a few cm accuracy without environment instrumentation?
  • 11. RF-Compass • Place RFID tags on both robot and objects • No reference tags in the environment
  • 12. Identifying the Object • RFID: a passive sticker – no battery, low cost • Reader shines RF signal on tags  Each tag replies with its unique ID  Works for up to 10 meters
  • 13. How to get centimeter-scale accuracy?
  • 14. • Compare distances between RFIDs Which blue tag is closer to the red tag? Tag 3 Tag 1 Tag 2 Distance ordering based on signal similarity [SIGCOMM’13] Building block: RF pairwise comparison
  • 15. Basic building block 2cm accuracy 
  • 16. Basic Idea: Localization by Partitioning Is the red tag closer to Tag 1 or Tag 2?
  • 17. Basic Idea: Localization by Partitioning Tag 1 is closer than Tag 2
  • 18. Basic Idea: Localization by Partitioning Tag 3 is closer than Tag 4
  • 19. Basic Idea: Localization by Partitioning Tag 4 is closer than Tag 1
  • 20. Basic Idea: Localization by Partitioning But not yet centimeter accuracy
  • 21. Basic Idea: Localization by Partitioning • Partitions can be iteratively refined
  • 22. Iterative Refining via Robot Navigation • Leveraging robot’s consecutive moves
  • 23. Iterative Refining via Robot Navigation • Every robot move gives a new set of partitions
  • 24. Iterative Refining via Robot Navigation • Lay new partitions over old partitions to refine
  • 25. • Keep refining until reaching centimeter accuracy Iterative Refining via Robot Navigation
  • 26. • Keep refining until reaching centimeter accuracy Iterative Refining via Robot Navigation
  • 27. Formulation as an Optimization 2 𝑥2 − 𝑥1 2 𝑦2 − 𝑦1 𝑥0 𝑦0 ≤ 𝑥2 2 + 𝑦2 2 − 𝑥1 2 − 𝑦1 2 (𝑥1, 𝑦1) (𝑥2, 𝑦2) (𝑥0, 𝑦0)
  • 28. Formulation as an Optimization 2(𝑥2 − 𝑥1) 2(𝑦2 − 𝑦1) ⋮ ⋮ 𝑥0 𝑦0 ≤ 𝑥2 2 + 𝑦2 2 − 𝑥1 2 − 𝑦1 2 ⋮ (𝑥0, 𝑦0)
  • 29. Formulation as an Optimization 𝑨 𝑥0 𝑦0 ≤ 𝒃 Works correctly even if randomly flipping 10% of pairwise comparisons, shown in paper (𝑥0, 𝑦0) • A feasibility problem with linear constraints • Efficiently solved via convex optimization • Over-constrained system ↓ Robustness to errors & outliers
  • 30. Problem: also need orientation for grasping Solution: • Multiple RFIDs on object • Naïve approach: localize each RFID independently and find orientation • Our approach: joint optimization using knowledge of their relative location Orientation
  • 31. Evaluation • Used a robot to fetch IKEA furniture parts • 9 tags on robot, 1 – 4 tags on object
  • 32. Baseline • VICON motion capture system • Sub-centimeter accuracy • Infrared cameras + infrared-reflective markers VICON Markers
  • 33. Navigation Performance CDF CDF Ratio to Optimal Path in LOS Ratio to Optimal Path in NLOS Direct line-of-sight RF-Compass enables effective navigation in NLOS VICON does NOT work in NLOS Occlusion and NLOS Only 6% longer than optimal on average
  • 34. Center Position Accuracy 4 cm 2.8 cm 1.9 cm 1.3 cm 0 1 2 3 4 5 6 1 Tag 2 Tags 3 Tags 4 Tags Number of Tags on Furniture Part ErrorinPositionEstimate(cm)
  • 35. Number of Tags on Furniture Part ErrorinOrientation(degree) 5.8˚ 3.6˚ 3.3˚ 0 1 2 3 4 5 6 7 2 Tags 3 Tags 4 Tags Orientation Accuracy
  • 36. Conclusion • RF-Compass: accuracy of a few cm and degrees • Iterative refining by leveraging robot’s navigation • Opens up opportunities for bridging robot object manipulation with RF localization