IRJET- Gesture Recognition using Sixth Sense Technology

International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 05 Issue: 03 | Mar-2018 www.irjet.net p-ISSN: 2395-0072
© 2018, IRJET | Impact Factor value: 6.171 | ISO 9001:2008 Certified Journal | Page 3424
GESTURE RECOGNITION USING SIXTH SENSE TECHNOLOGY
Aanchal Sharma1, Richa Bhatnagar2, Gaurav Singh Rawat3
1,2 Bachelors in Computer Science and Engineering, IMS Engineering College, Uttar Pradesh, India
3Professor, Dept. of Computer Science and Engineering, IMS Engineering College, Uttar Pradesh, India
---------------------------------------------------------------------***---------------------------------------------------------------------
Abstract - The aim of this project is basically to bridge the
gap between the physical world and digital world. The project
is software based in which user hand gestures are recognized
through web camera and then the related information
augments in the real world via projector. Through this paper,
theoretical explanation of this project is explained and also
how the software works and runs in real environment. The
coding part is done on microsoft visual studio software
through which built-in camera can be accessedforrecognition
of hand gestures. This project is similar to the Sixth sense
technology of Pranav Mistry, MIT Media Lab student. In this
project we are presenting one module of this technology.
Key Words: image processing, gesture recognition,
camera, digital information.
1. INTRODUCTION
In this era of modernization, technologies are advancing
rapidly. Every day we see some new technology coming in
market to simplify our livesmore than ever. 'SixthSense' is a
wearable gestural interface that augments the physical
world around us with digital information and lets us use
natural hand gestures to interact with that information.
'Sixth Sense' is wearable gestural links that build up the
substantial and real world around us with digital
information and lets us use natural hand expressions and
gestures to connect and communicate with that information
[2].
We've grown over millions of yearsto feel the worldaround
us. When we confront something, someone or some place,
we make use our five organic senses to differentiate
information about it; that information helps us make
decisions and chose the right actions to take. But arguably
the most useful intelligence that can help us make the right
judgment is not naturally cognitive with our five common
senses, namely the data, the information and the knowledge
that humankind has acquired about everything and whichis
progressively all accessible online. Although thedecrease of
computing devices allows us to carry computers in our
pockets, keeping us constantly connected to the digital
world, there is no channel between our digital gearsand our
communication with the physical world. Information is
limited normally on paper or digitally on a screen. Sixth
Sense overpasses the gap i.e., bringing unreal and abstract,
digital information out into the touchable world, and
allowing us to connect with this informationvianaturalhand
gestures.
1.1 Camera: the camera (see Figure 1) is the key input
device of this system. The camera attached isusedtocapture
the images to which the user is looking at. It tracks the
gestures made by the user. The camera recognizes
individuals, images, pictures, gestures that user makes with
his/her hands. Then the captured image or data issenttothe
mobile computing device for processing [8]. Camera in this
system acts like a digital eye which connects to the digital
world of information.[8] It integratesthe digital information
into our real world through our own made hand gestures.
Figure 1. Camera
1.2 Projector: the interpreted data is projected onto a
surface mainly walls, body or hands of a person for
augmenting the digital information in the real world [8]. A
tiny LED projector(see Figure 2) is used for projecting the
virtual info which has a small battery last for 3 hours. The
image captured by the cameras and processed by themobile
device is projected onto the small mirror located belowit.So
that when an object is touched, the related info is being
augments on a surface via internet ,as it is a part of that
object.
Figure 2. Mini Projector

2.3 Microsoft Enabled Laptop: The laptop(see Figure 3) is
used for implementing the code and running the software.
The code is written in C# language for about more than
10,000 lines of code. The laptop in which Microsoft visual
studio software is enabled used for processing the data or
image captured by the camera. This digital info is then
passed to the projector which projects the info of the object
considering as if it is the part of that object.
Figure 3. Laptop
2.4 Mirror: The mirror(see Figure 4) is used to reflect the
image or any digital info projected by the projector onto a
desired surface. It is located below the projector in the
system[8]. The user manually can change the tilt of the
mirror to change the location of the projection. Mirror
finally augments the digital world info on the physical world
so that one can build up the gap of virtual n real world. This
is the final step which frees the digital info into real world.
Thus, the mirror in the Sixth Sense helps in overcoming the
limitation of the limited projection space of the projector.
Figure 4. Mirror
2. WORKING
Figure 5. Working of Sixth Sense Device
Sixth sense technology is WUW i.e. Wear Ur World
technology which is a pendant like wearable device. It
consists of a camera, a mirror, color markers, colored tapes
and a projector connected wirelessly to the Bluetoothorwifi
of smart phone [5]. The hardware that makes Sixth Sense
work is a pendant like mobile wearable interface. It has a
camera, a mirror and a projector and is connectedwirelessly
to a Bluetooth smart phone that can slip comfortably into
one’s pocket. The camera recognizes individuals, images,
pictures, gestures one makes with their hands. Information
is sent to the Smartphone for processing[9].Thedownward-
facing projector projects the output image on to the mirror.
Mirror reflects image on to the desired surface. Thus, digital
information is freed from its confines and placed in the
physical world[10].
3. CONCLUSION
We have discussed about the latest innovative argot thathas
announces its existence in the technical field, it recognize
different varieties of actions and gestures, it can easily
interact with other objects. Sixth sense technologydefinitely
will going to bring up a great and wide change in the way we
look our world that’s why this technology musthaveabright
future. The main advantage of this technology is that, it is
portable as well as interactive than any other device like
laptop, Smartphone, tablets etc. In this report we have also
discussed about applications, disadvantages andadvantages
of sixth sense technology as well. This new technology has a
wearable device that authorizes us to have the entire world
of advanced data readily which is truly available. The
masterstroke of this technology is that it has the potential
that holds to connect INTERNET with real world and
superimposing the data on the real-world. The key point is
that it identifies the objects around oneself, let us access the
information in that way we have discussed displays and
want that particular information aswell, alltheseinthemost
simplest way[9].
REFERENCES
[1] http://tmu.ac.in/college-of-computing-sciences-and-
it/wp-content/uploads/sites/17/2016/10/ICAC-
1604141.pdf
[2] https://www.irjet.net/archives/V4/i5/IRJET-
V4I5127.pdf
[3] http://inpressco.com/wp-
content/uploads/2014/09/Paper213210-3213.pdf
[4]http://www.ijritcc.org/download/browse/Volume_5_I
ssues/June_17_Volume_5_Issue_6/1496901809_08-06-
2017.pdf
[5]
www.webopedia.com/TERM/G/gesture_recognition.ht
ml. Accessed 22 Feb-ruary 2014

[6] http://www.seminarsonly.com//Sixth-Sense-
Technology.php.
[7] http://www.devilscafe.in/2015/09/how-to-make-
your-own-sixth-sense-device.html
[8] www.pranavmistry@mit.com
[9]https://www.google.co.in/url?sa=t&rct=j&q=&esrc=s&
source=web&cd=9&cad=rja&uact=8&ved=0ahUKEwjUoL
m0_KLXAhUNUI8KHb76Dq8QFghYMAg&url
[10] http%3A%2F%2F
[11] www.ijert.org%2Fdownload%2F7188%2Fsixth-
sense-technology--a-brief-literary-
survey&usg=AOvVaw1TGhXwyw01aCjwL95qTV02

IRJET- Gesture Recognition using Sixth Sense Technology

More Related Content

What's hot (19)

Similar to IRJET- Gesture Recognition using Sixth Sense Technology (20)

More from IRJET Journal (20)

Recently uploaded (20)

IRJET- Gesture Recognition using Sixth Sense Technology