Augmented reality in E-commerce

AUGMENTED REALITY
IN E-COMMERCE
Presentation By:
• ARUN C (16)
• ASHWIN P (18)
• JITHIN B (27)
• KIRAN RAJ N V (30)
Guide:
Mr. Anoop P V
(Assistant Professor)
Department Of Computer Science and Engineering 1

PROJECT
OVERVIEW

INTRODUCTION
WHAT IS THIS PROJECT ABOUT?
• The Project is about Improving the shopping experience of
the furniture using Augmented Reality (AR) technology.
HOW IT USES AR TECHNOLOGY?
• It overlays digital content such as image, video, text, etc., and
in our case a furniture on to a physical object or location in 3D
Form and it is typically experienced by looking through the
Smartphone Camera.

Fig 1: Photo shot on from
this App
• The Project is an E-Commerce
Application harnessing the
power of AR Technology.
• Project includes an Android App
for users with an aim to make
purchases.
• Project also includes Web App
for the administrator to manage
the Shopping Experience.

OBJECTIVES
• To Provide Real Life Shopping Experience From The Comfort
Of Your Home.
• To Make Shopping More Entertaining Than Just Scrolling
Through A List Of Products.
• To Provide Trending Technology Such As Augmented Reality
Experience To Users.
• To Provide Brand New Way Of Shopping.
• To Make More Informed Shopping Experience.
• To Make More Informed Purchasing Decisions.
• To Be Ahead Of The Competition In The E-commerce Space.

SCOPE
• Augmented Reality is a very new technology, used mostly in gaming
as of now, and is yet to make a significant impact in the trillion dollar
E-Commerce market.
• As the shopping moves online for everything like electronics, apparel,
medicines, cosmetics and home furniture, the demand for a great
shopping experience also rises, and that’s where AR make becomes
a game changer.
• With AR, users can get a 360 degree view of the product, and helping
in making a better judgement.
• Areas where AR can make an impact goes long including Gaming,
E-Commerce, Medical, Training, Education, Entertainment, etc.

LITERATURE SURVEY
No Related Work Positives Negatives
1 Urban Ladder Great Web
Shopping UX/UI
No AR, User has to
decide based on
Images.
2 Pepper Fry UI, AR Support AR Support limited
to 2D Images, NO
3D View Support
3 NeyBers Lightening and
Shading Tools
Doesn't have 3D
Models
4 Normal Store
Shopping
Real Life Shopping
Experience
Long process of
reaching big stores
away from home
5 Our Product Simple UI/UX, AR,
3D, 360 degree
View Support
Less No. of Items

SYSTEM
DESIGN

SYSTEM FEATURES
The System After Careful Analysis Has Been Identified To Be Presented
With The Following Modules And Roles
1. ADMIN – Role includes CRUD (Create/Read/Update/Delete)
items, categories, and other tasks available from the
dashboard.
2. CLIENT – Use by customers for shopping.
3. AUGMENTED REALITY – On selecting AR View of a product
from client, an INTENT is send to the AR Module for
displaying a 3D View of the available item.

ADMIN – WEB APP
• The Administrator is the Super User of this application and
also the owner of company.
• Only they have access to the dashboard and to all other
functionalities available from it.
• They can manage Items.
• They can view information about all the registered users.
• They can view Item reviews posted by various user.
• They can view all the Orders placed by Users.
• They can send notifications to desired users on details like
Offers, Shipping details, etc.

CLIENT – ANDROID APP
• User Registration and Login.
• Display of all the available items along with item name, image
and price.
• User can View/Edit/Update their profile.
• User can view notification sent by admin regarding shipping
details, offers, etc.
• On selecting a particular product user can view product details
such as item name, enhanced item image, price, category and
description.

• View product reviews and rating.
• Add review and rating.
• Make an order.
• View order status.
• User can see the furniture in front of them using AR
Technology through smartphone camera.
• User can take the Screenshot of the item from a particular
viewpoint.
AR MODULE

DATA FLOW DIAGRAM

DFD - ADMIN

DFD - CLIENT

DATABASE
No Table Columns KEYS Comments
1 category 2 1 PK To classify items
2 item 6 1 PK, 1FK Store item details
3 login 4 1 PK Store user credentials
4 Order_master 6 1 PK, 1FK Store details of order placed by
users
5 Order_slave 4 1 PK, 2FK Order table split into 2, to
reduce data redundancy and for
Normalization Purpose.
6 review 6 1 PK, 2FK Store Reviews
7 User_details 10 1 PK, 1FK Store User details
Total 7 Tables 38

METHODOLOGY

METHODOLOGIES in ADMIN / CLIENT
• For Web App development, we have used MVC (Model-View-
Controller) Design Pattern.
• For Android App, also MVC Design Pattern is used, as here
every action starts with a call to a controller along with an
action.
• Java Servlets which is a Java software component are used to
extend the capabilities of a server.
• Agile Software development is practiced .

AUGMENTED REALITY MODULE
What is Augmented Reality?
● In this image you can see a stack of
floating information in front of his
view. This digital information is
augmented and it uses real time
environment.
● Unlike VR which creates a totally
artificial environment, AR uses an
existing environment and overlays
new information on top of it.
Fig 2: Scene from Iron Man

Other forms of Augmented Reality.
Fig 3: Snapchat filters Fig 4: Pokémon Go

1. Projection Based AR
• Functions using projections
on objects.
• It is a simple projection of
light to a surface.
Types of
Augmented Reality
2. Recognition Based AR
• This focuses on recognition of
objects and then provides more
information about the object.
• Example: using your mobile
phone for scanning a barcode
or QR code.

2.1. Marker Based AR
• When your device detects a
marker, it will overlay a 3D
object or animation over
that.
2.2 Marker-Less AR
• There are algorithms that
detect a surface plane of
either a table plane or floor
and use that as a reference
to place the 3D object.

3. Location Based AR
• Features they provide are in
terms of location detection. Helps
travellers.
4. Outline AR
• Uses live driving environments
to outline lanes, people and
objects when visibility gets
hindered.
5. Super-Imposition Based AR
• Provides an alternate view of a
object in concern. Replaces the
original view with the
augmented one.

1. Image Recognition
• It allows to identify objects,
places and images.
• Smartphones and other
devices use machine vision
together with camera and AI
software to track images that
can be overlayed with objects,
animations, content etc.
Technologies In Augmented Reality Application

2. 3D Recognition and Tracking
• Due to the tracking, an app can “understand” and enhance the
large spaces around the user, inside of large buildings such as
airports, bus stations, shopping malls, etc.
• Applications supporting it can recognize three-dimensional
objects like boxes, cups, cylinders, toys etc.
3.
• OpenSceneGraph is an open source 3D graphic toolkit
(application programming interface).
• It’s used by app developers in such domains as computer
games, augmented and virtual reality, scientific visualization
and modeling.

4. GPS support (Geolocation)
• If you are going to create a location-based AR application,
geolocation is a fundamental feature that must be supported
by the AR tool you are going to use.
• GPS can be used both in AR games like Pokemon Go as
well as in apps made to overlay data on some nearby
locations.
5. Unity support
• Unity is known to be the most popular and powerful game
engine worldwide. Though it’s usually used for developing
computer games, it can also be utilized for making AR apps
with powerful effects.

6. SLAM support
• SLAM means Simultaneous Localization and Mapping.
• It is an algorithm that maps the environment where the user
is located and tracks all of their movements.
• AR apps containing this feature can remember the position
of physical objects within some environment and position
virtual objects accordingly.
• SLAM has huge potential and can be used in many kinds of
apps, not only AR apps.
• The main advantage of this technology is the ability to be
used indoors while GPS is only available outdoors.

How To Use AR Experience
1. To place furniture make sure the room is well lit and hold
your smartphone at waist level.
2. Make sure the floor in front of you is non-reflective and
free of clutter.
3. Scan an empty piece of floor by moving your device
around.
4. Search the list of available products and select one.
5. Find an empty spot in the plane and place the product
there.
6. Move around the Augmented Furniture to get a 360
degree View.

SOFTWARE
DEVELOPMENT

TECHNOLOGIES USED
Web app (Admin)
Frontend HTML, CSS, Bootstrap frontend library and JavaScript.
Backend Java
Database MySQL,
Tools Used NetBeans, Sublime Editor, Apache Server, WAMP
(PHPMyAdmin), SQLyog
Android App (Client)
Frontend XML
Backend Java, Java Servlet
Tools Used Android Studio
Augmented Reality App (Client)
Tools Used Unity 3D Engine and Vuforia Engine.

Introduction To Vuforia
• Vuforia is Augmented Reality Software Development Kit or SDK
for mobile devices that enables the creation of AR applications.
• It uses Advanced Computer Vision Technology to recognize and
track planar images such as image targets and simple 3D
objects ground Planes in real time.
• This image recognition capability enables developers to
position and orient virtual objects such as 3D models and other
media in relation to the real world images when these are in the
view of camera of a mobile device.

● The virtual object then tracks the position and orientation of
the image in real time so that the viewer's perspective on
the object correspond with a perspective on the image
target so that it appears the virtual object is part of the real
world scene hence the term Augmented Reality.
● In a nutshell Vuforia makes implementing Augmented
Reality Apps easy for anyone to get started without having
to redevelop all the complex Detection and Tracking
algorithms that are incorporated into the Vuforia sdk.

How does Vuforia image recognition work?
• Well, you don't see the code for recognition and tracking
because they are Intellectual property of Qualcomm and
usually should not be revealed. Vuforia is not an open-
source library.
• Vuforia first detects "feature points" in your target image
and then uses the data to compare the features in target
image and the receiving frame from camera.

SYSTEM REQUIREMENTS
Web app (Admin) - PC
OS Windows 10 / Linux 17.04+ / MacOS
RAM / Processor 2 GB / 1.3 GHz intel core i3 (5th gen) Processor
Web Browser Google Chrome, Firefox, Safari
Other Wi-Fi
Android App (Client) - Smartphone
OS Android OS 6+
RAM 1 GB RAM
Tools Used Wi-Fi Connectivity
Augmented Reality App (Client) - Smartphone
Camera 5MP Quality Camera
Sensors Accelerometers and Gyroscope

STRENGTH OF THE SYSTEM
• High level technical knowledge is NOT required to operate the
System.
• Simple UI is used for client application, to get started
immediately.
• Shopping experience is enhanced by displaying items in
Augmented Form.

CHALLENGES
• Unity is not an Open source tool, it requires a High cost
subscription to store the assets (3D Images) on cloud, hence in
our product we have bundled the assets with the app.
• High development cost: Development of such application
requires quality developers and quality Software development
kit (SDK).
• Time Consuming: Creating AR Experience is also a time
consuming purpose which can delay product release since, app
has to go through a wide range of development and testing.

FUTURE SCOPE
• AR Assets (3D Images) can be fetched from cloud storage
instead of local database.
• More items can be added to provide better shopping
experience using AR Technology.
• More features can be added to Android app such as Search,
Filter, Bookmarking the product.
• Features like private chat can be implemented where users
can chat with product owners for bargaining or to get more
info on items.

CONCLUSION
• This application has attained its purpose of making furniture
shopping a better experience with the introduction of
Augmented Reality.
• The shopping experience in this app is better than industry
leaders in India like Urbanclap which only displays furniture
image and Pepperfry which display a 2D Image in that place.
• The project exposed us to the latest technology in the area of
mobile and web development

DEMONSTRATION
• Admin Module
• Client Module
• Augmented Module

BIBLIOGRAPHY
1. (Vuforia Extended Tracking)
https://library.vuforia.com/content/vuforia-
library/en/articles/Training/Extended-Tracking.html
2. (Vuforia Image Target Guide)
https://library.vuforia.com/content/vuforia-
library/en/articles/Training/Image-Target-Guide.html
3. (Working of AR) https://www.youtube.com/watch?v=uHyw17v-
AWYhttps://www.quora.com/How-does-Augmented-Reality-Work
4. (AR Dev) https://thinkmobiles.com/blog/how-much-cost-make-app-
like-ikea/

Augmented reality in E-commerce

More Related Content

What's hot (20)

Similar to Augmented reality in E-commerce (20)

Recently uploaded (20)

Augmented reality in E-commerce