EXPERIMENTING
WITH HOLOLENS
FEATURING: HOLOLENS APP CASE
FOR ECOMMERCE
Luis Gomes
@_lufego
Frontend Engineer
at commercetools gmbH
Frontend Engineer
Frontend Engineer
Frontend Engineer
?
?
?
Experimenting with HoloLens for E-Commerce
CURIOUSITY
C#
Windows OS
HOLOLENS APP
THE
CASE
UNDERSTANDING THE CONCEPTS
VR
Virtual Reality
AR
Augmented Reality
MR
Mixed Reality
VIRTUAL REALITY
“…A computer-generated simulation
of a three-dimensional image or
environment that can be interacted
with in a seemingly real or physical
way by a person using special
electronic equipment.”
UNDERSTANDING THE CONCEPTS
VR AR MR
Virtual Reality Augmented Reality Mixed Reality
AUGMENTED
REALITY
The real-world content
and the CG content are not
able to respond to each other.
UNDERSTANDING THE CONCEPTS
VR AR MR
Virtual Reality Augmented Reality Mixed Reality
Mixed Reality
“…Is the merging of real and virtual worlds
to produce new environments and visualisations
where physical and digital objects co-exist and interact in real time.”
UNDERSTANDING THE CONCEPTS
VR AR MR
Virtual Reality Augmented Reality Mixed Reality
UNDERSTANDING THE CONCEPTS
VR
Virtual Reality
AR
Augmented Reality
What does it mean for
ecommerce?
IN ECOMMERCE
AUGMENTED REALITY
IS ALREADY A REALITY
Mobile Augmented Reality could become the primary
driver of a $108 billion VR/AR market by 2021
(underperform $94 billion, outperform $122 billion)
https://www.digi-capital.com/news/2017/01/after-mixed-year-mobile-ar-to-drive-108-billion-vrar-market-by-2021
Ikea Place APP
WHY?
& Online Shopping
Expectation
Expectation is the
root of all heartache
- William Shakespeare
Expectation is the
mother of all frustration
- Unknown
Expectation Reality
Expectation Reality
WHY HOLOLENS
WHY
- It’s much more immersive than AR/VR
- The commercetools API is flexible and
allows us to
- We wanted to experiment something
New; Never done before
- Why not?
Experimenting with HoloLens for E-Commerce
Experimenting with HoloLens for E-Commerce
Experimenting with HoloLens for E-Commerce
Experimenting with HoloLens for E-Commerce
Experimenting with HoloLens for E-Commerce
commercetools API
DEMO TIME
HOW IT CONNECTS
TO OUR API
LEARNINGS
Experimenting with HoloLens for E-Commerce
CollisionAPIRequest.js
function OnTriggerEnter (product: Collider) {
}
function OnTriggerExit (product: Collider) {
removeLineItem(product.name);
}
addLineItem(product.name);
Experimenting with HoloLens for E-Commerce
Experimenting with HoloLens for E-Commerce
Experimenting with HoloLens for E-Commerce
Experimenting with HoloLens for E-Commerce
function OnTriggerEnter (product: Collider) {
}
addLineItem(product.name);
addLineItem(product.name);
CollisionAPIRequest.js
function addLineItem(productId) {
changeTextAndColor("Loading...", Color.yellow);
var requestUrl = "https://api.sphere.io/medimux-shop/carts/" + loggedUserCartId;
var getUserCart = gameObject.Find("API").GetComponent.<GetAPI>().Get(requestUrl);
yield getUserCart;
if (getUserCart.error) {
// If it fails to return the information, logs the error in the console
Debug.Log(getUserCart.error);
} else {
var currentCartVersion = JSON.Parse(getUserCart.text)["version"];
var cartVersionNumber = int.Parse(currentCartVersion);
// Builds body for the POST request
var requestBody = "{"version":" + cartVersionNumber
+ ", "actions": [{ "action": "addLineItem","
+ ""productId": "" + productId
+ "", "variantId": 1 }]}";
var postAddLineItem = gameObject.Find("API").GetComponent.<GetAPI>().Post(requestUrl, requestBody);
yield postAddLineItem;
if (!postAddLineItem.error) {
gameObject.Find("cartInSuccessSound").GetComponent.<AudioSource>().Play();
changeTextAndColor("Product added", Color.green);
} else {
// Plays feedback Audio
gameObject.Find("cartInErrorSound").GetComponent.<AudioSource>().Play();
changeTextAndColor("Product cannot be added", Color.red);
};
}
}
addLineItem
CollisionAPIRequest.js
addLineItem
productId
CollisionAPIRequest.js
addLineItem
var requestUrl = "https://api.sphere.io/medimux-shop/carts/" + loggedUserCartId;
CollisionAPIRequest.js
addLineItem
var getUserCart = Get(requestUrl);
CollisionAPIRequest.js
addLineItem
yield getUserCart;
CollisionAPIRequest.js
addLineItem
} else {
}
CollisionAPIRequest.js
addLineItem
var currentCartVersion = JSON.Parse(getUserCart.text)["version"]
CollisionAPIRequest.js
addLineItem
var requestBody = "{"version":" + cartVersionNumber
+ ", "actions": [{ "action": "addLineItem",
+ ""productId": "" + productId
+ "", "variantId": 1 }]}";
CollisionAPIRequest.js
addLineItem
var postAddLineItem = Post(requestUrl, requestBody);
yield postAddLineItem;
CollisionAPIRequest.js
addLineItem
var getUserCart = Get(requestUrl);
var postAddLineItem = Post(requestUrl, requestBody);
CollisionAPIRequest.js
addLineItem
gameObject.Find("API").GetComponent.<GetAPI>().Get( );
gameObject.Find("API").GetComponent.<GetAPI>().Post( );
API.js
function Get(url) {
var form = new WWWForm();
var headers = form.headers;
headers["Accept"] = "application/json";
headers["Content-Type"] = "application/json";
headers["Authorization"] = generatedToken;
return new WWW(url, null, headers);
}
function Post (url, payload : String) {
var form = new WWWForm();
var headers = form.headers;
var encoding = new System.Text.UTF8Encoding();
var rawData = encoding.GetBytes(payload);
headers["Accept"] = "application/json";
headers["Content-Type"] = "application/json";
headers["Authorization"] = generatedToken;
return new WWW(url, rawData, headers);
}
getProductInfo();
getToken();
getUserCart();
getHologramsList();
postRemoveLineItem();
postAddLineItem();
WHERE TO START
DEVELOPING FOR HOLOLENS
WHERE TO START
- Follow step-by-step tutorials
https://developer.microsoft.com/en-us/windows/mixed-reality/academy
- Grab the tools
Unity, Visual Studio, Windows OS
- Deep dive on the documentation
https://docs.microsoft.com/en-us/hololens/
LEARNINGS
LEARNINGS
- You don’t need to know everything
- Start small. Increase progressively
- Don’t be afraid to try new things
BE CURIOUS
Thank you!
@_lufego
luis.gomes@commercetools.de

More Related Content

PDF
WebAPIs & WebRTC - Spotify/sthlm.js
PPTX
Firefox OS, a startup opportunity - Mobile Startups Toronto & HTML Toronto me...
PDF
WebVR: Developing for the Immersive Web
PDF
HTML, not just for desktops: Firefox OS - Congreso Universitario Móvil - 201...
PDF
HTML for the Mobile Web, Firefox OS - All Things Open - 2014-10-22
PDF
Firefox OS, une plateforme à découvrir - IO Saglac - 2014-09-09
PPTX
Building AR and VR Experiences for Web Apps with JavaScript
PDF
Abandoned carts
WebAPIs & WebRTC - Spotify/sthlm.js
Firefox OS, a startup opportunity - Mobile Startups Toronto & HTML Toronto me...
WebVR: Developing for the Immersive Web
HTML, not just for desktops: Firefox OS - Congreso Universitario Móvil - 201...
HTML for the Mobile Web, Firefox OS - All Things Open - 2014-10-22
Firefox OS, une plateforme à découvrir - IO Saglac - 2014-09-09
Building AR and VR Experiences for Web Apps with JavaScript
Abandoned carts

Similar to Experimenting with HoloLens for E-Commerce (20)

PPTX
Hacking Reality: Browser-Based VR with HTML5
PPTX
Microsoft ignite tour - Create an immersive experience with office 365 data ...
PPTX
HTML5 WebWorks
PDF
Firefox OS: HTML5 sur les stéroïdes - HTML5mtl - 2014-04-22
PDF
The Future of Progressive Web Apps - Google for Indonesia
PDF
Firefox OS, HTML5 to the next level - Python Montreal - 2014-05-12
PDF
Augmenting Education
PDF
Augmenting Education (ISQ)
PDF
HTML pour le web mobile, Firefox OS - Devfest Nantes - 2014-11-07
PPT
Augmenting education
PDF
Pushing the Web: Interesting things to Know
PDF
Mozilla Web Apps - Super-VanJS
PDF
Firefox OS
PDF
mobl
PPTX
Build 2017 - B8108 - App engagement in Windows Timeline and Cortana with User...
PPTX
How We Built a Mobile Electronic Health Record App Using Xamarin, Angular, an...
PPTX
GDG GeorgeTown Devfest 2014 Presentation: Android Wear: A Developer's Perspec...
PDF
Go Mobile with Apache Cordova, Zagreb 2014
PDF
Pivorak.javascript.global domination
PDF
Andriy Vandakurov about "Frontend. Global domination"
Hacking Reality: Browser-Based VR with HTML5
Microsoft ignite tour - Create an immersive experience with office 365 data ...
HTML5 WebWorks
Firefox OS: HTML5 sur les stéroïdes - HTML5mtl - 2014-04-22
The Future of Progressive Web Apps - Google for Indonesia
Firefox OS, HTML5 to the next level - Python Montreal - 2014-05-12
Augmenting Education
Augmenting Education (ISQ)
HTML pour le web mobile, Firefox OS - Devfest Nantes - 2014-11-07
Augmenting education
Pushing the Web: Interesting things to Know
Mozilla Web Apps - Super-VanJS
Firefox OS
mobl
Build 2017 - B8108 - App engagement in Windows Timeline and Cortana with User...
How We Built a Mobile Electronic Health Record App Using Xamarin, Angular, an...
GDG GeorgeTown Devfest 2014 Presentation: Android Wear: A Developer's Perspec...
Go Mobile with Apache Cordova, Zagreb 2014
Pivorak.javascript.global domination
Andriy Vandakurov about "Frontend. Global domination"
Ad

More from Dirk Hoerig (20)

PDF
Lego-Bausteine des Online-Handels
PDF
It's the Experience, Stupid!
PDF
Alexa, Chatbots & Co: Getting ready for the Post-Web World with a Headless Ap...
PDF
Research Paper: The New Chiefs of Commerce in the Digital Enterprise
PDF
Wie Händler und Hersteller in der Post-Webshop-Ära zu Technologieunternehmen ...
PDF
Connected Channels - eCommerce Beyond Desktop with commercetools / Deutscher ...
PDF
Magnolia and commercetools, a powerful combination of content and commerce.
PDF
Warum Pureplay-E-Commerce in 5 Jahren tot ist
PPTX
How APIs Are Driving the New Commerce Landscape
PDF
Osudio + commercetools Webinar: Microservices - Flexibilität und Geschwindigk...
PDF
Storytelling mit Content Commerce
PDF
Boosting Product Categorization with Machine Learning
PPTX
Commerce technology of the past stifles marketing organizations of the future
PDF
Wer wagt - erreicht den Kunden von morgen!
PDF
How do you transform Europes largest bicycle cooperative into an online retai...
PPTX
The Future of Commerce Technology
PDF
Gefangen in der Innovationsspirale?
PDF
Micro-Service Architectures in E-Commerce environments with SPHERE.IO / comme...
PDF
How APIs are defining the future of retail - Shopping with Google Glass throu...
PDF
APIDays Berlin Edition 2014
Lego-Bausteine des Online-Handels
It's the Experience, Stupid!
Alexa, Chatbots & Co: Getting ready for the Post-Web World with a Headless Ap...
Research Paper: The New Chiefs of Commerce in the Digital Enterprise
Wie Händler und Hersteller in der Post-Webshop-Ära zu Technologieunternehmen ...
Connected Channels - eCommerce Beyond Desktop with commercetools / Deutscher ...
Magnolia and commercetools, a powerful combination of content and commerce.
Warum Pureplay-E-Commerce in 5 Jahren tot ist
How APIs Are Driving the New Commerce Landscape
Osudio + commercetools Webinar: Microservices - Flexibilität und Geschwindigk...
Storytelling mit Content Commerce
Boosting Product Categorization with Machine Learning
Commerce technology of the past stifles marketing organizations of the future
Wer wagt - erreicht den Kunden von morgen!
How do you transform Europes largest bicycle cooperative into an online retai...
The Future of Commerce Technology
Gefangen in der Innovationsspirale?
Micro-Service Architectures in E-Commerce environments with SPHERE.IO / comme...
How APIs are defining the future of retail - Shopping with Google Glass throu...
APIDays Berlin Edition 2014
Ad

Recently uploaded (20)

PDF
Course Overview and Agenda cloud security
PPTX
Reading as a good Form of Recreation
PPTX
t_and_OpenAI_Combined_two_pressentations
PPT
250152213-Excitation-SystemWERRT (1).ppt
PDF
simpleintnettestmetiaerl for the simple testint
PDF
Understand the Gitlab_presentation_task.pdf
PPTX
module 1-Part 1.pptxdddddddddddddddddddddddddddddddddddd
PDF
Exploring The Internet Of Things(IOT).ppt
PPTX
1402_iCSC_-_RESTful_Web_APIs_--_Josef_Hammer.pptx
PDF
Alethe Consulting Corporate Profile and Solution Aproach
PPT
FIRE PREVENTION AND CONTROL PLAN- LUS.FM.MQ.OM.UTM.PLN.00014.ppt
PPTX
Mathew Digital SEO Checklist Guidlines 2025
PDF
Alethe Consulting Corporate Profile and Solution Aproach
PDF
Containerization lab dddddddddddddddmanual.pdf
PPTX
Cyber Hygine IN organizations in MSME or
PPTX
newyork.pptxirantrafgshenepalchinachinane
PDF
Uptota Investor Deck - Where Africa Meets Blockchain
PDF
Top 8 Trusted Sources to Buy Verified Cash App Accounts.pdf
PPTX
Internet Safety for Seniors presentation
PPTX
curriculumandpedagogyinearlychildhoodcurriculum-171021103104 - Copy.pptx
Course Overview and Agenda cloud security
Reading as a good Form of Recreation
t_and_OpenAI_Combined_two_pressentations
250152213-Excitation-SystemWERRT (1).ppt
simpleintnettestmetiaerl for the simple testint
Understand the Gitlab_presentation_task.pdf
module 1-Part 1.pptxdddddddddddddddddddddddddddddddddddd
Exploring The Internet Of Things(IOT).ppt
1402_iCSC_-_RESTful_Web_APIs_--_Josef_Hammer.pptx
Alethe Consulting Corporate Profile and Solution Aproach
FIRE PREVENTION AND CONTROL PLAN- LUS.FM.MQ.OM.UTM.PLN.00014.ppt
Mathew Digital SEO Checklist Guidlines 2025
Alethe Consulting Corporate Profile and Solution Aproach
Containerization lab dddddddddddddddmanual.pdf
Cyber Hygine IN organizations in MSME or
newyork.pptxirantrafgshenepalchinachinane
Uptota Investor Deck - Where Africa Meets Blockchain
Top 8 Trusted Sources to Buy Verified Cash App Accounts.pdf
Internet Safety for Seniors presentation
curriculumandpedagogyinearlychildhoodcurriculum-171021103104 - Copy.pptx

Experimenting with HoloLens for E-Commerce