MSU LEETS 10 Augmented Reality Technologies

Editor's Notes

• #3: First off, what is Augmented Reality? Very simply, Augmented reality or AR (for short) is the use of hardware and software—usually combined in the form of a mobile device such as a tablet or smartphone equipped with a camera and a Wi-Fi connection. The concept is not unlike the augmented view a fighter pilot may have from a cockpit—a view that provides a view of both the horizon and all that’s contained in real life, as well as displayed data about the plane’s speed, angle, outside pressure and temperature, etc. Again, the view here being a combination of real life and computer generated information displayed together within the users filed of vision via a transparent display, screen—or mobile device. http://augreality.pbworks.com/w/page/9469034/Current%20Applications%20of%20AR
• #4: As we discuss augmented reality, many of you will recognize that AR was visualized in movies like terminator…..and…http://lemonsblack.com/the-terminators-vision/
• #5: And in television—sporting broadcasts will often overlay the screen with information to enhance the viewing experience…here’s NFL on NBC….http://treilanderror.blogspot.com/2012/07/11-design-principles-for-augmented.html
• #6: And here’s NASCAR on ESPN….now technically this isn’t augmented reality, but more like augmented televised sports…, however, if you had this content overlaid through a mobile device’s screen or camera while you were physically present at the football game or race, this would be considered ARhttp://www.theuksportsnetwork.com/datatainment-how-data-can-engage-sports-fans
• #7: For example, here a user holds up a mobile device of some sort to the surrounding skyline/landscape and is given additional data about the surrounding area through that window, making places, and the objects in and around those places become more 3 dimensional with increased information and awarenessIt is through our mobile devices that specific augmented reality software can be used to augment/enhance our surroundings, our functionality and perhaps how we live and workI’d like to share with you 10 different types of AR technologies or software that demonstrates a few ways augmented reality is being used now and perhaps in the near future
• #8: Now, depending on what you know about the technology or hope to learn, it may certainly seem like a cool—and fun technology. It may seem very science fiction—exciting to think about, yet not practical enough to make a priority for technology resources. But to put it in even more significant context, AR has recently been dubbed the 8th mass medium with users of augmented reality technologies currently numbering at 5 million, with an expected growth model showing there to be an expected number of user to be 1 billion by 2020—nearly double the number of newspaper circulation todayIt’s expected that within the next year, there will be 7 billion mobile devices—more than the number of people on the planet. In the past year, the Pew Internet & American Life project has found that smartphone use/ownership has just passed the 50% mark of total cellular phones, with more people now using a smart phone—a cell phone connected to the Internet, GPS services, social networking, email, and the many applications available----than a standard mobile phone with the primary function being making phone calls and/or sending text messages mobile technology expert TomiAhonenhttp://www.brightsideofnews.com/news/2012/4/11/tomi-ahonen-calls-out-augmented-reality-is-the-8th-mass-medium.aspx http://tedxtalks.ted.com/video/TEDxMongKok-Tomi-Ahonen-Augment1st mass media PRINT - from 1400s (books, pamphlets, newspapers, magazines, billboards)2nd mass media RECORDINGS - from 1890s (records, tapes, cartridges, videocassettes, CDs, DVDs)3rd mass media CINEMA - from 1900s4th mass media RADIO - from 1920s5th mass media TELEVISION - from 1940s6th mass media INTERNET - from 19927th mass media MOBILE - from 19988th mass media AUGMENTED REALITY - from 2010
• #9: The first augmented reality application that I’ll demonstrate is called “Spyglass” (switch to iPad view) This is one of the few apps with a price tag—at 3.99I chose to start with this app because it’s fairly simple and straight-forward, easy to grasp how the direcitonal information is overlaid onto reality as viewed through our tablet or other deviceSimple to use—we go to our iPad app, openThere are quite a few settings such as setting target distances, saving specific locations, adjusting magnitifcation, and various calulations…for the right user—specifically one that enjoys the outdoors, geocaching, orienteering, etc. having this app could be very helpful or even critical in a survival situation. For most, it’s just a fun application to play around with
• #10: These next few applications are great for finding and searching for objects, destinations, places based on your specific geographic locationOur next AR application or technology, is called Layar. Layar will allow users to overlay their reality with specific content provided through a multitude of “channels” from health related, to movies and entertainment, restaurants, social events, etc. Layar is credited with introducing AR technologies just a few years ago in 20105 minVideo--http://www.youtube.com/watch?v=HW9gU_4AUCA&feature=related
• #11: Now we go into a few AR technologies that are story-based as well as historically- oriented http://www.youtube.com/watch?v=vRYBu6gSMoU
• #12: Several of the examples we just discussed—Tagwhat, Robotvision,Wikitude, and Layar will all allow the user to choose content to display and augment their field of vision ---each with it’s own unique features, but similar in purpose and with a ton of potential…..The next application we’re going to discuss is call 110 stories and it’s purpose is quite specific and straightforward. It’s very limited by geography and it’s only offered with the iphone. However, it’s a very cool example of how augmented reality can be used for a specific and meaningful purpose. 110 stories was created by New Yorker….who was compelled to create an AR app that allowed residents and visitors alike to be able to view the outline of the Twin Towers in Manhattan, which upon being destroyed on September 11 2001, modified the skyscape and city’s appearance forever. When this app is used the outline of the Twin towers as shown will appear in the location of the original towers of manhattan. The app’s developer has not only created the augmented reality portion, but has developed a story telling component for users to share what the app means to them, what the Twin Towers represent, or even how they remember the events of 9/11.
• #13: Here are a few pictures from the 110 stories website of users that shared their augmented reality photos and some of their stories. Again, the 110 stories app is quite new and an android version is still being developed, but I show it as an example of the kind of things people will try to communicate with augmented reality software110 Stories App—App developers have created app that allows you to view the skyline as it would have looked if the twin towers in new york were still standing…..this app also encourages story telling, social interactions, based on why people are using the app and what it means to them to be able to view the NYC skyline this wayhttp://www.110stories.com/
• #14: Perhaps we would like to augment the night sky….the Starwalk app allows you to overlay the night sky with additional content—such as planetary orbits, constellations, names of stars, planets with links to more in-depth information by touching the specific objects for more information….this app allows you to choose between overlaying the content with the actual night sky or if you are in indoors, outside, or encounter other obstructions, you can view the content on its ownStar WalkSolar Walk
• #15: changing/altering the information 4.99 per language, for example French to English or English to Spanish Downloaded on my iPad is just the demo version which will allow you to erase words or reverse them to simulate the experience of changing the words from one language to anotherTo differentiate this type of AR app from some of the others we’ve discussed, I call these types adjusted reality instead of augmented. Still being augmented reality, these applications are designed to not simply overlay additional content onto your window of reality, but modify, change, or adjust something in the real world to make it better5 minhttp://questvisual.com/
• #16: Demo Word lens to show reverse and erase demosThe real versions of this app are 4.99 each…sorta steep in the Appstore world, but if planning travels to a foreign country, the technology could be incredibly helpful
• #17: In this screen shot you can see the Google Goggles uses the scanned image to search Google. Goggles is sophisticated enough to be able to search for both images and text that you scan with the application. Above you can see the search results from the scan of a candy bar from a gas station.
• #18: So, in a similar vain to Google Goggles, this app, Leafsnap, allows users to capture photos of…you guess it….leaves…specifically tree leaves and will then take the photo use it to search against it’s database of plant materials to help user identify the leaf—along with providing additional identifying characteristics—such as geographic and seasonal range, images of flowers and seeds from the tree, etc. So, in my efforts to put this app to the test, I went out into my backyard and wooded areas adjacent to the yard to find leaves to identify. And, once I gathered my leaf samples, I sought to use Leafsnap to help me identify my leaves. Again, using my iPad as my device, I opened my application and took pictures of my leaves. Most of my collection could be identified, some I was unsuccessful with. To demonstrate, I’ve brought along a leaf that we will identify together using Leafsnap. Pull out leaf…..The lesson from using this app is that through image recognition, augmented reality can take the form of database retrieved information
• #19: Now, our next several AR apps will showcase inserting and using 3-d models in and along side reality….so, we will start by showing an example of how AR may be used with a practical end result in mind….then we will use a few other apps to investigate how this sort of AR use can be made possible….this 15 second video shows an app developed by MITK Pille to provide medical providers anatomical models that can be overlaid onto real world healthcare situationsPlay video—15 seconds to show this app in action to demonstrate how AR applications can be used to impose 3-D objects onto reality http://youtu.be/T4mboj-GbEA?t=15s
• #20: Now, out first 3-d AR modeling experiment will be with String….On the screen here is a trigger image—one of several free to download and printOn my iPad, I’ve also downloaded the String AR app, which I will open now on my iPadWith the String App open—I place my device in front of the trigger image….and I am given additional content—an animated 3-d cartton---an augmented version of the printed imageGo to Demo on iPad3
• #21: Here’s another image….And I’ve also printed these images out and can set them side by side to view them both at the same timeAgain, this is sort of a fun application—think more about the potential here---attaching dynamic, rich content that is triggered by the user to augment their experience—their reality through the window of their tablet or smartphone
• #22: Our next technology is called AurasmaI’ve downloaded the Aurasma app on my iPad and we will use the Aurasma app to create our own augmented reality experience—(open the Aurasma app)Just for a demonstration, I use this slide to create an aura—content that will be displayed through my mobile device when viewing this image….so I will hold up my device with my Aurasma app open and view this slide…..and we are given an animation—this is a stock animation within the app—but we could use our own photos or videos in its placeFirst, the Aurasma app will allow you to set up and create Auras, which we will do—users can also check out other users’ auras and super-aurasSo, I’ve opened the Aurasma app…I will need to be connected to Wi-Fi to use the app—both viewing and creating aurasFirst step to create an aura—tell the app that we would like to create a new aura---we will then adjust the frame onto our chosen target object or image…we will be looking at the colored bar to ensure it turns green, telling us we’ve selected a good image to use. Also wanted to point out the slider on the right hand lower corner—which will allow us to label an aura as location specific—such as if we were taking a picture of a building (like this picture)—the object that we’ve taken a picture of will be labeled with gps data and will only display the aura in that particular location. But, we will keep this on ordinary, since we’re using an object that can be viewed anywhereSo, with ordinary selected, once my bar turns green we can snap the picture by hitting the camera icon…Once we have the image taken, now we want to choose the aura content that will be shown when a user views our target---aurasma gives you some content to choose from—3-d animation and imagery or you can select images from your device—photos or video or upload content from Blinkx—a video hosting site similar to YoutubeProvide additional rich content to print media with AR Printed—newspapers, text books, paintings, etc.
• #23: Now, devices are being developed to enhance this technology further—with wearable display…so in addition to tablets and smartphones being our mechanism for viewing augmented content, devices such as these will start to pop up….and just to demonstrate some examples, I’ll use the Google Glasses promo video…..Google Project Glass video
• #24: Earpiece, boom connect wirelessly to sensors using ANT+ standard—measure heartbeat, rate of bicycle—sensors can deliver information to the user audibly or visuallly by LED
• #25: This short video will show AR being integrated into a wearable display for firefighters
• #26: AR will also likely move beyond smartphones and tablets, but as the technology matures, becomes more understood, and gains larger audiences, will show up in places all over, won’t require user to have a device, or wearbable display…and the technology will become more integrated into daily lives
• #27: So, we’ve discussed 10 AR technologies..(read)…
• #28: Horizon report 2012Mobile ComputingSmartphones & TabletsGame-Based LearningGesture Based computing
• #30: Reminder about sign-in sheet, evaluation forms