User Experience Beyond the Screen
- 1. OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
- 2. OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN AI, VR, AR, MR… The digital industry is obsessed with experiences, predictions, and also fear.
- 3. OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN We are NOT sure of what’s coming But there’s lots of new start-ups, devices & apps
- 4. OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN That fear reminds me of Dolly It seemed sci-fi, we really didn’t know what to think This was just a sheep, but she was in human territory
- 5. OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN So this is not about VR, AR or anything like that It’s about change How it brings such uncertainty that some tend to celebrate, others fear, others ignore
- 6. OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN Technology is not neutral Change is at our doorstep Artificial Intelligence is not one thing Artificial Intelligence is not the best name yet Can we build a human-like computer? Machines find the nuggets of info that humans can’t Machines are one-trick ponies And most designers are already in the loop How can we tell? A deep insight is still something very human
- 7. Technology is not neutral It can profoundly change the way we live OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
- 8. Predictions tend to extremes: when the electric bulb came, some people said that is was a golden new era without crime and more reading, others said it there would be more work exploitation, since factories would labor day and night.
- 9. Change is at our doorstep And it’s not just about carrying powerful devices in our pockets That was yesterday’s news OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
- 10. Artificial Intelligence is now out of the incubator and into our living rooms. Roomba, a now common vacuuming robot knows when to work, calls for help only when it’s stuck and returns to the base when it’s done.
- 11. Artificial Intelligence is not one thing It comprises machine and deep learning, image and speech recognition, natural language processing, predictive analytics… More than that, companies cook a mix of these tools to solve a specific problem at hand OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
- 12. Artificial Intelligence is not the best name yet It is a spooky term, and it reminds us of Terminator The term suggests that machines can think, something inherently human OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN Oscar Schwartz: Can a computer write poetry? TED Talk | ted.com
- 13. Can we build a human-like computer? We should not be asking if we can build it, but “what kind of human do we want reflected to us?” Oscar Schwartz: Can a computer write poetry? TED Talk | ted.com OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
- 14. Machines find the nuggets of info that humans can’t They recognize patterns in data, and then predict similar patterns in new data This is called machine learning OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
- 15. Netflix studied 25 shows in 16 countries to understand after which episodes viewers were more likely to be hooked. They disclosed a list of those episodes, but not their findings on what makes a “hook episode”.
- 16. Machines are one-trick ponies They are doing tasks once reserved for humans, but they’re essentially doing the things we build them to do. OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
- 17. And most designers are already in the loop You most likely have already designed for products with some form of artificial intelligence (navigational apps or context-intelligent chatbots for instance) OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
- 18. How can we tell? “We, designers, have been creating user flowcharts, if-this-then-that scripts, and templates for dynamic information to populate. We design ways for users to indicate explicitly if they like or dislike something and ways for the computer to understand implicitly what users are interested in.” Elaine Lee: You Can Be an AI Designer Medium Post | uxdesign.cc OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
- 19. AI has been revealed as the secret sauce to many brands: Amazon, Spotify & Netflix recommendations; Facebook’s image recognition; voice assistants like Siri, or Google Home, keeping waiting times short in Uber and more.
- 20. And one of these days, maybe Alexa gets off the script.
- 21. A deep insight is still something very human We’re sometimes bad at predictions, like with the electric light, but we’re good in bringing a different view, context and meaning into our customer’s challenges And then empathy OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
- 22. OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN Where is the new interface? How did we get here? People seek experiences, not technology The process shifts intrinsically One thing is the environment, another is the interface The environment facilitates a personal experience The interface must find a balance between the old and the new
- 23. Where is the new interface? The needs of our users is moving target VR and AR and MR are bringing massive shifts to human-computer interactions OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
- 24. A week after the release Pokémon Go, around 65 million people were playing it. This is a strong statement about how humans are interacting with machines.
- 25. How did we get here? Usability: reducing friction between the user and the technology UX: designing for users and trying to inspire a sense of delight Experience Design: “tipping over to the experience side of UX” Chad Calease: VR, AR and MR - Designing the New Reality Experience InVision Blog | invisionapp.com OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
- 26. Getting the UX right is not going to be enough. New platforms are not being used in the traditional sense anymore. Fitbit’s SmartTrack recognizes and records our exercises for us without ever having to push a button.
- 27. People seek experiences, not technology Designers must shift focus this way But what is the skillset for that? OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
- 28. Designers need a sixth sense into human sensibilities. Not just being able to listen to what people want, need and fear, but being able to communicate with them.
- 29. Empathy plays a big part. Those gifted with it and with social insight will be one step ahead.
- 30. The process shifts intrinsically As the experience unfolds, the user decides if he stays or goes But immersive formats are slower, users need to adjust OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
- 31. Designers must find a set of new best practices, set around new ways to interact with technology. Ideally, users step into these worlds so naturally as a toddler using an iPad.
- 32. One thing is the environment, another is the interface The environment is making our body to enter the app The interface is 100% relevant to the user’s spatial relationship to the environment OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
- 33. The environment facilitates a personal experience Immersive experiences are non-linear and non-narrative The creator has to give up the control OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
- 34. The interface must find the balance between the old and the new Print design is more relevant again Organize the screen according to the targets Mockups are still a must have Feedback is everything Reuse patterns from other platforms, so that the interface balances the weirdness of the environment OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
- 35. OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN Robots cannot replace humans, not completely Data will allow designers to do better research Tools will allow designers to do better work The right formula merges AI with UX But there are big challenges ahead The designer’s answer is still the same Wrapping up
- 36. Robots cannot replace humans, not completely From designers, AI can expect the anticipation of the weirdness and ambiguity that can arise from the systems From AI, designers can expect new tools and fruitful collaboration OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
- 37. Meet TheGrid.io, a design platform based on an algorithm. It is built around the concept of continuous A/B testing.
- 38. Data will allow designers to do better research Predictive analysis will help them understand users and mapped them according to their behavior Data will be the foundation for personas, journey mapping and other research activities OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
- 39. Tools will allow designers to do better work Repetitive and lower-value creative tasks will be handled by the tools Fresh options will be served, and the designer will make the decisions Critical or strategic decisions are still human territory OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
- 40. Netflix generates layouts through an algorithm. Designers map out the visual guidelines and provide the raw graphic elements, the system is then capable of combining the 2.
- 41. The right formula merges AI with UX Designers need to supply the system with additional info like business rules or questions and this will change the way it analyses data Merging AI with UX can result in infusing intelligence to both processes Machines can be our new apprentices OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
- 42. But there are big challenges ahead What to do with so much data? How to address user frustration in interaction? How to design for experiences that far from being seamless? How to prevent biases coming from the machines? OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
- 43. The designer’s answer is still the same “UX research at an unprecedented scale” Sheena Lyonnais: The Rise of Artificial Intelligence Adobe Blog | adobe.com OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
- 44. Wrapping Up 1 We always wanted to design technology as an extension of human capabilities: get things done and be as transparent as possible in the process We were never this close to achieving it OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
- 45. Wrapping Up 2 We know for a while that computing is a changing and ubiquitous concept, and that we would soon be beyond desktop; and would take place without keyboards, mice or monitors We were never so far beyond OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
- 46. Wrapping Up 3 We start to notice that embodied interaction involves our body with technology in a way that traditional screens don’t, putting the action in the real world We were never so physical about it OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
- 47. Wrapping Up 4 We always wanted to be free from the repetitive work, and have more time to research and to create We were never this free to do it OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
- 48. Wrapping Up 5 We suck at predictions, we will be fine OUTSIDE THE SCREEN AND THEN BEYONDTHE SCREEN IS BROKEN SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
- 49. CALL JANE Remember? This was the road to high school The house of your best friend Jane
- 50. Remember? This was the road to high school The house of your best friend Jane CALL JANE And what about your endless conversations about Dolly, the sheep? GOOGLE “DOLLY THE SHEEP”
- 51. thank you SÍLVIA OTTO SEQUEIRA | UX BEYOND THE SCREEN
- 52. find me on LinkedIn and Medium find these slides on SlideShare SÍLVIA OTTO SEQUEIRA UX BEYOND THE SCREEN