The Vision of Computer Vision: The bold promise of teaching computers to understand the visual world - Tim Huckaby
1 like926 views
The document discusses the ITCamp17 conference presented by Tim Huckaby, focusing on advancements in computer vision and Microsoft's Cognitive Services. It outlines the importance of machine learning and computer vision technologies, showcasing various APIs and applications for enhancing user experiences through intelligent kiosks and analytics. Additionally, it highlights the contributions of Huckaby and his companies, Interknowlogy and Vsblty, in the field of AI and software innovation.
![Computer Vision API
Content of Image:
Categories v0: [{ “name”: “animal”, “score”: 0.9765625 }]
V1: [{ "name": "grass", "confidence": 0.9999992847442627 },
{ "name": "outdoor", "confidence": 0.9999072551727295 },
{ "name": "cow", "confidence": 0.99954754114151 },
{ "name": "field", "confidence": 0.9976195693016052 },
{ "name": "brown", "confidence": 0.988935649394989 },
{ "name": "animal", "confidence": 0.97904372215271 },
{ "name": "standing", "confidence": 0.9632768630981445 },
{ "name": "mammal", "confidence": 0.9366017580032349,
"hint": "animal" },
{ "name": "wire", "confidence": 0.8946959376335144 },
{ "name": "green", "confidence": 0.8844101428985596 },
{ "name": "pasture", "confidence": 0.8332059383392334 },
{ "name": "bovine", "confidence": 0.5618471503257751,
"hint": "animal" },
{ "name": "grassy", "confidence": 0.48627158999443054 },
{ "name": "lush", "confidence": 0.1874018907546997 },
{ "name": "staring", "confidence": 0.165890634059906 }]
Describe
0.975 "a brown cow standing on top of a lush green field“
0.974 “a cow standing on top of a lush green field”
0.965 “a large brown cow standing on top of a lush green field”](https://image.slidesharecdn.com/itcamp2017-timhuckaby-thevisionofcomputervisiontheboldpromiseofteachingcomputerstounderstandthevisua-170614175331/85/The-Vision-of-Computer-Vision-The-bold-promise-of-teaching-computers-to-understand-the-visual-world-Tim-Huckaby-24-320.jpg)
The Vision of Computer Vision: The bold promise of teaching computers to understand the visual world - Tim Huckaby
- 1. @ITCAMPRO #ITCAMP17Community Conference for IT Professionals The Vision of Computer Vision: The bold promise of teaching computers to understand the visual world Tim Huckaby InterKnowlogy, Founder / Chairman VSBLTY Founder / CTO Microsoft Worldwide RD Microsoft MVP, Artificial Intelligence A lap around the Microsoft Cognitive Services Vision API
- 2. @ITCAMPRO #ITCAMP17Community Conference for IT Professionals Many thanks to our sponsors & partners! GOLD SILVER PARTNERS PLATINUM POWERED BY
- 3. User Interface Innovation: What’s on the Horizon?Delivering the Art of Software A Little Bit About Me and Why We I am Here…
- 4. https://binged.it/2qpYCvF A THINK TANK OF MAKERS WHO CREATE FOR ALL DIGITAL SURFACES
- 5. Who we work for...that we are allowed to talk about...
- 6. Delivering the Art of Software interknowlogy.com 1525 Faraday Ave, Suite 250, Carlsbad CA 92008 curious@interknowlogy.com
- 7. User Interface Innovation: What’s on the Horizon?Delivering the Art of Software Computer Vision in Cognitive Services, Machine Learning and Artificial Intelligence With Computer Vision, comes responsibility… Objectives And Agenda Using Machine Learning without being an expert Where We have Been in Compuer Vision and Where We are Going How to get started Demos, Demos, Demos...
- 8. Bing Image API Face API Emotion API Computer Vision API Custom Vision Cognitive Toolkit U-SQL Gesture Reco Video Indexer Content Moderator
- 9. Microsoft Cognitive Services Give your apps a human side
- 10. Microsoft Cognitive Services Give your apps a human side
- 11. Microsoft Cognitive Services Give your apps a human side
- 12. Roll your own with REST APIs Simple to add: just a few lines of code required Make the same API code call on iOS, Android, and Windows Integrate into the language and platform of your choice Bring your own data for your custom experience Built by experts in their field from Microsoft Research, Bing, and Azure Machine Learning Quality documentation, sample code, and community support Easy Flexible Tested Why Microsoft Cognitive Services ?
- 13. Why? The Seeing AI App Computer Vision, Image, Speech Recognition, NLP, and ML from Microsoft Cognitive Services Watch Video HereRead Blog Here
- 14. Bing Image API Face API Emotion API Computer Vision API Custom Vision Cognitive Toolkit U-SQL Gesture Reco Video Indexer Content Moderator
- 15. Bing Image API Face API Emotion API Computer Vision API Custom Vision Cognitive Toolkit U-SQL Gesture Reco Video Indexer Content Moderator
- 16. Bing Image API Face API Emotion API Computer Vision API Custom Vision Cognitive Toolkit U-SQL Gesture Reco Video Indexer Content Moderator
- 17. Face API Tim Huckaby • InterKnowlogy, Chairman/Founder • VSBLTY, CTO • Microsoft Worldwide RD • Microsoft MVP, AI
- 18. Bing Image API Face API Emotion API Computer Vision API Custom Vision Cognitive Toolkit U-SQL Gesture Reco Video Indexer Content Moderator
- 19. Tim Huckaby • InterKnowlogy, Chairman/Founder • VSBLTY, CTO • Microsoft Worldwide RD • Microsoft MVP, AI
- 20. VisionCaptor™ VisionCaptor™ marries high impact, engaging motion graphics and interactive brand messaging on glass display at point-of- sale in retail environments including supermarkets and c-store. VSBLTY’s “first of its kind”, built-in facial recognition and data capture technology delivers real time demographic analytics, emotion detection, and other important KPI’s. Applications range from informational display to dynamic video and advertising to dynamic way finding. DataCaptor™ DataCaptor™ soley uses the optics and analytics technology and can be embedded into an end cap display in retail, traditional out of home applications, and existing POS screens to capture analytics and provide campaign measurement.
- 21. The engine behind the VSBLTY: “GoldenTrout” Tim Huckaby • InterKnowlogy, Chairman/Founder • VSBLTY, CTO • Microsoft Worldwide RD • Microsoft MVP, AI
- 22. Intelligent Kiosk: Real Time Crowd Insights Tim Huckaby • InterKnowlogy, Chairman/Founder • VSBLTY, CTO • Microsoft Worldwide RD • Microsoft MVP, AI
- 23. Bing Image API Face API Emotion API Computer Vision API Custom Vision Cognitive Toolkit U-SQL Gesture Reco Video Indexer Content Moderator
- 24. Computer Vision API Content of Image: Categories v0: [{ “name”: “animal”, “score”: 0.9765625 }] V1: [{ "name": "grass", "confidence": 0.9999992847442627 }, { "name": "outdoor", "confidence": 0.9999072551727295 }, { "name": "cow", "confidence": 0.99954754114151 }, { "name": "field", "confidence": 0.9976195693016052 }, { "name": "brown", "confidence": 0.988935649394989 }, { "name": "animal", "confidence": 0.97904372215271 }, { "name": "standing", "confidence": 0.9632768630981445 }, { "name": "mammal", "confidence": 0.9366017580032349, "hint": "animal" }, { "name": "wire", "confidence": 0.8946959376335144 }, { "name": "green", "confidence": 0.8844101428985596 }, { "name": "pasture", "confidence": 0.8332059383392334 }, { "name": "bovine", "confidence": 0.5618471503257751, "hint": "animal" }, { "name": "grassy", "confidence": 0.48627158999443054 }, { "name": "lush", "confidence": 0.1874018907546997 }, { "name": "staring", "confidence": 0.165890634059906 }] Describe 0.975 "a brown cow standing on top of a lush green field“ 0.974 “a cow standing on top of a lush green field” 0.965 “a large brown cow standing on top of a lush green field”
- 25. Intelligent Kiosk – Vision API Explorer Tim Huckaby • InterKnowlogy, Chairman/Founder • VSBLTY, CTO • Microsoft Worldwide RD • Microsoft MVP, AI
- 26. Bing Image API Face API Emotion API Computer Vision API Custom Vision Cognitive Toolkit U-SQL Gesture Reco Video Indexer Content Moderator
- 27. U-SQL Tim Huckaby • InterKnowlogy, Chairman/Founder • VSBLTY, CTO • Microsoft Worldwide RD • Microsoft MVP, AI
- 28. Bing Image API Face API Emotion API Computer Vision API Custom Vision Cognitive Toolkit U-SQL Gesture Reco Video Indexer Content Moderator
- 29. Custom Vision Portal (IRIS) Tim Huckaby • InterKnowlogy, Chairman/Founder • VSBLTY, CTO • Microsoft Worldwide RD • Microsoft MVP, AI
- 30. Object Recognition: “RoosterFish” Tim Huckaby • InterKnowlogy, Chairman/Founder • VSBLTY, CTO • Microsoft Worldwide RD • Microsoft MVP, AI
- 31. Bing Image API Face API Emotion API Computer Vision API Custom Vision Cognitive Toolkit U-SQL Gesture Reco Video Indexer Content Moderator
- 33. Bing Image API Face API Emotion API Computer Vision API Custom Vision Cognitive Toolkit U-SQL Gesture Reco Video Indexer Content Moderator
- 35. Video Indexer: vi.microsoft.com Tim Huckaby • InterKnowlogy, Chairman/Founder • VSBLTY, CTO • Microsoft Worldwide RD • Microsoft MVP, AI
- 36. Samples and Documentation: https://azure.microsoft.com/en-us/services/cognitive-services/ How to Sign Up: https://azure.microsoft.com/en-us/try/cognitive-services/ SDK: https://github.com/Microsoft/ProjectOxford-ClientSDK Samples in Github: https://github.com/search?o=desc&p=1&q=org%3AMicrosoft+cognitive&s=updated&type =Repositories (from Github search on: org:Microsoft cognitive)
- 37. The Engaging User Experience & the Natural User InterfaceDelivering the Art of Software More info on InterKnowlogy: ◦www.InterKnowlogy.com ◦http://ikeurope.com/ ◦www.vimeo.com/InterKnowlogy More info on VSBLTY: ◦www.VSBLTY.net About Tim Huckaby… • Founder/Chairman, InterKnowlogy, Actus Software, VSBLTY • Microsoft® Global Regional Director • Microsoft® AppDev Partner Advisory Council Founder / Member • Microsoft® MVP – Emerging Experiences • Accomplished Author & Speaker • Board Member: Facial Networks, Crespi Carmelite, San Diego Fly Fishers www.TimHuckaby.com Contact Tim: E-mail: TimHuck@InterKnowlogy.com THuckaby@VSBLTY.net Phone: Office: 760-683-9650 Mobile:: 619 990 9200 Blog: http://team.interknowlogy.com/blogs/timhuckaby FaceBook: http://www.facebook.com/Tim.Huckaby.Carlsbad LinkedIn: http://www.linkedin.com/in/timhuckaby Twitter: @TimHuckaby Tim Huckaby