Enriching your app with Image recognition and AWS AI services Hebrew Webinar
1 like246 views
The document discusses Amazon Web Services' (AWS) capabilities in image recognition and machine learning, highlighting tools like Amazon Rekognition and Amazon SageMaker. It covers the history, technology, and various applications of image recognition, including facial analysis and scene detection. Additionally, it presents use cases and demos that illustrate how Amazon's AI services can be integrated into applications for enhanced functionality.
![© 2019, Amazon Web Services, Inc. or its Affiliates.
@ziniman
Serverless Website – reko.ziniman.com
JavaScript
SDK
[
{"photo_id": "IMG_2018920-213126787.jpg”},
{"photo_id": "IMG_2018920-213320377.jpg"}
]
Static Site
Bucket
Images Bucket
Amazon
DynamoDB
Amazon
CloudFront
Lambda
Function
Amazon
RekognitionAmazon API
Gateway](https://image.slidesharecdn.com/enrichingyourappwithimagerecognitionandawsaiservices-190716145730/85/Enriching-your-app-with-Image-recognition-and-AWS-AI-services-Hebrew-Webinar-35-320.jpg)
Enriching your app with Image recognition and AWS AI services Hebrew Webinar
- 1. © 2019, Amazon Web Services, Inc. or its Affiliates. Enriching your App with Image Recognition and AWS AI Services Boaz Ziniman, Technical Evangelist Amazon Web Services @ziniman ziniman
- 2. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman • The History of Image Recognition • Introduction to the AWS AI Services • Amazon Rekognition and the different APIs • Use Cases • Demos Agenda
- 3. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman • Classification, Detection, segmentation • Face Detection • Face Verification • Face Recognition • Text Detection Image Processing
- 4. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman Convolutional Neural Networks (CNN) Le Cun, 1998: handwritten digit recognition, 32x32 pixels https://devblogs.nvidia.com/parallelforall/deep-learning-nutshell-core-concepts/
- 5. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman Our deep experience with AI/ML differentiates our approach Product recommendation engine Robot-enabled fulfillment centers New product categories Amazon has invested in AI/ML since our inception, and we share our knowledge and capabilities with our customers 20181995 Natural language processing-supported contact centers ML-driven supply chain and capacity planning Checkout-free shopping using deep learning
- 6. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman Our mission at AWS Put machine learning in the hands of every developer
- 7. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman M L F R A M E W O R K S & I N F R A S T R U C T U R E A I S E R V I C E S R E K O G N I T I O N I M A G E P O L L Y T R A N S C R I B E T R A N S L A T E C O M P R E H E N D & C O M P R E H E N D M E D I C A L L E XR E K O G N I T I O N V I D E O Vision Speech Chatbots A M A Z O N S A G E M A K E R B U I L D T R A I N F O R E C A S TT E X T R A C T P E R S O N A L I Z E D E P L O Y Pre-built algorithms & notebooks Data labeling (G R O U N D T R U T H ) One-click model training & tuning Optimization (N E O ) One-click deployment & hosting M L S E R V I C E S F r a m e w o r k s I n t e r f a c e s I n f r a s t r u c t u r e E C 2 P 3 & P 3 d n E C 2 C 5 F P G A s G R E E N G R A S S E L A S T I C I N F E R E N C E Reinforcement learningAlgorithms & models ( A W S M A R K E T P L A C E F O R M A C H I N E L E A R N I N G ) Language Forecasting Recommendations The Amazon ML stack: Broadest & deepest set of capabilities
- 8. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman Amazon SageMaker Machine learning for every developer and data scientist.
- 9. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman Amazon SageMaker: Build, train, and deploy ML 1 2 3 1 2 3
- 10. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman A I S E R V I C E S R E K O G N I T I O N I M A G E P O L L Y T R A N S C R I B E T R A N S L A T E C O M P R E H E N D & C O M P R E H E N D M E D I C A L L E XR E K O G N I T I O N V I D E O Vision Speech Chatbots F O R E C A S TT E X T R A C T P E R S O N A L I Z E Language Forecasting Recommendations Put AI to work for your business
- 11. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman Amazon Rekognition Easily add intelligent image and video analysis to your applications.
- 12. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman Amazon Rekognition: Deep Learning-Based Image and Video Analysis
- 13. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman Amazon Rekognition Benefits Low cost Your data is your ownServerless Rapid integration State of the art capabilities Continuous improvement
- 14. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman Amazon Rekognition Image Object and scene detection Facial analysis Face recognition Text in image Unsafe image detection Celebrity recognition Face comparison
- 15. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman Object & Scene Detection
- 16. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman Smiling? Facial Analysis
- 17. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman Crowd Detection – up to 100 faces
- 18. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman Facial Search
- 19. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman Explicit Nudity Nudity Graphic Male Nudity Graphic Female Nudity Sexual Activity Partial Nudity Suggestive Female Swimwear or Underwear Male Swimwear or Underwear Revealing Clothes Image Moderation
- 20. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman Celebrity Recognition
- 21. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman Text in Image
- 22. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman DEMO https://github.com/ziniman/aws-rekognition-demo
- 23. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman Amazon Rekognition Video Deep Learning-based video analysis service
- 24. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman Video Analysis
- 25. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman
- 26. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman Scaling video indexing C-SPAN uses Amazon Rekognition to automatically index video news footage for search. With Rekognition, C-SPAN reduced indexing time per video from 1 hour to 20 minutes and uploaded 97,000 images in under 2 hours.
- 27. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman Real-time identity verification Aella Credit uses Amazon Rekognition to analyze images to verify an individual’s identity in real-time without human intervention, allowing it to provide instant loans to eligible customers through its mobile app.
- 28. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman boazz: ~/ aws rekognition detect-labels --image '{"S3Object":{"Bucket":"demos.ziniman.com","Name":"photos/reko.jpg"}}’ { "Labels": [ { "Confidence": 99.14048767089844, "Name": "Human" }, { "Confidence": 99.1404800415039, "Name": "People" }, { "Confidence": 99.14048767089844, "Name": "Person" }…… Rekognition API Example
- 29. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman boazz: ~/ aws rekognition detect-faces --image '{"S3Object":{"Bucket":"demos.ziniman.com","Name":"photos/reko.jpg"}}' --attributes "ALL” { "FaceDetails": [ { .... "Gender": { "Confidence": 99.9211654663086, "Value": "Male" }, "AgeRange": { "High": 52, "Low": 35 }, .... Rekognition API Example
- 30. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman Rekognition Lambda Python Example
- 31. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman Demo – https://reko.ziniman.com https://github.com/ziniman/aws-serverless-website-photo-tagging
- 32. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman Serverless Website – reko.ziniman.com Amazon Cognito JavaScript SDK https://reko.ziniman.com • Write images into Images Bucket • Read list of images • Read data from DynamoDB Static Site Bucket Images Bucket Lambda Function Role Amazon DynamoDB Amazon CloudFront Amazon Rekognition
- 33. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman Serverless Website – reko.ziniman.com JavaScript SDK • Read image from Images Bucket • Execute Rekognition detect_moderation_labels() • Execute Rekognition detect_labels() • Write data to DynamoDB• Write images into Images Bucket • Read list of images • Read data from DynamoDB Amazon Cognito Static Site Bucket Images Bucket Lambda Function Amazon DynamoDB Amazon CloudFront Amazon Rekognition Role Role Lambda Function Amazon API Gateway
- 34. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman Serverless Website – reko.ziniman.com JavaScript SDK Static Site Bucket Images Bucket Amazon DynamoDB Amazon CloudFront Lambda Function Amazon RekognitionAmazon API Gateway
- 35. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman Serverless Website – reko.ziniman.com JavaScript SDK [ {"photo_id": "IMG_2018920-213126787.jpg”}, {"photo_id": "IMG_2018920-213320377.jpg"} ] Static Site Bucket Images Bucket Amazon DynamoDB Amazon CloudFront Lambda Function Amazon RekognitionAmazon API Gateway
- 36. © 2019, Amazon Web Services, Inc. or its Affiliates. @ziniman • https://aws.amazon.com/rekognition/ • https://aws.amazon.com/blogs/machine-learning/ • https://aws.amazon.com/blogs/machine-learning/classify-your-own- images-using-amazon-sagemaker/ • https://github.com/ziniman/aws-rekognition-demo • https://github.com/ziniman/aws-serverless-website-photo-tagging Where to Start?
- 37. © 2019, Amazon Web Services, Inc. or its Affiliates. Thank You! Boaz Ziniman, Technical Evangelist Amazon Web Services @ziniman ziniman