Understanding GenAI/LLM and What is Google Offering - Felix Goh
- 1. Understanding LLM/GenAI Google Portfolio of AI Services Felix Goh Strategic Lead, Singapore Education, Research and EdTech Global Public Sector, Google Cloud M: +65 90117062 | E: fgoh@google.com
- 2. Introductions Born and breed in Singapore, gone through the Singapore education system & military system. Started my career as an IT Trainer teaching Pri - Sec school students. Focused on the education sector for over 17 years holding technical, consultant, program and sales roles.
- 3. The AI Revolution & How it’s impacted Industries Exploring Google Portfolio of Services What’s Next and how do I get started? Contents
- 4. Organize the world’s information and make it universally accessible and useful
- 5. 1969 Information Technology 1870 Electricity 1784 Steam Power Today We’re in an AI driven revolution Source: AI: Recent Trends and Applications, Emerging Communication and Computing
- 6. Confidential + Proprietary First, some vocab Generative Model: An ML model that produces content, including language, code, imagery, music, video, etc. Large Language Model: machine learning models that are really good at understanding and generating human language. Large refers to both size and complexity of the neural network itself, as well as the size of the dataset it was trained on. Can also be used for non-generative language tasks (eg classification) Transformer: The neural network architecture underlying most of today’s generative models (and, more widely, most SOTA ML models). Published by Google in 2017.
- 7. What is Generative AI? AI Artificial Intelligence Ability for machines to mimic human intelligence ML Machine Learning Making predictions using data NLP Natural Language Processing Machine learning with text data as input DL Deep Learning Based on deep neural network LLM Large Language Models NLP neural networks based on 1b+ model parameters GLM Universal/Foundation Models General purpose language models, text generation models capable of solving many use cases
- 8. The Path to Generative Language Models Traditional Programming Is this a cat? This is a cat. This is not a cat. Yes. Wave of Neural Networks (~2012) Go read this huge pile of books. So, you’ve learned about cats and a ton of other concepts. What’s a cat? A cat is… Generative Language Models
- 9. Google pioneered AI advances for a decade… Responsible AI at the foundation
- 11. Making AI more helpful for everyone
- 12. Proprietary + Confidential A paradigm shift across industries powered by Generative AI Internal - The Impact of Generative AI in the Enterprise Technology Media & Telecom Consumer & Retail Life Sciences & Healthcare Banking & Fin. Services Industrial & Manufacturing Government & Public Sector Personalized AR/VR Experience Generation Interactive Streaming & User Engagement Conversational eCommerce & Retail AR/VR Content Generation for Digital Therapy Fraud Simulation & Pattern Detection Generative AR/VR Product design Academic 24/7 Office Hours Virtual Assistant Personalized & Automated UI/UX Design Trailer Generation & Feedback Curation Customized Product Design & Recommendation Predictive & Virtual Patient Triage Tax and Compliance Audit & Scenario Testing Generative Simulation & Safety Testing Infrastructure Mapping & Planning Synthetic Outage / Threat Simulation for Testing Script/Score Design & Subtitle Generation Product Details & Photography Generation Protein Sequence Modeling for Drug Discovery Personalized Virtual Financial Advisor Text-to-Simulatio n Product Design & Development Predictive Policing & Emergency Response Autonomous Code Generation & Completions Personalized News & Content Generation Digital Shopping Assistant & Exp. Management Genomic Analysis for Personalized Therapy Plans End-to-end Automated Claims Processing Automated Technical Equipment Training Personalized Academic Planning & Testing Automated Debugging & Issue Resolution Personalized Wired/Wireless Phone Plans Personal Travel & Logistics Assistant Diagnostic Decision Support & Report Generation Financial Reporting Analysis & Insight Generation Generative Automation for Smart Factories NLP-based Administrative Processing Generative Product / Offering Design Self-serve HR & IT functions End-to-end Automated Customer Service Accessibility Support (text-to-speech & speech-to-text) Social Media Marketing Campaign Generation Enterprise Search & Knowledge Management Text Summarization & Image Generation Marketing / Sales Content Generation Customer Feedback Sentiment Classification Market Research Acceleration Vertical Use Cases Horizontal Use Cases Emerging Mature Early value capture through horizontal use cases across industries such as customer support, content generation Vertical use cases will require nuanced domain expertise and customized models
- 13. Google Workspace brings the best of Google to Education AppSheet Productivity & Work Transformation
- 14. Even with Google Workspace… Spelling & Grammar Suggestions Smart Reply Noise Cancellation Portrait Restore Smart Compose Malware Detection and Prevention 2017 2018 2019 2020 2021 2022 2023 2016 Explore 2015 Suggested Actions Chart Suggestions Answers Grammar Suggestions Formula Acceleration Formula Suggestions Smart Compose Smart Compose File Suggestions Write & Re-Write AI-Generated Summaries Sharing Suggestions
- 15. Generative AI in Google Workspace Easily integrate an intuitive, natural language experience that delights your customers and drivers conversion into your existing consumer search apps and platform.
- 16. Google Workspace Duet AI Demo
- 17. Google Cloud brings the best of Google to Education AppSheet Compute Engine Google Kubernetes Engine App Engine Cloud Storage Cloud VPN Google Cloud Armor Application Migration Security Command Center IAM Virtual Private Cloud Cloud Network Contact Center AI BigQuery AI Platform Cloud Spanner Cloud SQL Apigee API Platform Cloud Data Fusion Apigee Sense Productivity & Work Transformation Public Cloud Hybrid Cloud Multi Cloud Edge Cloud Infrastructure-as-a-Service Insights Platform/ Smart Analytics -as-a-Service Data Management -as-a-Service API Management -as-a-Service Application Platform -as-a-Service
- 18. Generative AI: for businesses & governments Generative AI support in Vertex AI Generative AI APIs, end to end support from serving to tuning of foundation models ● Generative AI APIs across multiple modalities ● Model Garden and Generative AI Studio ● Prompt design and prompt tuning ● Fine tuning of foundation models ● Foundation model support for training, prediction and ML Ops Generative AI App Builder Fast application development leveraging the power of search, immersive conversational experiences, and foundation models with enterprise controls Search ● Google-quality out-of-box search ● Tuneable ● Multimodal ● Conversational Conversation ● Single Turn ● Multi Turn ● Information Seeking ● Transactional ● Flow Control
- 19. Expanding our portfolio To support the needs of Generative AI centric enterprise development Business users Developers AI Practitioners Vertex AI Powered by Foundation Models CCAI Document AI Discovery AI Healthcare AI Conversation AI Enterprise Search Foundation Models Generative AI App Builder End-to-End ML Platform Generative AI Studio | Generative AI APIs | Model Garden Google Cloud Infrastructure Powered by Foundation Models Powered by Foundation Models Powered by Foundation Models
- 21. Proprietary + Confidential Enterprise Search Developers No ML skill required AI Practitioners Advanced ML skill OOTB search Google-quality out-of-the-box search experience for implementers Fast and easy setup for Application Developers Tuneable, multimodal, & conversational search “Tune the OOTB” search Customization for Search Developers Build your own search “Build your own” search with advanced ML/AI Model training/ tuning for AI/ML Engineers
- 23. Education, research & tools Online training courses, guidebooks, research papers, product documentation, RAI best practices, Tensorflow Responsible AI toolkit Product & use case reviews Customer AI Use case & Product Development Reviews, Fairness Testing Responsible AI offerings ML Metadata, Model Registry, Explainable AI, Model Monitoring AI comes with its own set of unique challenges. At Google, we are integrating AI into our products boldly and with a deep sense of responsibility and highest standards of information integrity with our AI principles. Responsible AI at the foundation
- 24. surveillance violating internationally accepted norms 1 be socially beneficial avoid creating or reinforcing unfair bias 2 be built and tested for safety 3 be accountable to people 4 incorporate privacy design principles 5 uphold high standards of scientific excellence 6 7 be made available for uses that accord with these principles AI should: likely to cause overall harm principal purpose to direct injury purpose contravenes international law and human rights Google AI Principles 1 2 3 4 Applications we will not pursue:
- 25. So what’s next?
- 26. Introduction to Generative AI Learning Path This learning path provides an overview of generative AI concepts, from the fundamentals of large language models to responsible AI principles.
- 27. Introduction to Large Language Models An introductory level micro-learning course that explores what large language models (LLM) are, the use cases where they can be utilized, and how you can use prompt tuning to enhance LLM performance. It also covers Google tools to help you develop your own Gen AI apps.
- 28. Google Certified Coach (GCC) The Certified Coach program empowers instructional coaches to work 1:1 with educators and drive impactful technology use in their schools. Google Certified Educator Level 1 (GCE Level 1) The Google Certified Educator Level 1 offers certification on the fundamentals of Google Workspace for Education. Google Certified Innovator (GCI) The Certified Innovator program are for educators who innovate with technology to solve meaningful challenges in educator. Google Certified Trainer (GCT) The Certified Trainer program empowers instructional leaders to train, develop, and support educators in learning with technology Google Certified Educator Level 2 (GCE Level 2) The Google Certified Educator Level 2 offers certification on the advance uses of Google Workspace for Education. Google Certified Educator In Google for Education, we offer certification programs to help educators equip themselves with the right tools. These certifications are globally recognised and provides opportunities for educators to be leaders in their schools.
- 29. ● Explore what you can do with Google Cloud Platform to engage students and enhance teaching. ● It is the intent of the program that the credits are used by students to learn how to use the cloud for career development purposes. ● Faculty can apply to receive $100 in GCP credits and $50 per student. Credits can be used in courses, student clubs, and other faculty-sponsored events. Google Cloud Credits for Learning ● Get hands-on experience using Google Cloud Platform with training for everyone from beginners through advanced users. ● Faculty can apply for 5,000 Qwiklabs credits, while students and IT enablers can apply for 200 credits. Everyone can request free access to 13 online training courses in Coursera. Google Cloud Training Credits ● Transform research data into valuable insights and conduct large-scale analyses with the power of Google Cloud Platform. ● Research faculty can apply for up to $5,000 in Google Cloud Platform credits for academic research. Google Cloud Research Credits Google Cloud Programs for Education Fuel new research, encourage teachers to innovate, and offer Google Cloud Platform training and certification with credits and discounts from Google
- 30. ● Google Cloud Generative AI Learning Path ● Google Skillshop ● Skills Ignition SG ● Google Digital Garage ● Google Bard ● Google AI Test Kitchen ● Google AI ● Google Interland Additional Resources
- 31. Thank you for attending NUS-ISS Learning Festival! We hope you have gain great insights and knowledge from the sessions today and we want to hear from you! 1. Post your photo or video on your Facebook/Instagram/TikTok/Linkedin account. Remember to make your post public! 2. Use the hashtag #NUSISSLearningFestival and tag our official account (@iss.nus/@nus_iss) to make sure we see your masterpiece. 3. In the caption, share your insights or takeaways from the festival. What have you learned? What inspired you? The best entries will get a complimentary course of your choice from our Blended Learning Programmes! Let's make learning a blast! 🚀💡😁 Share Your Learnings!
- 32. We’d Love to Hear From You Speakers’ decks will be shared with attendees who completed the post event survey.
- 33. Thank You Felix Goh Strategic Lead, Singapore Education, Research and EdTech Global Public Sector, Google Cloud M: +65 90117062 | E: fgoh@google.com