![1. X. Han, Z. Zhang, N. Ding, Y. Gu, X. Liu, Y. Huo, J. Qiu, Y. Yao, A. Zhang, L. Zhang et al., “Pre-trained models: Past, present and future,” AI Open, vol. 2, pp. 225–250, 2021.
2. ”Introducing OpenAI”. [Accessed on 23.03.2023]. [Online]. Available: https://openai.com/blog/introducing-openai
3. L. Dong, S. Xu, and B. Xu, “Speech-transformer: a no-recurrencesequence-to-sequence model for speech recognition,” in 2018 IEEE international conference on acoustics,
speech and signal processing (ICASSP). IEEE, 2018, pp. 5884–5888.
4. B. D. Lund and T. Wang, “Chatting about chatgpt: how may ai and gpt impact academia and libraries?” Library Hi Tech News, 2023.
5. E. Kasneci, K. Seßler, S. K¨uchemann, M. Bannert, D. Dementieva, F. Fischer, U. Gasser, G. Groh, S. G¨unnemann, E. H¨ullermeier et al., “Chatgpt for good? on opportunities and
challenges of large language models for education,” Learning and Individual Differences, vol. 103, p. 102274, 2023.
6. X. Qiu, T. Sun, Y. Xu, Y. Shao, N. Dai, and X. Huang, “Pre-trained models for natural language processing: A survey,” Science China Technological Sciences, vol. 63, no. 10, pp.
1872–1897, 2020.
7. A. S. George, A. H. George, T. Baskar, and A. G. Martin, “Revolutionizing business communication: Exploring the potential of gpt-4 in corporate settings,” Partners Universal
International Research Journal, vol. 2, no. 1, pp. 149–157, 2023.
8. ] C. Zhang, C. Zhang, S. Zheng, Y. Qiao, C. Li, M. Zhang, S. K. Dam, C. M. Thwal, Y. L. Tun, L. L. Huy et al., “A complete survey on generative ai (aigc): Is chatgpt from gpt-4 to gpt-
5 all you need?” ar Xiv preprint arXiv:2303.11717, 2023.
9. M. Zaib, Q. Z. Sheng, and W. Emma Zhang, “A short survey of pretrained language models for conversational ai-a new age in nlp,” in Proceedings of the Australasian computer
science week multiconference, 2020, pp. 1–4.
10.Z. Liu, X. Yu, L. Zhang, Z. Wu, C. Cao, H. Dai, L. Zhao, W. Liu, D. Shen, Q. Li et al., “Deid-gpt: Zero-shot medical text deidentification by gpt-4,” arXiv preprint arXiv:2303.11032,
2023.
11. P. Rivas and L. Zhao, “Marketing with chatgpt: Navigating the ethical terrain of gpt-based chatbot technology,” AI, vol. 4, no. 2, pp. 375–384, 2023.
12. M. Leippold, “Thus spoke gpt-3: Interviewing a large-language model on climate finance,” Finance Research Letters, vol. 53, p. 103617, 2023
For Comprehensive Review:
Generative Pre-trained Transformer: A Comprehensive Review on Enabling Technologies, Potential Applications, Emerging Challenges, and Future Directions, VIT University,
References](https://image.slidesharecdn.com/chatgpt-gtr22-9-23-231001132737-bac3cedc/85/ChatGPT-GTR-22-9-23-pdf-31-320.jpg)
ChatGPT-GTR 22-9-23.pdf
- 1. Hearty Welcome K-MaP : ChatGPT - Dr. G T Raju Divine Blessings Paramapoojya Jagadguru Padmabhushana Sri Sri Sri Dr. Balagangadharanatha Maha Swamiji His Holiness Jagadguru Sri Sri Sri Dr. Nirmalanandanatha Maha Swamiji and || Jai Sri Gurudev || Sri Adichunchanagiri Shikshana Trust ® 22nd Sept 2023 King Maker Technology
- 2. ❖ Introduction and Definitions of GPT ❖ Uses, Advantages and Limitations of ChatGPT ❖ ChatGPT v/s Google Search ❖ Evolution of Pre-Trained Models and Roadmap of ChatGPT ❖ Inside ChatGPT – How does GPT Work ? ❖ Enabling Technologies of GPT models ❖ Demystifying ChatGPT 3.5 ❖ The impact of GPT models on various applications ❖ ChatGPT 4 & Beyond, Comparison of Various GPT Models ❖ Evolution of AI, Trending Technologies and Advancements ❖ Challenges and Future Directions ❖ Conclusion ❖ References Agenda
- 3. ChatGPT - stands for Chat Generative Pre-trained Transformer ➢ An AI-powered large language model–based chatbot developed by OpenAI, launched on November 30, 2022, capable of generating human-like text based on context and past conversations. ➢ An AI chatbot auto-generative system created by OpenAI for online customer care. ➢ A pre-trained generative chat, which makes use of Natural Language Processing(NLP) ➢ GPT stands for “Generative Pre-trained Transformer”, is based on the transformer architecture, a deep neural network designed for NLP tasks ➢ Works by gathering data from the internet written by people and using computing predictions to answer questions and queries raised by the user ➢ Gives natural answers to questions in a conversational tone and can generate stories, essays, and poems. ➢ Has a language-based model architecture created by OpenAI called the GPT that the developer fine-tunes for human interaction in a conversational manner. ➢ Primarily designed for customer service Introduction
- 4. • Definition 1: GPTs are language models pre-trained on vast quantities of textual data and can perform a wide range of language-related tasks • Definition 2: GPT is a language model relying on Deep Learning that can generate human-like texts based on a given text- based input • Definition 3: GPT is a language model developed by OpenAI to help give systems intelligence and is used in such projects as ChatGPT Definitions - GPT
- 5. Introduction • You can access ChatGPT @ chat.openai.com by creating an OpenAI account. • You can also use chat.openai.com/chat
- 6. • The main feature of ChatGPT is generating responses like those humans would provide, in a text box. Therefore, it is suitable for chatbots, AI system conversations, and virtual assistants. • However, it can also give natural answers to questions in a conversational tone and can generate stories poems and more. Moreover, it can: • Write code • Write an article or blog post • Translate • Debug • Write a story/poem • Recommend chords and lyrics To make the AI carry out one of these demands, all you need to do is type the command into the chatbot. Uses of ChatGPT Prompt: Write a tagline for an ice cream shop. Completion/Response: We serve up smiles with every scoop!
- 7. • One of the main benefits of ChatGPT is its ability to generate responses quickly. ✓ Using ChatGPT can be incredibly beneficial for tasks that require a quick turnaround. You can complete your tasks in a fraction of the time it would have taken you manually. • It can also be used to generate ideas and content and can automate mundane tasks such as data entry or categorization, freeing up your team’s time for more important work. • Using ChatGPT for website content will not negatively impact SEO as long as it provides relevancy to users Note: The decision to use ChatGPT should be based on specific needs, goals, technical expertise, and available resources. Advantages of ChatGPT
- 8. • There is a risk of plagiarism, which is unacceptable at all costs. • While ChatGPT can generate content quickly and accurately on simple topics, it struggles with more complex ideas or issues. • Users must consider that ChatGPT is still learning and is unable to produce perfect results. ✓ Although it can be advantageous regarding its learning capabilities, it also means that the tool may only sometimes generate the most accurate or appropriate responses. ✓ With the lack of reliability in content, it is evident that this could lead to errors or misunderstandings, which may negatively impact the user experience. • Requires user’s significant training and fine-tuning to get the best results. It can become more time-consuming and require higher technical expertise, which may be a challenge for some users. • Finally, while ChatGPT is open source and available to everyone, its requirement for additional resources, such as computing power or storage space, to run effectively may create a barrier for entry-level users. Limitations of ChatGPT
- 9. • Google search helps you to get suggested answers to your questions by giving you a list of websites that are relevant to your questions. • Every answer you get on google search works on its own large language models and algorithm and uses extensive AI to bring you the most credible information. • Google is really good at finding information, videos, images, products, and almost anything on the internet ChatGPT v/s Google Search • On the other hand, ChatGPT gives you the to-the-point answers in a natural flow. It is like using a guidebook. • ChatGPT is insanely good at generating human-like responses to queries and solving problems through textual conversations • One can say that ChatGPT creators will definitely modify it in the near future with more features to compete against google search. ChatGPT Google Search
- 10. Timeline of the evolution of several pre-trained models from Eliza(1960) , to the ChatGPT (2022).
- 11. Roadmap of ChatGPT MIT University Computer Program interacting with Humans and Machines 1964 ELIZA Chatbot Enabled with Keyboard responses 1966 SmarterChild Interactive Bot on Messengers 2001 Siri Alexa GoogleNow Apple / Amazon / Google - Virtual / Personal Assistant 2011 2014 2015 GPT-1 GPT-2 GPT-3 InstructGPT ChatGPT3.5 ChatGPT4 OpenAI 2018 2019 2020 2022 2023 ALICE Language Processing Bot 1995
- 12. Roadmap of ChatGPT • OpenAI - a San Francisco-based AI research and deployment company • Founders: Elon Musk, Sam Altman, Peter Thiel, Ilya Sutskever, Jessica Livingston, and Reid Hoffman. • Invented in the year November 30, 2022 • Conversational Chatbot • Admit mistakes • Challenge incorrect premises • Reject inappropriate requests Elon Musk Sam Altman
- 14. Inside ChatGPT - An Overview Trained on 500GB of Dataset 175 billion parameters across 96 layers
- 15. How does GPT Work ?
- 16. How does GPT Work ? - Summary
- 17. Enabling Technologies of GPT models
- 18. ChatGPT Is it a Threat or Opportunity ?! DataAutomation, Augmentation, Generation !!! Technical skills ? Critical thinking? Creativity? Human Centric ? Reveal Truth? Creativity?
- 19. Demystifying ChatGPT 3.5 - Let us experience it Live!!! Direct Queries Suggestions Translations Comparison Creative Writing Brainstorm Ideas Summarize articles List Generation Pros & Cons Quotes & Studies Feedback Role Playing Concepts Explanation Commands Generation Mentorship Draft Email Grammar Corrections Essay Coding
- 20. The impact of GPT models on various applications
- 21. ChatGPT and Beyond Limitations of ChatGPT ➔ Lack of true understanding ➔ Biases on the Data ➔ Contextual limitations ➔ Limited knowledge - till 2021 ➔ Inability to reason ➔ Does not cite the articles ➔ Slow ChatGPT 3.5 output ➔ Lack of helpfulness ➔ Contains hallucinations ➔ Lack Interpretability ➔ Toxic or biased content
- 22. ChatGPT and Beyond Chat GPT - 4 : the newest OpenAI model, released on March 14, 2023 ● Ability to drastically increase the number of words that can be used in an input - up to 25,000, 8 times as many as the original ChatGPT model. ● Ability to create websites, complete tax returns, make recipes and deal with reams of legal information. ● Advanced reasoning capability ● Understand Images ● Long memory ● Multilingual ● Microsoft Bing, Duolingo presently running on GPT-4
- 23. ChatGPT and Beyond Chat GPT - 5 : will change the world (coming out in 2024 !) ● Multiple Modalities ● Unprecedented Entertainment ● Rise of General robots ● Era of AI ● Future prediction Mastery ● Revolution in Medicine, Science, Business and Work ● Personalized Virtual Assistant ● Humanoid Robots ● Enhanced Personalized learning ● Enhanced Cybersecurity and Data protection
- 24. COMPARSION OF DIFFERENT VERSIONS OF GPT MODEL
- 25. Challenges and Future Directions
- 26. Challenges and Future Directions
- 27. VARIOUS LESSONS LEARNED AND FUTURE RESEARCH DIRECTIONS
- 28. Evolution of Artificial Intelligence
- 29. Trending Technologies and Advancements ❖ Google adds GenerativeAI to workspaces ❖ Google Introduces Meta PaLM 2 ❖ OpenAI announcing Chat GPT - 5 ❖ Microsoft Introduces AI Copilot for 365 suite ❖ Microsoft Introduces Jarvis ❖ Meta introduces LLaMA - billion parameter LLM model What Fuels these Technologies and Advancements ….???!!!
- 30. ✓ ChatGPT is a natural language processing tool driven by AI technology that allows you to have human-like conversations and much more with the chatbot. ✓ The language model can answer questions and assist you with tasks, such as composing emails, essays, and code. ✓ GPT is a convergence of several technologies, enabled by the latest technologies like Big data, AI, Cloud Computing, EC, 5G and beyond networks, and HCI. ✓ GPT represent a notable breakthrough in the domain of natural language processing, which is propelling us toward the development of machines that can understand and communicate using language in a manner that closely resembles that of humans. ✓ GPT has gained significant popularity among researchers and industrial communities, making them one of the most widely used and effective models in natural language processing and related fields ✓ GPT has become a transformative technology in the field of NLP, enabling the rapid development and growth of a wide range of industries and applications. Despite its wide adoption and numerous potential applications, there is still much to be explored and understood about GPT’s capabilities. ✓ We need to continue to evaluate and reflect on the impact of GPT and other language models, to ensure that they are being used in a way that benefits society as a whole. By doing so, we can help to ensure that these technologies are used to their fullest potential while minimizing any negative impact that they may have. Conclusion
- 31. 1. X. Han, Z. Zhang, N. Ding, Y. Gu, X. Liu, Y. Huo, J. Qiu, Y. Yao, A. Zhang, L. Zhang et al., “Pre-trained models: Past, present and future,” AI Open, vol. 2, pp. 225–250, 2021. 2. ”Introducing OpenAI”. [Accessed on 23.03.2023]. [Online]. Available: https://openai.com/blog/introducing-openai 3. L. Dong, S. Xu, and B. Xu, “Speech-transformer: a no-recurrencesequence-to-sequence model for speech recognition,” in 2018 IEEE international conference on acoustics, speech and signal processing (ICASSP). IEEE, 2018, pp. 5884–5888. 4. B. D. Lund and T. Wang, “Chatting about chatgpt: how may ai and gpt impact academia and libraries?” Library Hi Tech News, 2023. 5. E. Kasneci, K. Seßler, S. K¨uchemann, M. Bannert, D. Dementieva, F. Fischer, U. Gasser, G. Groh, S. G¨unnemann, E. H¨ullermeier et al., “Chatgpt for good? on opportunities and challenges of large language models for education,” Learning and Individual Differences, vol. 103, p. 102274, 2023. 6. X. Qiu, T. Sun, Y. Xu, Y. Shao, N. Dai, and X. Huang, “Pre-trained models for natural language processing: A survey,” Science China Technological Sciences, vol. 63, no. 10, pp. 1872–1897, 2020. 7. A. S. George, A. H. George, T. Baskar, and A. G. Martin, “Revolutionizing business communication: Exploring the potential of gpt-4 in corporate settings,” Partners Universal International Research Journal, vol. 2, no. 1, pp. 149–157, 2023. 8. ] C. Zhang, C. Zhang, S. Zheng, Y. Qiao, C. Li, M. Zhang, S. K. Dam, C. M. Thwal, Y. L. Tun, L. L. Huy et al., “A complete survey on generative ai (aigc): Is chatgpt from gpt-4 to gpt- 5 all you need?” ar Xiv preprint arXiv:2303.11717, 2023. 9. M. Zaib, Q. Z. Sheng, and W. Emma Zhang, “A short survey of pretrained language models for conversational ai-a new age in nlp,” in Proceedings of the Australasian computer science week multiconference, 2020, pp. 1–4. 10.Z. Liu, X. Yu, L. Zhang, Z. Wu, C. Cao, H. Dai, L. Zhao, W. Liu, D. Shen, Q. Li et al., “Deid-gpt: Zero-shot medical text deidentification by gpt-4,” arXiv preprint arXiv:2303.11032, 2023. 11. P. Rivas and L. Zhao, “Marketing with chatgpt: Navigating the ethical terrain of gpt-based chatbot technology,” AI, vol. 4, no. 2, pp. 375–384, 2023. 12. M. Leippold, “Thus spoke gpt-3: Interviewing a large-language model on climate finance,” Finance Research Letters, vol. 53, p. 103617, 2023 For Comprehensive Review: Generative Pre-trained Transformer: A Comprehensive Review on Enabling Technologies, Potential Applications, Emerging Challenges, and Future Directions, VIT University, References
- 32. ❖ Reach me @ ➢ Dr. G T Raju Phone: +91-9448308345, 9731292555 Email ID: gtraju@sjcit.ac.in, principal@sjcit.ac.in