Efficient development of smart apps: The role of AI gateways
0 likes20 views
The document discusses the significance of AI gateways in developing efficient smart applications by emphasizing their role in managing traffic and integrating multiple services. It highlights the characteristics of smart apps, including being data-driven and API-centric, while addressing challenges such as security and governance. Key takeaways include the distinction between API and AI gateways and their combined ability to enhance developer productivity and application security.
Efficient development of smart apps: The role of AI gateways
- 1. © OPITZ CONSULTING 2024 / Öffentlich Efficiently develop smart apps with an AI Gateway 1 with an AI Gateway Nuremberg, 20.11.24 Sven Bernhardt EFFICIENTLY DEVELOP SMART APPS Source: Wacken.com
- 2. © OPITZ CONSULTING 2024 / Öffentlich Efficiently develop smart apps with an AI Gateway 2 92 % say that AI is a priority Source: Kong API Impact Report 2024
- 3. © OPITZ CONSULTING 2024 / Öffentlich YOU’RE A SOFTWARE DEVELOPER. WHAT DOES EFFICIENCY MEAN TO YOU? Efficiently develop smart apps with an AI Gateway 3 Efficiency in software development means achieving the desired outcomes with the least wasted time, effort, and resources while maintaining high quality and the ability to adapt to changes.
- 4. © OPITZ CONSULTING 2024 / Öffentlich Efficiently develop smart apps with an AI Gateway 4 Source: Wacken.com
- 5. © OPITZ CONSULTING 2024 / Öffentlich Efficiently develop smart apps with an AI Gateway 5 Traffic must be regulated to ensure the stability of the overall system
- 6. © OPITZ CONSULTING 2024 / Öffentlich WE ARE FACING AN INCREASING AMOUNT OF TRAFFIC TO MANAGE Efficiently develop smart apps with an AI Gateway 6
- 7. © OPITZ CONSULTING 2024 / Öffentlich Application Application Application Client Items Customers Orders Invoices Load Balancer SHIFT FROM MONOLITHIC TO MICROSERVICE CREATES NEW CHALLENGES 7 Efficiently develop smart apps with an AI Gateway
- 8. © OPITZ CONSULTING 2024 / Öffentlich Client Items Items Items Items Items Customers Items Items Invoices Items Items Orders Client may beanother service MORE LOGIC Load Balancer Load Balancer - Authentication - Security - Logging - Transformations - Load-Balancing - Etc NEW STANDALONE APPS NEED TO BE SECURED AND MANAGED Efficiently develop smart apps with an AI Gateway 9
- 9. © OPITZ CONSULTING 2024 / Öffentlich Load Balancer Client Items Items Items Items Items Customers Items Items Invoices Items Items Orders Load Balancer Client may beanother service MORE LOGIC Load Balancer MORE LOGIC MORE LOGIC MORE LOGIC Load Balancer - Authentication - Encryption - Logging - Transformations - Load-Balancing - etc. - Authentication - Encryption - Logging - Transformations - Load-Balancing - etc. - Authentication - Encryption - Logging - Transformations - Load-Balancing - etc. - Authentication - Encryption - Logging - Transformations - Load-Balancing - etc. DISTRIBUTION CAN LEAD TO FRAGMENTATION 11 Efficiently develop smart apps with an AI Gateway
- 10. © OPITZ CONSULTING 2024 / Öffentlich ABSTRACTIONLAYER Client Items Items Items Items Items Customers Items Items Invoices Items Items Orders Client may beanother service API Gateway Authentication Encryption Logging Transformations Load-Balancing …and more API GATEWAY HELPS TO SOLVE THE FRAGMENTATION CHALLENGE 12 Efficiently develop smart apps with an AI Gateway
- 11. © OPITZ CONSULTING 2024 / Öffentlich Efficiently develop smart apps with an AI Gateway 13 An API Gateway acts as a single entry point to company data
- 12. © OPITZ CONSULTING 2024 / Öffentlich CHARACTERISTICS OF A SMART APP Efficiently develop smart apps with an AI Gateway 14 AI-powered Data-driven Personalization Automation Real-time
- 13. © OPITZ CONSULTING 2024 / Öffentlich Efficiently develop smart apps with an AI Gateway 15 Smart apps are API-driven #thereNoAiWithoutAPIs
- 14. © OPITZ CONSULTING 2024 / Öffentlich WHAT DOES A SMART APP LOOK LIKE? Efficiently develop smart apps with an AI Gateway 16 Usually, traffic to external services!
- 15. © OPITZ CONSULTING 2024 / Öffentlich Efficiently develop smart apps with an AI Gateway 17 Source: Kong API Impact Report 2024
- 16. © OPITZ CONSULTING 2024 / Öffentlich CHALLENGE: MULTI-LLM USAGE Efficiently develop smart apps with an AI Gateway 18 Security Credential Management Governance Observability
- 17. © OPITZ CONSULTING 2024 / Öffentlich CHALLENGE: NEW ATTACK VECTORS & LEGAL RESTRICTIONS Efficiently develop smart apps with an AI Gateway 19 Intelligent Apps OWASP Top 10 API OWASP Top 10 LLM & GenAI Apps EU AI Act
- 18. © OPITZ CONSULTING 2024 / Öffentlich AN AI GATEWAY CAN HELP TO CONSISTENTLY TACKLE THE NEW CHALLENGES Efficiently develop smart apps with an AI Gateway 20 Source: Kong
- 19. © OPITZ CONSULTING 2024 / Öffentlich CONCEPTUAL DIFFERENCE API AND AI GATEWAY Efficiently develop smart apps with an AI Gateway 21 Consumer focus Handles outbound / egress traffic Provider focus Handles inbound / ingress traffic
- 20. © OPITZ CONSULTING 2024 / Öffentlich Efficiently develop smart apps with an AI Gateway 22 An AI Gateway acts as a central exit point
- 21. © OPITZ CONSULTING 2024 / Öffentlich TYPICAL RAG ARCHITECTURE Efficiently develop smart apps with an AI Gateway 23 Intelligent app cares about: Security Content sanitization Prompt augmentation Req/Resp transformation Logging Ingestion services: Security Observability
- 22. © OPITZ CONSULTING 2024 / Öffentlich …ENHANCED WITH AN AI GATEWAY Efficiently develop smart apps with an AI Gateway 24 AI Gateway cares about: Security AuthN to LLM Content sanitization Prompt augmentation Templating Decoration Req/Resp transformation Logging
- 23. © OPITZ CONSULTING 2024 / Öffentlich …IMPROVED WITH AN ADDITIONAL API GATEWAY Efficiently develop smart apps with an AI Gateway 25 API Gateway cares about: Security AuthN/AuthZ Rate limiting Response Caching Observability …
- 24. © OPITZ CONSULTING 2024 / Öffentlich …FURTHER EXTENDED WITH A SERVICE MESH Efficiently develop smart apps with an AI Gateway 26 Mesh cares about: Zero-trust security Observability Reliability
- 25. © OPITZ CONSULTING 2024 / Öffentlich KEY TAKEAWAYS Efficiently develop smart apps with an AI Gateway 27 AI Gateway is more than just a marketing term Intelligent apps are API-driven An API Gateway is a central entry point that handles inbound traffic An AI Gateway is a central exit point that handles outbound traffic Both combined relieve the burden on developers Consistent Connectivity platform enables developers to be as productive, effective, and satisfied as possible
- 26. © OPITZ CONSULTING 2024 / Öffentlich PRESENTATIONS BY OPITZ CONSULTING COLLEAGUES PROGRAM BOOKLET FOR DOWNLOAD Efficiently develop smart apps with an AI Gateway 28
- 27. © OPITZ CONSULTING 2024 / Öffentlich BACK TO FUTURE WITH OPITZ CONSULTING TAKE PART IN THE RAFFLE NOW! Efficiently develop smart apps with an AI Gateway 29 Participation in the booth of OPITZ CONSULTING Raffle on Thursday, 21.11.2024 1:50 p.m. here at the booth *Winnings will only be given to people present
- 28. © OPITZ CONSULTING 2024 / Öffentlich IN CASE OF ANY QUESTIONS… Efficiently develop smart apps with an AI Gateway 30 Sven Bernhardt Chief Architect / Integration Evangelist | Kong Champion OPITZ CONSULTING Deutschland GmbH Kirchstrasse 6, 51647 Gummersbach, Germany Phone: +49 172 2193529 Mail: sven.bernhardt@opitz-consulting.com X: @sbernhardt Blog: https://svenbernhardt.wordpress.com