DSS_A Solid Foundation for GenAI Apps - Exploring Architectural Blueprints for LLM Solutions with Java

A Solid Foundation for GenAI
Apps - Exploring Architectural
Blueprints for LLM Solutions
with Java
Juarez Barbosa Junior @juarezjunior
Sr Principal Java Developer Evangelist, Oracle

Juarez Barbosa Junior
Senior Principal Java Developer Evangelist
• Speaking from Dublin, Ireland
• 28 years of experience in SW Engineering & DevRel
• Oracle, Microsoft, IBM, Nokia, Unisys, Accenture, startups
• Microsoft Azure Developer Relations Lead
• IBM Watson Tech Evangelist & Cloud Rockstar
• IBM Mobile Tech Evangelist & Global Thought Leader
• Nokia Developers Global Champion
• Java, Python, Cloud, DevOps, SRE, Cloud-native, IoT, AI,
Blockchain, Rust
• Speaker at conferences
• Oracle CloudWorld, Oracle Code, Microsoft Ignite, Microsoft
TechX, jPrime, JCON, DevConf.cz, GeeCon, DevOpsDays,
DeveloperWeek, DevOps Institute, CloudLand, DWX, The
Developer’s Conference (TDC), Sec4Dev, JSNation, NodeConf,
Conf42, Shift Conf, Global Azure, Open-Source Lisbon,
CodeFrenzy, Mêlée Numérique, React Summit, Test.js Summit,
Porto TechHub Conf, Pyjamas, MiTechCon, JUGs, meetups, etc.
@juarezjunior
@juarezjunior

Agenda
• AI and GenAI – Synthetic Content
• GenAI Concepts and AGI
• Reference Architecture for GenAI Apps
• Direct LLM calls (text generation)
• LLM + RAG + Oracle Database 23ai (vector DB)
• Multimodality Prompts (various media)
• Function Calling (execution of client-side
functions)
• Audience: SW Engineers + Business audiences
(not necessarily ML Engineers)
Copyright © 2024, Oracle and/or its affiliates

AI and GenAI –
Synthetic Content
Dublin in Ireland pictured in a futuristic
cityscape

• Core concepts in a nutshell
• GenAI - Artificial intelligence algorithms and transformer models with the capability
of generating content.
• Content - Text, images, videos, code, and others.
• Generation – a result of an input prompt (prompt engineering).
• Training data – dataset
• Apps – Applied currently in the fields of content development, entertainment, drug
discovery, software development, healthcare, material generation sciences, and
others.
• Ethical issues – misuse, deep fakes, bias and discrimination, automation and job
replacements, cybersecurity and cybercriminals.
• AI is now a commodity!
• Artificial General Intelligence (AGI) Research – ultimate goal
GenAI Concepts and AGI

Reference
Architecture
for GenAI Apps

Direct LLM calls - Spring AI with Open AI
• Demo - Direct LLM calls - Spring AI with Open AI

Oracle Database 23ai Free available for
download now
• Oracle Database 23ai Free accelerates
Oracle’s mission to make it simple to
develop and run all data-driven apps
• Provides developers easy early access to
23ai AppDev features
• Limited database size, memory, and CPU
threads
http://oracle.com/23aiFree
http://oracle.com/23aiFree

RAG - Spring AI with Open AI and Oracle
Database 23ai
• Demo - RAG - Spring AI with Open AI and Oracle
Database 23ai

Multimodality - Spring AI with Open AI
(GPT-4o)
• Demo - Multimodality - Spring AI with Open AI (GPT-
4o)

Function Calling - Spring AI with Open AI
• Demo -Function Calling - Spring AI with Open AI

Technical References
• Spring AI - https://spring.io/projects/spring-ai
• OpenAI - https://openai.com/
• Oracle AI Vector Search - https://rb.gy/sp41uk
• Oracle AI Vector Search for Java Developers with the Oracle Database 23ai -
https://rb.gy/7ivwxr
• Java / JDBC – https://www.oracle.com/jdbc
• Introduction to Oracle JDBC Driver Support for Virtual Threads -
https://bit.ly/3UlNJWP
• Developing an Oracle JDBC app with GraalVM Native Image - https://rb.gy/iy3sgh
• Getting Started with Reactive Relational Database Connectivity and the Oracle R2DBC
Driver - https://rb.gy/42dnz5
• Getting Started with the Java library for Reactive Streams Ingestion (RSI) -
https://bit.ly/3rEiRnC
• Introduction to JDBC Reactive Extensions with the Oracle Database — Developer
Release – https://rb.gy/qxlrbx
• Pipelined Database Operations - https://rb.gy/iy3sgh

DSS_A Solid Foundation for GenAI Apps - Exploring Architectural Blueprints for LLM Solutions with Java

Java App
Dev with
Oracle
Database

Overview of Oracle DB Access with Java

Oracle JDBC - Support for the Latest Java
Versions
• Support to the latest Java versions
(11, 17, 21) and GraalVM
• Project Loom - Virtual Threads
support
• Java Virtual Threads and Pipelined
Database Operations
• JDBC Standards - 4.2 and 4.3
• Reactive Streams - Java Flow API
support
• R2DBC, Reactive Streams Ingestion
(RSI)
• Pipelined Database Operations
Data access is critical in
mission-critical applications!

Oracle LiveLabs
Showcasing how Oracle’s solutions can
solve your business problems
500+
free workshops,
available or in
development
3.5 million
people have already visited
LiveLabs
developer.oracle.com/livelabs
learn something new …at your pace!
600+
events run
using LiveLabs
workshops

3 membership tiers
Connect: @oracleace facebook.com/OracleACEs
aceprogram_ww@oracle.com
500+ technical experts &
community leaders helping peers globally
The Oracle ACE Program recognizes & rewards individuals for
their technical & community contributions to the Oracle community
Nominate
yourself or a candidate:
ace.oracle.com/nominate
Learn more - ace.oracle.com
blogs.oracle.com/ace

Create your FREE
Cloud Account
• Go to
https://signup.cloud.oracle.com/

DSS_A Solid Foundation for GenAI Apps - Exploring Architectural Blueprints for LLM Solutions with Java

More Related Content

Similar to DSS_A Solid Foundation for GenAI Apps - Exploring Architectural Blueprints for LLM Solutions with Java (20)

More from Juarez Junior (20)

Recently uploaded (20)

DSS_A Solid Foundation for GenAI Apps - Exploring Architectural Blueprints for LLM Solutions with Java