Exploring Multimodal Embeddings with Milvus
1 like250 views
The document discusses multimodal embeddings and their application in vector databases using Milvus, emphasizing tools and partnerships in the data platform space. It highlights the capabilities of vector embeddings to manage unstructured data across various formats, including text, images, and audio. The content outlines Zilliz's offerings and services such as cloud solutions and benchmarking tools for high-performance vector search.
![10 | © Copyright 2023 Zilliz
10
“A building with a small window”
Vector Embeddings
Embedding
Model
[-0.099,-0.028,-0.047,0.012,...,-0.011,...]](https://image.slidesharecdn.com/05-07-2024-unstructureddatameetup2-multimodalembeddings-240508200421-fa98df48/85/Exploring-Multimodal-Embeddings-with-Milvus-10-320.jpg)
![12 | © Copyright 2023 Zilliz
12
12 | © Copyright 9/25/23 Zilliz
12 | © Copyright 9/25/23 Zilliz
“The iPhone is a line of smartphones produced by
Apple”
Vector Embedding
Embedding
Model
[-0.099,-0.028,-0.047,0.012,...,-0.011]](https://image.slidesharecdn.com/05-07-2024-unstructureddatameetup2-multimodalembeddings-240508200421-fa98df48/85/Exploring-Multimodal-Embeddings-with-Milvus-12-320.jpg)
![19 | © Copyright 2023 Zilliz
19
Multimodal Embeddings
Image Encoder
[-0.099,-0.028,-0.047,0
.012,...,-0.011]
Text Encoder
[-0.096,-0.026,-0.044,0
.012,...,-0.011]
Audio Encoder
[-0.093,-0.021,-0.047,0.
012,...,-0.010]
A dog smiling](https://image.slidesharecdn.com/05-07-2024-unstructureddatameetup2-multimodalembeddings-240508200421-fa98df48/85/Exploring-Multimodal-Embeddings-with-Milvus-19-320.jpg)
Exploring Multimodal Embeddings with Milvus
- 1. 1 | © Copyright 10/22/23 Zilliz 1 | © Copyright 10/22/23 Zilliz Stephen Batifol, Zilliz Multimodal Embeddings with Milvus
- 2. 2 | © Copyright 10/22/23 Zilliz 2 | © Copyright 10/22/23 Zilliz Stephen Batifol Developer Advocate, Zilliz stephen.batifol@zilliz.com https://www.linkedin.com/in/stephen-batifol/ https://twitter.com/stephenbtl Speaker
- 3. 3 | © Copyright 10/22/23 Zilliz 3 | © Copyright 10/22/23 Zilliz Open Source Deploy fully managed or “Bring Your Own Cloud” (BYOC) Commercial Offerings Zilliz Cloud Optimized Milvus with essential data and security tools for a high-performing vector search platform VECTOR SEARCH ENGINE VECTORDB BENCHMARK TOOL VECTOR DATABASE SEMANTIC CACHE FOR LLM QUERIES GPT-Cache Product Portfolio GUI for Milvus
- 4. 4 | © Copyright 10/22/23 Zilliz 4 | © Copyright 10/22/23 Zilliz Couple of Customers
- 5. 5 | © Copyright 10/22/23 Zilliz 5 | © Copyright 10/22/23 Zilliz Cloud Service Provider Data Platform GenAI Tooling Chip Manufacturer Partner with Industry Leaders
- 6. 6 | © Copyright 10/22/23 Zilliz 6 | © Copyright 10/22/23 Zilliz 01 Where do Vectors Come From? CONTENTS 03 04 Demo! 02 OpenAI CLIP What is Multimodal?
- 7. 7 | © Copyright 2023 Zilliz 7 Where do Vectors Come From? 01
- 8. 8 | © Copyright 2023 Zilliz 8 Vector Databases Unstructured Data + ML = Vector Magic
- 9. 9 | © Copyright 2023 Zilliz 9 Embeddings Models
- 10. 10 | © Copyright 2023 Zilliz 10 “A building with a small window” Vector Embeddings Embedding Model [-0.099,-0.028,-0.047,0.012,...,-0.011,...]
- 11. 11 | © Copyright 2023 Zilliz 11 Vector Embeddings
- 12. 12 | © Copyright 2023 Zilliz 12 12 | © Copyright 9/25/23 Zilliz 12 | © Copyright 9/25/23 Zilliz “The iPhone is a line of smartphones produced by Apple” Vector Embedding Embedding Model [-0.099,-0.028,-0.047,0.012,...,-0.011]
- 13. 13 | © Copyright 2023 Zilliz 13 | © Copyright 9/25/23 Zilliz 13 Milvus can handle different data and not only text
- 14. 14 | © Copyright 2023 Zilliz 14 OpenAI CLIP 02
- 15. 15 | © Copyright 2023 Zilliz 15 CLIP
- 16. 16 | © Copyright 2023 Zilliz 16 CLIP
- 17. 17 | © Copyright 2023 Zilliz 17 CLIP Embeddings CLIP
- 18. 18 | © Copyright 2023 Zilliz 18 What is Multimodal? 03
- 19. 19 | © Copyright 2023 Zilliz 19 Multimodal Embeddings Image Encoder [-0.099,-0.028,-0.047,0 .012,...,-0.011] Text Encoder [-0.096,-0.026,-0.044,0 .012,...,-0.011] Audio Encoder [-0.093,-0.021,-0.047,0. 012,...,-0.010] A dog smiling
- 20. 20 | © Copyright 2023 Zilliz 20 Multimodal Embeddings
- 21. 21 | © Copyright 2023 Zilliz 21 Search over everything A dog smiling Lorem Ipsum
- 22. 22 | © Copyright 2023 Zilliz 22 | © Copyright 9/25/23 Zilliz 22 Demo! MultiModal RAG
- 23. 23 | © Copyright 8/16/23 Zilliz 23 | © Copyright 8/16/23 Zilliz Basic RAG Architecture
- 24. 24 | © Copyright 8/16/23 Zilliz 24 | © Copyright 8/16/23 Zilliz Give Milvus a Star! Chat with me on Discord! Questions? Github