DSSML24_tspann_CodelessGenerativeAIPipelines
0 likes122 views
The document discusses codeless generative AI pipelines, highlighting integration with Milvus and various technologies such as Apache NiFi and Python for processing unstructured data. It emphasizes features of NiFi 2.0.0, including new processors for tasks like company name extraction and image classification, and provides links for further resources and demos. Additionally, it invites interaction through Slack and upcoming meetings related to unstructured data and AI applications.
DSSML24_tspann_CodelessGenerativeAIPipelines
- 1. Codeless Generative AI Pipelines (GenAI with Milvus) Tim Spann Principal Developer Advocate
- 2. Timothy Spann Principal Developer Advocate https://medium.com/@tspann https://github.com/tspannhw
- 3. This week in Milvus, Towhee, Attu, Apache NiFi, Apache Flink, Apache Kafka, ML, AI, Apache Spark, Apache Iceberg, Python, Java, LLM, GenAI, Vector DB and Open Source friends. https://flipstackweekly.com/ FLaNK-AIM Stack Weekly
- 4. https://www.meetup.com/unstructured-data-meetup-new-york/ https://www.meetup.com/pro/unstructureddata/ From Unstructured Data to Vector Databases to ML to Generative AI to Deep Learning to Data Science Unstructured Data Meetup @ New York
- 7. https://flankworkspace.slack.com/ https://join.slack.com/t/flankworkspac e/shared_invite/zt-2fycjv241-~NRHZDt dfwDjlfvXK_Bz0A Join Our Slack and Interact with LLM
- 8. DataFlow Pipelines Can Help External Context Ingest Ingesting, routing, clean, enrich, transforming, parsing, chunking and vectorizing structured, unstructured, semistructured, binary data and documents Prompt engineering Crafting and structuring queries to optimize LLM responses Context Retrieval Enhancing LLM with external context such as Retrieval Augmented Generation (RAG) Roundtrip Interface Act as a Discord, REST, Kafka, SQL, Slack bot to roundtrip discussions
- 9. https://medium.com/cloudera-inc/getting-ready-for-apache-nifi-2-0-5a5e6a67f450 NiFi 2.0.0 Features ● Python Integration ● Parameters ● JDK 21+ ● JSON Flow Serialization ● Rules Engine for Development Assistance ● Run Process Group as Stateless ● flow.json.gz https://cwiki.apache.org/confluence/display/NIFI/NiFi+2.0+Release+Goals
- 10. Extract Company Names ● Python 3.10+ ● Hugging Face, NLP, SpaCY, PyTorch https://github.com/tspannhw/FLaNK-python-ExtractCompanyName-processor
- 11. CaptionImage ● Python 3.10+ ● Hugging Face ● Salesforce/blip-image-captioning-large ● Generate Captions for Images ● Adds captions to FlowFile Attributes ● Does not require download or copies of your images https://github.com/tspannhw/FLaNK-python-processors
- 12. RESNetImageClassification ● Python 3.10+ ● Hugging Face ● Transformers ● Pytorch ● Datasets ● microsoft/resnet-50 ● Adds classification label to FlowFile Attributes ● Does not require download or copies of your images https://github.com/tspannhw/FLaNK-python-processors
- 13. NSFWImageDetection ● Python 3.10+ ● Hugging Face ● Transformers ● Falconsai/nsfw_image_detection ● Adds normal and nsfw to FlowFile Attributes ● Gives score on safety of image ● Does not require download or copies of your images https://github.com/tspannhw/FLaNK-python-processors
- 14. FacialEmotionsImageDetection ● Python 3.10+ ● Hugging Face ● Transformers ● facial_emotions_image_detection ● Image Classification ● Adds labels/scores to FlowFile Attributes ● Does not require download or copies of your images https://github.com/tspannhw/FLaNK-python-processors
- 15. Let’s do a metamorphosis on your data. Don’t fear changing data. You don’t need to be a brilliant writer to stream data. Franz Kafka was a German-speaking Bohemian novelist and short-story writer, widely regarded as one of the major figures of 20th-century literature. His work fuses elements of realism and the fantastic. Wikipedia YES, FRANZ, IT’S KAFKA
- 16. Open Source Edition •Apache NiFi in Docker •Try new features quickly •Develop applications locally ● Docker NiFi ○ docker run --name nifi -p 8443:8443 -d -e SINGLE_USER_CREDENTIALS_USERNAME=admin -e SINGLE_USER_CREDENTIALS_PASSWORD=ctsBtRBKHRAx69EqUgh vvgEvjnaLjFEB apache/nifi:latest ● Licensed under the ASF License ● Unsupported ● NiFi 1.26 and NiFi 2.0.0-M3 https://hub.docker.com/r/apache/nifi
- 18. Dziękujemy za uwagę Zapraszamy do zadawania pytań oraz oceny wystąpienia pod nagraniem.