Open-Source AI: Community is the Way
Download as PPTX, PDF0 likes92 views
Alexy Khrabrov discusses the importance of community involvement in the development and validation of open-source generative AI technologies, emphasizing trust, safety, and transparency. He highlights the role of organizations like the Linux Foundation in fostering collaboration and democratization within the AI field, and the potential of open-source solutions for industrial and enterprise applications. The presentation also touches on digital transformation and the need for collaboration among multiple AI bodies to enhance the effectiveness of generative AI.
Open-Source AI: Community is the Way
- 1. Alexy Khrabrov, PhD Open-Source Science Director IBM Research, Accelerated Discovery Chair, Generative AI Commons LF AI & Data, Linux Foundation @chiefscientist (X/LinkedIn/Telegram) alexy@ chiefscientist.org Open-Source AI: Community is the Way
- 2. Why do we need community around LLMs? • Claims of trust, safety, performance, transparency and openness cannot be unilateral announcements by one or even a few companies • Need an established community vehicle like LF, ML Commons, NumFOCUS 2 Generative AI needs Community
- 3. 3 PyData Hamburg, Germany LLM Avalanche San Francisco, CA ChiPy & PyData Chicago, IL PyData Accra, Ghana UCSC OSPO Santa Cruz, CA PyData Berlin, Germany OSPOs for Good @ United Nations ACS Off-Site, Almaden SciPy 2023 Austin, TX LLM Avalanche San Francisco, CA ACS San Francisco, CA NumFOCUS Donation to Data Science Education
- 4. • Data • Models • Applications • Community Validation 4 What is the OSS Generative AI? • Data: training, lakehouses, retraining • Models: OSS models, serving, inference • Applications: • frameworks, prompt engineering, DSP, Open Interpreter • Enterprise Integration • Community Validation: benchmarks, openness metrics, measurable broad societal consensus
- 5. 5 Generative AI Commons at LF AI & Data The LF AI & Data Generative AI Commons is dedicated to fostering the democratization, advancement and adoption of efficient, secure, reliable, and ethical Generative AI open source innovations through neutral governance, open and transparent collaboration and education.
- 6. Alexy Khrabrov and Peter Staar CZI HQ, Redwood City 10/26/23 DeepSearch used to identify software mentions in Arxiv at the CZI hackathon Mapping the Impact of Research Software in Science (Chan Zuckerburg Initiative Hackathon, Oct 24–27, 2023) • Which sciences grow faster with OSS • Which software is most used, by discipline • Which organizations support OSS • How to extract software mentions from papers • Grants, Authors, Organizations • Software citation intent
- 7. • Digital Transformation 1.0 was low-level automation, a gas-powered horse • Clerks replaced by PDF flows • Middle management still in place to operate PDF-enabled clerk teams • SSAs will replace clerks and middle management workflow (data+instruction) • Human in the Loop creators will translate strategy to SSAs • Actual organizational restructuring • SAP, Oracle, legal integrations • Industrial infrastructure, machinery, networks, grids subject to DT2 7 Digital Transformation 2.0: DT2
- 8. Material knowledge about specialized processes • BIMs and Power Tools • Factory Automation • Communications and Utilities • Specialized Machinery (Long Tail) • Hardware and chip-based infrastructure • AI vs A/V • Undocumented tribal knowledge IBM Confidential | © 2020 IBM 8 Industrial AI
- 9. • Ownership With open-source, organizations can secure AI sovereignty and protect their IP encapsulated in the models. This empowers them to freely create, modify, and deploy their agents within their own industrial environments, without vendor lock-in. Factory setup also required high-bandwidth local networks. – Small is Beautiful (Unix => and Efficient!) The OSS model can be specialized and compressed, fitting in the environments where it should be deployed. It can be reasoned about and proven correct for the specific domain, preserving ownership and expertise. – Do One Thing, Do It Well! (GM) Specialist models can be fused with company knowledge. 9 Why OSS AI is needed for Industrial AI?
- 10. 10 Why OSS AI is needed for Enterprise AI?
- 11. • Generative AI Commons at Linux Foundation • ML Commons – MLperf benchmark, AI safety group • Foundation models in Climate, Chemistry, Biology, IBM+NASA+… • Partnership for AI • Frontier Model Forum • OECD/WEF working groups 11 Multiple AI Bodies need to Collaborate
- 12. 12 Thoughtful Software Engineering + LLMs scale.bythebay.io — Oakland, November 13-15 — K1st 30% off passes