Open source and AI keynote
Download as PPTX, PDF1 like115 views
The document discusses open source software and IBM Z. It notes that the latest innovations in areas like augmented reality, virtual reality, and artificial intelligence are all based on open source technologies. It highlights some key open source statistics like over 210 million repositories and 500,000 projects. The rest of the document focuses on encouraging open source contribution and consumption, providing examples of open source projects relevant to IBM Z, and use cases that apply machine learning to real world problems using open source tools and libraries.
Open source and AI keynote
- 1. Open Source Software and IBM Z Javier Perez | Open Source Leader | IBM Z @jperezp_bos javier.perez@ibm.com javierperez.mozello.com www.linkedin.com/in/javierperez
- 2. Innovation & Open Source Latest Innovations are all Open Augmented Reality, Virtual Reality, Autonomous cars, AI, ML, DL, Blockchain, Virtual Assistance,… All Programming Languages and Frameworks are Open Source
- 3. 210M+ Repositories 500K+ Open-Source Projects Open Source Projects 56M+ Developers
- 5. 1.5M + 869 packages per day 376K + 142 packages per day 297K + 101 packages per day 286K + 207 packages per day 241K + 126 packages per day 164K + 15 packages per day Millions of Open-Source Libraries Source: Feb. 1, 2021 www.modulecounts.com
- 6. Survey: 3,400 Developer Consider open source software better than proprietary software Developer Managers say open source knowledge is a Factor for Hiring Decisions Agree that contributions impress potential employers 94 % 65 % 87 % Photo by Michèle Eckert on Unsplash Source: 2021 O'Reilly Media survey, commissioned by IBM
- 7. Downstream & Upstream Consume: • Reuse open source software • Build on top of open source software • Monetize your software Contribute: • Help the project, be a “good neighbor” • Deliver innovation back to the project • Advocate for quality and security • Meaningful contributions foster community Free photo by Chris Urbanowicz
- 8. Take Action As a Developer create or review: • Open source license • README • Contribution guidelines & code of conduct Contributions: • Enhancements • Innovation • Bug fixes • Vulnerability fixes • Port to new platform
- 9. Contribute not just Code • Test • Write documentation • Translate • Bug triaging • Suggest a feature • Graphic design • Write a blog • Give a talk
- 10. Open Source Software Ecosystem for IBM Z Linux Distributions & Virtualization Networking & Monitoring Cloud & Container Services Languages & Runtimes DevOps/Automation Linux Community Versions Big Data, Observability, Analytics Databases & Storage Middleware & others ClefOS www.ibm.com/community/z/open-source-software/ hub.docker.com Memcached More:
- 12. • Python • Cassandra • Kafka • Spark • Apache Airflow • PostgreSQL • Hadoop • Storm • Flume • Kinesis Financial Industry ML OSS • TensorFlow • SPARQL • Hive • MongoDB • Oozie • Apache Beam • PySpark • PyTorch • R • Kotlin
- 13. Fun & Real ML Use Cases
- 14. Fan Open Debate Questions • Searches more than 40 million pieces of unstructured data such as sports news and analysis articles. Pros and cons for online debates Match Insights Factsheets • Generate factsheets before matches by querying 14 million articles from more than 100K sites ML Audience noise in broadcast • Analysis of previous years crowd reactions to determine moments of excitement for highlights ML Use Case: US Open 2020
- 15. ML helps fans make more informed fantasy lineup and trade decisions by giving them new insights (over 25 billions insights) • Read and comprehend hundreds of millions of articles (228 million in 2019) • Apply NLP to determine boom/bust and scoring spreads • Information for fair market valuation and cost for player trades ESPN Fantasy Football
- 16. A fully-autonomous, AI powered marine research vessel to travel from Plymouth UK to Plymouth, MA • Onboard cameras, radar, sensors, GPS, geospatial information • 2 years of ML trained models with millions of nautical images • Operation Decision Management to identify “unsafe” situations like weather and computer vision to avoid hazards such as land, debris and other ships Mayflower Autonomous Ship mas400.com/technology
- 17. ● Is all about Open Source ● AI/ML/DL is based on Open Source ● Consume & Contribute to Open Source ● Build something great! Photo by Prateek Katyal from Pexels Key Takeaways
- 18. Thank you! Javier Perez | Open Source Leader | IBM Z @jperezp_bos javier.perez@ibm.com javierperez.mozello.com www.linkedin.com/in/javierperez
Editor's Notes
- #2: Photo by ActionVance on Unsplash
- #3: OSS is mainstream, is everywhere, all latest innovations are develop in the open Millions of Open Source Libraries
- #6: http://www.modulecounts.com/ The grow continue and it is great if you are also contributing to open source either making your software open or contributing to existing OSS These are impressive number of OSS by programming language: NPM for JavaScript and Node.js Maven Central for Java Packagist for PHP - Packagist is the main Composer repository. It aggregates public PHP packages installable with Composer. PyPI Python package index Nuget for .NET apps
- #7: O'Reilly Media survey, commissioned by IBM, surveyed 3,400+ developers and technology managers to understand their views related to open source and the cloud. - 94% Open source software was rated equal to or better than proprietary software
- #8: Meaningful contributions foster community
- #11: General Points: - We have a large and growing ecosystem of open source software for IBM Z & LinuxONE - This slide represents only a partial list of all the open source software available in IBM Z & LinuxONE No different to other processor architectures like ARM or x86, software for IBM Z & LinuxONE also known as s390x requires Linux distribution compiled in the corresponding processor architecture. Outside IBM the open source community has ported and validated hundreds of open source software for s390x. This open source software for s390x, is available in GitHub, individual software distribution sites or in Docker Hub IBM Investment: We have a team of IBM upstream engineers that are constantly porting and validating new versions of open source software or adding new open source software. More than 30 engineers porting and validating open source software Teams all over the world including research centre in Boeblingen, Germany (30+) with contributors to Linux, including Maintainers to Linux Kernel subsytstem and a variety of other open source projects related to compilers, emulators and other tooling (GCC, LLVM, GDB, QEMU, OpenSSL, Perf, others) With an Open Source Program Manager we are collaborating with the IBM Open Technology team to bring more open source software to IBM Z and LinuxONE. Recent examples include Kubeflow and ONNX projects now starting to build software for IBM Z. 6-figure dollar budget allocated to software bounties for the open source communities to bring key open source functionality to IBM Z Promotion at industry events, including open source foundations where we advocate for more open source software for IBM Z
- #13: https://www.salon.com/2019/04/15/learn-to-trade-stocks-like-a-pro-with-this-training/ Little secret, to identify what are all those Large and Fintech org are using Regardless of the architecture, you are using these oss
- #15: Searches more than 40 million pieces of unstructured data such as sports news and analysis articles. It extracts pertinent information, such as wins, losses and other records, and presents that as pros and cons for online debates Match Insights Factsheets Generate factsheets before matches by querying a trove of structured data, such as match and performance statistics, to digest detailed information on players and present it in a readable manner to fans. ML Audience noise in broadcast Samples of audience noise from analysis of previous years crowd reactions to determine moments of excitement for highlights
- #17: geo
- #18: Photo by Prateek Katyal from Pexels
- #19: Photo by ActionVance on Unsplash