OSA Con 2022 - The Open Source Analytic Universe, Version 2022 - Robert Hodges - Altinity.pdf
0 likes27 views
The document discusses the state of the open-source analytic universe in 2022, focusing on advancements in real-time analytics, integration of transactional and analytical processing, and the significance of object storage for large datasets. It highlights the importance of user ownership of data and code in driving developments within the open-source analytics community. The presentation is delivered by Robert Hodges, CEO of Altinity, emphasizing their role in the ClickHouse ecosystem.
OSA Con 2022 - The Open Source Analytic Universe, Version 2022 - Robert Hodges - Altinity.pdf
- 1. The Open Source Analytic Universe Version 2022 Robert Hodges, Altinity CEO 1
- 2. Presenter and Company www.altinity.com Enterprise provider for ClickHouse. We run Altinity.Cloud, the first managed platform for ClickHouse on AWS and GCP Robert Hodges - Altinity CEO 30+ years on DBMS plus virtualization and security. Working with analytic databases since 2013
- 3. State of the open source analytic universe 2021 3
- 4. Real-time analytics introduce new use cases for SaaS analytics Weblogs Online ad bids Service logs Network telemetry System monitoring Market trading data Sub-second response Millions of events per second Trillions of stored events
- 5. Real-time data in practice - continuous operation on large data sets 5 Millions of rows/sec with constant query load 10s of TBs per server node
- 6. Kubernetes is also flourishing 6 Open source infrastructure Cloud-native databases
- 7. What’s new in 2022? 7
- 8. Connecting transactions to analytics enables basic operations 8 Fraud Detection App Fraud Credit card transaction OK ✘ ✔
- 9. Real-time OLTP / OLAP integration is critical 9 Fraud Detection App Fraud Credit card transaction OK ✘ ✔ Transaction Processing Analytics
- 10. Improving that integration is key to efficiency 10 Fraud Detection App Fraud Credit card transaction OK ✘ ✔ Transaction Processing Analytics Simple, near real-time transfer
- 11. And HTAP is having a moment… 11 Fraud Detection App Fraud Credit card transaction OK ✘ ✔ Hybrid Transactional/Analytic Processing
- 12. Object storage is surging as a solution for large datasets 12 Server SSD Cache Server SSD Cache Server SSD Cache Object Storage 2014
- 13. Virtually all analytic databases support it 13 Server SSD Cache Server SSD Cache Server SSD Cache Object Storage 2022
- 14. Open table formats allow reuse of large data sets 14 Server SSD Cache Server SSD Cache Server SSD Cache Object Storage Metadata Transactions Security
- 15. How might this play out for open source analytics? 15 Server SSD Cache Server SSD Cache Server SSD Cache ClickHouse “ObjectTree” Data Ingest AI/ML 2022 202?... 2018
- 16. PostgreSQL is fading as an influence on analytics 16 Aster Data Truviso Yahoo Everest Netezza Greenplum Vertica ParAccel Redshift TimescaleDB Materialize
- 17. ClickHouse Word Cloud! 17 ByteHouse Hydrolix Firebolt CloudFlare PingCAP CaspianDB TinyBird Huawei ClickHouse Cloud DoubleCloud Gigapipe Yandex.Cloud eBay Alibaba Cloud Altinity.Cloud Aiven Tencent Cloud ChistaDATA Cloud Cloud Service Fork Released in 2022
- 18. Geographical distribution of forks and cloud services 18 Fork Cloud Service
- 19. Fearless predictions for 2023 19 Real-time integration from OLTP to OLAP Innovation in and around object storage New ClickHouse cloud services and forks!
- 20. One final topic 20 In real Open Source, you have the right to control your own destiny. - Linus Torvalds Ownership of data
- 21. And a final prediction for 2023 21 To own your data you must also own the code Committers Communitees Users Vendors
- 22. And a final prediction for 2023 22 User needs for ownership will help drive open source analytic development To own your data you must also own the code Committers Communitees Users Vendors
- 23. Thank you and enjoy the conference! rhodges at altinity.com https://altinity.com