New accelerators in Big Data - Upsolver
0 likes294 views
Upsolver is a fully managed platform for ETL and data lakes, designed for scalable and cloud-driven data transformations. It offers features such as SQL-driven transformations, data exploration, low cost of change, and supports both batch and real-time processing. With a focus on simplifying data management, Upsolver enables quick implementation and integrates easily with various data sources.
New accelerators in Big Data - Upsolver
- 1. UPSOLVER WITNESSING A REVOLUTION BORIS TROFIMOV
- 2. ABOUT ME ⎼⎼ ■ Driving big data competence @ Sigma Software ■ 15+ years in software engineering ■ Designed and developed data platform for AOL ■ Expertise in high-load big data ■ Associate Professor at ONPU
- 3. REALITY FROM ENGINEER’S PERSPECTIVE ⎼⎼ И ДАЙТЕ НАМ ЕЩЕ ГОД SPARK AWS SCALA
- 4. REALITY FROM CUSTOMER’S PERSPECTIVE ⎼⎼ ВЖУХ И ВСЕ ГОТОВО
- 10. DATA PLATFORM IN DEPTH ⎼⎼
- 11. DATA PLATFORM IN DEPTH ⎼⎼
- 12. DATA PLATFORM IN DEPTH ⎼⎼
- 13. DATA PLATFORM IN DEPTH ⎼⎼
- 14. DATA PLATFORM IN DEPTH ⎼⎼
- 15. DATA PLATFORM IN DEPTH ⎼⎼
- 16. AND WHAT ABOUT THIS ? ⎼⎼ ■ Data profile and exploration ■ Schema evolution ■ Privacy management and PII anonymization ■ Low Cost of Change ■ Auto Reprocessing ■ Multiple sinks
- 18. UPSOLVER IS COMING UP
- 19. UPSOLVER IS COMING UP ⎼⎼
- 20. WHAT IS UPSOLVER? ⎼⎼ ■ ETL + Data Lake ■ Fully managed platform ■ SQL driven transformations ■ Enterprise - enabled ■ Scalable ■ Cloud-driven
- 21. CONCEPTS ⎼⎼ ■ Data source ■ Output ■ Lookup tables ■ Internal Data Lake to persist derivatives ■ Data partitioned by processing time
- 22. CONCEPTS - DATA STREAM ⎼⎼
- 23. CONCEPTS - STREAM REUSE ⎼⎼
- 24. CONCEPTS - STREAM JOINS ⎼⎼
- 25. CONCEPTS - DATA MESH ⎼⎼
- 28. MORE FEATURES ⎼⎼ ■ Upserts ■ Internal data lake explorer ■ In-memory lookup tables ■ Easier to switch from batch to realtime ■ Data reprocessing ■ Easier to manage late arrivals ■ Anonymization features ■ Python UDF
- 29. COMPETITORS ⎼⎼
- 30. WHEN IT IS RELEVANT ⎼⎼ ■ Short TTM and low CoC ■ SQL-like transformations ■ UI-first is OK ■ Single consistent product ■ Regular structured data formats ■ Sufficient budget for OPEX ■ Cloud-agnostic
- 31. INFORMATION ⎼⎼ ■ Official web site and Trial account https://app.upsolver.com/login ■ Quick start within 10 min https://docs.upsolver.com/upsolver-1/getting-started/start-using-upsolver/upsolver-in-10- minutes/upsolver-quickstart-in-10-minutes#create-a-data-source ■ Upsolver Dev Day Streaming Module https://www.upsolver.com/docs ■ More tech details on Medium https://medium.com/@orirafael/what-is-an-open-data-lakehouse-a-world-without- monoliths-1993b966c2b7
- 32. THANK YOU