Дмитрий Лавриненко "Blockchain for Identity Management, based on Fast Big Data"
0 likes352 views
Dmitry Lavrinenko is a solutions architect who specializes in blockchain for identity management, big data, and related technologies. He proposes a vendor-agnostic SaaS platform that utilizes fast data technologies like continuous loading, parallel processing, and data consolidation. The solution would include a data warehouse, processing, analytics, visualization, machine learning, and identity management capabilities. Blockchain provides benefits like cryptographic security, privacy, consensus, audibility and smart contracts for managing identities. The proposed architecture features data lakes, batch and speed layers, serving layers, storage, functions, streaming, and machine learning components.
Дмитрий Лавриненко "Blockchain for Identity Management, based on Fast Big Data"
- 1. Dmitry Lavrinenko SoftServe Blockchain for Identity Management, based on Fast Big Data
- 2. About Me • Solutions Architect • DevOps • IoT • Big Data • Blockchain • AI • ML dlavrin@softserveinc.com
- 3. Business Goal Deliver a vendor-agnostic and open-source based SaaS platform by using most up to date automation technologies and utilizing the partnership with major software vendors and independent developers.
- 4. What is Fast Data for us • Continuous data loading • Massively parallel processing • Data consolidation • Dimensional processing • Data normalization & denormalization (depends on tech stack) • Structured & dimensional data models • Hybrid distributed warehouses
- 5. What is Fast & Big Data Solution • Data WH • Processing • Analytics • Visualisation • Machine Learning • Data Virtualization • Data Ingestion • Identity As a Service
- 6. Why Blockchain • Cryptographic environment • IoT Privacy • Blockchain Identity • Consensus • Integration • Internal assurance • Resilience • Tracking • Smart contracts • Digital fingerprint • Audibility
- 7. Portal Solution Architecture Event Strea m data cach retention scenario s Data Lake Batch layer Speed layer Serving layer Consumer Dashboard Storage Stream Serving Storage Function s Stream Processin Ad-Hoc Queries BI Analytics Visualizati on engine ML ML IoT Edge Orchestratio n P2P Blockchain Storage Consens us Data Storage
- 8. Blockchain Layer Architecture Batch LayerDistributed Data Storage Smart IoT Edge Orchestratio n P2 P Serving Layer API layer Consensus Identity Blockchain framework
- 9. Data Integration & Processing Data Warehouse BI Platforms Big Data & NoSQL Data Science Using Best-of-Breed Technologies
- 10. And even more :)
- 11. • ~ 10,000 Identity requests • ~1,000 per min • Independent clusters in scale • Independent Streaming in scale • Distributed Data Storage • Custom Analytics platforms, cloud based. • Machine learning on flight Identity Processing: Facts
- 12. Thank you Dmitry Lavrinenko, DevOps Solutions Architect