Xanadu Big Data Platform Technology Introduction
2 likes1,180 views
Xanadu is an advanced big data management platform developed in collaboration with Oxford University, featuring a scalable, fault-tolerant NoSQL key-value-time database with ACID properties. It supports real-time analytics and complex queries, enabling developers to process large datasets, with use cases demonstrated in radio astronomy and location tracking systems. The platform promotes efficient data management through deduplication and immutability, ensuring data remains accessible while minimizing storage requirements.
Xanadu Big Data Platform Technology Introduction
- 1. ©2016 Xanadu Big Data, LLC All Rights Reserved www.xanadubigdata.com Xanadu Big Data Management Platform Technology Introduction
- 2. ©2016 Xanadu Big Data, LLC All Rights Reserved©2016 Xanadu Big Data, LLC All Rights Reserved Index -Overview -Benchmark -Use Cases -Applications
- 3. ©2016 Xanadu Big Data, LLC All Rights Reserved Xanadu is the most advanced big data management platform technology developed originally in collaboration with researchers at Oxford University. Overview ©2016 Xanadu Big Data, LLC All Rights Reserved K Data Access NoSQL Database Users Query Retrieve Data Access Web & Applications Web, Application Developers Big Data Analytics Data Scientists AnyTypes&SizeofData
- 4. ©2016 Xanadu Big Data, LLC All Rights Reserved Xanadu enables the NoSQL write-only (archiving) key-value-time database functionality with ACID properties. NoSQL databases are designed to deliver faster performance than traditional Relational Database Management Systems (RDBMS) in many cases, particularly when big data is involved. The ACID properties are essential for the mission-critical systems. The ACID properties are also essential for many predictive analysis. Key-value-time store (time series of all key-value pairs) facilitates easy extraction and analysis based on multiple time series. Overview ©2016 Xanadu Big Data, LLC All Rights Reserved
- 5. ©2016 Xanadu Big Data, LLC All Rights Reserved Xanadu provides a highly scalable, available, fault tolerant, de- duplicated, immortal, and high performance big data store. Scalability enables speed and/or storage capacity grows linearly as extra servers are added. Xanadu reduces the actual storage footprint by recognizing duplicate data and maintaining only as many copies as it needs to assure its availability. Immortal data is never deleted or modified once written. Overview ©2016 Xanadu Big Data, LLC All Rights Reserved
- 6. ©2016 Xanadu Big Data, LLC All Rights Reserved Xanadu exploits the Distributed File System (DFS) technology using commodity servers and storage devices. Overview
- 7. ©2016 Xanadu Big Data, LLC All Rights Reserved Xanadu enables database with built-in massively parallel big data processing exploiting the DFS (e.g., data intensive deep learning applications). Xanadu enables real-time big data analytics (e.g. Industrial IoT applications). Xanadu enables Javascript-based, complex, integrated, parallel queries. This feature lowers the entry barrier for developers using the most widespread web programming language to transform themselves into powerful, high-valued 'data scientists.' Xanadu provides a presentation layer to enable the insights of the big data analytics to be presented on the web. Overview
- 8. ©2016 Xanadu Big Data, LLC All Rights Reserved Benchmark: Performance Tests with Yahoo Cloud Storage Benchmarks on Rackspace cloud servers
- 9. ©2016 Xanadu Big Data, LLC All Rights Reserved Benchmark: Scalability Tests show that it is possible (with a new approach to fundamentals) to introduce ACID properties while even improving performance.
- 10. ©2016 Xanadu Big Data, LLC All Rights Reserved Use Case: SKA - Big Data Analysis At SKA, the radio telescopes collect massive amount of data everyday - so called “Big Data”. Xanadu helps radio astronomers to process information and answer some of the big questions about the Universe by deriving insight from complex, large data sets. 3-Dimensional Source Finding DuChamp Source Finder Process Emulation Xanadu_Analytics Big Data NoSQL Database Data De-duplication Data Replication Xanadu_Store Reduced & Enhanced Data Archiving Information Service Report Generator Data Management Xanadu_Web Data Access Data Access WebApp MobileApp -SKA Largest & Most Sensitive Radio Telescope1,000 petabytes/day, 1018 operations/sec -theSkyNet Cloud Computing for Radio Astronomy Dataover 1 billion jobs processed in 2012 Data Science Xanadu provides powerful tools & APIs for processing data. This provide a gateway through which Javascript programmers could develop into fully fledged Data Scientists.
- 11. ©2016 Xanadu Big Data, LLC All Rights Reserved Use Case: Xanadu with Kinetic/Ember System Kinetic system is a simulator of Seagate where the data saves in system hard disk, where Ember system is a real hardware works on Seagate software called KINETIC API. .
- 12. ©2016 Xanadu Big Data, LLC All Rights Reserved Application: Cloud Storage WebApp Storage Cloud Service User Management MobileApp Anytime, Anywhere, Any Device Put files in Xanadu and get to it from your computers, phones, or tablets. Contents Management Xanadu_Web key-value store WebApp MobileApp http firewall internet NoSQL Database Data De-duplication Data Replication Xanadu_Store User can be in the Cloud or Enterprises Share with confidence Share your files with friends & work with your team without worry of losing data. Data in Xanadu is never deleted, but values are updated over time. Immortal Data Store
- 13. ©2016 Xanadu Big Data, LLC All Rights Reserved NoSQL Database Client Account Xanadu_Store Cargo Profile Device Management Location Data Geographic Information Location Tracking System Xanadu_Web Mobile Service Web Service Billing Statistic Report Data Feed key-value store GPS / GLONASS WCDMA / LTE VPN WebApp MobileApp WebApp MobileApp internet User Administrator Tracking Device Space-based satellite navigation system that provides location and time information Location Database to capture, store, manipulate, analyze, manage, and present all types of geographical data Application: Location Tracking System
- 14. ©2016 Xanadu Big Data, LLC All Rights Reserved Thank you Contact: Alex G. Lee (alexglee@xanadubigdata.com))