SlideShare a Scribd company logo
©2018 Xanadu Big Data, LLC All Rights Reserved www.xanadubigdata.com
Xanadu Based
Big Data CBIR System:
Automated Astronomical Objects
Classification & Identification
1Q 2018
Alex G. Lee (alexglee@xanadubigdata.com)
©2018 Xanadu Big Data, LLC All Rights Reserved
Index for Part I: Xanadu Introduction
-Xanadu Functionality
-Xanadu Performance BMT
-Xanadu based Big Data Archive
-Xanadu Big Data Deep Learning Integration
©2018 Xanadu Big Data, LLC All Rights Reserved
Xanadu provides Resilient, Durable, Scalable, Consistent Distributed Big
Data Database. Xanadu enables competitive big data management in the
Clouds or Enterprises
Xanadu Functionality
K
AnyTypes&SizeofData
NoSQL Database
Data De-duplication
Data Replication
Massively Scalable Fault Tolerance
Data Store
NoSQL
Database
ACID Compliance
High
Throughput
Low Latency
Data
Access
©2018 Xanadu Big Data, LLC All Rights Reserved
Xanadu Performance BMT
©2018 Xanadu Big Data, LLC All Rights Reserved
Deduplication functionality reduces the actual storage footprint by recognizing
duplicate data and maintaining only as many copies as it needs to assure its
availability.
Time stamping functionality provides inherent (built-in) backup of the database.
ACID compliance guarantees reliable and consistent data update even in the face
of the storage failure.
Xanadu enables a high speed data querying archive system with massive
scalability.
Xanadu provides database for real time big data analytics.
Xanadu provides intra/inter enterprise collaborative data sharing platform.
Xanadu based Big Data Archive
©2018 Xanadu Big Data, LLC All Rights Reserved
Xanadu provides a composable architecture that can be integrated with
other big data systems: Xanadu can be integrated with Hadoop based Big
Data Deep Leaning on Local Machines & AWS Clusters.
Xanadu Big Data Deep Learning Integration
+
Total Integration
Big Data
Applications
Big Data
IT Infrastructure
Xanadu
Data Management
Platform
GPS /
GLONASS
WCDMA /
LTE
+
©2018 Xanadu Big Data, LLC All Rights Reserved
Index for Part II: Xanadu Based Medical CBIR System
-Content Based Image Retrieval (CBIR) System
-Xanadu based Astronomical CBIR System
-Automated Galaxy Type Classification
-Xanadu based Astronomical CBIR System Demo for Galaxy
Identification using 4458 Images in EFIGI Catalogue
©2018 Xanadu Big Data, LLC All Rights Reserved
CBIR is a way of searching image database using visual features of an
image as a search term to find images that share the similar visual features.
Content Based Image Retrieval (CBIR) System
source: http://www.sciencedirect.com/science/article/pii/S0925231217308445
©2018 Xanadu Big Data, LLC All Rights Reserved
As astronomy has become an immensely data-rich field, techniques
to automate the search a huge volumes of data are needed for speeding up
research process.
For some astronomical objects, assessment of pre-researched records in the
database is sufficient for quick and accurate identification. By comparing a new
astronomical images to similar images available in the database, it becomes
easier for researchers to identify a nature of the new astronomical images.
As the number of records in the database increases, the database can become
comprehensive and exhaustive resulting into an improvement in accuracy of an
identification based on the database.
Xanadu based CBIR system provides a scalable and efficient architecture that
enables archiving of such large number of records that allows quick retrieval of
relevant records on demand at a low cost.
Xanadu based Astronomical CBIR System
©2018 Xanadu Big Data, LLC All Rights Reserved
Deep learning can be used for automating galaxy type classification
Automated Galaxy Classification
©2018 Xanadu Big Data, LLC All Rights Reserved
Xanadu based Astronomical CBIR System Demo for Galaxy
Identification using 4458 Images in EFIGI Catalogue
©2018 Xanadu Big Data, LLC All Rights Reserved
Thank you
Xanadu Big Data, LLC

More Related Content

PDF
Solutions Linux 2013: Extracting value from Big Data through a new informatio...
PPTX
Cloudian HyperStore Operating Environment
PPTX
LendingClub RealTime BigData Platform with Oracle GoldenGate
PDF
Self Service Analytics at Twitch
PDF
Data Con LA 2018 - Big Data as a Service: Running Elasticsearch on Pure by Br...
PDF
AWS Earth and Space 2018 - Element 84 Processing and Streaming GOES-16 Data...
DOCX
PDF
IP EXPO Nordic: Data Science in the Cloud
Solutions Linux 2013: Extracting value from Big Data through a new informatio...
Cloudian HyperStore Operating Environment
LendingClub RealTime BigData Platform with Oracle GoldenGate
Self Service Analytics at Twitch
Data Con LA 2018 - Big Data as a Service: Running Elasticsearch on Pure by Br...
AWS Earth and Space 2018 - Element 84 Processing and Streaming GOES-16 Data...
IP EXPO Nordic: Data Science in the Cloud

What's hot (20)

PDF
Build your own Real Time Analytics and Visualization, Enable Complex Event Pr...
PDF
Big Data Landscape 2016
PPTX
Hybrid Transactional/Analytics Processing with Spark and IMDGs
PDF
A secure and dynamic multi
PPTX
Geo-Analytics with Apache Spark and In-Memory Data Grids
PPT
Counting Unique Users in Real-Time: Here's a Challenge for You!
PDF
QMeeting 2018 - Como integrar qlik e cloudera
PDF
Big Trends in Big Data
PDF
Google BigQuery is the future of Analytics! (Google Developer Conference)
PPTX
Google Developer Group - Cloud Singapore BigQuery Webinar
DOC
A secure and dynamic multi keyword ranked search scheme over encrypted cloud ...
PDF
Bigdata Machine Learning Platform
PPTX
Obfuscating LinkedIn Member Data
PPTX
Spark DC Interactive Meetup: HTAP with Spark and In-Memory Data Grids
PDF
Elastic in oil and gas
PDF
2004 Colorado Grid Computing Initiative
PPTX
From Data to Insights to Action: When Transactions and Analytics Converge
PDF
DE gitConnect
PDF
Building a Real-Time Gaming Analytics Service with Apache Druid
PDF
Google professional data engineer exam dumps
Build your own Real Time Analytics and Visualization, Enable Complex Event Pr...
Big Data Landscape 2016
Hybrid Transactional/Analytics Processing with Spark and IMDGs
A secure and dynamic multi
Geo-Analytics with Apache Spark and In-Memory Data Grids
Counting Unique Users in Real-Time: Here's a Challenge for You!
QMeeting 2018 - Como integrar qlik e cloudera
Big Trends in Big Data
Google BigQuery is the future of Analytics! (Google Developer Conference)
Google Developer Group - Cloud Singapore BigQuery Webinar
A secure and dynamic multi keyword ranked search scheme over encrypted cloud ...
Bigdata Machine Learning Platform
Obfuscating LinkedIn Member Data
Spark DC Interactive Meetup: HTAP with Spark and In-Memory Data Grids
Elastic in oil and gas
2004 Colorado Grid Computing Initiative
From Data to Insights to Action: When Transactions and Analytics Converge
DE gitConnect
Building a Real-Time Gaming Analytics Service with Apache Druid
Google professional data engineer exam dumps
Ad

Similar to Xanadu Based Big Data CBIR System:Automated Astronomical Objects Classification & Identification (15)

PPTX
Xanadu Based Big Data CBIR System:Automated Diseases Classification & Diagnosis
PPTX
BigQuery - Snowflake compete deck _ Sales _ Y21.pptx
PDF
Architecting Data Lakes on AWS
PPTX
Accelerating Data Lakes and Streams with Real-time Analytics
PPTX
Xanadu Based Blockchain Integration System Development
PDF
2018 Oracle Impact 발표자료: Oracle Enterprise AI
PDF
AWS를 통한 데이터 분석 및 처리의 새로운 혁신 기법 - 김윤건, AWS사업개발 담당:: AWS Summit Online Korea 2020
PPTX
ACDKOCHI19 - Next Generation Data Analytics Platform on AWS
PDF
Value of Data Beyond Analytics by Darin Briskman
PDF
Introduction Big Data
PPTX
Data Con LA 2018 - A tale of two BI standards: Data warehouses and data lakes...
PDF
A Tale of Two BI Standards
PPTX
Part 2: Apache Kudu: Extending the Capabilities of Operational and Analytic D...
PPTX
How to Build Continuous Ingestion for the Internet of Things
PDF
final-the-data-teams-guide-to-the-db-lakehouse-platform-rd-6-14-22.pdf
Xanadu Based Big Data CBIR System:Automated Diseases Classification & Diagnosis
BigQuery - Snowflake compete deck _ Sales _ Y21.pptx
Architecting Data Lakes on AWS
Accelerating Data Lakes and Streams with Real-time Analytics
Xanadu Based Blockchain Integration System Development
2018 Oracle Impact 발표자료: Oracle Enterprise AI
AWS를 통한 데이터 분석 및 처리의 새로운 혁신 기법 - 김윤건, AWS사업개발 담당:: AWS Summit Online Korea 2020
ACDKOCHI19 - Next Generation Data Analytics Platform on AWS
Value of Data Beyond Analytics by Darin Briskman
Introduction Big Data
Data Con LA 2018 - A tale of two BI standards: Data warehouses and data lakes...
A Tale of Two BI Standards
Part 2: Apache Kudu: Extending the Capabilities of Operational and Analytic D...
How to Build Continuous Ingestion for the Internet of Things
final-the-data-teams-guide-to-the-db-lakehouse-platform-rd-6-14-22.pdf
Ad

More from Alex G. Lee, Ph.D. Esq. CLP (20)

PDF
[Presentation] Webinar on Patent Management and Patent Asset STO in the ChatG...
PDF
Metaverse x AI x Web3 x Sustainability Convergence
PDF
Tokenization, Securitization, Monetization of Real-World Assets
PDF
Maximizing Innovation through ChatGPT Powered Patent Analysis
PDF
Maximizing AI Business Value Creation Utilizing Patents
PDF
Real-World Assets STO + Institutional DeFi Integration
PDF
Metaverse x Web3 Interoperability Overview
PDF
AI for Metaverse x Web3 Overview
PDF
NFT Web3 Metaverse Global Leaders Roundtable
PDF
Fame Universe Introduction
PDF
Metaverse Fashion Overview
PDF
Global Metaverse Fashion Innovators Roadshow
PDF
NFT Financialization Overview
PDF
Metaverse & Web3 Technology Innovation & Business Development
PDF
NFT Monetization Innovation Webinar
PDF
웹3.0기반 메타버스 응용을 위한 NFT 가치개발과 가치평가 특강
PDF
NFT for Web3 Based Metaverse Monetization Webinar.pdf
PDF
FAME UNIVERSE Fashion NFT Monetization Platform Introduction
PDF
NAVIGATING THE METAVERSE (Wiley) One Page Book Summary
PDF
FAME Universe Introduction
[Presentation] Webinar on Patent Management and Patent Asset STO in the ChatG...
Metaverse x AI x Web3 x Sustainability Convergence
Tokenization, Securitization, Monetization of Real-World Assets
Maximizing Innovation through ChatGPT Powered Patent Analysis
Maximizing AI Business Value Creation Utilizing Patents
Real-World Assets STO + Institutional DeFi Integration
Metaverse x Web3 Interoperability Overview
AI for Metaverse x Web3 Overview
NFT Web3 Metaverse Global Leaders Roundtable
Fame Universe Introduction
Metaverse Fashion Overview
Global Metaverse Fashion Innovators Roadshow
NFT Financialization Overview
Metaverse & Web3 Technology Innovation & Business Development
NFT Monetization Innovation Webinar
웹3.0기반 메타버스 응용을 위한 NFT 가치개발과 가치평가 특강
NFT for Web3 Based Metaverse Monetization Webinar.pdf
FAME UNIVERSE Fashion NFT Monetization Platform Introduction
NAVIGATING THE METAVERSE (Wiley) One Page Book Summary
FAME Universe Introduction

Recently uploaded (20)

DOCX
Viruses (History, structure and composition, classification, Bacteriophage Re...
PDF
AlphaEarth Foundations and the Satellite Embedding dataset
PDF
Phytochemical Investigation of Miliusa longipes.pdf
PPTX
TOTAL hIP ARTHROPLASTY Presentation.pptx
PDF
IFIT3 RNA-binding activity primores influenza A viruz infection and translati...
PPTX
The KM-GBF monitoring framework – status & key messages.pptx
PPT
POSITIONING IN OPERATION THEATRE ROOM.ppt
PDF
HPLC-PPT.docx high performance liquid chromatography
PDF
Placing the Near-Earth Object Impact Probability in Context
PPTX
2Systematics of Living Organisms t-.pptx
PDF
SEHH2274 Organic Chemistry Notes 1 Structure and Bonding.pdf
PPTX
2. Earth - The Living Planet Module 2ELS
PPTX
2. Earth - The Living Planet earth and life
PPT
The World of Physical Science, • Labs: Safety Simulation, Measurement Practice
PDF
Unveiling a 36 billion solar mass black hole at the centre of the Cosmic Hors...
PDF
The scientific heritage No 166 (166) (2025)
PDF
bbec55_b34400a7914c42429908233dbd381773.pdf
PDF
Formation of Supersonic Turbulence in the Primordial Star-forming Cloud
PPTX
EPIDURAL ANESTHESIA ANATOMY AND PHYSIOLOGY.pptx
PPTX
neck nodes and dissection types and lymph nodes levels
Viruses (History, structure and composition, classification, Bacteriophage Re...
AlphaEarth Foundations and the Satellite Embedding dataset
Phytochemical Investigation of Miliusa longipes.pdf
TOTAL hIP ARTHROPLASTY Presentation.pptx
IFIT3 RNA-binding activity primores influenza A viruz infection and translati...
The KM-GBF monitoring framework – status & key messages.pptx
POSITIONING IN OPERATION THEATRE ROOM.ppt
HPLC-PPT.docx high performance liquid chromatography
Placing the Near-Earth Object Impact Probability in Context
2Systematics of Living Organisms t-.pptx
SEHH2274 Organic Chemistry Notes 1 Structure and Bonding.pdf
2. Earth - The Living Planet Module 2ELS
2. Earth - The Living Planet earth and life
The World of Physical Science, • Labs: Safety Simulation, Measurement Practice
Unveiling a 36 billion solar mass black hole at the centre of the Cosmic Hors...
The scientific heritage No 166 (166) (2025)
bbec55_b34400a7914c42429908233dbd381773.pdf
Formation of Supersonic Turbulence in the Primordial Star-forming Cloud
EPIDURAL ANESTHESIA ANATOMY AND PHYSIOLOGY.pptx
neck nodes and dissection types and lymph nodes levels

Xanadu Based Big Data CBIR System:Automated Astronomical Objects Classification & Identification

  • 1. ©2018 Xanadu Big Data, LLC All Rights Reserved www.xanadubigdata.com Xanadu Based Big Data CBIR System: Automated Astronomical Objects Classification & Identification 1Q 2018 Alex G. Lee (alexglee@xanadubigdata.com)
  • 2. ©2018 Xanadu Big Data, LLC All Rights Reserved Index for Part I: Xanadu Introduction -Xanadu Functionality -Xanadu Performance BMT -Xanadu based Big Data Archive -Xanadu Big Data Deep Learning Integration
  • 3. ©2018 Xanadu Big Data, LLC All Rights Reserved Xanadu provides Resilient, Durable, Scalable, Consistent Distributed Big Data Database. Xanadu enables competitive big data management in the Clouds or Enterprises Xanadu Functionality K AnyTypes&SizeofData NoSQL Database Data De-duplication Data Replication Massively Scalable Fault Tolerance Data Store NoSQL Database ACID Compliance High Throughput Low Latency Data Access
  • 4. ©2018 Xanadu Big Data, LLC All Rights Reserved Xanadu Performance BMT
  • 5. ©2018 Xanadu Big Data, LLC All Rights Reserved Deduplication functionality reduces the actual storage footprint by recognizing duplicate data and maintaining only as many copies as it needs to assure its availability. Time stamping functionality provides inherent (built-in) backup of the database. ACID compliance guarantees reliable and consistent data update even in the face of the storage failure. Xanadu enables a high speed data querying archive system with massive scalability. Xanadu provides database for real time big data analytics. Xanadu provides intra/inter enterprise collaborative data sharing platform. Xanadu based Big Data Archive
  • 6. ©2018 Xanadu Big Data, LLC All Rights Reserved Xanadu provides a composable architecture that can be integrated with other big data systems: Xanadu can be integrated with Hadoop based Big Data Deep Leaning on Local Machines & AWS Clusters. Xanadu Big Data Deep Learning Integration + Total Integration Big Data Applications Big Data IT Infrastructure Xanadu Data Management Platform GPS / GLONASS WCDMA / LTE +
  • 7. ©2018 Xanadu Big Data, LLC All Rights Reserved Index for Part II: Xanadu Based Medical CBIR System -Content Based Image Retrieval (CBIR) System -Xanadu based Astronomical CBIR System -Automated Galaxy Type Classification -Xanadu based Astronomical CBIR System Demo for Galaxy Identification using 4458 Images in EFIGI Catalogue
  • 8. ©2018 Xanadu Big Data, LLC All Rights Reserved CBIR is a way of searching image database using visual features of an image as a search term to find images that share the similar visual features. Content Based Image Retrieval (CBIR) System source: http://www.sciencedirect.com/science/article/pii/S0925231217308445
  • 9. ©2018 Xanadu Big Data, LLC All Rights Reserved As astronomy has become an immensely data-rich field, techniques to automate the search a huge volumes of data are needed for speeding up research process. For some astronomical objects, assessment of pre-researched records in the database is sufficient for quick and accurate identification. By comparing a new astronomical images to similar images available in the database, it becomes easier for researchers to identify a nature of the new astronomical images. As the number of records in the database increases, the database can become comprehensive and exhaustive resulting into an improvement in accuracy of an identification based on the database. Xanadu based CBIR system provides a scalable and efficient architecture that enables archiving of such large number of records that allows quick retrieval of relevant records on demand at a low cost. Xanadu based Astronomical CBIR System
  • 10. ©2018 Xanadu Big Data, LLC All Rights Reserved Deep learning can be used for automating galaxy type classification Automated Galaxy Classification
  • 11. ©2018 Xanadu Big Data, LLC All Rights Reserved Xanadu based Astronomical CBIR System Demo for Galaxy Identification using 4458 Images in EFIGI Catalogue
  • 12. ©2018 Xanadu Big Data, LLC All Rights Reserved Thank you Xanadu Big Data, LLC