Big Data in the Cloud - Solutions & Apps
0 likes936 views
This document discusses Google Cloud Platform solutions for big data. It introduces Wally Yau from Google Cloud Platform and describes how the Google Solutions Team provides solution papers, best practices, case studies, sample applications, and live demos related to big data solutions using Google Cloud Platform technologies like BigQuery, Compute Engine, and Hadoop. Specific resources highlighted include solution papers on getting started with BigQuery and managing Hadoop clusters on Compute Engine, sample applications for Hadoop clusters on Compute Engine and an automated file loader for BigQuery, and a live demo of a data sensing lab architecture using App Engine and Compute Engine.
Big Data in the Cloud - Solutions & Apps
- 1. Big Data In The Cloud Google Solutions Team
- 2. Speaker Wally Yau Google Cloud Platform Solutions Architect http://about.me/wally_yau
- 3. Google Solutions Team Who Are We ? ● Experienced Solutions Architects ● Seasoned Software Engineers
- 4. Google Solutions Team What We Provide ? ● https://cloud.google.com/resources/ Solution Papers Best Practices Case Studies Sample Apps
- 5. Live Demos BigQuery ● ● ● Familiar SQL Interface Easy Web Interface Public data set is available ○ ○ ○ ○ Query 1 - Wikipedia Page View Query 2 - Compute Engine Instance Query 3 - Mother’s Age By State Query 4 - Mother’s Age By State/Region - Spreadsheet Integration
- 7. Solution Papers Getting Started With BigQuery https://cloud.google.com/resources/articles/getting-started-with-google-bigquery
- 8. Solution Papers Manage Hadoop Clusters on Compute Engine https://cloud.google.com/resources/articles/managing-hadoop-clusters-on-google-compute-engine
- 9. Solution Papers Apache Hadoop, Hive and Pig on Google Compute Engine https://cloud.google.com/resources/articles/apache-hadoop-hive-and-pig-on-google-compute-engine
- 10. Sample Apps
- 11. Sample Apps Google Compute Engine Cluster For Hadoop https://github.com/GoogleCloudPlatform/solutions-google-compute-engine-cluster-for-hadoop Hadoop Worker Data Files Mapper Reducer Hadoop Master Mapper Reducer Hadoop Worker Mapper Reducer Hadoop Worker Mapper Reducer
- 12. Sample Apps Automated File Loader for BigQuery https://github.com/GoogleCloudPlatform/solutions-automated-file-loader-for-bigquery
- 13. Sample Apps Using ETL Tool on Google Compute Engine https://github.com/GoogleCloudPlatform/Solutions-Using-ETL-tool-on-Google-Compute-Engine
- 14. Demos Data Sensing Lab ● ● http://data-sensing-lab.appspot.com/kiosks End to end solution using Google Cloud Platform
- 15. Demos Data Sensing Lab Architecture Google App Engine Instances Compute Engine Instances lease Tasks from Pull Queues
- 17. Feedbacks
- 18. Feedbacks