Apache hadoop pig overview and introduction
Download as PPTX, PDF1 like699 views
The document provides an overview of Apache Hadoop and its ecosystem, emphasizing the Apache Pig framework for data processing. It details features, sample scripts, and advanced functions of Apache Pig, alongside mechanisms for loading and analyzing data. Additionally, it mentions various client APIs and connections available for interacting with Pig.
Apache hadoop pig overview and introduction
- 1. Apache HADOOP Overview & Introduction
- 2. HADOOP Architecture Eco System Components
- 3. Apache Pig
- 4. Apache Pig Frame work
- 5. Apache Pig Data Processing 1. Schema on Read policy 2. No Meta Store 3. Processing control 4. Set Mappers 5. Integrations 6. File Formats 7. User defined functions 8. Script execution plan 9. Data set splitting PIG Supports
- 6. Apache Pig Script Creation
- 7. Apache Pig Features 1. Data Types 2. Data Sets 3. Data Set Joins 4. Foreach 5. Joins 6. Grouping 7. Filtering 8. Storing 9. Union 10.CoGroup
- 8. Apache Pig Sample Script
- 9. Apache Pig First Script A = LOAD '/user/mapr/training/pig/emp.csv' USING PigStorage(',') AS (id, firstname, lastname, designation, city); STORE A INTO '/user/mapr/training/pig/output'; DUMP A INTO '/user/mapr/training/pig/output';
- 10. Apache Pig Example Scripts X = LOAD '/user/mapr/training/pig/emp_pig1.csv' USING PigStorage(',') AS (id, firstname, lastname, designation, city); Y = LOAD '/user/mapr/training/pig/emp_pig2.csv' USING PigStorage(',') AS (id, firstname, lastname, designation, city); Z = JOIN X by (designation), Y BY (designation); final = FILTER Z by X::designation MATCHES 'Manager'; A = GROUP X BY city; B = FOREACH X GENERATE id, designation; STORE final INTO '/user/mapr/training/pig/output'; PIG – More Samples
- 11. Apache Pig Advanced Scripts PIG – Advanced
- 12. Apache Pig Functions PIG – User Defined Functions
- 14. Apache Pig Interfaces and Connections 1.PIG Grunt 2.Java Client API 3.Python API 4.Hive connectors 5.HBase Connectors 6.Alternatives 7.Cascading
- 15. Learn HADOOP Contact: USA: +1 732 325 1626 India: +91 800 811 4040 Mail: info@bigclasses.com /bigclasses /bigclasses /bigclasses http://bigclasses.com/hadoop-online-training.html
- 16. Watch HADOOP DEMO Videos On YouTube www.youtube.com/user/bigclassescom