Hadoopを業務で使ってみました
Download as KEY, PDF4 likes2,198 views
Hadoop is an open-source software framework for distributed storage and processing of large datasets across clusters of computers. It allows for the distributed processing of large datasets across clusters of nodes using simple programming models. Hadoop can distribute data and computations across a cluster of commodity machines and scale to thousands of nodes, handling failures in an automatic way. Common uses of Hadoop include distributed computing, big data analytics, data mining, and scientific applications.
Hadoopを業務で使ってみました
- 1. Hadoop
- 2. • id:sasata299 • • Ruby Perl •
- 3. Hadoop
- 4. 816 30 3 1
- 5. ( )
- 7. • • GROUP BY ( ( Д`) • 7000 ( )
- 9. Hadoop
- 10. Hadoop • Hadoop Streaming • Ruby • Amazon EC2 Hadoop • 50
- 11. Hadoop Streaming
- 12. • ( ) • Mapper Reducer
- 15. Java ( or JRuby ) Java API
- 16. Hadoop Streaming …orz
- 18. Hadoop cat `hadoop dfs -cat s3://xxxx/user/root/in/hoge` HDFS
- 19. 7000 ( )→
- 20. 7000 ( )→ 30
- 21. Hadoop !!
- 22. • Hadoop Streaming HDFS (Hadoop cat ) • 7000 30 Hadoop