Hadoop 3.0 features
- 1. HADOOP 3.0.0 FEATURES WoW ..This is again the Hadoop 3.0.0 release with handful of features like enhancing High availability features with luxury of integration
- 3. JAVA 8 MINIMUM RUNTIME VERSION All Hadoop 3 JARs are compiled for a Java 8 language version, and require a Java 8 runtime version. This is also important because many libraries only support Java 8, so this bump allowing Hadoop to upgrade its dependencies to more modern versions.
- 4. ENHANCED HIGH AVAILABILITY SERVICES HDFS Name Node high availability with Quorum Journal Manager uses a Paxos quorum to store the Name Node edit log. With a three-node quorum, this change means we can tolerate the loss of any one node and still continue operation. However, business-critical deployments may wish to run with higher levels of fault-tolerance, e.g. a five-node quorum to be able to tolerate the loss of any two nodes.
- 5. SHELL SCRIPT REWRITE The Hadoop shell scripts have been rewritten with an eye toward unifying behavior, addressing numerous long-standing bugs, improving documentation, as well as adding new functionality. This update affects users who use Hadoop environment variables or integrate with the shell commands.
- 6. HDFS ENSURE CODING HDFS Erasure Coding is a major new feature, and one of the driving features for releasing Hadoop 3.0.0. and can actually improve read and write performance in some conditions.
- 7. YARN TIMELINE SERVICE The Timeline Service v2 is a new implementation that improves upon the scalability and reliability of TSv1, and enhances usability by introducing flows and aggregation.
- 8. INTRA-DATANODE BALANCER Intra-DataNode balancing functionality addresses the intra-node skew that can occur when disks are added or replaced. See the disk balancer section in the HDFS Commands Guide for more information.
- 9. MISCELLANEOUS The 3.0.0-alpha1 release is also the first release that incorporates a number of changes to the release process. We are now using Apache Yetus to automatically generate our release notes and changelog from JIRA, a vast improvement over our previous system of manually editing a text file. For webinar please contact at bigdatainandout@gmail.com