Apache Bigtop,used for packaging, testing, and configuration of the open source components that make up the Hadoop infrastructure, has been updated with a major new version. Bigtop 3 now has support for continuous integration testing based on Jenkins. 

Bigtop works with a wide range of components and projects, including Hadoop, HBase and Spark. Apache's aim for Bigtop is to build a community around the packaging, deployment and interoperability testing of Hadoop-related projects. Bigtop supports the wider selection that makes up the Hadoop-related projects, including Hbase, Pig, Hive MapReduce, Zookeeper and Avro. For virtualization, Bigtop provides vagrant recipes, raw images, and (work-in-progress) docker recipes for deploying Hadoop from zero.

Version 3 has been updated to support up-to-date versions of major components such as Hadoop, Hive and Spark, with other components also upgraded so that they are compatible with the major ones.

Fedora 33 and Ubuntu 20.04 have been added as the supported distros. There's also new support for ppc64le, which has been added in addition to x86_64 and aarch64.

Another improvement to version 3.0 is for continuous integration (CI) testing. Apache Bigtop uses Jenkins for continuous integration testing, and there is a Jenkins server currently running for the project. Jenkins is a leading open source automation server that provides hundreds of plugins to support building, deploying and automating any project. As an extensible automation server, Jenkins can be used as a simple CI server.

Other recent improvements to Bigtop include the addition of Bigtop Mpack, meaning that users can deploy Bigtop components via Apache Ambari. The Livy and ELK stack (Elasticsearch, Logstash, Kibana) were also added as components.

The latest version is available on the Apache Bigtop website.

More Information

Apache Bigtop Site 

Bigtop Jenkins Server For CI Testing

Related Articles

Apache Bigtop 1.4 Adds Smoke Test

Apache Bigtop Adds OpenJDK 8 Support 

To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on Twitter, Facebook or Linkedin.

Comments

Make a Comment or View Existing Comments Using Disqus

or email your comment to: comments@i-programmer.info