Apache Bigtop 3 Improves CI Support
Written by Kay Ewbank   
Tuesday, 09 November 2021

Apache Bigtop,used for packaging, testing, and configuration of the open source components that make up the Hadoop infrastructure, has been updated with a major new version. Bigtop 3 now has support for continuous integration testing based on Jenkins. 

Bigtop works with a wide range of components and projects, including Hadoop, HBase and Spark. Apache's aim for Bigtop is to build a community around the packaging, deployment and interoperability testing of Hadoop-related projects. Bigtop supports the wider selection that makes up the Hadoop-related projects, including Hbase, Pig, Hive MapReduce, Zookeeper and Avro. For virtualization, Bigtop provides vagrant recipes, raw images, and (work-in-progress) docker recipes for deploying Hadoop from zero.


Version 3 has been updated to support up-to-date versions of major components such as Hadoop, Hive and Spark, with other components also upgraded so that they are compatible with the major ones.

Fedora 33 and Ubuntu 20.04 have been added as the supported distros. There's also new support for ppc64le, which has been added in addition to x86_64 and aarch64.

Another improvement to version 3.0 is for continuous integration (CI) testing. Apache Bigtop uses Jenkins for continuous integration testing, and there is a Jenkins server currently running for the project. Jenkins is a leading open source automation server that provides hundreds of plugins to support building, deploying and automating any project. As an extensible automation server, Jenkins can be used as a simple CI server.

Other recent improvements to Bigtop include the addition of Bigtop Mpack, meaning that users can deploy Bigtop components via Apache Ambari. The Livy and ELK stack (Elasticsearch, Logstash, Kibana) were also added as components.

The latest version is available on the Apache Bigtop website.


More Information

Apache Bigtop Site 

Bigtop Jenkins Server For CI Testing

Related Articles

Apache Bigtop 1.4 Adds Smoke Test

Apache Bigtop Adds OpenJDK 8 Support 


To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on Twitter, Facebook or Linkedin.


Angular and Wiz To Merge

Two web development frameworks used at Google are merging. One, Angular is open source and widely known, while the other, Wiz, is an internal web framework developed and used by Google for some o [ ... ]

The Appeal of Google Summer of Code

With the list of participating organizations now published, it is time for would-be contributors to select among them and apply for Google Summer of Code (GSoC). Rust has joined in the program fo [ ... ]

More News

raspberry pi books



or email your comment to: comments@i-programmer.info

Last Updated ( Tuesday, 09 November 2021 )