Apache Bigtop 1.4 Adds Smoke Test
Written by Kay Ewbank   
Monday, 26 August 2019

Apache Bigtop has been updated with a new version of its integration test Framework, and a newly developed Smoke Test CI Matrix to guard the quality of releases. 

Bigtop is an Apache Foundation project that you can use for packaging, testing, and configuration of the big name open source big data components that make up the Hadoop infrastructure. Bigtop works with a wide range of components and projects, including Hadoop, HBase and Spark. Apache's aim for Bigtop is to build a community around the packaging, deployment and interoperability testing of Hadoop-related projects. Bigtop supports the wider selection that makes up the Hadoop-related projects, including Hbase, Pig, Hive MapReduce, Zookeeper and Avro. For virtualization, Bigtop provides vagrant recipes, raw images, and (work-in-progress) docker recipes for deploying Hadoop from zero.


The integration test framework aims to provide a one stop integrated Hadoop ecosystem build and test solutions inside Docker. You can control it using a single Gradle command.

The newly developed Smoke Test CI Matrix is gradle based, and aims to make it simple to customize and test Apache BigTop's Hadoop distribution. Using it, you can easily add new tests to Bigtop without adding new directories or xml files. The developers say it debugs tests easily makes logging transparent, and can generate easy to read test reports. You can use it to run Bigtop tests without needing a jar file, and ideally without needing gradle or maven. Is what is probably an overstatement, the developers say the framework makes testing with Apache Bigtop easy as well as fun!

The new release also updates support for Hadoop 2.8.5, Kafka 1.1.1, Spark 2.4.0, and Alluxio 1.8.1 It also includes new smoke tests for Flink and Giraph (Crunch).

The latest version is available on the Apache Bigtop website.


More Information

Apache Bigtop Site 

Related Articles

Apache Bigtop Adds OpenJDK 8 Support

Hadoop Adds Resource Estimator 

Hadoop Adds In-Memory Caching

Hadoop SQL Query Engine Launched

Hadoop 2 Introduces YARN

Spark Gets NLP Library 


To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on, Twitter, Facebook or Linkedin.


Pluralsight Insights Into Upskilling

A survey from Pluralsight into workplace skill development has revealed key disparities between the upskilling needs of employees and the approaches taken by employers.

Spot Responds To Covid-19

Spot, Boston Dynamics first commercial robot, is finding new roles as a sheep dog in New Zealand, a park warden in Singapore and as a nursing auxiliary in Massachusetts. Good dog. 

More News





or email your comment to: comments@i-programmer.info

Last Updated ( Monday, 26 August 2019 )