Free Combinatorial Testing Tool
Wednesday, 17 November 2010

Testing just six parameter combinations is as good as exhaustive testing - NIST has a (free) tool for that.

Banner

 

National Institute of Standards and Technology (NIST) has released the latest version of its free testing tool, complete with a new tutorial on how to use it.

The tool is a fairly specialised combinatorial testing rig called Advanced Combinatorial Testing System (ACTS). It can process tests for 2-way through 6-way interactions.  However, based on studies of crashes, it is an empirical finding that most failures (70 to 95%) are triggered by only two-variables interacting and close to 100% are triggered by no more than six. Thus the NIST concludes that combinatorial testing with 6-way interactions is as good in practice as exhaustive testing. The program also claims to implement testing efficiently by grouping tests into covering sets. 

 

 

It is important to realise that the software provided only computes the test schedules - you have to actually implement the tests. For example, if you have a code library which works on n mobile phones each using m browsers with p language engines the program will tell you which combinations need testing - you then have to create the configurations and perform the test. This means that the ACTS program can be used in a wide variety of testing situations and be built into your own larger testing framework.

The new tutorial, Practical Combinatorial Testing, introduces key concepts and methods along with explaining the use of software tools for generating combinatorial tests.  The tutorial is designed to be accessible to undergraduate students in computer science or engineering it is available from http://csrc.nist.gov/groups/SNS/acts/documents/SP800-142-101006.pdf

More information and download from:http://csrc.nist.gov/groups/SNS/acts

Banner


Google To Close Freebase and Open Up Knowledge Graph
19/12/2014

Google is shutting down Freebase, its semi-structured database of well-known people, places and things, but plans on offering access to Knowledge Graph.



Qt 5.4 Released
12/12/2014

The latest version of the Qt framework has been released with revamped and renewed web support.


More News

Last Updated ( Wednesday, 17 November 2010 )
 
 

   
RSS feed of news items only
I Programmer News
Copyright © 2014 i-programmer.info. All Rights Reserved.
Joomla! is Free Software released under the GNU/GPL License.