Mechanical Turk Launches Categorization App
Written by Lucy Black   
Wednesday, 23 May 2012

Amazon's Mechanical Turk has just introduced a Categorization App that should make it easier to get accurate results on categorization projects.

Given that Mechanical Turk has been going since 2005 it is a bit surprising that it has taken so long to devise an app that streamlines the process of specifying a categorization task - but then this crowdsourcing venture that recruits ten of thousands of "workers" to complete "HITs" - Human Intelligence Tasks for "Requesters" is still in beta.

The new facility is designed to help Requesters who have tasks that involve categorization. This type of project is a common one on Mechanical Turk and is often used by organizations to clean dirty data. According to the blogpost announcing the new app:

Categorization is one of the most common use cases for Mechanical Turk.  A categorization HIT is one that asks a Worker to select from a list of options.  Categorization projects are used by many companies for many different reasons. For instance, a retailer‘s categorization project may ask Workers to "Select the product category for this item.”  A listing or directory service may ask Workers “Is this the correct web address for this business?” Or a stock photo site may ask Workers “Is this image a photo or illustration?”

The app is intended to help with every part of defining the HIT - including recruiting pre-qualified Master Worker, eliminating the step of devising a test to screen Workers before accepting them and also providing a pricing recommendation. Essentially it uses forms to go through the steps of supplying categories and providing instruction without requiring Requesters to edit HTML to add radio buttons and label.

The App also arranges that a HIT will be completed by two Master Workers because experience has shown that when two Masters agree on an answer, there is a higher level of accuracy. And where there's disagreement the  instructions can be modified to clarify what is required.

The new app should make Mechanical Turk more attractive to new Requesters and, by encouraging Workers to become Categorization Masters who will receive fair remuneration based on the complexity of the task, should also appeal to Workers.


More Information

Announcing the Mechanical Turk Categorization App

Mechanical Turk

Related Articles

Crowd sourcing replaces journalists


To be informed about new articles on I Programmer, subscribe to the RSS feed, follow us on Google+, Twitter, Linkedin or Facebook, install the I Programmer Toolbar or sign up for our weekly newsletter.



The DevOps with Docker Course From Finland

A course by Jami Kousa of University of Helsinki teaches Docker from zero to hero. It's free and self-paced and contains a lot of material you need to work through from start to finish.

BitLocker Defeated Using Logic Analyser

Security is hard, very hard, in fact so hard that I really don't think a device can be secure if you have physical access to it. To prove the point news that Bitlocker can be bypassed if you have a ch [ ... ]

More News


Summer SALE Kindle 9.99 Paperback $10 off!!




or email your comment to:


Last Updated ( Wednesday, 23 May 2012 )