Faster Jigsaw Solving

New Book Reviews!

 Faster Jigsaw Solving
Written by Alex Armstrong
Monday, 18 June 2012

You might imagine that computers would be good at solving jigsaw puzzles, but the task is harder than you think. Pattern matching is fairly easy when you have a specified orientation. If you try it when you don't know which way to hold the pieces, you'll soon see the problem.

If you think that you solve a mean jigsaw, consider that the latest algorithm can manage 10,000 pieces in 24 hours - three times last year's record of 3,300 pieces. Andrew Gallagher at Cornell University in Ithaca, New York has improved the standard approach by copying what humans do  in finding groups of pieces that best match and working outwards from there.

9600-piece puzzle solved!

The algorithm tackles problems with square pieces which is harder than the traditional shaped interlocking puzzle because you have no orientation clues. It can even solve puzzles that are mixed together without being told how many puzzles the pieces come from or their dimensions.

Before you think that the problem is easy, consider how many possible arrangements there are of even a small number of pieces. Clearly you can't just try every combination - and even if you did how would you recognize that you had a solution? Indeed puzzle assembly is an NP-hard problem.

The algorithm used is a greedy tree-based method and a new measure of piece similarity. The measure of similarity is based on the well-known Mahalanobis distance, which scales the distance between distributions by their dispersion. The new measure compares pieces using the intensity gradient near the edge scaled by the covariance of the color channel. The greedy tree-based assembly builds a minimum-spanning tree with constraints to make sure that only one piece is placed against another. To make the problem tractable, a heuristic is used to find an approximate solution in reasonable time.

You can see the algorithm in action in the following two videos:

600-piece bicycle

600-piece Yosemite

If you think that jigsaw puzzles are a bit frivolous, then notice that similar algorithms can be used to put shredded documents back together - as per the recent DARPA challenge.

The real question is can you do better?

With video input being no problem and GPUs readily available, this is one AI task anyone can attempt.

Jigsaw Puzzles with Pieces of Unknown Orientation

Related Articles

DARPA Shredder Challenge

 What's Important To Get A Developer Job22/05/2018New data from HackerRank reveals that three out of four technical recruiters and hiring managers have hired individuals whose resumes would not have passed the screening process. It also warns th [ ... ] + Full Story An Exponential Law For AI Compute23/05/2018OpenAI has released an analysis showing that since 2012, the amount of compute used in the largest AI training runs has has grown by more than 300,000x. To put it another way, the computer resour [ ... ] + Full Story More News

Last Updated ( Monday, 18 June 2012 )