IBM's TrueNorth Simulates 530 Billion Neurons
Written by Mike James   
Friday, 23 November 2012

IBM Research has broken new ground with a simulation of 530 billion neurons in a network modeled on the connectivity of a monkey brain - almost enough for a complete working brain.

The paper detailing the system involved "TrueNorth" is simply titled 1014 which is the number of synapses simulated. The simulation of TrueNorth was run on the IBM Blue Gene/Q super computer at Lawrence Livermore Labs.

The figures make impressive reading. The system simulated 2 billion neurosynaptic cores, which contained the 530 billion neurons and the 1014synapses. The whole thing was running only 1500 times slower than the real hardware would have. By comparison the human brain is estimated to have between 0.6 to 2.4 x 1014 synapses.

The research is IBM's effort towards DARPA's Systems of Neuromorphic Adaptive Plastic Scalable Electronics (SyNAPSE)project. As the research paper says:

"We have not built a biologically realistic simulation of the complete human brain. Rather, we have simulated a novel modular, scalable, non-Von Neumann, ultra-low power, cognitive computing architecture.."

The neurosynaptic cores are chips each containing 256 neurons with a connection network of 1024 axons - making a total of 1024x256 synapses. The neuronal model is based on a leaky integrate-and-fire action, which is a relatively commonly used neural network. Unlike real neurons which emit a series of pulses when they fire, these artificial neurons simply fire when the activity on their inputs summed over time exceed a threshold. This is the "integrate-and-fire" part of the description. The "leaky" simply means that the effect of an input dies away over time so that the neuron doesn't have an unlimited memory of past activity. It is generally agreed that this is a reasonable baseline model of the behavior of a biological neuron but notice that it doesn't contain any element of learning in terms of modifying the strengths of the connections - so it only models the behaviour of a fully trained brain.

 

neuroncore

 

The overall architecture of the simulation was based on a model of the brain of a monkey with the 2 billion neurosynaptic cores divided into 77 brain-inspired regions each with their own probabilistic white matter or grey matter connectivity. Again this is not an unreasonable way to organize things but it is a fairly crude approximation to the structure of a real brain. The truth of the matter is that we really have no idea how accurately we have to reproduce brain structure to reproduce the behavior. Perhaps random connections with the same statistics as the real brain is good enough - but as the neurons in the simulation have no learning capacity it is even more limited than it seems at first.

 

 

neuronmapmonkey

Neuro-synaptic cores are locally clustered into brain-inspired regions, and each core is represented as an individual point along the ring. Arcs are drawn from a source core to a destination core with an edge color defined by the color assigned to the source core.

 

As a model of the brain this is fairly crude, even if an amazing achievement, but it might well be all that is needed. No details of what the simulation achieved are provided, apart from the simple fact that it worked and proved more than possible. If you are expecting results such as the simulation showed - thought patterns, alpha waves or it learned something, then you are probably going to be disappointed. The network existed as a functioning entity for a very short time and with a time scaling factor of around 1500 for an even shorter "thinking" time about 0.5s.

It is worth noting that the neuromorphic core has been used in a number of experimental applications, including learning to play the game of Pong but in each case the learning was done off line and the resulting architecture was transferred to the network for implementation. In other words, as implemented, the network has no ability to learn. We still have some way to go before we reach the goal of a brain in a box.

You can see some of the basic ideas in the following IBM Research promo video:

 

Don't get too taken in by the glossy presentation and the appearance of the "artificial brain"  and flashing lights - this is important work but still a long way from the goal of strong AI - to create a machine intelligence of the same nature as the human brain.

 

More Information

1014

Building Block of a Programmable Neuromorphic
Substrate: A Digital Neurosynaptic Core

Cognative Computing Blog

Related Articles

The Influence Of Warren McCulloch

Near Instant Speech Translation In Your Own Voice

Flying Neural Net Avoids Obstacles

Google's Deep Learning - Speech Recognition

A Neural Network Learns What A Face Is

The Paradox of Artificial Intelligence

McCulloch-Pitts Neuron

Neural networks


To be informed about new articles on I Programmer, install the I Programmer Toolbar, subscribe to the RSS feed, follow us on, Twitter, Facebook, Google+ or Linkedin,  or sign up for our weekly newsletter.

 

blog comments powered by Disqus

Banner


Dual Screen Android App Challenge
25/03/2014

There's $100K in prize money for Android apps that display different content on an Android phone and on a connected display such as an HDTV.



Mozilla Enhances Browser-Based Gaming
21/03/2014

Mozilla  has partnered with Unity Technologies and with Epic Games in order to provide games devs with facilities for delivering superior performance and near-native speeds in Firefox.


More News

Last Updated ( Friday, 23 November 2012 )
 
 

   
RSS feed of news items only
I Programmer News
Copyright © 2014 i-programmer.info. All Rights Reserved.
Joomla! is Free Software released under the GNU/GPL License.