Microsoft Open Sources AI Debugging Tool
Written by Kay Ewbank   
Friday, 12 July 2019

Microsoft has released TensorWatch, an AI debugging and visualization tool, under open source on GitHub. TensorWatch can be used to create custom visualizations, UIs and dashboards.

It can also be used to execute arbitrary queries against your live ML training process, return a stream as a result of the query and view this stream using your choice of a visualizer.

TensorWatch is a Python library that uses Jupyter Notebook instead of prepackaged user interfaces, on the basis Jupyter Notebook is easier to customize. You get the choice of using either the composable UI in Jupyter Notebooks or the live shareable dashboards in Jupyter Lab when carrying out interactive debugging of real-time training processes. You can also build your own custom UIs using Python, or choose existing Python UIs. TensorWatch also supports several standard visualization types, including bar charts, histograms, and pie charts, in 2D and 3D versions.

tensorwatch

Data in TensorWatch is treated as a stream, as are other objects including files, console, sockets, cloud storage, and visualizations. TensorWatch streams can listen to other streams, making it possible to put together custom data flow graphs.The developers say this means you can render many streams into the same visualization, or one stream can be rendered in many visualizations simultaneously, or a stream can be persisted in many files, or not persisted at all.

The other main idea used in TensorWatch is a lazy logging mode. What this means is that you don't have to set up explicit logging; instead, you can have TensorWatch observe the variables. This carries a much lower overhead, so you can track as many variables as you like, including large models or entire batches during the training.

You can then perform interactive queries that run in the context of the variables observed by TensorWatch, and get streams returned  as a result. These streams can then be visualized, saved, or processed. The developers give the example of writing a lambda expression that computes mean weight gradients in each layer in the model at the completion of each batch and sending the result as a stream of tensors that can be plotted as a bar chart.

TensorWatch also provides features for pre- and post-training phases based on existing open-source libraries to provide model graph visualization, data exploration through dimensionality reduction, model statistics, and several prediction explainers for convolution networks.

 

More Information

TensorWatch On Github

Related Articles

Kedro Open Source library For Machine Learning

How Do Open Source Deep Learning Frameworks Stack Up?

Infer.NET Machine Learning Framework Now Open Source

Databricks Runtime for Machine Learning

Machine Learning For .NET

 

To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on, Twitter, Facebook or Linkedin.

Banner


Edge - Can A New Logo Change Its Fortunes
05/11/2019

The new version of Microsoft's Edge browser, which is being built on Chromium OS,  is planned for release early next year. Its new logo has a "swoopy" design was meant to “capture the wave [ ... ]



Amazon Migrates Away From Oracle DB
24/10/2019

Amazon has completed the migration of the databases in its consumer business away from Oracle, turning off the last Oracle database, in the consumer division at least, though some third-party applicat [ ... ]


More News

graphics

 



 

Comments




or email your comment to: comments@i-programmer.info