PyTorch 1.10 Focuses on Improved Training and Performance
Written by Kay Ewbank   
Thursday, 02 December 2021

PyTorch, Facebook's open-source deep-learning framework, has been updated with an integration with CUDA Graphs API.  The new version also has better performance thanks to JIT compiler updates, as well as beta support for the Android Neural Networks API (NNAPI). Two new libraries, TorchVision and TorchAudio have also been released.



The support for Android NNAPI means Android apps can use hardware accelerators such as GPUs and neural processing units. It is now included as a beta feature with improvements including being able to run tests on mobile hosts and support for flexible tensor shapes. The CUDA Graphs APIs integration is another beta inclusion, and is designed to improve the runtime performance where workloads are CPU-bound by using a GPU. The way this works is that the workload is sent to the GPU, and the results are captured and reused at runtime. This obviously loses flexibility but gains a more acceptable performance.

A number of features in the new release are now moved from beta to production, including a module for remote communication, the training memory optimizer, and the handler for distributed data parallel communications.

The FX module is also now marked as stable. This consists of a symbolic tracer, an intermediate representation, and a Python code generator. The module gives developers the tools to create their own custom transformations. You can take a module and convert it to a graph representation that can then be modified in code. The resulting graph can then be converted to PyTorch compatible Python source code.


More Information

PyTorch Website

PyTorch On GitHub

Related Articles

PyTorch 1.8 Improves FFT Support

PyTorch Adds New APIs

PyTorch Scholarship Challenge

PyTorch Developer Day Updates

PyTorch Adds TorchScript API

PyTorch 1.5 Updates C++ API 


To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on Twitter, Facebook or Linkedin.


BASIC Turns 60

On May 1,1964 the first BASIC program ran and the world was about to change. Now when we look back it is easy to be critical, but these were different times.

OpenAI Introduces GPT-4o, Loses Sutskever

It's an eventful week for OpenAI, the research company dedicated to making advances towards Artificial General Intelligence that are both safe and beneficial to all. A day after it showcased its lates [ ... ]

More News

raspberry pi books



or email your comment to:

Last Updated ( Thursday, 02 December 2021 )