Supercomputers can accelerate machine learning progress and enable a world with machine …

Supercomputers can accelerate machine learning progress and enable a world with machine …

The Sunway TiahuLight machine is the fastest supercomputer in the world running on the 10 million-core with a peak of 125 petaflops.The TaihuLight supercomputer is being harnessed for some interesting work on deep neural networks. What is fascinating here is that currently, the inference side of such workloads can scale to many processors, but the training side is often scale-limited hardware and software-wise.Fu described an ongoing project on the Sunway TaihuLight machine to develop an open source deep neural network library and make the appropriate architectural optimization for both high performance and efficiency on both the training and inference parts of deep learning workloads. “Based on this architecture, we can provide support for both single and double precision as well as fixed point,” he explains. The real challenge, he says,…


Link to Full Article: Supercomputers can accelerate machine learning progress and enable a world with machine …