Alpa: Automating Model Sharding for Distributed Deep Learning – InfoQ

This led to an increased effort within the deep learning community to develop larger models. To keep up with the growing network size, …

Link to Full Article: Read Here