Why is MoE so popular, and how is Microsoft using it for their Translator API?

A mixture of experts is a deep learning model architecture consisting of multiple expert networks dividing a problem into homologous regions.

Link to Full Article: Read Here