SINGA is designed for distributed training of large deep learning models with huge amount of training data.
Here we introduce distrbuted SINGA in following aspects:
System Architecture
Training Frameworks
System Communication