Apache SINGA
A distributed deep learning platform .
|
ParamInfo is used to construct a parameter shard. More...
#include <trainer.h>
Public Member Functions | |
ParamInfo (shared_ptr< Param > p, int local, int owner) | |
void | AddParam (shared_ptr< Param > p, int local, int owner) |
Associate the counter to a Param object. More... | |
Public Attributes | |
int | num_update |
int | next_version |
all counters are atomic | |
int | num_local |
local workers uses the shared parameter | |
int | num_total |
total workers uses the shared parameter | |
int | owner_procs |
the procs id of the worker that owns the parameter | |
vector< shared_ptr< Param > > | shares |
ParamInfo is used to construct a parameter shard.
For each worker group: Every unique Param object is associated with a ParamCounter object whose param field points the to Param object itself.
Param objects sharing the same values (due to data parallelism) are associated with the same ParamCounter whose param field also shares the same values.
Usage: we need to aggregate gradients from all workers for the shared parameters before sending the update request. The nUpdate counter counts the number.
TODO test with different physical architectures.
|
inline |