EMERGENCE OF HIERARCHICAL MODES FROM DEEP LEARNING

Emergence of hierarchical modes from deep learning

Large-scale deep neural networks consume expensive training costs, but the training results in less-interpretable weight matrices constructing the networks.Here, we propose a mode decomposition learning that can interpret the weight matrices as a hierarchy of latent modes.These modes are akin to patterns in physics studies of memory networks, but t

read more