Emergence of hierarchical modes from deep learning
Large-scale deep neural networks consume expensive training costs, but the training results in less-interpretable weight matrices constructing the networks.Here, we propose a mode decomposition learning that can interpret the weight matrices as a hierarchy of latent modes.These modes are akin to patterns in physics studies of memory networks, but t