Current Location:home > Detailed Browse

Article Detail

Network of Recurrent Neural Networks

Submit Time: 2017-10-02
Author: Wang, Chao-Ming 1 ;
Institute: 1.Beijing Jiaotong University;

Abstracts

We describe a class of systems theory based neural networks called "Network Of Recurrent neural networks" (NOR), which introduces a new structure level to RNN related models. In NOR, RNNs are viewed as the high-level neurons and are used to build the high-level layers. More specifically, we propose several methodologies to design different NOR topologies according to the theory of system evolution. Then we carry experiments on three different tasks to evaluate our implementations. Experimental results show our models outperform simple RNN remarkably under the same number of parameters, and sometimes achieve even better results than GRU and LSTM.
Download Comment Hits:5710 Downloads:1663
From: Chao-Ming Wang
DOI:10.12074/201710.00001
Recommended references: Wang, Chao-Ming.(2017).Network of Recurrent Neural Networks.[ChinaXiv:201710.00001] (Click&Copy)
Version History
[V1] 2017-10-02 14:04:18 chinaXiv:201710.00001V1 Download
Related Paper

Download

Current Browse

Cross Subject Browse

  • - NO