2013•Journal of the Physical Society of JapanRequires access

Inter-Layer Correlation in a Feed-Forward Network with Intra-Layer Common Noise

Ryo Karakida, Yasuhiko Igarashi, Kenji Nagata, Masato Okada

Open publisher page 1 citations

Abstract

Neural networks generate correlated neural activities. In a multi-layer network, experimental studies have shown that spike correlations appear within a layer and between different layers. It is input common among neurons in each layer that realizes such correlated activities. Theoretical studies have demonstrated that common input given to neurons within a layer, which we call “intra-layer common noise”, generates spike correlation within the layer, which is “intra-layer correlation”, in a feed-forward network. However, it has not been studied whether the common noise can generate spike correlation between different layers, which is “inter-layer correlation”. In this study, we constructed a theory of inter-layer correlation and calculated the theoretical values of the inter-layer correlation in a multi-layer feed-forward network with intra-layer common noise. Our theory revealed that the common noise generates the inter-layer correlation, which coincided with results of simulation.

About this research paper

What this paper is about

Neural networks generate correlated neural activities. In a multi-layer network, experimental studies have shown that spike correlations appear within a layer and between different layers. It is input common among neurons in each layer that realizes such correlated activities. Theoretical studies have demonstrated that common input given to neurons within a layer, which we call “intra-layer common noise”, generates spike correlation within the layer, which is “intra-layer correlation”, in a feed-forward network. However, it has not been studied whether the common noise can generate spike correlation between different layers, which is “inter-layer correlation”. In this study, we constructed a theory of inter-layer correlation and calculated the theoretical values of the inter-layer correlation in a multi-layer feed-forward network with intra-layer common noise. Our theory revealed that the common noise generates the inter-layer correlation, which coincided with results of simulation.

Why it matters

OpenAlex reports 1 citations for this work. Citation counts describe recorded attention and do not establish research quality.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

Neural networks generate correlated neural activities. In a multi-layer network, experimental studies have shown that spike correlations appear within a layer and between different layers. It is input common among neurons in each layer that realizes such correlated activities. Theoretical studies have demonstrated that common input given to neurons within a layer, which we call “intra-layer common noise”, generates spike correlation within the layer, which is “intra-layer correlation”, in a feed-forward network. However, it has not been studied whether the common noise can generate spike correlation between different layers, which is “inter-layer correlation”. In this study, we constructed a theory of inter-layer correlation and calculated the theoretical values of the inter-layer correlation in a multi-layer feed-forward network with intra-layer common noise. Our theory revealed that the common noise generates the inter-layer correlation, which coincided with results of simulation.

Key concepts: Layer (electronics), Correlation, Noise (video), Network layer, Spike (software development), Artificial neural network, Biological system, Computer science

Related papers

Back to paper searchBrowse research topicsOriginal source
Inter-Layer Correlation in a Feed-Forward Network with Intra-Layer Common Noise — Research Paper | ScholarLens