Knowledge simplification of hierarchical neural network for multidimensional pattern recognition problems

Satoru Suzuki, Yasue Mitsukura

研究成果: Conference contribution


The purpose of this study is to delete the redundant connections of hierarchical neural network constructed for solving pattern recognition problem with images. The performance of neural network changes depending on the number of hidden units. For example, a lot of hidden units cause the over-fitting problem and make it difficult to understand the role of hidden units. In order to diminish the redundant connections, we propose the connection elimination method by using genetic algorithm. Firstly, walsh-hadamard transform is applied to images for feature extraction. Secondly, neural network is trained with extracted features based on back-propagation algorithm. Finally, redundant connections are eliminated by optimization processing with genetic algorithm. In order to show the effectiveness of the proposed method, computer simulation is performed for face recognition examples. From the simulation results, it was confirmed that our proposed method was useful for eliminating redundant connections of neural network, maintaining recognition performance at high level.

ホスト出版物のタイトルProceedings of SICE Annual Conference 2010, SICE 2010 - Final Program and Papers
出版社Society of Instrument and Control Engineers (SICE)
出版ステータスPublished - 2010


名前Proceedings of the SICE Annual Conference

ASJC Scopus subject areas

  • 制御およびシステム工学
  • コンピュータ サイエンスの応用
  • 電子工学および電気工学


「Knowledge simplification of hierarchical neural network for multidimensional pattern recognition problems」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。