TY - JOUR
T1 - A simple and effective method for removal of hidden units and weights
AU - Hagiwara, Masafumi
PY - 1994/4
Y1 - 1994/4
N2 - The objective of this paper is to present a simple and effective method for removal of both hidden units and weights. In this paper, we propose two methods, the 'Consuming energy' method and the 'Weights power' method, and compare them with the conventional method. According to our computer simulations using the mirror symmetry problem, the Weights power method has shown the best performance with respect to size reduction (removal of units and weights), generalization performance, and the amount of computation required. For example, the number of hidden units reduced to about 40% of the initial state, and the number of weights reduced to less than a fourth of the initial state. In addition, generalization performance was improved more than 10%.
AB - The objective of this paper is to present a simple and effective method for removal of both hidden units and weights. In this paper, we propose two methods, the 'Consuming energy' method and the 'Weights power' method, and compare them with the conventional method. According to our computer simulations using the mirror symmetry problem, the Weights power method has shown the best performance with respect to size reduction (removal of units and weights), generalization performance, and the amount of computation required. For example, the number of hidden units reduced to about 40% of the initial state, and the number of weights reduced to less than a fourth of the initial state. In addition, generalization performance was improved more than 10%.
UR - http://www.scopus.com/inward/record.url?scp=0028413960&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=0028413960&partnerID=8YFLogxK
U2 - 10.1016/0925-2312(94)90055-8
DO - 10.1016/0925-2312(94)90055-8
M3 - Article
AN - SCOPUS:0028413960
SN - 0925-2312
VL - 6
SP - 207
EP - 218
JO - Neurocomputing
JF - Neurocomputing
IS - 2
ER -