Nonlinear logistic discrimination via regularized radial basis functions for classifying high-dimensional data

Tomohiro Ando, Sadanori Konishi

Research output: Contribution to journalArticlepeer-review

3 Citations (Scopus)


A flexible nonparametric method is proposed for classifying high- dimensional data with a complex structure. The proposed method can be regarded as an extended version of linear logistic discriminant procedures, in which the linear predictor is replaced by a radial-basis-expansion predictor. Radial basis functions with a hyperparameter are used to take the information on covariates and class labels into account; this was nearly impossible within the previously proposed hybrid learning framework. The penalized maximum likelihood estimation procedure is employed to obtain stable parameter estimates. A crucial issue in the model-construction process is the choice of a suitable model from candidates. This issue is examined from information-theoretic and Bayesian viewpoints and we employed Ando et al. (Japanese Journal of Applied Statistics, 31, 123-139, 2002)'s model evaluation criteria. The proposed method is available not only for the high-dimensional data but also for the variable selection problem. Real data analysis and Monte Carlo experiments show that our proposed method performs well in classifying future observations in practical situations. The simulation results also show that the use of the hyperparameter in the basis functions improves the prediction performance.

Original languageEnglish
Pages (from-to)331-353
Number of pages23
JournalAnnals of the Institute of Statistical Mathematics
Issue number2
Publication statusPublished - 2009 Jun
Externally publishedYes


  • Bayes approach
  • Information criteria
  • Maximum penalized likelihood method
  • Radial basis functions

ASJC Scopus subject areas

  • Statistics and Probability


Dive into the research topics of 'Nonlinear logistic discrimination via regularized radial basis functions for classifying high-dimensional data'. Together they form a unique fingerprint.

Cite this