GA-facilitated classifier optimization with varying similarity measures

Michael R. Peterson, Travis E. Doom, Michael L. Raymer

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Genetic algorithms are powerful tools for k-nearest neighbors classification. Traditional knn classifiers employ Euclidian distance to assess neighbor similarity, though other measures may also be used. GAs can search for optimal linear weights of features to improve knn performance using both Euclidian distance and cosine similarity. GAs also optimize additive feature offsets in search of an optimal point of reference for assessing angular similarity using the cosine measure. This poster explores weight and offset optimization for knn with varying similarity measures, including Euclidian distance (weights only), cosine similarity, and Pearson correlation. The use of offset optimization here represents a novel technique for enhancing Pearson/knn classification performance. Experiments compare optimized and non-optimized classifiers using public domain datasets. While unoptimized Euclidian knn often outperforms its cosine and Pearson counterparts, optimized Pearson and cosine knn classifiers show equal or improved accuracy compared to weight-optimized Euclidian knn.
Original languageEnglish
Title of host publicationGECCO 2005 - Genetic and Evolutionary Computation Conference
EditorsHans-Georg Beyer
Place of PublicationNew York, NY
PublisherAssociation for Computing Machinery
Pages1549-1550
Number of pages2
ISBN (Print)978-1-59593-010-1
DOIs
StatePublished - 2005
EventGECCO 2005 - Genetic and Evolutionary Computation Conference - Washington, D.C., United States
Duration: Jun 25 2005Jun 29 2005

Conference

ConferenceGECCO 2005 - Genetic and Evolutionary Computation Conference
Country/TerritoryUnited States
CityWashington, D.C.
Period6/25/056/29/05

ASJC Scopus Subject Areas

  • General Engineering

Keywords

  • Dimensionality reduction
  • Genetic algorithms
  • K-nearest neighbors
  • Pattern recognition

Disciplines

  • Computational Biology

Cite this