Skip to main navigation Skip to search Skip to main content

Evaluating and comparing classifiers: Review, some recommendations and limitations

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

32 Citations (Scopus)

Abstract

Performance evaluation of supervised classification learning method related to its prediction ability on independent data is very important in machine learning. It is also almost unthinkable to carry out any research work without the comparison of the new, proposed classifier with other already existing ones. This paper aims to review the most important aspects of the classifier evaluation process including the choice of evaluating metrics (scores) as well as the statistical comparison of classifiers. Critical view, recommendations and limitations of the reviewed methods are presented. The article provides a quick guide to understand the complexity of the classifier evaluation process and tries to warn the reader about the wrong habits.

Original languageEnglish
Title of host publicationProceedings of the 10th International Conference on Computer Recognition Systems, CORES 2017
EditorsMarek Kurzynski, Michal Wozniak, Robert Burduk
PublisherSpringer Verlag
Pages12-21
Number of pages10
ISBN (Print)9783319591612
DOIs
Publication statusPublished - 2018
Event10th International Conference on Computer Recognition Systems, CORES 2017 - Polanica-zdroj, Poland
Duration: 22 May 201724 May 2017

Publication series

NameAdvances in Intelligent Systems and Computing
Volume578
ISSN (Print)2194-5357

Conference

Conference10th International Conference on Computer Recognition Systems, CORES 2017
Country/TerritoryPoland
CityPolanica-zdroj
Period22/05/1724/05/17

Keywords

  • Classifier evaluation
  • Performance metrics
  • Statistical classifier comparison
  • Supervised classification

ASJC Scopus subject areas

  • Control and Systems Engineering
  • General Computer Science

Fingerprint

Dive into the research topics of 'Evaluating and comparing classifiers: Review, some recommendations and limitations'. Together they form a unique fingerprint.

Cite this