Introducing Image Classification Efficacies

Accuracy assessment is essential in all image classification-related fields, ranging from molecular imaging to earth observation. However, existing accuracy metrics are too sensitive to class imbalance or lack explicit interpretations for assessing classification performance. Consequently, their scores may be misleading when they are applied to compare classification algorithms that address different image data sources. These limitations jeopardize the widespread application of deep learning classification methods for classifying different image types. We introduce the metrics of image classification efficacy from medicine and pharmacology to overcome the limitations of accuracy metrics. We include a baseline classification to derive the metrics of image classification efficacy and apply real-world and hypothetical examples to further examine their usefulness. Image classification efficacies can be applied at the map and class levels and for binary and multiclass classifications. The interpretability and comparability of image classification efficacies facilitate reliable classification method evaluation across data sources. We detail the procedures of classification efficacy assessment for image classification researchers and classifier users.

Abstract licence: CC BY-NC-ND

1. 19.

   Convolutional neural network for the diagnosis of early gastric cancer based on magnifying narrow band imaging · 2019

2. 26.

   The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation · 2020

3. 33.

   The Matthews correlation coefficient (MCC) is more reliable than balanced accuracy, bookmaker informedness, and markedness in two-class confusion matrix evaluation · 2021

37 more references, whose wording the paper’s licence keeps private.

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.