TY - GEN
T1 - Improving the detection of noisy labels in image datasets using modified Confidence Learning
AU - Popowicz, Adam
AU - Radlak, Krystian
AU - Lasota, Slawomir
AU - Szczepankiewicz, Karolina
AU - Szczepankiewicz, Michal
N1 - Publisher Copyright:
© 2022 IEEE.
PY - 2022
Y1 - 2022
N2 - The effectiveness of machine learning algorithms, including deep neural networks (DNN) for classifying image data, depends on proper preparation of the training dataset. Erroneously labeled images in the training data will degrade algorithmic efficiency and cause unpredictable model behavior, thus reduce its safety. Verifying labels in the numerous available databases remains a complicated and laborious task. In this article, we present a MultiNET approach that allows for efficient verification of labeled image datasets. We adapt a state-of-the-art technique, namely Confidence Learning, extending its flexibility and improving the effectiveness by combining outcomes from various DNN architectures. Thanks to the proposed modification, it is possible to automatically detect incorrect labels while minimizing the number of false positives, thus making the verification process much less burdensome. The technique may be of use for researchers and software engineers dealing with externally supplied image datasets.
AB - The effectiveness of machine learning algorithms, including deep neural networks (DNN) for classifying image data, depends on proper preparation of the training dataset. Erroneously labeled images in the training data will degrade algorithmic efficiency and cause unpredictable model behavior, thus reduce its safety. Verifying labels in the numerous available databases remains a complicated and laborious task. In this article, we present a MultiNET approach that allows for efficient verification of labeled image datasets. We adapt a state-of-the-art technique, namely Confidence Learning, extending its flexibility and improving the effectiveness by combining outcomes from various DNN architectures. Thanks to the proposed modification, it is possible to automatically detect incorrect labels while minimizing the number of false positives, thus making the verification process much less burdensome. The technique may be of use for researchers and software engineers dealing with externally supplied image datasets.
KW - confident learning
KW - database verification
KW - label noise
UR - https://www.scopus.com/pages/publications/85139039277
U2 - 10.1109/MMAR55195.2022.9874318
DO - 10.1109/MMAR55195.2022.9874318
M3 - Conference contribution
AN - SCOPUS:85139039277
T3 - 2022 26th International Conference on Methods and Models in Automation and Robotics, MMAR 2022 - Proceedings
SP - 158
EP - 163
BT - 2022 26th International Conference on Methods and Models in Automation and Robotics, MMAR 2022 - Proceedings
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 26th International Conference on Methods and Models in Automation and Robotics, MMAR 2022
Y2 - 22 August 2022 through 25 August 2022
ER -