TY - GEN
T1 - Convolutional Nets Versus Vision Transformers for Diabetic Foot Ulcer Classification
AU - Galdran, Adrian
AU - Carneiro, Gustavo
AU - Ballester, Miguel A.González
N1 - Publisher Copyright:
© 2022, Springer Nature Switzerland AG.
PY - 2022
Y1 - 2022
N2 - This paper compares well-established Convolutional Neural Networks (CNNs) to recently introduced Vision Transformers for the task of Diabetic Foot Ulcer Classification, in the context of the DFUC 2021 Grand-Challenge, in which this work attained the first position. Comprehensive experiments demonstrate that modern CNNs are still capable of outperforming Transformers in a low-data regime, likely owing to their ability for better exploiting spatial correlations. In addition, we empirically demonstrate that the recent Sharpness-Aware Minimization (SAM) optimization algorithm improves considerably the generalization capability of both kinds of models. Our results demonstrate that for this task, the combination of CNNs and the SAM optimization process results in superior performance than any other of the considered approaches.
AB - This paper compares well-established Convolutional Neural Networks (CNNs) to recently introduced Vision Transformers for the task of Diabetic Foot Ulcer Classification, in the context of the DFUC 2021 Grand-Challenge, in which this work attained the first position. Comprehensive experiments demonstrate that modern CNNs are still capable of outperforming Transformers in a low-data regime, likely owing to their ability for better exploiting spatial correlations. In addition, we empirically demonstrate that the recent Sharpness-Aware Minimization (SAM) optimization algorithm improves considerably the generalization capability of both kinds of models. Our results demonstrate that for this task, the combination of CNNs and the SAM optimization process results in superior performance than any other of the considered approaches.
KW - Convolutional Neural Networks
KW - Diabetic Foot Ulcer Classification
KW - Sharpness-Aware Optimization
KW - Vision Transformers
UR - https://www.scopus.com/pages/publications/85124157677
U2 - 10.1007/978-3-030-94907-5_2
DO - 10.1007/978-3-030-94907-5_2
M3 - Conference contribution
AN - SCOPUS:85124157677
SN - 9783030949068
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 21
EP - 29
BT - Diabetic Foot Ulcers Grand Challenge - 2nd Challenge, DFUC 2021, Held in Conjunction with MICCAI 2021, Proceedings
A2 - Yap, Moi Hoon
A2 - Cassidy, Bill
A2 - Kendrick, Connah
PB - Springer Science and Business Media Deutschland GmbH
T2 - 2nd Diabetic Foot Ulcers Grand Challenge, DFUC 2021 held in conjunction with 24th International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2021
Y2 - 27 September 2021 through 27 September 2021
ER -