AIROGS: Artificial Intelligence for Robust Glaucoma Screening Challenge
- Coen De Vente(corresponding author),
- Koenraad A. Vermeer,
- Nicolas Jaccard,
- He Wang,
- Hongyi Sun,
- Firas Khader
- Radboud University Nijmegen,
- University of Amsterdam,
- Amsterdam University Medical Center,
- The Rotterdam Eye Hospital,
- ORBIS International,
- Chinese Academy of Medical Sciences
Research Output:
Contribution to journal
Article
Research
Peer-reviewOpen access
Abstract
<p>The early detection of glaucoma is essential in preventing visual impairment. Artificial intelligence (AI) can be used to analyze color fundus photographs (CFPs) in a cost-effective manner, making glaucoma screening more accessible. While AI models for glaucoma screening from CFPs have shown promising results in laboratory settings, their performance decreases significantly in real-world scenarios due to the presence of out-of-distribution and low-quality images. To address this issue, we propose the Artificial Intelligence for Robust Glaucoma Screening (AIROGS) challenge. This challenge includes a large dataset of around 113,000 images from about 60,000 patients and 500 different screening centers, and encourages the development of algorithms that are robust to ungradable and unexpected input data. We evaluated solutions from 14 teams in this paper and found that the best teams performed similarly to a set of 20 expert ophthalmologists and optometrists. The highest-scoring team achieved an area under the receiver operating characteristic curve of 0.99 (95% CI: 0.98-0.99) for detecting ungradable images on-the-fly. Additionally, many of the algorithms showed robust performance when tested on three other publicly available datasets. These results demonstrate the feasibility of robust AI-enabled glaucoma screening.</p>
Research Output Information
Output type
Research Output:
Contribution to journal
Article
Research
Peer-reviewOriginal language
EnglishPages from-to (Number of pages)
Pages 542-557 (16 pages)Journal (Volume, Issue Number)
IEEE Transactions on Medical Imaging (Volume 43, Issue 1)Publication milestones
- Accepted/In press - 2023
- Published - 01/01/2024
Publication status
Published - 01/01/2024
ISSN
0278-0062Publication IDs
- Scopus: 85169909301
- PubMed: 37713220
Publication metrics
Metrics
Download statistics
Download count
15
SciVal
citations
76
SciVal
FWCI
7.30
SciVal
Author count
36
SciVal
Paper percentile
98
SciVal
Top percentile
5
PlumX, opens in new tab
Citation count
77
Captures
105
