Skip to search boxSkip to navigationSkip to main content

AIROGS: Artificial Intelligence for Robust Glaucoma Screening Challenge

  • Coen De Vente(corresponding author)
    ,
  • Koenraad A. Vermeer
    ,
  • Nicolas Jaccard
    ,
  • He Wang
    ,
  • Hongyi Sun
    ,
  • Firas Khader
*Corresponding author for this work
  • Radboud University Nijmegen
    ,
  • University of Amsterdam
    ,
  • Amsterdam University Medical Center
    ,
  • The Rotterdam Eye Hospital
    ,
  • ORBIS International
    ,
  • Chinese Academy of Medical Sciences
Research Output:
Contribution to journal
Article
Research
Peer-review

Open access

Abstract

<p>The early detection of glaucoma is essential in preventing visual impairment. Artificial intelligence (AI) can be used to analyze color fundus photographs (CFPs) in a cost-effective manner, making glaucoma screening more accessible. While AI models for glaucoma screening from CFPs have shown promising results in laboratory settings, their performance decreases significantly in real-world scenarios due to the presence of out-of-distribution and low-quality images. To address this issue, we propose the Artificial Intelligence for Robust Glaucoma Screening (AIROGS) challenge. This challenge includes a large dataset of around 113,000 images from about 60,000 patients and 500 different screening centers, and encourages the development of algorithms that are robust to ungradable and unexpected input data. We evaluated solutions from 14 teams in this paper and found that the best teams performed similarly to a set of 20 expert ophthalmologists and optometrists. The highest-scoring team achieved an area under the receiver operating characteristic curve of 0.99 (95% CI: 0.98-0.99) for detecting ungradable images on-the-fly. Additionally, many of the algorithms showed robust performance when tested on three other publicly available datasets. These results demonstrate the feasibility of robust AI-enabled glaucoma screening.</p>

Research Output Information

Output type

Research Output:
Contribution to journal
Article
Research
Peer-review

Original language

English

Pages from-to (Number of pages)

Pages 542-557 (16 pages)

Journal (Volume, Issue Number)

IEEE Transactions on Medical Imaging (Volume 43, Issue 1)

Publication milestones

  • Accepted/In press - 2023
  • Published - 01/01/2024

Publication status

Published - 01/01/2024

ISSN

0278-0062

Publication IDs

  • Scopus: 85169909301
  • PubMed: 37713220

Publication metrics

Metrics

Scopus
citations
Download statistics
Download count
15
SciVal
citations
76
SciVal
FWCI
7.30
SciVal
Author count
36
SciVal
Paper percentile
98
SciVal
Top percentile
5

PlumX, opens in new tab

Citation count
77
Captures
105