Deep Bayesian Active Learning to Rank for Endoscopic Image Data

Abstract

Automatic image-based disease severity estimation generally uses discrete (i.e., quantized) severity labels. Annotating discrete labels is often difficult due to the images with ambiguous severity. An easier alternative is to use relative annotation, which compares the severity level between image pairs. By using a learning-to-rank framework with relative annotation, we can train a neural network that estimates rank scores that are relative to severity levels. However, the relative annotation for all possible pairs is prohibitive, and therefore, appropriate sample pair selection is mandatory. This paper proposes a deep Bayesian active-learning-to-rank, which trains a Bayesian convolutional neural network while automatically selecting appropriate pairs for relative annotation. We confirmed the efficiency of the proposed method through experiments on endoscopic images of ulcerative colitis. In addition, we confirmed that our method is useful even with the severe class imbalance because of its ability to select samples from minor classes automatically.

Publication
Proceedings of the 26th UK Conference on Medical Image Understanding and Analysis (MIUA 2022)
Hideaki Hayashi
Hideaki Hayashi
Associate Professor

Hideaki Hayashi is an associate professor with D3 Center, Osaka University. His research interests focus on neural networks, machine learning, and medical data analysis.