Severity Classification of Ulcerative Colitis in Colonoscopy Videos by Learning from Confusion

Md Farhad Mokter; Azeez Idris; Jung Hwan Oh; Wallapak Tavanapong; Piet C. de Groen

doi:10.1007/978-3-031-20713-6_33

Severity Classification of Ulcerative Colitis in Colonoscopy Videos by Learning from Confusion

Md Farhad Mokter, Azeez Idris, Jung Hwan Oh, Wallapak Tavanapong, Piet C. de Groen

Medicine - Gastro, Hepatology, Nutrition Division

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Endoscopic measurement of ulcerative colitis (UC) severity is important since endoscopic disease severity may better predict future outcomes in UC than symptoms. However, it is difficult to evaluate the endoscopic severity of UC objectively because of the non-uniform nature of endoscopic features associated with UC, and large variations in their patterns. In this paper, we propose a method to classify UC severity in colonoscopy videos by learning from confusion. The similar looking frames from the colonoscopy videos generate similar features, and the Convolutional Neural Network (CNN) model trained using these similar features is confused. Therefore, it cannot provide accurate classification. By isolating these similar frames (features), we potentially reduce model confusion. We propose a new training strategy to isolate these similar frames (features), and a CNN based method for classifying UC severity in colonoscopy videos using the new training strategy. The experiments show that the proposed method for classifying UC severity increases classification effectiveness significantly.

Original language	English (US)
Title of host publication	Advances in Visual Computing - 17th International Symposium, ISVC 2022, Proceedings
Editors	George Bebis, Bo Li, Angela Yao, Yang Liu, Ye Duan, Manfred Lau, Rajiv Khadka, Ana Crisan, Remco Chang
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	431-443
Number of pages	13
ISBN (Print)	9783031207129
DOIs	https://doi.org/10.1007/978-3-031-20713-6_33
State	Published - 2022
Event	17th International Symposium on Visual Computing, ISVC 2022 - San Diego, United States Duration: Oct 3 2022 → Oct 5 2022

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	13598 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	17th International Symposium on Visual Computing, ISVC 2022
Country/Territory	United States
City	San Diego
Period	10/3/22 → 10/5/22

Bibliographical note

Funding Information:
Conflict of Interest and Acknowledgments. Tavanapong and Oh have equity interest and management roles in EndoMetric Corp. Dr. de Groen serves on the Scientific Advisory Board of EndoMetric Corp. This work is partially supported by the NIH Grant No. 1R01DK106130-01A1. Findings, opinions, and conclusions expressed in this paper do not necessarily reflect the view of the funding agency.

Publisher Copyright:
© 2022, The Author(s), under exclusive license to Springer Nature Switzerland AG.

Keywords

CNN
Learning from confusion
Medical image classification
Ulcerative colitis severity

Access

10.1007/978-3-031-20713-6_33

OpenUrl availability

Full text

Cite this

Mokter, M. F., Idris, A., Oh, J. H., Tavanapong, W., & de Groen, P. C. (2022). Severity Classification of Ulcerative Colitis in Colonoscopy Videos by Learning from Confusion. In G. Bebis, B. Li, A. Yao, Y. Liu, Y. Duan, M. Lau, R. Khadka, A. Crisan, & R. Chang (Eds.), Advances in Visual Computing - 17th International Symposium, ISVC 2022, Proceedings (pp. 431-443). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 13598 LNCS). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-031-20713-6_33

Severity Classification of Ulcerative Colitis in Colonoscopy Videos by Learning from Confusion. / Mokter, Md Farhad; Idris, Azeez; Oh, Jung Hwan et al.
Advances in Visual Computing - 17th International Symposium, ISVC 2022, Proceedings. ed. / George Bebis; Bo Li; Angela Yao; Yang Liu; Ye Duan; Manfred Lau; Rajiv Khadka; Ana Crisan; Remco Chang. Springer Science and Business Media Deutschland GmbH, 2022. p. 431-443 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 13598 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Mokter, MF, Idris, A, Oh, JH, Tavanapong, W & de Groen, PC 2022, Severity Classification of Ulcerative Colitis in Colonoscopy Videos by Learning from Confusion. in G Bebis, B Li, A Yao, Y Liu, Y Duan, M Lau, R Khadka, A Crisan & R Chang (eds), Advances in Visual Computing - 17th International Symposium, ISVC 2022, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 13598 LNCS, Springer Science and Business Media Deutschland GmbH, pp. 431-443, 17th International Symposium on Visual Computing, ISVC 2022, San Diego, United States, 10/3/22. https://doi.org/10.1007/978-3-031-20713-6_33

Mokter MF, Idris A, Oh JH, Tavanapong W, de Groen PC. Severity Classification of Ulcerative Colitis in Colonoscopy Videos by Learning from Confusion. In Bebis G, Li B, Yao A, Liu Y, Duan Y, Lau M, Khadka R, Crisan A, Chang R, editors, Advances in Visual Computing - 17th International Symposium, ISVC 2022, Proceedings. Springer Science and Business Media Deutschland GmbH. 2022. p. 431-443. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-031-20713-6_33

Mokter, Md Farhad ; Idris, Azeez ; Oh, Jung Hwan et al. / Severity Classification of Ulcerative Colitis in Colonoscopy Videos by Learning from Confusion. Advances in Visual Computing - 17th International Symposium, ISVC 2022, Proceedings. editor / George Bebis ; Bo Li ; Angela Yao ; Yang Liu ; Ye Duan ; Manfred Lau ; Rajiv Khadka ; Ana Crisan ; Remco Chang. Springer Science and Business Media Deutschland GmbH, 2022. pp. 431-443 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{61a8e96d408c4615a2ac665563349e83,

title = "Severity Classification of Ulcerative Colitis in Colonoscopy Videos by Learning from Confusion",

abstract = "Endoscopic measurement of ulcerative colitis (UC) severity is important since endoscopic disease severity may better predict future outcomes in UC than symptoms. However, it is difficult to evaluate the endoscopic severity of UC objectively because of the non-uniform nature of endoscopic features associated with UC, and large variations in their patterns. In this paper, we propose a method to classify UC severity in colonoscopy videos by learning from confusion. The similar looking frames from the colonoscopy videos generate similar features, and the Convolutional Neural Network (CNN) model trained using these similar features is confused. Therefore, it cannot provide accurate classification. By isolating these similar frames (features), we potentially reduce model confusion. We propose a new training strategy to isolate these similar frames (features), and a CNN based method for classifying UC severity in colonoscopy videos using the new training strategy. The experiments show that the proposed method for classifying UC severity increases classification effectiveness significantly.",

keywords = "CNN, Learning from confusion, Medical image classification, Ulcerative colitis severity",

author = "Mokter, {Md Farhad} and Azeez Idris and Oh, {Jung Hwan} and Wallapak Tavanapong and {de Groen}, {Piet C.}",

note = "Funding Information: Conflict of Interest and Acknowledgments. Tavanapong and Oh have equity interest and management roles in EndoMetric Corp. Dr. de Groen serves on the Scientific Advisory Board of EndoMetric Corp. This work is partially supported by the NIH Grant No. 1R01DK106130-01A1. Findings, opinions, and conclusions expressed in this paper do not necessarily reflect the view of the funding agency. Publisher Copyright: {\textcopyright} 2022, The Author(s), under exclusive license to Springer Nature Switzerland AG.; 17th International Symposium on Visual Computing, ISVC 2022 ; Conference date: 03-10-2022 Through 05-10-2022",

year = "2022",

doi = "10.1007/978-3-031-20713-6_33",

language = "English (US)",

isbn = "9783031207129",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "431--443",

editor = "George Bebis and Bo Li and Angela Yao and Yang Liu and Ye Duan and Manfred Lau and Rajiv Khadka and Ana Crisan and Remco Chang",

booktitle = "Advances in Visual Computing - 17th International Symposium, ISVC 2022, Proceedings",

address = "Germany",

}

TY - GEN

T1 - Severity Classification of Ulcerative Colitis in Colonoscopy Videos by Learning from Confusion

AU - Mokter, Md Farhad

AU - Idris, Azeez

AU - Oh, Jung Hwan

AU - Tavanapong, Wallapak

AU - de Groen, Piet C.

N1 - Funding Information: Conflict of Interest and Acknowledgments. Tavanapong and Oh have equity interest and management roles in EndoMetric Corp. Dr. de Groen serves on the Scientific Advisory Board of EndoMetric Corp. This work is partially supported by the NIH Grant No. 1R01DK106130-01A1. Findings, opinions, and conclusions expressed in this paper do not necessarily reflect the view of the funding agency. Publisher Copyright: © 2022, The Author(s), under exclusive license to Springer Nature Switzerland AG.

PY - 2022

Y1 - 2022

N2 - Endoscopic measurement of ulcerative colitis (UC) severity is important since endoscopic disease severity may better predict future outcomes in UC than symptoms. However, it is difficult to evaluate the endoscopic severity of UC objectively because of the non-uniform nature of endoscopic features associated with UC, and large variations in their patterns. In this paper, we propose a method to classify UC severity in colonoscopy videos by learning from confusion. The similar looking frames from the colonoscopy videos generate similar features, and the Convolutional Neural Network (CNN) model trained using these similar features is confused. Therefore, it cannot provide accurate classification. By isolating these similar frames (features), we potentially reduce model confusion. We propose a new training strategy to isolate these similar frames (features), and a CNN based method for classifying UC severity in colonoscopy videos using the new training strategy. The experiments show that the proposed method for classifying UC severity increases classification effectiveness significantly.

AB - Endoscopic measurement of ulcerative colitis (UC) severity is important since endoscopic disease severity may better predict future outcomes in UC than symptoms. However, it is difficult to evaluate the endoscopic severity of UC objectively because of the non-uniform nature of endoscopic features associated with UC, and large variations in their patterns. In this paper, we propose a method to classify UC severity in colonoscopy videos by learning from confusion. The similar looking frames from the colonoscopy videos generate similar features, and the Convolutional Neural Network (CNN) model trained using these similar features is confused. Therefore, it cannot provide accurate classification. By isolating these similar frames (features), we potentially reduce model confusion. We propose a new training strategy to isolate these similar frames (features), and a CNN based method for classifying UC severity in colonoscopy videos using the new training strategy. The experiments show that the proposed method for classifying UC severity increases classification effectiveness significantly.

KW - CNN

KW - Learning from confusion

KW - Medical image classification

KW - Ulcerative colitis severity

UR - http://www.scopus.com/inward/record.url?scp=85145217551&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85145217551&partnerID=8YFLogxK

U2 - 10.1007/978-3-031-20713-6_33

DO - 10.1007/978-3-031-20713-6_33

M3 - Conference contribution

AN - SCOPUS:85145217551

SN - 9783031207129

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 431

EP - 443

BT - Advances in Visual Computing - 17th International Symposium, ISVC 2022, Proceedings

A2 - Bebis, George

A2 - Li, Bo

A2 - Yao, Angela

A2 - Liu, Yang

A2 - Duan, Ye

A2 - Lau, Manfred

A2 - Khadka, Rajiv

A2 - Crisan, Ana

A2 - Chang, Remco

PB - Springer Science and Business Media Deutschland GmbH

T2 - 17th International Symposium on Visual Computing, ISVC 2022

Y2 - 3 October 2022 through 5 October 2022

ER -

Severity Classification of Ulcerative Colitis in Colonoscopy Videos by Learning from Confusion

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access

OpenUrl availability

Other files and links

Fingerprint

Cite this