This paper is in the following e-collection/theme issue:

Digital Health Reviews (1289) Artificial Intelligence (1371) Machine Learning (1465) Imaging Informatics (193) Decision Support for Health Professionals (1185) Colon and Rectal Cancer (21)

Published on in Vol 23, No 7 (2021): July

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/27370, first published .
Diagnostic Accuracy of Artificial Intelligence and Computer-Aided Diagnosis for the Detection and Characterization of Colorectal Polyps: Systematic Review and Meta-analysis

Diagnostic Accuracy of Artificial Intelligence and Computer-Aided Diagnosis for the Detection and Characterization of Colorectal Polyps: Systematic Review and Meta-analysis

Diagnostic Accuracy of Artificial Intelligence and Computer-Aided Diagnosis for the Detection and Characterization of Colorectal Polyps: Systematic Review and Meta-analysis

Authors of this article:

Scarlet Nazarian1 Author Orcid Image ;   Ben Glover1 Author Orcid Image ;   Hutan Ashrafian1 Author Orcid Image ;   Ara Darzi1 Author Orcid Image ;   Julian Teare1 Author Orcid Image
Article Authors Cited by (45) Tweetations (10) Metrics

    Review

    Department of Surgery and Cancer, Imperial College London, London, United Kingdom

    *all authors contributed equally

    Corresponding Author:

    Hutan Ashrafian, PhD

    Department of Surgery and Cancer

    Imperial College London

    10th Floor, QEQM Building, St Mary’s Hospital

    Praed Street

    London, W2 1NY

    United Kingdom

    Phone: 44 2075895111

    Email: h.ashrafian@imperial.ac.uk


    Background: Colonoscopy reduces the incidence of colorectal cancer (CRC) by allowing detection and resection of neoplastic polyps. Evidence shows that many small polyps are missed on a single colonoscopy. There has been a successful adoption of artificial intelligence (AI) technologies to tackle the issues around missed polyps and as tools to increase the adenoma detection rate (ADR).

    Objective: The aim of this review was to examine the diagnostic accuracy of AI-based technologies in assessing colorectal polyps.

    Methods: A comprehensive literature search was undertaken using the databases of Embase, MEDLINE, and the Cochrane Library. PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines were followed. Studies reporting the use of computer-aided diagnosis for polyp detection or characterization during colonoscopy were included. Independent proportions and their differences were calculated and pooled through DerSimonian and Laird random-effects modeling.

    Results: A total of 48 studies were included. The meta-analysis showed a significant increase in pooled polyp detection rate in patients with the use of AI for polyp detection during colonoscopy compared with patients who had standard colonoscopy (odds ratio [OR] 1.75, 95% CI 1.56-1.96; P<.001). When comparing patients undergoing colonoscopy with the use of AI to those without, there was also a significant increase in ADR (OR 1.53, 95% CI 1.32-1.77; P<.001).

    Conclusions: With the aid of machine learning, there is potential to improve ADR and, consequently, reduce the incidence of CRC. The current generation of AI-based systems demonstrate impressive accuracy for the detection and characterization of colorectal polyps. However, this is an evolving field and before its adoption into a clinical setting, AI systems must prove worthy to patients and clinicians.

    Trial Registration: PROSPERO International Prospective Register of Systematic Reviews CRD42020169786; https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42020169786

    J Med Internet Res 2021;23(7):e27370

    doi:10.2196/27370

    Keywords

    artificial intelligence; colonoscopy; computer-aided diagnosis; machine learning; polyp 


    Colorectal cancer (CRC) is the third-leading malignancy worldwide and a leading cause of mortality [1]. CRC typically develops from sporadic colorectal adenomatous polyps, and colonoscopy is established for the detection and resection of these lesions, which has been shown to reduce the incidence and mortality from CRC [2]. However, as with any procedure, endoscopic polyp detection has operator-dependent limitations. There is evidence highlighting that small polyps may be missed at colonoscopy with a miss rate for adenomas as high as 26% [3]. The primary colonoscopy quality indicator is the adenoma detection rate (ADR). Given that ADR is inversely proportional to postcolonoscopy CRC risk, with each 1% increase in ADR equivalent to a 3% decrease in the subsequent risk of cancer [4], there is an unmet need to tackle the problems that prevent high-quality colonoscopy.

    Human and technical factors lead to a small but significant proportion of missed polyps during colonoscopy. Several studies have suggested that ADR can be increased by improving the educational and behavioral skills of the endoscopist. Training programs, consisting of hands-on teaching and regular feedback, showed good results in increasing ADR in trials [5,6]. However, the increase in detection from baseline in these studies was minimal and the ability of even expert endoscopists to detect very small, subtle, or flat lesions remains a limiting factor.

    Recently, there has been a successful adoption of artificial intelligence (AI) technologies in health care diagnostics [7]. The ability of AI, specifically machine learning approaches, to differentiate and characterize distinct pathologies is continuously enhancing early computer-aided diagnosis (CAD) techniques. Deep learning models are built using artificial neural networks and have proven very useful with analysis of big data in health care. Convolutional neural networks (CNNs) and their variants with AI models have become the most preferred and widely used methods in medical image analysis. Convolutional layers convolve the input and pass its result to the next layer. Application of AI in colonoscopy has focused more on polyp detection than characterization, driven by the development of deep CNNs (DCNNs). The architecture of these algorithms includes multiple layers of processing between the input and output layers, allowing analysis of complex data with efficient performance. The most advanced polyp detection systems are those that can be applied to video-based analysis during colonoscopy.

    In the field of endoscopy, a machine learning algorithm can be trained to recognize or characterize polyps in real time. Two endoscopic approaches have been studied: techniques used for analysis of nonmagnified endoscopic images and those for cellular imaging at a microscopic level (ie, optical biopsy).

    The idea of such approaches is that by detecting more polyps (ie, increasing the polyp detection rate [PDR]), there will be a corresponding reduction in the number of missed adenomas and, consequently, a reduction in the subsequent risk of CRC. However, this presents a financial burden on health care systems, especially the histopathology departments, involved in analysis of resected tissue, which will only increase with the increase in detection of polyps. The ultimate goal of a CAD system would be the reliable detection of every polyp within the colon during the colonoscopy procedure, while also characterizing them as hyperplastic or adenomatous to guide decision making for polypectomy and histopathological examination [8]. The Preservation and Incorporation of Valuable endoscopic Innovations (PIVI) initiative, set by the American Society of Gastrointestinal Endoscopy (ASGE), has established a desired threshold for the introduction of new endoscopic technologies, including the optical diagnosis of diminutive colorectal polyps [9]. Despite several, predominantly single-site, studies meeting the PIVI criteria showing that a “resect and discard” strategy or a “diagnose and leave” strategy could be adopted [10,11], a recent multicenter study showed that the accuracy of optical diagnosis requires imaging advances before it can be used to determine surveillance without histology [12].

    Machine learning by definition is a model that is able to constantly adapt and improve when presented with new information. To ensure this refinement, large quantities of good-quality data should be used for training the algorithm. Current AI systems that are not synthesized in this way are prone to the risk of overfitting, whereby the system performs well with training data to the extent that it negatively impacts its performance when tested on new data [13]. Thus, for an AI system to be successful in its ability to detect and characterize polyps, it should adopt a machine learning model based on good-quality high-yield data and the model should have a high sensitivity for the detection of polyps, have a low rate of false positives, and be able to maintain fast processing speeds to be applicable in near-real time during colonoscopy [14].

    Our aims were to systematically review and meta-analyze the diagnostic accuracy of AI-based technologies in the detection and characterization of colorectal polyps.


    This review was carried out and reported in accordance with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) statement [15]. It has been registered on PROSPERO (International Prospective Register of Systematic Reviews) (registration No. CRD42020169786).

    Search Strategy

    A comprehensive literature search was undertaken using the databases of Embase, MEDLINE, and the Cochrane Library. All published articles up until October 2020 were included. Search terms used in Embase and MEDLINE included “colon*,” “polyp,” “artificial intelligence OR machine learning,” and “computer aided or assisted and diagnos* OR detect*.” Studies in the Cochrane Library were identified with the terms “colonic polyp,” “artificial intelligence,” and “diagnosis, computer-assisted” (Multimedia Appendix 1).

    Inclusion and Exclusion Criteria

    Inclusion criteria were as follows:

    • Studies reporting computer-aided detection of colorectal polyps retrospectively, using endoscopic images or videos
    • Studies reporting computer-aided classification of colorectal polyps retrospectively, using endoscopic images or videos
    • Studies reporting the use of CAD of colorectal polyps during colonoscopy
    • Studies reporting ADR, PDR, sensitivity, specificity, and diagnostic accuracy data or studies with adequate information to calculate these data
    • Studies published or translated into English.

    Exclusion criteria were as follows:

    • Studies with no original data present (eg, review article or letter)
    • Studies with no full text available
    • Studies conducted in patients with inflammatory bowel disease (IBD)
    • Studies greater than 20 years old
    • Studies without adequate data to calculate sensitivity, specificity, and diagnostic accuracy data; PDR and ADR; adenoma miss rate; or mean adenomas per patient, or those not reporting these data.

    Study Selection

    The retrieved articles were screened for duplicates by two reviewers; these were excluded. Titles and abstracts were then screened for relevance by two reviewers independently, and irrelevant studies were excluded. Following this, full-text reviews of remaining studies were completed. The reference lists of identified review articles and included papers were scrutinized for relevant studies. Disagreements about eligibility were settled by consensus, both after screening and following full‐text review. Inclusion and exclusion criteria were met by all final articles.

    Data Extraction

    Data were gathered from studies and placed onto a standard spreadsheet template. For each study, we extracted the following data: study details (ie, first author, year of publication, and journal), primary outcome (ie, polyp detection vs characterization), study design (ie, type of study, method of AI, and exclusion criteria), information on type of imaging modality (ie, images or videos, images for training, and images for validation), and information regarding diagnostic accuracy characteristics (ie, sensitivity, specificity, accuracy, ADR, and PDR).

    Study Quality Assessment

    Study quality was independently assessed using the Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) tool [16]. Each domain was classified as low-risk, high-risk, or unclear risk of bias. For randomized controlled trials (RCTs), the Jadad scale was used for quality scoring [17]. Studies with a Jadad score of 3 or more were considered good quality.

    Statistical Analysis

    Independent proportions and their differences were calculated and pooled through DerSimonian and Laird random-effects modeling. This considered both between-study and within-study variances, which contributed to study weighting. Pooled values and 95% CIs were computed and represented on forest plots. Statistical heterogeneity was determined by the I2 statistic, where <30% was low, 30%-60% was moderate, and >60% was high. Analyses were performed using Stata, version 15 (StataCorp LLC). Probability values of P≤.05 were considered statistically significant.


    Search Results and Characteristics

    A total of 899 articles were identified from the database searches. After removing duplicates, 575 records were screened on the basis of titles and abstracts. A total of 141 articles were identified as appropriate for full-text review. Further evaluation and application of the exclusion criteria revealed 48 studies, which were included in this systematic review and meta-analysis. The study screening and selection process is shown in Figure 1.

    Studies in this systematic review included preclinical studies for polyp detection (Table 1 [18-35]), preclinical studies for polyp characterization (Table 2 [11,13,36-55]), and recent RCTs (Table 3 [56-63]). The studies were all published between 2003 and 2020. The outcome measures were polyp detection in 18 studies, polyp characterization in 22 studies, and PDR in 8 studies. The studies analyzing sensitivity, specificity, and accuracy when testing each AI system were found to present results at the per-patient, per-polyp, and/or per-image levels, whereas the RCTs evaluating the ADR and PDR consistently presented per-patient results.

    ‎
    Figure 1. PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) flow diagram for study selection.
    View this figure

    Studies for polyp detection predominantly used CNN or DCNN as their machine learning approach. A total of 14 studies for polyp detection were carried out retrospectively. There was a large variation in the number of images used by each paper to train or validate the AI systems in detecting polyps, with one study using 8 images [20] to train the system, while another used 5545 images [25].

    In the majority of studies, narrow band imaging (NBI) or endocytoscopy was the imaging method of choice for characterizing polyps, with one exception in which the imaging modality was not stated [47]. Data for polyp characterization was gathered retrospectively in 18 studies. In 3 studies that collected data prospectively, a support vector machine classifier was used as the machine learning approach. Similarly to studies for polyp detection, those analyzing polyp characterization had a large variation in number of images used for training or validating the AI system. However, studies for polyp characterization focused more on the number of polyps used than on overall images, as seen in Table 2.

    Table 1. Characteristics of included studies whose primary outcome was polyp detection.
    AuthorsYearRecruitmentMachine learning approachImaging modalityPatients, nPolyps, nTotal images, nImages for training, nImages for validation, n
    Karkanis et al [18]2003RetrospectiveCWCaRGBb–color frame grabber669513801801200
    Fu et al [19]2014RetrospectiveSFFSc with SVMd classifierStill image enhanced by PCTe100—f36529273
    Wang et al [20]2015RetrospectivePolyp edge detection—ECSPgVideo clip—43—853
    Tajbakhsh et al [21]2015RetrospectiveHybrid context-shape approachCVCh-Colon database—15300300—
    Tajbakhsh et al [21]2015RetrospectiveHybrid context-shape approachASUi-Mayo database—1019,400300—
    Fernández-Esparrach et al [22]2016RetrospectiveWM-DOVAj mapsWhite light colonoscope—31612——
    Park and Sargent [23]2016RetrospectiveCNNk-CRFl modelWhite light and NBIm—9211,802——
    Urban et al [24]2018RetrospectiveDCNNnNBI images>2000—8641——
    Wang et al [25]2018RetrospectiveANNo- SegNet architectureStill images2428——554527,113
    Misawa et al [26]2018RetrospectiveCNNWhite light images73155546411135
    Figueiredo et al [27]2019RetrospectiveSVM binary classifierWhite light images4242———
    Yamada et al [28]2019RetrospectiveFaster R-CNNpStill images—752—>40004840
    Becq et al [29]2020ProspectiveANN- SegNet architectureVideo50165———
    Gao et al [30]2020RetrospectiveCNNWhite light images——17091196256
    Guo et al [31]2020RetrospectiveCNN-YOLOqVideo283—1991——
    Lee et al [32]2020ProspectiveCNN-YOLOVideo1526—8495110,728
    Ozawa et al [33]2020RetrospectiveCNNNBI and white light12,895309—20,4317077
    Misawa et al [34]2020ProspectiveCNN-YOLOWhite light images140510056,66851,8894769
    Poon et al [35]2020ProspectiveCNN-ResNet50, YOLOVideo144128—198,13834,469

    aCWC: color wavelet covariance.

    bRGB: red, green, and blue.

    cSFFS: sequential floating-forward selection.

    dSVM: support vector machine.

    ePCT: principal components transformation.

    fThis value was not reported.

    gECSP: edge cross-section profiles.

    hCVC: Computer Vision Center.

    iASU: Arizona State University.

    jWM-DOVA: window median depth of valleys accumulation.

    kCNN: convolutional neural network.

    lCRF: conditional random field.

    mNBI: narrow band imaging.

    nDCNN: deep convolutional neural network.

    oANN: artificial neural network.

    pR-CNN: region-based convolutional neural network.

    qYOLO: you only look once.

    Table 2. Characteristics of included studies whose primary outcome was polyp characterization.
    AuthorsYearRecruitmentMachine learning approachImage modalityPatients, nPolypsor lesions, nTotal images, nImages for training, nImages for validation, n
    Tischendorf et al [36]2010Prospective pilotSVMa classifierMagnification NBIb223209—c208—
    Gross et al [37]2011ProspectiveSVM classifierMagnification NBI214434—433—
    Ganz et al [13]2012RetrospectiveShape-UCMdNBI———5887
    Takemura et al [38]2012RetrospectiveSVM classifierMagnification NBI—371—1519371
    Mori et al [39]2015RetrospectiveECe-CADfEC152176———
    Kominami et al [11]2016RetrospectiveSVM classifierMagnification NBI41118—2247—
    Misawa et al [40]2016RetrospectiveEndoBRAINgNBI and EC—851079979100
    Mesejo et al [41]2016RetrospectiveSfMhWhite light and NBI—76———
    Mori et al [42]2016RetrospectiveSVM classifierEC-CAD123205——6051
    Takeda et al [43]2017RetrospectiveSVM classifierEC-CAD24237558435643200
    Byrne et al [44]2017RetrospectiveDCNNiNBI—125—60,089—
    Komeda et al [45]2017RetrospectiveCNNEndoscopic images——1200——
    Misawa et al [46]2017RetrospectiveEndoBRAIN and ECVj-CADNBI10012418341731661
    Mori et al [47]2018Retrospective—EC—144———
    Chen et al [48]2018ProspectiveDNNkNBI19328424412157284
    Renner et al [49]2018RetrospectiveDNNNBI and HDWLl250231788602186
    Mori et al [50]2018ProspectiveSVM classifierNBI and EC325466—61,925450
    Mori et al [50]2018ProspectiveSVM classifierNBI and EC325466—61,925450
    Kudo et al [51]2019RetrospectiveEndoBRAIN systemWhite light, NBI, and EC89100—69,1425065
    Kudo et al [51]2019RetrospectiveEndoBRAIN systemWhite light, NBI, and EC89100—69,1425065
    Figueiredo et al [52]2019RetrospectiveSegmentation algorithmNBI1011864343
    Rodriguez-Diaz et al [53]2020RetrospectiveDeepLab frameworkHigh magnification NBI286607740——
    Yang et al [54]2020RetrospectiveCNN-Inception-ResNetWhite light1339—3828—240
    Zachariah et al [55]2020RetrospectiveCNN-Inception-ResNetNBI and white light——6223—634

    aSVM: support vector machine.

    bNBI: narrow band imaging.

    cThis value was not reported.

    dShape-UCM is an algorithm for automatic polyp segmentation.

    eEC: endocytoscopy.

    fCAD: computer-aided diagnosis.

    gEndoBRAIN is a novel artificial intelligence system.

    hSfM: structure from motion.

    iDCNN: deep convolutional neural network.

    jECV: endocytoscopic vascular pattern.

    kDNN: deep neural network.

    lHDWL: high-definition white light.

    Table 3. Characteristics of randomized controlled trials whose primary outcome was polyp detection.
    AuthorsYearRecruitmentMachine learning approachImaging modalityPatients, nPolyps, nPDRa
    –AIb, %    		PDR
    –control, %    		ADRc
    –AI, %    		ADR
    –control, %    		Withdrawal timed;
    AI vs control, min    		P
    value
    Wang et al [56]2019Real-time, prospectiveANNe-SegNet architectureVideo stream105876745.0229.1029.1220.346.18 vs 6.07.15
    Wang et al [57]2020ProspectiveANN-SegNet architectureVideo stream962809523734286.48 vs 6.37.14
    Su et al [58]2020ProspectiveDCNNfVideo stream62327338.3125.4028.9016.507.03 vs 5.68

    		<.001
    Gong et al [59]2020ProspectiveDCNNVideo stream704—g47341686.38 vs 4.76<.001
    Liu et al [60]2020ProspectiveANNVideo stream102673443.6527.8139.1023.896.82 vs 6.74<.001
    Luo et al [61]2020ProspectiveCNN-YOLOhVideo stream15018538.734.0——6.22 vs 6.17

    		.10
    Repici et al [62]2020ProspectiveCNN-GI GeniusiVideo stream685596——54.840.46.95 vs 7.25

    		.10
    Wang et al [63]2020ProspectiveANN-EndoscreenerVideo stream369—63.5955.1442.3935.686.55 vs 6.51

    		.75

    aPDR: polyp detection rate.

    bAI: artificial intelligence.

    cADR: adenoma detection rate.

    dWithdrawal time excluded the time to perform the biopsy.

    eANN: artificial neural network.

    fDCNN: deep convolutional neural network.

    gThis value was not reported.

    hYOLO: you only look once.

    iGI Genius (Medtronic) is novel artificial intelligence system.

    Detection or Localization of a Polyp

    The diagnostic accuracy of the machine learning systems for detecting polyps was assessed using 103,049 still images in 10 studies, reporting a pooled sensitivity of 0.84 (95% CI 0.74-0.93), a specificity of 0.87 (95% CI 0.83-0.90), and an accuracy of 0.89 (95% CI 0.81-0.97). Lesions within video frames or images were used by 14 studies to report the diagnostic performance of their detection systems, highlighting a sensitivity of 0.92 (95% CI 0.89-0.95), a specificity of 0.89 (95% CI 0.84-0.94; Figure 2), and an accuracy of 0.87 (95% CI 0.76-0.97). There were 11 studies analyzing the accuracy of polyp detection through the use of images or video clips gathered from more than 17,401 patients. These demonstrated a sensitivity of 0.92 (95% CI 0.90-0.94), a specificity of 0.93 (95% CI 0.91-0.96), and accuracy of 0.92 (95% CI 0.87-0.98).

    ‎
    Figure 2. Pooled analysis of specificity of polyp detection by the use of lesions or polyps within video frames or images. Effect sizes (ES) are shown with 95% CIs. A random-effects model was used.
    View this figure

    Characterization of a Detected Polyp

    There were 9 studies reporting diagnostic accuracy characteristics for computer analysis of single image frames. These included a total of 22,862 images and demonstrated a sensitivity of 0.92 (95% CI 0.90-0.95; Figure 3), a specificity of 0.79 (95% CI 0.68-0.91), and an accuracy of 0.87 (95% CI 0.83-0.91). A further 20 studies assessed the diagnostic accuracy of techniques for predicting the histological diagnosis of a polyp, with a sensitivity of 0.94 (95% CI 0.92-0.95), a specificity of 0.87 (95% CI 0.83-0.90), and an accuracy of 0.91 (95% CI 0.88-0.93). A total of 16 studies analyzed diagnostic accuracy using images or video clips from a cohort of 4001 patients having undergone colonoscopy. These studies showed a sensitivity of 0.94 (95% CI 0.92-0.95), a specificity of 0.82 (95% CI 0.73-0.91), and an accuracy of 0.90 (95% CI 0.86-0.94).

    ‎
    Figure 3. Pooled analysis of sensitivity of polyp characterization by the use of images. Effect sizes (ES) are shown with 95% CIs. A random-effects model was used.
    View this figure

    PDR and ADR for Polyp Detection: RCTs

    The 8 RCTs consisted of a total of 5577 patients: 2438 patients in the AI group and 2463 patients in the control group with standard colonoscopy alone [56-59]. These captured data prospectively with the use of deep learning methods on real-time video streams from colonoscopy.

    The meta-analysis showed a significant increase in pooled PDR in patients with the use of AI for polyp detection during colonoscopy compared with patients who had standard colonoscopy (odds ratio [OR] 1.75, 95% CI 1.56-1.96; P<.001; Figure 4). The PDR ranged from 38% to 64% when using AI, with a median of 45%. When comparing patients undergoing colonoscopy with the use of AI to those having standard colonoscopy, there was also a significant increase in ADR (OR 1.53, 95% CI 1.32-1.77; P<.001; Figure 5). The ADR ranged from 16% to 55% with a median of 34% when using AI technology compared to standard colonoscopy.

    ‎
    Figure 4. Pooled analysis of polyp detection rate. Odds ratios are shown with 95% CIs. A random-effects model was used for the meta-analysis.
    View this figure
    ‎
    Figure 5. Pooled analysis of adenoma detection rate. Odds ratios are shown with 95% CIs. A random-effects model was used for the meta-analysis.
    View this figure

    Heterogeneity of Studies

    There was a high degree of variation between studies. The heterogeneity was statistically significant when comparing the studies for polyp detection and characterization and assessing for sensitivity, specificity, and accuracy (P<.05). The lowest variation for polyp detection was among the studies assessing accuracy with polyp data (I2=86.3%), and the highest was among those analyzing the sensitivity of machine learning systems using image data sets (I2=99.9%). When considering studies for polyp characterization, the heterogeneity was lowest for studies analyzing sensitivity using patient data sets (I2=51.1%) and highest when assessing specificity using image data sets (I2=99.9%). Within the RCTs assessed, there was found to be a low degree of heterogeneity for PDR (I2=0%; P=.70) and a moderate degree of heterogeneity for ADR (I2=45.5%; P=.09). These results were not statistically significant.

    Quality Assessment

    The assessment of bias for the studies when using the QUADAS-2 tool is depicted in Table S1 in Multimedia Appendix 2. Most of the RCTs scored 3 or more on the Jadad scale and were, therefore, considered to be of good quality (Table S2 in Multimedia Appendix 2). One study scored 2, suggesting poor quality, but after reviewing the paper and its evidence in detail, the paper was included in the final analysis [64]. This is because despite the lack of mention of blinding, the selection process for participants was justified with consecutive patients enrolled, and there were no concerns regarding applicability. The paper matched the selection criteria of our study and was otherwise in line with other studies that were included.


    Principal Findings

    The aim of this systematic review and meta-analysis was to examine the current status of diagnostic accuracy for AI-based technologies in the detection and characterization of colorectal polyps. We found a wide variety of machine learning systems being used for polyp detection and characterization in numerous studies. The overall diagnostic accuracy for these systems to detect polyps was high, predominantly with sensitivities, specificities, and accuracies above 84%. When characterizing polyps, the majority of machine learning systems had sensitivities, specificities, and accuracies above 82%. These outcomes show good results for current machine learning systems and algorithms to detect and characterize polyps, and indirectly in regard to the rate of false positives.

    This meta-analysis highlights a significant increase in PDR and ADR when using AI systems in conjunction with colonoscopy in real time to detect polyps in the colon and rectum with an overall OR of 1.75 (95% CI 1.56-1.96; P<.05) and 1.53 (95% CI 1.32-1.77; P<.05), respectively. The UK key performance indicators and quality assurance standards for colonoscopy dictate that the minimal ADR should be 15%, with an aspirational target of 20% [65]. It has previously been shown that endoscopists with an ADR of less than 20% had a hazard ratio for interval cancer that was 10 times higher than those with an ADR of greater than 20% [66]. All RCTs in this review were shown to have an ADR of greater than 15% when detecting polyps with the use of an AI system, the majority of which highlighted an ADR of greater than 25% [56-58]. These outcomes are a promising start for the use of AI to detect missed polyps and, thus, may lead to a reduction in CRC incidence.

    The assessment of quality of the diagnostic accuracy studies included in this paper highlighted an overall low risk of bias, justifying the validity of the study results and implying that their results may be applicable to clinical practice. The main area of bias in the RCTs was in the process of blinding. This may have contributed to an overestimation in the effects of AI in polyp detection.

    There are many limitations within the published studies (Table S1 in Multimedia Appendix 3). Factors contributing to the miss rate of polyps are multifactorial and include patient-related factors, polyp-related factors, and image-related factors [67,68]. It is encouraging to note that a variety of imaging modalities were used in the studies in this review, since this will improve applicability in a clinical setting. We note that most studies with image enhancement techniques have used NBI, and it will be important to validate the performance of AI systems in endoscopy using image enhancement approaches from other manufacturers (eg, i-scan from PENTAX Medical and blue laser imaging from Fujifilm Corporation). Some studies analyzing polyp characterization used magnification NBI [11,36,38,69]. This imaging modality is not commonly used in Western endoscopic practice, so is less applicable to a health care setting in the Western world. Although there has been significant development in computer-assisted technologies to increase ADR, issues with image quality still remain. Many studies in this review excluded images that were blurred or of poor quality when assessing diagnostic accuracy of the machine learning systems. [27,40,42,51]. Recent RCTs have tried to tackle this problem by developing models to recognize blurry frames [58,59]. Other studies excluded images with poor bowel preparation [27,36,48]. Adequate bowel cleansing is vital for complete mucosal inspection; however, it has been shown in a meta-analysis that low-quality preparation does not significantly affect ADR, since these patients frequently undergo repeat colonoscopy [70]. Most RCTs included in this review used the Boston Bowel Preparation Scale [71] to assess adequacy of bowel preparation.

    Sufficient withdrawal time allows full mucosal inspection with careful examination of all folds and flexures, in an attempt to avoid missing any polyps. It has been shown that an increase in withdrawal time is associated with an increase in ADR [72]. This supports the use of withdrawal times as a quality indicator for screening colonoscopy. In preclinical studies, it is difficult to assess withdrawal times given the use of still images and video clips. In the RCTs assessed, the withdrawal times—excluding biopsy time—were mostly higher with the use of AI-based technology, although not significantly so in all studies (Table 3). However, the ability to record the withdrawal time is equally important [58,59]. This may suggest that quality control during colonoscopy examinations can be maintained with the use of machine learning.

    Given the fact that AI is a relatively new and evolving area of medical practice, there is a lack of evidence-based standards to support its development. This is highlighted through the inconsistencies in validating the machine learning systems in each study. The data used for training the algorithms vary in type, for example, as either a static image from the colonoscopy [45,46] or an image of a polyp [21,47], and in number, with some studies having very small sample sizes [21,52]. We acknowledge the high degree of heterogeneity in the included studies, which may, in part, be explained by the wide range of approaches or algorithms used. This may suggest that our findings are applicable to a wide range of study settings and outcomes. However, the high degree of heterogeneity also emphasizes the issue of inconsistencies within the development of AI systems and, thus, weakens their design and may hinder implementation of the AI systems in a clinical setting. In order to address this problem, we are developing a new multidisciplinary, consensus-based reporting standards statement called STARD-AI (Standards for Reporting of Diagnostic Accuracy Studies–Artificial Intelligence). It is being developed to provide stringent guidelines for all AI-based clinical trials that report diagnostic accuracy [73,74].

    The lack of standards among these studies introduces an element of selection bias. In traditional computer programming, intelligent systems were built by writing models by hand and, therefore, understanding the rules from which conclusions were made. Neural networks and deep learning techniques are criticized for their “black box” problem, in failing to produce an intelligible description of the results produced. This creates tension between our need for explanations and our interests in efficiency. Most studies in this systematic review did not reveal their algorithms, which begs one to question whether they only used the algorithms that were most successful in producing the desired outcome without understanding the process underlying it.

    Multiple other factors contribute to the lack of applicability of these studies in clinical practice. Many of the studies about polyp detection and characterization have been carried out in Japan [46,50,51] or China [19,56,59], and differences in polyp biology and tumorigenesis may limit application to Western endoscopy practice [75]. Furthermore, for real-time detection to be successful, the operation of the AI system to detect and characterize polyps must be fast, practical, and nondisruptive to workflow. However, most current studies are designed in a nonclinical environment and carried out retrospectively, with only a handful of recent RCTs. More RCTs are needed to provide prospective data by testing the machine learning systems while a colonoscopy procedure is undertaken.

    The financial implications of introducing an AI system to endoscopy should be considered. The studies in this review lack evidence to show that AI systems would be cost-effective. Before clinical application, studies must demonstrate that the current burden on health care systems and histopathology departments can be relieved, both in view of workload and in terms of costs. A very recent study examining the use of AI combined with the diagnose-and-leave strategy for diminutive polyps has found substantial reductions in the cost of colonoscopy based on prospective data [76]. This is an encouraging outcome, but more studies are needed.

    The role of the health care workforce must also be considered in a time of developing AI systems. At present, real-time detection systems during colonoscopy are not able to operate independently of human direction, but understanding the change in the role of the endoscopist and nurses will be crucial for the future. In addition, a skills gap to prepare the workforce for AI will need to be addressed. The refinement of machine learning systems in detecting polyps will eventually lead to the use of AI in conjunction with all routine colonoscopy procedures. This will allow the procedure to be performed by staff who will not require the lengthy training or accreditation [77]. In this scenario, only patients with complex polyps requiring more advanced management may need to be referred to expert endoscopists.

    It is important to also consider some of the ethical dilemmas that arise from the use of AI in health care. The aim of AI in polyp detection and characterization is to introduce machine learning as a “checker system” for the endoscopist. As a result, incorporation of AI into endoscopy should be encouraged as a complementary tool and not as a replacement for a clinician. For this reason, a high degree of accuracy is required from AI systems. We expect that they operate with 100% sensitivity and a low rate of false positives. However, AI is not yet free from bias or errors, and an AI decision support tool could easily succumb to automation bias when its predictions are almost always followed by the endoscopist [78]. Machine learning systems can also unintentionally reproduce or magnify existing biases of their training data sets and exacerbate health disparities [79]. Many of the studies in this meta-analysis, for example, have excluded patients with IBD or sessile serrated polyps [39,43,56], limiting their applicability for these populations. We recognize that these other cohorts of patients, including those with benign colonic pathologies and not exclusively polyps, are important to include in such research. However, this technology is still in its infancy and these patient groups represent a minority. It is difficult and not entirely feasible to create validated AI algorithms for all patient cohorts until the technology is more established and works well in its own right.

    Although this systematic review has shown the performance of the AI systems to be satisfactory, the majority of the studies are preclinical trials that have not addressed these clinical needs. As a result, there remains a lack of confidence by endoscopists and patients to fully adopt the system as a whole. The clinical expectations exceed the aims of the machine learning algorithms. To fully support the incorporation of an AI system into routine practice, the diagnostic accuracy for polyp detection and characterization must meet the desired threshold, while also providing confidence that quality requirements will be fulfilled.

    A further two challenges threaten the ability for AI to thrive in health care: patient confidentiality and accountability. The lack of stringent policies for the use of training data in AI means that the methods used to deidentify patient information are weak, and we suggest that standardized guidance is required for the consent of collection and use of patient data for AI training purposes. Once an algorithm-based health care system is operational, the question of accountability arises. In the case that a machine learning system working in unison with an endoscopist detects and characterizes a polyp as hyperplastic when, in fact, it is adenomatous, who is held liable for this mistake? A robust legal framework in association with national and international endoscopy representative groups (eg, the Joint Advisory Group on Gastrointestinal Endoscopy in the United Kingdom and the ASGE in the United States) for the use of AI in health care is vital to protect endoscopists and patients. Addressing these important concerns will help build confidence and trust among patients and doctors for the use of machine learning in the delivery of care.

    Conclusions

    This systematic review and meta-analysis highlights the growing interest in the field of polyp detection and characterization during colonoscopy using AI. The current accuracy of machine learning for this role is high. There is potential to improve ADR and, consequently, reduce the incidence of CRC.

    However, AI and machine learning systems are still evolving. Firstly, higher-quality research with modern trial designs is needed in this field, with particular attention on using larger data sets and by validating the AI systems prospectively in a clinical setting. Secondly, these systems must provide quality assurance with a robust ethical and legal framework before they can be fully embraced by clinicians and patients in the future.

    Acknowledgments

    Infrastructure support for this research was provided by the National Institute for Health Research Imperial Biomedical Research Centre.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    Search strategy for studies to include.

    DOCX File , 13 KB
    ‎
    Multimedia Appendix 2

    Quality assessment of the studies.

    DOCX File , 21 KB
    ‎
    Multimedia Appendix 3

    Limitations within the published studies.

    DOCX File , 13 KB

    References

    1. Globocan 2018. Colorectal cancer: Number of new cases in 2018, both sexes, all ages. International Agency for Research on Cancer. 2018.   URL: http://gco.iarc.fr/today [accessed 2019-11-01]
    2. Zauber AG, Winawer SJ, O'Brien MJ, Lansdorp-Vogelaar I, van Ballegooijen M, Hankey BF, et al. Colonoscopic polypectomy and long-term prevention of colorectal-cancer deaths. N Engl J Med 2012 Feb 23;366(8):687-696. [CrossRef]
    3. Zhao S, Wang S, Pan P, Xia T, Chang X, Yang X, et al. Magnitude, risk factors, and factors associated with adenoma miss rate of tandem colonoscopy: A systematic review and meta-analysis. Gastroenterology 2019 May;156(6):1661-1674.e11. [CrossRef] [Medline]
    4. Corley DA, Jensen CD, Marks AR, Zhao WK, Lee JK, Doubeni CA, et al. Adenoma detection rate and risk of colorectal cancer and death. N Engl J Med 2014 Apr 03;370(14):1298-1306 [FREE Full text] [CrossRef] [Medline]
    5. Coe SG, Crook JE, Diehl NN, Wallace MB. An endoscopic quality improvement program improves detection of colorectal adenomas. Am J Gastroenterol 2013 Feb;108(2):219-226; quiz 227. [CrossRef] [Medline]
    6. Kaminski MF, Anderson J, Valori R, Kraszewska E, Rupinski M, Pachlewski J, et al. Leadership training to improve adenoma detection rate in screening colonoscopy: A randomised trial. Gut 2016 Apr;65(4):616-624 [FREE Full text] [CrossRef] [Medline]
    7. Killock D. AI outperforms radiologists in mammographic screening. Nat Rev Clin Oncol 2020 Mar;17(3):134. [CrossRef] [Medline]
    8. Mori Y, Kudo S, Misawa M, Mori K. Simultaneous detection and characterization of diminutive polyps with the use of artificial intelligence during colonoscopy. VideoGIE 2019 Jan;4(1):7-10 [FREE Full text] [CrossRef] [Medline]
    9. Rex DK, Kahi C, O'Brien M, Levin T, Pohl H, Rastogi A, et al. The American Society for Gastrointestinal Endoscopy PIVI (Preservation and Incorporation of Valuable Endoscopic Innovations) on real-time endoscopic assessment of the histology of diminutive colorectal polyps. Gastrointest Endosc 2011 Mar;73(3):419-422. [CrossRef] [Medline]
    10. Ignjatovic A, East JE, Suzuki N, Vance M, Guenther T, Saunders BP. Optical diagnosis of small colorectal polyps at routine colonoscopy (Detect InSpect ChAracterise Resect and Discard; DISCARD trial): A prospective cohort study. Lancet Oncol 2009 Dec;10(12):1171-1178. [CrossRef]
    11. Kominami Y, Yoshida S, Tanaka S, Sanomura Y, Hirakawa T, Raytchev B, et al. Computer-aided diagnosis of colorectal polyp histology by using a real-time image recognition system and narrow-band imaging magnifying colonoscopy. Gastrointest Endosc 2016 Mar;83(3):643-649. [CrossRef] [Medline]
    12. Rees CJ, Rajasekhar PT, Wilson A, Close H, Rutter MD, Saunders BP, et al. Narrow band imaging optical diagnosis of small colorectal polyps in routine clinical practice: The Detect Inspect Characterise Resect and Discard 2 (DISCARD 2) study. Gut 2017 May;66(5):887-895 [FREE Full text] [CrossRef] [Medline]
    13. Ganz M, Yang X, Slabaugh G. Automatic segmentation of polyps in colonoscopic narrow-band imaging data. IEEE Trans Biomed Eng 2012 Aug;59(8):2144-2151. [CrossRef]
    14. Chao W, Manickavasagan H, Krishna SG. Application of artificial intelligence in the detection and differentiation of colon polyps: A technical review for physicians. Diagnostics (Basel) 2019 Aug 20;9(3):99 [FREE Full text] [CrossRef] [Medline]
    15. Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Med 2009 Jul 21;6(7):e1000097 [FREE Full text] [CrossRef] [Medline]
    16. Whiting PF, Rutjes AWS, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, QUADAS-2 Group. QUADAS-2: A revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med 2011 Oct 18;155(8):529-536 [FREE Full text] [CrossRef] [Medline]
    17. Jadad AR, Moore R, Carroll D, Jenkinson C, Reynolds DM, Gavaghan DJ, et al. Assessing the quality of reports of randomized clinical trials: Is blinding necessary? Control Clin Trials 1996 Feb;17(1):1-12. [CrossRef]
    18. Karkanis S, Iakovidis D, Maroulis D, Karras D, Tzivras M. Computer-aided tumor detection in endoscopic video using color wavelet features. IEEE Trans Inf Technol Biomed 2003 Sep;7(3):141-152. [CrossRef] [Medline]
    19. Fu JJ, Yu Y, Lin H, Chai J, Chen CC. Feature extraction and pattern classification of colorectal polyps in colonoscopic imaging. Comput Med Imaging Graph 2014 Jun;38(4):267-275. [CrossRef] [Medline]
    20. Wang Y, Tavanapong W, Wong J, Oh JH, de Groen PC. Polyp-Alert: Near real-time feedback during colonoscopy. Comput Methods Programs Biomed 2015 Jul;120(3):164-179. [CrossRef] [Medline]
    21. Tajbakhsh N, Gurudu SR, Liang J. Automated polyp detection in colonoscopy videos using shape and context information. IEEE Trans Med Imaging 2016 Feb;35(2):630-644. [CrossRef]
    22. Fernández-Esparrach G, Bernal J, López-Cerón M, Córdova H, Sánchez-Montes C, Rodríguez de Miguel C, et al. Exploring the clinical potential of an automatic colonic polyp detection method based on the creation of energy maps. Endoscopy 2016 Sep;48(9):837-842. [CrossRef] [Medline]
    23. Park SY, Sargent D. Colonoscopic polyp detection using convolutional neural networks. In: Proceedings of SPIE Medical Imaging: Computer-Aided Diagnosis. 2016 Presented at: SPIE Medical Imaging: Computer-Aided Diagnosis; February 27-March 3, 2016; San Diego, CA p. 978528. [CrossRef]
    24. Urban G, Tripathi P, Alkayali T, Mittal M, Jalali F, Karnes W, et al. Deep learning localizes and identifies polyps in real time with 96% accuracy in screening colonoscopy. Gastroenterology 2018 Oct;155(4):1069-1078.e8 [FREE Full text] [CrossRef] [Medline]
    25. Wang P, Xiao X, Glissen Brown JR, Berzin TM, Tu M, Xiong F, et al. Development and validation of a deep-learning algorithm for the detection of polyps during colonoscopy. Nat Biomed Eng 2018 Oct;2(10):741-748. [CrossRef] [Medline]
    26. Misawa M, Kudo S, Mori Y, Cho T, Kataoka S, Yamauchi A, et al. Artificial intelligence-assisted polyp detection for colonoscopy: Initial experience. Gastroenterology 2018 Jun;154(8):2027-2029.e3 [FREE Full text] [CrossRef] [Medline]
    27. Figueiredo P, Figueiredo I, Pinto L, Kumar S, Tsai Y, Mamonov A. Polyp detection with computer-aided diagnosis in white light colonoscopy: Comparison of three different methods. Endosc Int Open 2019 Feb;7(2):E209-E215 [FREE Full text] [CrossRef] [Medline]
    28. Yamada M, Saito Y, Imaoka H, Saiko M, Yamada S, Kondo H, et al. Development of a real-time endoscopic image diagnosis support system using deep learning technology in colonoscopy. Sci Rep 2019 Oct 08;9(1):14465 [FREE Full text] [CrossRef] [Medline]
    29. Becq A, Chandnani M, Bharadwaj S, Baran B, Ernest-Suarez K, Gabr M, et al. Effectiveness of a deep-learning polyp detection system in prospectively collected colonoscopy videos with variable bowel preparation quality. J Clin Gastroenterol 2020 Jul;54(6):554-557. [CrossRef] [Medline]
    30. Gao J, Guo Y, Sun Y, Qu G. Application of deep learning for early screening of colorectal precancerous lesions under white light endoscopy. Comput Math Methods Med 2020;2020:1-8 [FREE Full text] [CrossRef] [Medline]
    31. Guo Z, Nemoto D, Zhu X, Li Q, Aizawa M, Utano K, et al. Polyp detection algorithm can detect small polyps: Ex vivo reading test compared with endoscopists. Dig Endosc 2021 Jan;33(1):162-169. [CrossRef] [Medline]
    32. Lee JY, Jeong J, Song EM, Ha C, Lee HJ, Koo JE, et al. Real-time detection of colon polyps during colonoscopy using deep learning: Systematic validation with four independent datasets. Sci Rep 2020 May 20;10(1):8379 [FREE Full text] [CrossRef] [Medline]
    33. Ozawa T, Ishihara S, Fujishiro M, Kumagai Y, Shichijo S, Tada T. Automated endoscopic detection and classification of colorectal polyps using convolutional neural networks. Therap Adv Gastroenterol 2020;13:1-13 [FREE Full text] [CrossRef] [Medline]
    34. Misawa M, Kudo S, Mori Y, Hotta K, Ohtsuka K, Matsuda T, et al. Development of a computer-aided detection system for colonoscopy and a publicly accessible large colonoscopy video database (with video). Gastrointest Endosc 2021 Apr;93(4):960-967.e3. [CrossRef] [Medline]
    35. Poon CCY, Jiang Y, Zhang R, Lo WWY, Cheung MSH, Yu R, et al. AI-doscopist: A real-time deep-learning-based algorithm for localising polyps in colonoscopy videos with edge computing devices. NPJ Digit Med 2020;3:73 [FREE Full text] [CrossRef] [Medline]
    36. Tischendorf J, Gross S, Winograd R, Hecker H, Auer R, Behrens A, et al. Computer-aided classification of colorectal polyps based on vascular patterns: A pilot study. Endoscopy 2010 Mar;42(3):203-207. [CrossRef] [Medline]
    37. Gross S, Trautwein C, Behrens A, Winograd R, Palm S, Lutz HH, et al. Computer-based classification of small colorectal polyps by using narrow-band imaging with optical magnification. Gastrointest Endosc 2011 Dec;74(6):1354-1359. [CrossRef] [Medline]
    38. Takemura Y, Yoshida S, Tanaka S, Kawase R, Onji K, Oka S, et al. Computer-aided system for predicting the histology of colorectal tumors by using narrow-band imaging magnifying colonoscopy (with video). Gastrointest Endosc 2012 Jan;75(1):179-185. [CrossRef] [Medline]
    39. Mori Y, Kudo S, Wakamura K, Misawa M, Ogawa Y, Kutsukawa M, et al. Novel computer-aided diagnostic system for colorectal lesions by using endocytoscopy (with videos). Gastrointest Endosc 2015 Mar;81(3):621-629 [FREE Full text] [CrossRef] [Medline]
    40. Misawa M, Kudo S, Mori Y, Nakamura H, Kataoka S, Maeda Y, et al. Characterization of colorectal lesions using a computer-aided diagnostic system for narrow-band imaging endocytoscopy. Gastroenterology 2016 Jun;150(7):1531-1532.e3 [FREE Full text] [CrossRef] [Medline]
    41. Mesejo P, Pizarro D, Abergel A, Rouquette O, Beorchia S, Poincloux L, et al. Computer-aided classification of gastrointestinal lesions in regular colonoscopy. IEEE Trans Med Imaging 2016 Sep;35(9):2051-2063. [CrossRef]
    42. Mori Y, Kudo S, Chiu P, Singh R, Misawa M, Wakamura K, et al. Impact of an automated system for endocytoscopic diagnosis of small colorectal lesions: An international web-based study. Endoscopy 2016 Dec;48(12):1110-1118. [CrossRef] [Medline]
    43. Takeda K, Kudo S, Mori Y, Misawa M, Kudo T, Wakamura K, et al. Accuracy of diagnosing invasive colorectal cancer using computer-aided endocytoscopy. Endoscopy 2017 Aug;49(8):798-802. [CrossRef] [Medline]
    44. Byrne MF, Chapados N, Soudan F, Oertel C, Linares Pérez M, Kelly R, et al. Real-time differentiation of adenomatous and hyperplastic diminutive colorectal polyps during analysis of unaltered videos of standard colonoscopy using a deep learning model. Gut 2019 Jan;68(1):94-100 [FREE Full text] [CrossRef] [Medline]
    45. Komeda Y, Handa H, Watanabe T, Nomura T, Kitahashi M, Sakurai T, et al. Computer-aided diagnosis based on convolutional neural network system for colorectal polyp classification: Preliminary experience. Oncology 2017;93 Suppl 1:30-34 [FREE Full text] [CrossRef] [Medline]
    46. Misawa M, Kudo S, Mori Y, Takeda K, Maeda Y, Kataoka S, et al. Accuracy of computer-aided diagnosis based on narrow-band imaging endocytoscopy for diagnosing colorectal lesions: Comparison with experts. Int J Comput Assist Radiol Surg 2017 May;12(5):757-766. [CrossRef] [Medline]
    47. Mori Y, Kudo S, Mori K. Potential of artificial intelligence-assisted colonoscopy using an endocytoscope (with video). Dig Endosc 2018 Apr;30 Suppl 1:52-53. [CrossRef] [Medline]
    48. Chen P, Lin M, Lai M, Lin J, Lu HH, Tseng VS. Accurate classification of diminutive colorectal polyps using computer-aided analysis. Gastroenterology 2018 Feb;154(3):568-575. [CrossRef] [Medline]
    49. Renner J, Phlipsen H, Haller B, Navarro-Avila F, Saint-Hill-Febles Y, Mateus D, et al. Optical classification of neoplastic colorectal polyps - A computer-assisted approach (the COACH study). Scand J Gastroenterol 2018 Sep;53(9):1100-1106. [CrossRef] [Medline]
    50. Mori Y, Kudo S, Misawa M, Saito Y, Ikematsu H, Hotta K, et al. Real-time use of artificial intelligence in identification of diminutive polyps during colonoscopy. Ann Intern Med 2018 Aug 14;169(6):357. [CrossRef]
    51. Kudo S, Misawa M, Mori Y, Hotta K, Ohtsuka K, Ikematsu H, et al. Artificial intelligence-assisted system improves endoscopic identification of colorectal neoplasms. Clin Gastroenterol Hepatol 2020 Jul;18(8):1874-1881.e2. [CrossRef] [Medline]
    52. Figueiredo IN, Pinto L, Figueiredo PN, Tsai R. Unsupervised segmentation of colonic polyps in narrow-band imaging data based on manifold representation of images and Wasserstein distance. Biomed Signal Process Control 2019 Aug;53:101577. [CrossRef]
    53. Rodriguez-Diaz E, Baffy G, Lo W, Mashimo H, Vidyarthi G, Mohapatra SS, et al. Artificial intelligence-augmented visualization with real time histology mapping of colorectal polyps. Gastroenterology 2020 May;158(6):S-369. [CrossRef]
    54. Yang YJ, Cho B, Lee M, Kim JH, Lim H, Bang CS, et al. Automated classification of colorectal neoplasms in white-light colonoscopy images via deep learning. J Clin Med 2020 May 24;9(5):1593 [FREE Full text] [CrossRef] [Medline]
    55. Zachariah R, Samarasena J, Luba D, Duh E, Dao T, Requa J, et al. Prediction of polyp pathology using convolutional neural networks achieves "resect and discard" thresholds. Am J Gastroenterol 2020 Jan;115(1):138-144 [FREE Full text] [CrossRef] [Medline]
    56. Wang P, Berzin TM, Glissen Brown JR, Bharadwaj S, Becq A, Xiao X, et al. Real-time automatic detection system increases colonoscopic polyp and adenoma detection rates: A prospective randomised controlled study. Gut 2019 Oct;68(10):1813-1819 [FREE Full text] [CrossRef] [Medline]
    57. Wang P, Liu X, Berzin TM, Glissen Brown JR, Liu P, Zhou C, et al. Effect of a deep-learning computer-aided detection system on adenoma detection during colonoscopy (CADe-DB trial): A double-blind randomised study. Lancet Gastroenterol Hepatol 2020 Apr;5(4):343-351. [CrossRef]
    58. Su J, Li Z, Shao X, Ji C, Ji R, Zhou R, et al. Impact of a real-time automatic quality control system on colorectal polyp and adenoma detection: A prospective randomized controlled study (with videos). Gastrointest Endosc 2020 Feb;91(2):415-424.e4. [CrossRef] [Medline]
    59. Gong D, Wu L, Zhang J, Mu G, Shen L, Liu J, et al. Detection of colorectal adenomas with a real-time computer-aided system (ENDOANGEL): A randomised controlled study. Lancet Gastroenterol Hepatol 2020 Apr;5(4):352-361. [CrossRef]
    60. Liu W, Zhang Y, Bian X, Wang L, Yang Q, Zhang X, et al. Study on detection rate of polyps and adenomas in artificial-intelligence-aided colonoscopy. Saudi J Gastroenterol 2020;26(1):13. [CrossRef]
    61. Luo Y, Zhang Y, Liu M, Lai Y, Liu P, Wang Z, et al. Artificial intelligence-assisted colonoscopy for detection of colon polyps: A prospective, randomized cohort study. J Gastrointest Surg 2020 Sep 23:1-8. [CrossRef] [Medline]
    62. Repici A, Badalamenti M, Maselli R, Correale L, Radaelli F, Rondonotti E, et al. Efficacy of real-time computer-aided detection of colorectal neoplasia in a randomized trial. Gastroenterology 2020 Aug;159(2):512-520.e7. [CrossRef] [Medline]
    63. Wang P, Liu P, Glissen Brown JR, Berzin TM, Zhou G, Lei S, et al. Lower adenoma miss rate of computer-aided detection-assisted colonoscopy vs routine white-light colonoscopy in a prospective tandem study. Gastroenterology 2020 Oct;159(4):1252-1261.e5. [CrossRef] [Medline]
    64. Liu W, Zhang Y, Bian X, Wang L, Yang Q, Zhang X, et al. Study on detection rate of polyps and adenomas in artificial-intelligence-aided colonoscopy. Saudi J Gastroenterol 2020;26(1):13. [CrossRef]
    65. Rees CJ, Thomas Gibson S, Rutter MD, Baragwanath P, Pullan R, Feeney M, British Society of Gastroenterology‚ the Joint Advisory Group on GI Endoscopy‚ the Association of Coloproctology of Great Britain and Ireland. UK key performance indicators and quality assurance standards for colonoscopy. Gut 2016 Dec;65(12):1923-1929 [FREE Full text] [CrossRef] [Medline]
    66. Kaminski MF, Regula J, Kraszewska E, Polkowski M, Wojciechowska U, Didkowska J, et al. Quality indicators for colonoscopy and the risk of interval cancer. N Engl J Med 2010 May 13;362(19):1795-1803. [CrossRef]
    67. Kim NH, Jung YS, Jeong WS, Yang H, Park S, Choi K, et al. Miss rate of colorectal neoplastic polyps and risk factors for missed polyps in consecutive colonoscopies. Intest Res 2017 Jul;15(3):411-418 [FREE Full text] [CrossRef] [Medline]
    68. Leufkens A, van Oijen M, Vleggaar F, Siersema P. Factors influencing the miss rate of polyps in a back-to-back colonoscopy study. Endoscopy 2012 May;44(5):470-475. [CrossRef] [Medline]
    69. Gross S, Trautwein C, Behrens A, Winograd R, Palm S, Lutz HH, et al. Computer-based classification of small colorectal polyps by using narrow-band imaging with optical magnification. Gastrointest Endosc 2011 Dec;74(6):1354-1359. [CrossRef] [Medline]
    70. Clark BT, Rustagi T, Laine L. What level of bowel prep quality requires early repeat colonoscopy: Systematic review and meta-analysis of the impact of preparation quality on adenoma detection rate. Am J Gastroenterol 2014 Nov;109(11):1714-1723; quiz 1724 [FREE Full text] [CrossRef] [Medline]
    71. Lai EJ, Calderwood AH, Doros G, Fix OK, Jacobson BC. The Boston bowel preparation scale: A valid and reliable instrument for colonoscopy-oriented research. Gastrointest Endosc 2009 Mar;69(3 Pt 2):620-625 [FREE Full text] [CrossRef] [Medline]
    72. Shaukat A, Rector TS, Church TR, Lederle FA, Kim AS, Rank JM, et al. Longer withdrawal time is associated with a reduced incidence of interval cancer after screening colonoscopy. Gastroenterology 2015 Oct;149(4):e14-e15. [CrossRef]
    73. Reporting guidelines under development for other study designs. The EQUATOR (Enhancing the QUAlity and Transparency Of health Research) Network.   URL: https:/​/www.​equator-network.org/​library/​reporting-guidelines-under-development/​reporting-guidelines-under-development-for-other-study-designs/​ [accessed 2020-03-24]
    74. Sounderajah V, Ashrafian H, Aggarwal R, De Fauw J, Denniston AK, Greaves F, et al. Developing specific reporting guidelines for diagnostic accuracy studies assessing AI interventions: The STARD-AI Steering Group. Nat Med 2020 Jun;26(6):807-808. [CrossRef] [Medline]
    75. Hur J, Baek MJ. Limitation and value of using the adenoma detection rate for colonoscopy quality assurance. Ann Coloproctol 2017 Jun;33(3):81 [FREE Full text] [CrossRef] [Medline]
    76. Mori Y, Kudo S, East JE, Rastogi A, Bretthauer M, Misawa M, et al. Cost savings in colonoscopy with artificial intelligence-aided polyp diagnosis: An add-on analysis of a clinical trial (with video). Gastrointest Endosc 2020 Oct;92(4):905-911.e1. [CrossRef] [Medline]
    77. Topol E. Artificial intelligence and robotics. The Topol Review. Preparing the Healthcare Workforce to Deliver the Digital Future. London, UK: NHS England; 2019 Feb.   URL: https://topol.hee.nhs.uk/wp-content/uploads/HEE-Topol-Review-2019.pdf [accessed 2021-07-01]
    78. DeCamp M, Lindvall C. Latent bias and the implementation of artificial intelligence in medicine. J Am Med Inform Assoc 2020 Dec 09;27(12):2020-2023 [FREE Full text] [CrossRef] [Medline]
    79. Rigby MJ. Ethical dimensions of using artificial intelligence in health care. AMA J Ethics 2019 Feb 01;21:121-124 [FREE Full text] [CrossRef]

    ‎
    ADR: adenoma detection rate
    AI: artificial intelligence
    ASGE: American Society of Gastrointestinal Endoscopy
    CAD: computer-aided diagnosis
    CNN: convolutional neural network
    CRC: colorectal cancer
    DCNN: deep convolutional neural network
    IBD: inflammatory bowel disease
    NBI: narrow band imaging
    OR: odds ratio
    PDR: polyp detection rate
    PIVI: Preservation and Incorporation of Valuable endoscopic Innovations
    PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses
    PROSPERO: International Prospective Register of Systematic Reviews
    QUADAS-2: Quality Assessment of Diagnostic Accuracy Studies 2
    RCT: randomized controlled trial
    STARD-AI: Standards for Reporting of Diagnostic Accuracy Studies–Artificial Intelligence

    Edited by R Kukafka; submitted 22.01.21; peer-reviewed by K Lam, F Iqbal; comments to author 27.01.21; revised version received 09.03.21; accepted 06.05.21; published 14.07.21

    Copyright

    ©Scarlet Nazarian, Ben Glover, Hutan Ashrafian, Ara Darzi, Julian Teare. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 14.07.2021.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.