This paper is in the following e-collection/theme issue:

Digital Health Reviews (1186) Diabetes Self-Management (463) Diabetes Reviews and Scoping Studies (29) Diabetes (152) Diabetes Prevention (77) Web-based and Mobile Health Interventions (3114) Diabetes Health Services and System Innovations (104) Quality Evaluation and Descriptive Analysis/Reviews of Multiple Existing Mobile Apps (362) Diabetes Technology Around the World (18) Health Coaching for Diabetes Patients (142) Reviews on Diabetes Technologies and Innovations (20)

Published on in Vol 24, No 1 (2022): January

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/33348, first published .
Digital Behavior Change Interventions for the Prevention and Management of Type 2 Diabetes: Systematic Market Analysis

Digital Behavior Change Interventions for the Prevention and Management of Type 2 Diabetes: Systematic Market Analysis

Digital Behavior Change Interventions for the Prevention and Management of Type 2 Diabetes: Systematic Market Analysis

Authors of this article:

Roman Keller1, 2 Author Orcid Image ;   Sven Hartmann3 Author Orcid Image ;   Gisbert Wilhelm Teepe4 Author Orcid Image ;   Kim-Morgaine Lohse4 Author Orcid Image ;   Aishah Alattas1 Author Orcid Image ;   Lorainne Tudor Car5, 6 Author Orcid Image ;   Falk Müller-Riemenschneider2, 7 Author Orcid Image ;   Florian von Wangenheim1, 4 Author Orcid Image ;   Jacqueline Louise Mair1, 2 Author Orcid Image ;   Tobias Kowatsch1, 3, 4 Author Orcid Image
Article Authors Cited by (17) Tweetations (15) Metrics

    Review

    1Future Health Technologies Programme, Campus for Research Excellence and Technological Enterprise, Singapore-ETH Centre, Singapore, Singapore

    2Saw Swee Hock School of Public Health, National University of Singapore, Singapore, Singapore

    3Centre for Digital Health Interventions, Institute of Technology Management, University of St Gallen, St Gallen, Switzerland

    4Centre for Digital Health Interventions, Department of Management, Technology, and Economics, ETH Zurich, Zurich, Switzerland

    5Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore

    6Department of Primary Care and Public Health, School of Public Health, Imperial College London, London, United Kingdom

    7Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore

    *these authors contributed equally

    Corresponding Author:

    Roman Keller, MSc

    Future Health Technologies Programme

    Campus for Research Excellence and Technological Enterprise

    Singapore-ETH Centre

    1 Create Way

    CREATE Tower, #06-01

    Singapore, 138602

    Singapore

    Phone: 65 82645302

    Email: roman.keller@sec.ethz.ch


    Background: Advancements in technology offer new opportunities for the prevention and management of type 2 diabetes. Venture capital companies have been investing in digital diabetes companies that offer digital behavior change interventions (DBCIs). However, little is known about the scientific evidence underpinning such interventions or the degree to which these interventions leverage novel technology-driven automated developments such as conversational agents (CAs) or just-in-time adaptive intervention (JITAI) approaches.

    Objective: Our objectives were to identify the top-funded companies offering DBCIs for type 2 diabetes management and prevention, review the level of scientific evidence underpinning the DBCIs, identify which DBCIs are recognized as evidence-based programs by quality assurance authorities, and examine the degree to which these DBCIs include novel automated approaches such as CAs and JITAI mechanisms.

    Methods: A systematic search was conducted using 2 venture capital databases (Crunchbase Pro and Pitchbook) to identify the top-funded companies offering interventions for type 2 diabetes prevention and management. Scientific publications relating to the identified DBCIs were identified via PubMed, Google Scholar, and the DBCIs’ websites, and data regarding intervention effectiveness were extracted. The Diabetes Prevention Recognition Program (DPRP) of the Center for Disease Control and Prevention in the United States was used to identify the recognition status. The DBCIs’ publications, websites, and mobile apps were reviewed with regard to the intervention characteristics.

    Results: The 16 top-funded companies offering DBCIs for type 2 diabetes received a total funding of US $2.4 billion as of June 15, 2021. Only 4 out of the 50 identified publications associated with these DBCIs were fully powered randomized controlled trials (RCTs). Further, 1 of those 4 RCTs showed a significant difference in glycated hemoglobin A1c (HbA1c) outcomes between the intervention and control groups. However, all the studies reported HbA1c improvements ranging from 0.2% to 1.9% over the course of 12 months. In addition, 6 interventions were fully recognized by the DPRP to deliver evidence-based programs, and 2 interventions had a pending recognition status. Health professionals were included in the majority of DBCIs (13/16, 81%,), whereas only 10% (1/10) of accessible apps involved a CA as part of the intervention delivery. Self-reports represented most of the data sources (74/119, 62%) that could be used to tailor JITAIs.

    Conclusions: Our findings suggest that the level of funding received by companies offering DBCIs for type 2 diabetes prevention and management does not coincide with the level of evidence on the intervention effectiveness. There is considerable variation in the level of evidence underpinning the different DBCIs and an overall need for more rigorous effectiveness trials and transparent reporting by quality assurance authorities. Currently, very few DBCIs use automated approaches such as CAs and JITAIs, limiting the scalability and reach of these solutions.

    J Med Internet Res 2022;24(1):e33348

    doi:10.2196/33348

    Keywords

    digital health companies; health care; type 2 diabetes; prevention; management; conversational agent; digital behavior change intervention; investment; just-in-time adaptive intervention; digital health; diabetes; agent; behavior 


    In 2019, approximately 463 million adults were estimated to be living with diabetes [1]. This estimate is expected to rise to more than 700 million by 2045 [1]. More than 90% of this burden is caused by type 2 diabetes. [1,2]. Over 1 million deaths worldwide were attributed to this condition in 2017 alone, making it the ninth leading cause of mortality [3]. Diabetes is also a leading source of global health expenditure with an estimated annual cost of US $760 billion in high- and low-income countries, including the United States (US $259 billion), China (US $109 billion), and Brazil (US $52 billion) [1].

    Guidelines for the prevention and management of type 2 diabetes include specific recommendations for lifestyle behavior changes such as diet, exercise, smoking cessation, and the addition of oral antidiabetic agents or insulin therapy in some cases [4,5]. Traditionally, diabetes prevention and self-management education programs have been delivered in person with individual or face-to-face group interactions between health professionals and participants [6]. However, traditional in-person approaches have been hampered by low uptake and engagement rates [7]. Qualitative literature suggests that participants often find face-to-face programs difficult to attend because of issues with the timing of the courses, lack of transport, family and work commitments, or negative feelings toward participating in groups [8]. More recently, digital behavior change interventions (DBCIs) for diabetes prevention and management have emerged as potentially effective, scalable, and low-cost options to provide behavioral counseling when in-person programs are not accessible or attractive [9-11].

    DBCIs are interventions that use digital technology to encourage and support behavior change that will maintain or improve health through the prevention and management of health problems and can, for example, be delivered through computer programs, websites, mobile apps, or wearable devices [12]. DBCIs may involve telehealth elements such as remote monitoring by health professionals who provide virtual support, either individually or in groups, or fully automated interventions that are based on algorithms [13]. DBCIs are becoming increasingly automated, interactive, and personalized because they use self-reports of users or sensor data to tailor feedback without the need for inputs from health professionals [14]. This development is facilitated by new technology-driven developments such as conversational agents (CAs) and just-in-time adaptive interventions (JITAIs). CAs, also known as chatbots, are computer systems that imitate human conversation using text or spoken language and can offer personalized human-like interactions [15-18]. Evidence from interventions using CAs show promising findings in terms of patient satisfaction [19], treatment success [20], and the capability to build work alliances with the patient [21-23]. CAs can also foster experiences equivalent to those offered by human coaches but with the additional advantage of being persistent and more consistent in providing choices that cultivate user autonomy [24]. This makes the use of CAs in DBCIs an encouraging component to complement or replace the need for human health professionals in intervention delivery.

    Moreover, recent advances in wireless devices and mobile technology have enabled the design of JITAIs that can provide behavior change support at opportune moments and in response to an individual’s changing contexts [25-27]. More specifically, JITAIs adapt the provision of intervention content (eg, the type, timing, and intensity) by measuring the health condition or patient behavior with mobile technology such as smartphones, sensors, and software analytics to deliver intervention content at the time and in the context that the person needs it the most, and this is likely to improve health-related behaviors [25,27-29].

    Novel technology-driven opportunities for DBCIs in diabetes care have attracted various health care stakeholders such as investors, health insurance companies, researchers, physicians, and patients [30]. The global market for digital diabetes care is rapidly growing and is expected to be worth US $1.5 billion in 2024 [31]. In 2018 alone, venture capital companies invested a record US $417 million into digital diabetes companies, a 12-fold increase in funding compared to 2013 [32]. However, little is known about the DBCIs provided by companies that have a substantial impact on the market, including the content of the interventions, how effective they are in managing and preventing type 2 diabetes, and the degree to which these interventions leverage new technology-driven developments such as CAs or JITAIs.

    The aim of this paper is to systematically review the solutions provided by the top-funded companies offering DBCIs for type 2 diabetes prevention and management with a particular focus on how new technological developments, such as CAs and JITAIs, are being used to automate and scale-up intervention delivery. Therefore, the paper has the following objectives: (1) to identify the top-funded companies offering DBCIs for type 2 diabetes management and prevention, (2) to appraise the level of evidence to support these DBCIs in the form of peer-reviewed publications and recognition by national authorities for delivering evidence-based programs, and (3) to describe the characteristics of these DBCIs, with particular focus on the use of automation involved in the DBCIs by investigating the use of CAs, involvement of human health professionals, and what as well as how health and behavioral outcomes are measured that could be used to tailor JITAIs.


    Searches

    Companies

    Digital health companies offering DBCIs were identified using 2 venture capital databases, Crunchbase Pro and Pitchbook [33,34]. Both databases are among the most comprehensive and accurate venture capital databases and are commonly used as data sources for academic reports and by investors [35]. We define digital health companies as companies that build and sell digital health products or services according to the definition of Safavi et al [36].

    Searches were carried out on July 23, 2020, and they were updated on April 8, 2021 (Crunchbase Pro only). The total funding amount was last updated on June 15, 2021 using Crunchbase Pro). In case of conflicting funding information between the 2 databases, Crunchbase Pro data were reported, as Crunchbase Pro has better coverage than Pitchbook with respect to the financing rounds and total capital committed [35]. The search strategy included an extensive list of terms describing the constructs “verticals, methods, and industries,” “diabetes,” and “management and prevention.” The overview of the complete search strategy used for Crunchbase and Pitchbook is given in Table 1.

    Table 1. Search strategy used in Crunchbase Pro and Pitchbook.
    Search categorySearch terms
    1. Verticals, methods, and industriesMonitoring Equipment OR diagnostic OR HealthTech OR healthcare devices OR connected health* OR Therapeutic Devices OR Digital Health OR digital health* OR health* technology OR health* app* OR wearables OR Mobile health OR mhealth OR mobile app OR personal health OR virtual care OR e-health OR assistive technology OR telehealth OR telemedicine OR health* platform OR healthcare it OR data management OR Artificial Intelligence & Machine Learning OR Cloud data services OR analytics OR health* diagnostics OR Big Data OR information OR digital OR data OR biometrics OR home health care OR medtech OR self-monitoring
    2. Diabetesobesity OR blood sugar OR blood glucose OR insulin OR diabet*
    3. Management and preventiondiabetes management OR diabetes treatment OR diabetes control OR diabetes monitoring OR blood sugar monitoring OR disease monitoring OR disease management OR risk reduction OR disease prevention OR diabetes prevention OR prevention OR prediabet*
    Inclusion and Exclusion Criteria

    We were interested in the companies having a substantial impact on the market and their ability to develop evidence-based solutions. Therefore, we decided to limit the scope of the analysis to the 15 top-funded companies defined as the leading companies in terms of the total funding amount, given that these companies are likely best equipped to develop and evaluate their interventions.

    Companies were included if they (1) offered a DBCI for the prevention or management of type 2 diabetes and (2) involved a mobile app as the main intervention component. Companies were excluded if their DBCI (1) did not predominantly involve behavior change, (2) did not involve a mobile app as the main intervention component, and (3) did not focus on type 2 diabetes. We also excluded companies where the targeted conditions of the companies’ DBCIs were not clearly identifiable.

    Company Selection

    Following the removal of duplicates, companies were ranked in the order of their funding amount. Company screening was conducted by screening from the most to the least funded companies until 15 companies eligible for inclusion in the study were identified. All the remaining companies were excluded due to insufficient funding amount. The list of the identified companies was reviewed by 3 experts with extensive industry and academic experience in the fields of digital health and type 2 diabetes to confirm that all relevant companies, covering the current market, had been identified through database searching. The experts included 2 scientific researchers with over 10 years of work experience with DBCIs at universities in the United Kingdom and United States and 1 industry expert with several years of work experience at one of the global market leaders for diabetes management systems in Germany.

    Publications

    We searched PubMed and Google Scholar for scientific articles published up to April 30, 2021, using search terms “Name_Intervention” AND (Smartphone OR Application OR App OR Intervention OR Mobile Health) relating to the identified company’s DBCI. In addition, we identified studies by screening the websites of the companies for publication references.

    Inclusion and Exclusion Criteria

    To investigate the impact of the included DBCIs on health or behavioral outcomes in the study population, we included publications reporting quantitative results of experimental trials. Therefore, we excluded studies that did not involve effectiveness outcomes and those that did not report quantitative results. Furthermore, we excluded protocol studies and studies that targeted conditions other than type 2 diabetes.

    DBCIs

    All the identified DBCIs included a mobile app as the main form of intervention delivery. We searched and downloaded all the identified apps from the 2 most popular app stores, Google Play Store and Apple App Store [37], between October 12, 2020, and April 10, 2021. If an app was not accessible, the companies were approached via email to request access. If no reply was received for the first email, a follow-up email was sent 2 weeks later. We also reviewed the DBCIs’ and companies’ websites as well as the identified publications for information on the characteristics of the DBCIs. Additional hardware devices such as activity trackers, blood glucose meters, wireless scales, or blood pressure devices that came as a part of the intervention program were not available and were therefore not reviewed.

    Data Extraction

    Data extraction of companies, publications, and DBCIs was performed by 2 independent investigators (RK and SH). Disagreements were discussed and resolved by consensus. If no agreement was possible, disagreements were resolved through discussion with a third reviewer (GWT). Data extraction was performed using the Covidence Systematic Review software (Veritas Health Innovation Ltd) [38].

    Companies

    The extracted data for each company included the founding year, total funding amount, number of employees, and company headquarter location.

    Publications

    From the identified publications, we extracted the publication year, study design, number of participants, measured outcomes, quality of evidence (using the criteria of the US Preventive Services Task Force), journal impact factor, comparison to other treatment methods, and study findings. Similar to Safavi et al [36], the quality of individual studies was defined according to the USPSTF hierarchy of research design as follows: Level 1 includes evidence obtained from properly powered and conducted randomized controlled trials (RCTs), well-conducted systematic reviews, or meta-analyses of homogeneous RCTs. Level 2 includes evidence obtained from well-designed controlled trials without randomization, well-designed cohort or case-control analysis studies, or multiple time-series designs with or without the intervention or dramatic results in uncontrolled studies of large magnitude. Level 3 includes opinions of respected authorities, based on clinical experience or descriptive studies, or reports of expert committees [39]. As we were interested in the best available scientific evidence regarding the interventions, we extracted the results of publications with quality level 1. We specifically examined the primary outcome(s) from RCTs that were powered to detect change.

    DBCIs

    For each DBCI, we extracted the name of the intervention, name of the app, app accessibility information, number of app downloads (from Google Play Store only, as this information is not available on the Apple App Store), operating systems, cost, addressed category of the health care continuum (management or prevention), and the involvement of health professionals. For each DBCI with app access, we also extracted information on the availability of a CA and the measured health and behavioral outcomes. We were particularly interested in what and how health and behavioral outcomes were measured and if they could potentially be used to tailor JITAIs. Health and behavioral outcomes were defined as any biomarkers or health behaviors relevant for diabetes care such as diet, physical activity, or blood glucose tracking. Measurements included self-report data or sensor and device analytics [40-42]. More information on the framework used to assess the measurements of health and behavioral outcomes can be found in Multimedia Appendix 1.

    We were also interested in whether the DBCIs were recognized by a national authority as an evidence-based program. For this purpose, we used the Diabetes Prevention Recognition Program (DPRP) developed by the US Centers for Disease Control and Prevention (CDC) [43]. The DPRP is the quality assurance arm of the National Diabetes Prevention Program, which is a partnership of public and private organizations that aim to prevent or delay type 2 diabetes [43]. Through the DPRP, the US CDC recognizes organizations that have demonstrated their ability to deliver an effective lifestyle change program. The organizations are required to use a CDC-approved curriculum and can deliver the intervention either in person by employing a trained human health coach or through a virtual setting with interaction involving a lifestyle coach [44]. The organizations are evaluated regularly based on the participant data submitted to the DPRP. These data need to fulfill a set of requirements, including a reduction in the risk of diabetes by achieving improvements in participant outcomes such as weight loss or glycated hemoglobin (HbA1c) reductions [44].

    Data Synthesis

    The information extracted from the companies, publications, and DBCIs was summarized narratively.


    Selection and Inclusion of Companies

    The search yielded a total of 133 companies on Crunchbase Pro and 399 companies on Pitchbook. After removal of duplicates, 489 companies were eligible for screening. After screening, 54 companies were found to be ineligible for study inclusion, with the most common reason being not predominantly involving behavior change (36/54, 67%). Of the remaining 435 companies, 420 were excluded due to insufficient funding to be among the 15 top-funded companies. An additional company (KKT Technology Pte Ltd) was included on the recommendation of the independent experts, ultimately resulting in 16 companies eligible for study inclusion. Figure 1 outlines the selection process and reasons for exclusion. All the DBCIs of the included companies were available in English language.

    The apps of 6 DBCIs were not accessible to the study authors (Virta, Dario, Welldoc, Liva, Twin, and Sweetch) because they were only available with a subscription service, in a specific geographic region, with an employer subscription, or when referred by a physician. Therefore, no information on the health and behavioral outcomes, measurements, or availability of CAs is provided on these apps within the results.

    ‎
    Figure 1. Flowchart of the company selection process.
    View this figure

    Company Characteristics

    The funding amount of the 16 top-funded digital health companies chosen for inclusion in the analysis ranged from US $657.3 to 15.5 million, totaling US $2.355 billion, as indicated in Table 2. Moreover, 11 companies (69%) were headquartered in the United States, 2 (13%) in the United Kingdom (13%), and 1 each in Denmark, Israel, and Singapore (6%). The year of founding ranged between 2005 and 2018, with 81% (13/16 companies) founded from 2011 onward. Additional information regarding the companies’ characteristics can be found in Multimedia Appendix 2.

    Table 2. Overview of funding amounts determined for the included companies and scientific evidence obtained for the included digital behavior change interventions.
    Company nameFunding
    (million US$)    		DBCIa nameNumber of publications categorized by
    evidence levelb    		DPRPc recognitiond



    		Level 1Level 2Level 3
    Noom Inc657.3Noom170Full
    Virta Health Corp373Virta070None
    Omada Health Inc256.5Omada0110Full
    Livongo Health Inc235Livongo130Full
    Vida Health Inc188Vida020Full
    DarioHealth Corp169Dario000None
    Informed Data Systems Inc (One Drop)106.2One Drop020Pending
    Lark Technologies Inc95.7Lark010Full
    Welldoc Inc55.2BlueStar150Pending
    Liva Healthcare ApS43.5Liva130None
    Twin Health Inc43.5Twin010None
    Oviva Inc33Oviva020None
    KKT Technology Pte Ltd (Holmusk)31.3GlycoLeap010None
    Sweetch Health Ltd27.5Sweetch010None
    Nemaura Medical Inc25BEATdiabetes000None
    Fruit Street Health Inc15.5Fruit Street000Full

    aDBCI: digital behavior change intervention.

    bPublication evidence level determined using the criteria of the US Preventive Services Task Force.

    cDPRP: Diabetes Prevention Recognition Program.

    dRecognition was established as none, pending, preliminary, or full, in line with the DPRP.

    Scientific Evidence

    Totally 50 published studies related to the 16 companies’ DBCIs focusing on effectiveness were identified, as shown in Table 2. Further details on the study characteristics are available in Multimedia Appendix 3. The publication dates ranged from 2008 to 2021, with 86% (43/50) of the studies published from 2016 onward. The sample size of each study ranged from 16 to 35,921 participants. Out of the 50 studies, only 4 (8%) had quality level 1, evaluating DBCIs Noom, Livongo, BlueStar, and Liva. The remaining 46 studies (92%) had quality level 2. No studies were found for interventions Dario, BEATdiabetes, and Fruit Street. For 8 DBCIs, the recognition status in the DPRP of the US CDC was available, of which 6 DBCIs achieved full CDC recognition (Noom, Omada, Livongo, Vida, Lark, and Fruit Street), and 2 DBCIs had a pending recognition status (One Drop and BlueStar).

    Effectiveness of DBCIs

    Of the 4 identified studies with quality level 1, 3 were RCTs having a duration of 12 months involving interventions Noom, BlueStar, and Liva [45-47], whereas 1 study involving Livongo [48] was a 6-month-long intervention tested within a randomized crossover trial spanning 12 months, with crossover at 6 months. BlueStar was the only intervention that resulted in a significantly greater improvement in the HbA1c of the intervention group than that of the usual care group (mean difference 1.2%; 95% CI 0.5-1.9; P=.001) at 12 months follow-up [47]. In the study with Noom, Toro-Ramos et al [46] found no difference in the HbA1c (mean difference 0.006%; SE 0.07; P=.93) between the intervention and control groups at 12 months follow-up [46]. Johansen et al [46] found that the Liva intervention did not reach the prespecified criterion for equivalence (mean difference −0.26%; 95% CI −0.52 to −0.01; P=.15) [46]. In the randomized crossover trial of Livongo, Amante et al [49] reported similar rates of HbA1c change in both groups (intervention/usual care and usual care/intervention), and a significant treatment effect (mean change for intervention/usual care −1.1%, SD 1.5; mean change for usual care/intervention −0.8%, SD 1.5; P<.001) during the first 6 months. However, in the mixed-effects model, there was no significant improvement in HbA1c between the intervention and usual care conditions (mean change 0.4%; P=.06). Compared to baseline, the interventions of Noom, Liva, and BlueStar showed HbA1c reductions of 0.23% [45], 0.31% [46], and 1.9% [47] at 12 months, respectively. Using Livongo yielded HbA1c reductions of 0.9% and 1.2% for the intervention/usual care and usual care/intervention group, respectively [48]. A summary of all the reported effectiveness measures among the identified scientific publications can be found in Multimedia Appendix 3.

    Characteristics of DBCIs

    The full list of the included DBCIs is outlined in Table 3. Overall, 11 DBCIs were found to address diabetes prevention and management (Noom, Omada, Livongo, Vida, Lark, BlueStar, Liva, Oviva, GlycoLeap, Sweetch, and BEATdiabetes), whereas 4 DBCIs addressed only diabetes management (Virta, Dario, One Drop, and Twin), and 1 solely focused on diabetes prevention (Fruit Street). The program costs varied, ranging from US $19.99 to $249 per month, whereas some were available on an annual basis or covered by health care providers, health plans, or employers. Furthermore, 11 DBCIs (Noom, Virta, Omada, Vida, One Drop, BlueStar, Liva, Oviva, GlycoLeap, BEATdiabetes, and Fruit Street) involved a human health professional as part of the intervention delivery, and 2 DBCIs (Livongo and Dario) offered it as an optional feature. Among the 3 remaining DBCIs, 2 did not employ a health professional (Lark and Sweetch), and this could not be determined in 1 DBCI (Twin). Of the 16 included DBCIs, 10 apps were accessible to the authors. Only 1 of the 10 accessible apps employed a CA (Lark).

    We found that all the 10 accessible apps (10/16, 63%) tracked health or behavioral outcomes using self-reports as well as sensor and device analytics. Diet and body weight were the most frequently tracked health and behavioral outcomes (n=10), followed by physical activity or exercise (n=9), blood glucose (n=7), blood pressure and HbA1c (n=5), mood (n=3), sleep (n=3), medication (n=2), waist circumference (n=1), well-being (n=1), calories (n=1), heart rate (n=1), and stress (n=1).

    Table 3. Intervention delivery characteristics of the companies’ digital behavior change interventions.
    DBCIa nameHealth continuum categoryCostHHPb
    involved    		CAc usedTracked health and behavioral outcomesSelf-reports; sensor and device analytics
    NoomPrevention and managementUS $59/month or $199/yearYesNoPhysical activity, body weight, sleep, diet, and blood pressureOpen questions, ratings, multiple choice, physical activity recordings, and accelerometer gyroscope
    VirtaManagementUS $249/month plus a one-time $250 initiation feeYes—d——
    OmadaPrevention and managementUS $140/month for the first 4 months and $20/month for the following monthsYesNoBlood glucose, physical activity, body weight, diet, and blood pressureOpen questions, ratings, multiple choice, body sensors, physical activity recordings, and Bluetooth
    LivongoPrevention and managementPurchase free; costs covered by employer, health plan, or health care providerYes, but optionalNoHbA1ce, blood glucose, physical activity, body weight, diet, and blood pressureOpen questions, ratings, body sensors, camera, Bluetooth, and accelerometer gyroscope
    VidaPrevention and managementFree download, free 1 week trial, and subscription US $58.25-$79/monthYesNoHbA1c, physical activity, body weight, stress, and dietOpen questions, ratings, multiple choice, and Bluetooth
    DarioManagementBasic US $25-$30/month, pro US $33-$40/month, and premium US $70-$85/ monthYes, but optional———
    One DropManagementDigital membership US $19.99/month, supplies $20.99/month, and combined package $30.99/monthYesNoHbA1c, blood glucose, physical activity, body weight, medication, diet, and blood pressureOpen questions, ratings, multiple choice, location, camera, and telephone
    LarkPrevention and managementLark Weight Loss Pro US $19.99, Lark Wellness Pro $14.99, and Lark Diabetes Prevention Program Pro $119.99NoYesPhysical activity, body weight, sleep, mood, well-being, and dietOpen questions, ratings, multiple choice, Bluetooth, accelerometer gyroscope, GPSf, and app usage
    BlueStarPrevention and managementUnclearYes———
    LivaPrevention, ManagementUnclearYes———
    TwinManagementINRg 1450 (1 INR=US $0.01344) for a 14-day trial; price for continuous use unclearUnclear———
    OvivaPrevention and managementCHFh 484 (1 CHF=US $1.09204) carried by health care providerYesNoBlood glucose, physical activity, body weight, mood, and dietOpen questions, ratings, multiple choice, and camera
    GlycoLeapPrevention and managementFree, but only available for diabetic and prediabetic patients through their doctor if they are part of the project or through particular employersYesNoHbA1c, blood glucose, body weight, mood, and dietOpen questions, ratings, camera, Bluetooth, and photos
    SweetchPrevention and managementUnclearNo———
    BEATdiabetesPrevention and ManagementUnclearYesNoHbA1c, blood glucose, physical activity, body weight, medication, waist circumference, and dietOpen questions, ratings, multiple choice, and Bluetooth
    Fruit StreetPreventionUS $19.99/monthYesNoBlood glucose, physical activity, body weight, sleep, heart rate, calories, diet, and blood pressureOpen questions, ratings, physical activity recordings, camera, and Bluetooth

    aDBCI: digital behavior change intervention.

    bHHP: human health professional.

    cCA: conversational agent.

    d—app not accessible.

    eHbA1c: glycated hemoglobin A1c.

    fGPS: Global Positioning System.

    gINR: Indian Rupee.

    hCHF: Swiss Franc.

    The findings regarding the usage of self-reports as well as sensor and device analytics are summarized in Figure 2. In the 119 usages considered, self-reports were used 74 times (62%), whereas sensor and device analytics were used 45 times (38%) as the data source of the 10 accessible apps. Self-reports were most frequently measured by closed questions including ratings, Likert scales, and multiple-choice questions (49 times, 41%) followed by open questions (25 times, 21%). The sensor and device analytics that were most frequently used were Bluetooth and cameras, which were used 18 (15%) and 7 times (6%), respectively. The darker color indicates a higher number of occurrences.

    ‎
    Figure 2. Gray scale illustrating the number of times health or behavioral outcomes were measured by self-reports or sensor and device analytics summarized considering all the 10 reviewed apps. DA: device analytics; GPS: Global Positioning System.
    View this figure

    Principal Results

    Of the 16 companies and DBCIs included in this review, only 4 were assessed for their effectiveness in changing HbA1c via high-quality RCTs. Results from the 4 RCTs analyzed indicate these DBCIs have a varying effect on HbA1c. For example, the BlueStar intervention showed a significant improvement of 1.2% in HbA1c compared to the usual care group at 12 months, whereas the Noom, Livongo, and Liva interventions did not show any significant improvements. Furthermore, there was a wide range in the number of effectiveness studies across DBCIs, with 1 study having no published scientific evidence to 1 having 11 associated publications. We found a trend toward more published studies involving higher-funded companies, with the 3 top-funded companies (Noom, Virta, and Omada) accounting for more than half (26/50, 52%) of all publications. We also found that 5 of the highest-funded DBCIs achieved full recognition status from the DPRP (Noom, Omada, Livongo, Vida, and Lark), whereas only 1 among the lower-funded companies with funding ranks 9 to 16 (Fruit Street) received full DPRP recognition. Further, 2 DBCIs in our sample (Dario and BEATdiabetes) were neither recognized by the DPRP nor had any published effectiveness studies available. More adequately powered and high-quality RCTs are needed to confirm the effectiveness of top-funded DBCIs for type 2 diabetes prevention and management.

    Recognition by national authorities to deliver evidence-based programs can be an important reference point for potential consumers and physicians when deciding to use or prescribe a particular intervention program and can serve to incentivize the adoption of impact-focused interventions [36]. Recognition can benefit the companies offering the interventions by providing sustainability and reimbursement for the intervention through many private and public payers that require recognition, such as Medicare [49]. Recognition can also be an effective marketing tool and encourage referrals. However, we only found 1 certification program for evidence-based diabetes prevention or management programs, which was the DPRP offered by the US CDC [43]. This lack of quality assurance programs could hamper consumers’ and health care providers’ decision-making processes when identifying the most effective programs. Therefore, additional quality assurance programs that can certify diabetes prevention and management interventions based on evidence-based criteria are necessary, especially for diabetes management interventions and in countries other than the United States.

    Reduction in HbA1c is one of the key clinical outcomes for assessing the effectiveness of interventions for type 2 diabetes prevention and management and is also one of the effectiveness criteria to achieve recognition by the DPRP [44]. In the 4 RCTs evaluated in our analysis, the Noom and Liva interventions showed modest HbA1c reductions of 0.2% to 0.3% [45,46], whereas the BlueStar and Livongo interventions showed higher HbA1c reductions of over 1% [47,48]. According to the criteria of the DPRP, an HbA1c reduction of 0.2 percentage points is considered sufficient for a lifestyle change program to receive recognition [44], although a change of 0.4% to 0.5% is considered a clinically meaningful improvement [50]. The 4 RCTs reviewed [46-49] were also powered to detect changes in HbA1c between 0.4% and 1%. Therefore, this raises the question of whether the effectiveness criterion of the DPRP standards around the change in HbA1c is sufficient. Furthermore, even though recognition from the DPRP guarantees that a certain level of diabetes risk reduction was achieved because of a specific DBCI, the recognition does not give any further information on the magnitude of the reduction, as data that companies submit to achieve DPRP recognition are not made publicly available. This lack of information limits transparency for researchers, investors, users, and payers to identify the most effective programs. Moreover, this lack of data transparency could become even more troublesome if companies that are already recognized to deliver evidence-based programs are then unwilling to invest additional resources into research and development. Therefore, we highlight the need for more transparency regarding data related to the effectiveness of DBCIs. We believe that our findings also indicate the importance of encouraging the digital health industry to build more evidence-based DBCIs. Clarifying the regulatory landscape around DBCIs and developing incentives that lead to a stronger customer market have been identified as 2 possible areas that policy makers may address to foster such an encouragement [36]. In addition, we recognize the poor standard of reporting by the DBCI companies regarding the app features, employed behavior change techniques, and information on what and how sensing data are being utilized. This lack of transparent reporting is likely because companies that develop these proprietary apps tend to be reluctant to disclose app details that could potentially be useful for competitors. From a research perspective, this lack of transparency makes it difficult to compare intervention features objectively. It also reveals the need for more transparent reporting on the characteristics of DBCIs by the companies.

    In our reviewed DBCIs, the most commonly tracked health and behavioral outcomes were diet and body weight, which were tracked in all the 10 accessible apps, followed by physical activity or exercise, which was tracked in 9 apps. Other frequently tracked outcomes were blood glucose (7 apps), blood pressure, and HbA1c (5 apps each). Our findings are in line with previous studies that reviewed apps for self-management and lifestyle modification in type 2 diabetes patients [51-53] and are also similar to the opinion of clinical experts regarding important intervention components [53,54]. However, we found that less than 40% of health and behavioral outcomes were measured using sensors and device analytics and that most outcomes were measured by self-reports. Although such self-reports can be used in the form of ecological momentary assessments [55] that are closely related to the concept of JITAIs [56], self-reports can be burdensome for participants to complete and may lead to difficulties in keeping users engaged [25,57]. Therefore, we believe that self-reports are not sufficient to leverage the full potential of JITAIs. The low usage of measurements from sensor and device analytics indicates that it is unlikely that the investigated interventions use JITAI mechanisms to tailor the intervention content to the user. In addition, there is no clear evidence on how these intervention components are related to intervention effectiveness; therefore, future studies must identify which DBCI features most successfully impact intervention effectiveness.

    Our review also aimed to assess the extent to which human health professionals and automated CAs are used within the DBCIs. We found that 13 of the 16 DBCIs involved a human health professional, of which 2 DBCIs offered it as an optional feature. We found that among the 10 apps that were available to us, only 1 app used a CA. The high usage of human health coaches alongside the low usage of CAs, and the unlikely use of JITAI mechanisms to tailor intervention content, indicates the low use of automation among the investigated DBCIs. This limits the overall scalability of existing DBCIs and the potential of the interventions to reach a greater proportion of the eligible population [58] because the involvement of human health coaches is generally time- and resource-intensive.

    We identified 4 potential reasons that might account for this low use of automation among the investigated DBCIs. First, automated approaches, such as CAs, are still part of an emerging area within type 2 diabetes management and DBCIs. It is possible that users might have concerns when relying on CAs for actionable medical information around diabetes [59]. Second, app features that use sensor technologies might not be adequately developed to replace input from human health professionals or self-report methods, thus leading to significant user burden. For example, the current state-of-the-art food volume estimation approaches to assess dietary intake are not yet usable in commercial apps due to several gaps and technological issues [60]. Therefore, many apps rely on user inputs, for example, by selecting serving sizes of identified foods, based on which nutritional values can be estimated [60]. Third, there appears to be insufficient evidence to support the widespread use of fully automated approaches without remote access to a human health professional [13]. Thus, additional RCTs or cohort studies that directly compare DBCIs involving digital human coaches with fully automated approaches are needed to better understand the potential and effectiveness of automated DBCIs. Fourth, in the current standards and operating procedures of the DPRP, live interactions with lifestyle coaches should be offered at least on a weekly basis during the first 6 months [44]. Although email and text message interactions may contribute toward this requirement, it is likely to be challenging for companies aiming to offer fully automated DBCIs to meet this requirement. Recognition by the DPRP is valuable to many companies [49]; nevertheless, satisfying the requirement of offering live coaching interactions prevents the recognition of fully automated approaches and limits the scalability of DBCIs for type 2 diabetes prevention. Further research is warranted to establish if human coaches are indeed necessary to deliver an effective lifestyle change program.

    Strengths and Limitations

    This study has several strengths. First, we conducted a comprehensive company search involving 2 widely used venture capital databases [35], and we had 3 independent digital health experts confirm that the final list of included companies covered the market. Second, we conducted comprehensive data extraction using multiple sources, including databases, intervention websites, peer-reviewed publications, and mobile apps. Third, we summarized only the highest quality scientific evidence on the effectiveness of the included DBCIs.

    However, our review has some limitations. First, even though we identified the top-funded companies in the field, this does not guarantee that their interventions reach a significant proportion of the target population. Many of the reviewed companies are still in the start-up phase where they typically acquire considerable funding; however, their DBCIs may have limited accessibility, for example, only through referral by partnering clinicians. Second, we were only able to access 10 out of the 16 DBCI apps, as some apps were only accessible with a subscription service, in a specific geographic region, with a doctor’s prescription, an access code, or through an employer subscription. Although we systematically contacted the companies and requested app access, we only received additional access to 5 paid or proprietary apps through the companies. Third, we were unable to access, and therefore assess, any additional devices that may have accompanied the DBCI apps. Some of these devices record additional health parameters via sensors, such as (smart) blood glucose meters, (smart or wireless) scales, activity trackers, or smartwatches. Therefore, we could not assess all the functionalities of these devices, which limited the comprehensiveness of our review. Fourth, we were not able to assess certain app features that were behind a paywall. This was often the case for support that was delivered through health professionals. Fifth, the DPRP is only relevant for interventions targeting diabetes prevention and therefore does not cover DBCIs that solely target diabetes management. In addition, not all reviewed DBCIs were available in the United States; consequently, they are not eligible to achieve recognition by the DPRP. Sixth, given that most of the investigated DBCIs and all DBCIs with a corresponding fully powered RCT address diabetes management and diabetes prevention, it was not feasible to separately report the results in these 2 categories.

    Comparison With Prior Work

    This is the first systematic assessment of the top-funded companies that offer DBCIs for type 2 diabetes prevention or management. Previous reviews have focused on apps and digital interventions for diabetes management, but they were mostly limited to interventions reported in scientific research without a particular impact on the market [51,52,61-64]. These reviews generally found DBCIs to be effective in improving diabetes-related outcomes, particularly HbA1c [51,52,61-64], which is in line with our findings; nevertheless, they also concur that the current evidence is limited and there is a need for adequately powered, rigorous trials with long-term follow-ups to determine the clinical and economic impact of such interventions [52,65]. In terms of JITAIs, a recent systematic review investigating popular mental health apps for individuals with depression concluded that JITAI mechanisms have not yet been translated into mainstream depression apps [66], which also aligns with our findings.

    Conclusions

    Our findings suggest that the level of funding received by companies offering DBCIs for type 2 diabetes prevention and management does not coincide with the level of evidence on the intervention effectiveness. There is significant variation in the level of evidence underpinning the different DBCIs and an overall need for more rigorous effectiveness trials as well as additional certification programs for evidence-based diabetes prevention and management interventions in countries other than the United States. In addition, we emphasize the need for more data transparency from quality assurance authorities to inform stakeholders and consumers on how effective each DBCI is in improving diabetes-related outcomes. We further found low usage of CAs, an unlikely use of JITAI mechanisms, and a high level of support from human health professionals among the apps investigated, which indicates low usage of automated approaches. Because automation and technology are critical factors to increase the interventions’ scalability, further research is warranted to establish the effectiveness of fully automated DBCIs in comparison to those offering support from human health professionals. Finally, we recommend that national authorities such as the DPRP help reduce barriers for the recognition of fully automated approaches and encourage policy makers to foster an environment that encourages the digital health industry to build more evidence-based solutions.

    Acknowledgments

    We would like to thank Dr Alicia Salamanca-Sanabria for reviewing the manuscript and providing feedback. The research was conducted as part of the Future Health Technologies program, which was established collaboratively between ETH Zurich and the National Research Foundation, Singapore. This research is supported by the National Research Foundation, Prime Minister’s Office, Singapore, under its Campus for Research Excellence and Technological Enterprise program and by CSS Insurance (Switzerland).

    Authors' Contributions

    RK, SH, KL, and TK were responsible for the study design. GWT and TK developed the underlying framework defining which areas to investigate and how to review these areas. RK adapted this framework for the study. SH and KL were responsible for the search strategy. RK and SH were responsible for screening and data extraction. RK and GWT were responsible for aggregation, cleaning, and condensation of the data. RK was responsible for the first draft. All authors were responsible for critical feedback and final revisions to the manuscript. JM and TK share last authorship.

    Conflicts of Interest

    SH, GWT, KL, FvW, and TK are affiliated with the Center for Digital Health Interventions, a joint initiative of the Department of Management, Technology, and Economics at ETH Zurich and the Institute of Technology Management at the University of St Gallen, which is funded in part by CSS, a Swiss health insurer. TK is also the cofounder of Pathmate Technologies, a university spin-off company that creates and delivers digital clinical pathways. However, Pathmate Technologies was not involved in any way in the design, interpretation, and analysis during the study, or in writing the paper.

    ‎
    Multimedia Appendix 1

    Codebook for app review.

    DOCX File , 23 KB
    ‎
    Multimedia Appendix 2

    Company and intervention characteristics.

    PDF File (Adobe PDF File), 177 KB
    ‎
    Multimedia Appendix 3

    Study characteristics.

    PDF File (Adobe PDF File), 122 KB
    1. International DF. IDF Diabetes Atlas 9th Edition. Brussels, Belgium: International Diabetes Federation; 2019.
    2. Global Report on Diabetes. Geneva, Switzerland: World Health Organisation; 2016.
    3. Khan MAB, Hashim MJ, King JK, Govender RD, Mustafa H, Al Kaabi J. Epidemiology of type 2 diabetes—global burden of disease and forecasted trends. J Epidemiol Glob Health 2020 Mar;10(1):107-111 [FREE Full text] [CrossRef] [Medline]
    4. Nathan DM, Davidson MB, DeFronzo RA, Heine RJ, Henry RR, Pratley R, American Diabetes Association. Impaired fasting glucose and impaired glucose tolerance: implications for care. Diabetes Care 2007 Mar;30(3):753-759. [CrossRef] [Medline]
    5. American Diabetes Association. 5. Facilitating behavior change and well-being to improve health outcomes: standards of medical care in diabetes—2020. Diabetes Care 2020 Jan;43(Suppl 1):S48-S65 [FREE Full text] [CrossRef] [Medline]
    6. Diabetes Prevention Program (DPP) Research Group. The Diabetes Prevention Program (DPP): description of lifestyle intervention. Diabetes Care 2002 Dec;25(12):2165-2171 [FREE Full text] [CrossRef] [Medline]
    7. Penn L, Rodrigues A, Haste A, Marques MM, Budig K, Sainsbury K, et al. NHS Diabetes Prevention Programme in England: formative evaluation of the programme in early phase implementation. BMJ Open 2018 Feb;8(2):e019467 [FREE Full text] [CrossRef] [Medline]
    8. Horigan G, Davies M, Findlay-White F, Chaney D, Coates V. Reasons why patients referred to diabetes education programmes choose not to attend: a systematic review. Diabet Med 2017 Jan;34(1):14-26. [CrossRef] [Medline]
    9. Azar KMJ, Koliwad S, Poon T, Xiao L, Lv N, Griggs R, et al. The Electronic CardioMetabolic Program (eCMP) for patients with cardiometabolic risk: a randomized controlled trial. J Med Internet Res 2016 May;18(5):e134 [FREE Full text] [CrossRef] [Medline]
    10. Smith KJ, Kuo S, Zgibor JC, McTigue KM, Hess R, Bhargava T, et al. Cost effectiveness of an internet-delivered lifestyle intervention in primary care patients with high cardiovascular risk. Prev Med 2016 Jun;87:103-109. [CrossRef] [Medline]
    11. Gamble A, Pham Q, Goyal S, Cafazzo JA. The challenges of COVID-19 for people living with diabetes: considerations for digital health. JMIR Diabetes 2020 May;5(2):e19581 [FREE Full text] [CrossRef] [Medline]
    12. Hekler EB, Michie S, Pavel M, Rivera DE, Collins LM, Jimison HB, et al. Advancing models and theories for digital behavior change interventions. Am J Prev Med 2016 Nov;51(5):825-832. [CrossRef] [Medline]
    13. Tice J, Chapman R, Shore K, Seidner M, Ollendorf D, Weissberg J, et al. Diabetes prevention programs: effectiveness and value; final evidence report and meeting summary. Institute for Clinical and Economic Review (ICER).   URL: https://icer-review.org/material/final-report-dpp/ [accessed 2021-02-03]
    14. Yardley L, Choudhury T, Patrick K, Michie S. Current issues and future directions for research into digital behavior change interventions. Am J Prev Med 2016 Nov;51(5):814-815. [CrossRef] [Medline]
    15. Tudor Car L, Dhinagaran DA, Kyaw BM, Kowatsch T, Joty S, Theng Y, et al. Conversational agents in health care: scoping review and conceptual analysis. J Med Internet Res 2020 Aug;22(8):e17158 [FREE Full text] [CrossRef] [Medline]
    16. Bérubé C, Schachner T, Keller R, Fleisch E, V Wangenheim F, Barata F, et al. Voice-based conversational agents for the prevention and management of chronic and mental health conditions: systematic literature review. J Med Internet Res 2021 Mar;23(3):e25933 [FREE Full text] [CrossRef] [Medline]
    17. Schachner T, Keller R, V Wangenheim F. Artificial intelligence-based conversational agents for chronic conditions: systematic literature review. J Med Internet Res 2020 Sep;22(9):e20701 [FREE Full text] [CrossRef] [Medline]
    18. Laranjo L, Dunn AG, Tong HL, Kocaballi AB, Chen J, Bashir R, et al. Conversational agents in healthcare: a systematic review. J Am Med Inform Assoc 2018 Sep;25(9):1248-1258 [FREE Full text] [CrossRef] [Medline]
    19. Bickmore TW, Mitchell SE, Jack BW, Paasche-Orlow MK, Pfeifer LM, Odonnell J. Response to a relational agent by hospital patients with depressive symptoms. Interact Comput 2010 Jul;22(4):289-298 [FREE Full text] [CrossRef] [Medline]
    20. Ma T, Chattopadhyay D, Sharifi H. Virtual humans in health-related interventions: a meta-analysis. In: CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. 2019 Presented at: CHI Conference on Human Factors in Computing Systems; May 4-9, 2019; Glasgow, Scotland p. 1-6. [CrossRef]
    21. Bickmore TW, Picard RW. Establishing and maintaining long-term human-computer relationships. ACM Trans Comput Hum Interact 2005 Jun;12(2):293-327. [CrossRef]
    22. Hauser-Ulrich S, Künzli H, Meier-Peterhans D, Kowatsch T. A smartphone-based health care chatbot to promote self-management of chronic pain (SELMA): pilot randomized controlled trial. JMIR Mhealth Uhealth 2020 Apr;8(4):e15806 [FREE Full text] [CrossRef] [Medline]
    23. Kowatsch T, Schachner T, Harperink S, Barata F, Dittler U, Xiao G, et al. Conversational agents as mediating social actors in chronic disease management involving health care professionals, patients, and family members: multisite single-arm feasibility study. J Med Internet Res 2021 Feb;23(2):e25060 [FREE Full text] [CrossRef] [Medline]
    24. Mitchell EG, Maimone R, Cassells A, Tobin JN, Davidson P, Smaldone AM, et al. Automated vs. human health coaching. Proc ACM Hum-Comput Interact 2021 Apr;5(CSCW1):1-37. [CrossRef]
    25. Nahum-Shani I, Smith SN, Spring BJ, Collins LM, Witkiewitz K, Tewari A, et al. Just-in-time adaptive interventions (JITAIs) in mobile health: key components and design principles for ongoing health behavior support. Ann Behav Med 2016 Sep;52(6):446-462. [CrossRef] [Medline]
    26. Nahum-Shani I, Hekler EB, Spruijt-Metz D. Building health behavior models to guide the development of just-in-time adaptive interventions: a pragmatic framework. Health Psychol 2015 Dec;34(Suppl):1209-1219 [FREE Full text] [CrossRef] [Medline]
    27. Hardeman W, Houghton J, Lane K, Jones A, Naughton F. A systematic review of just-in-time adaptive interventions (JITAIs) to promote physical activity. Int J Behav Nutr Phys Act 2019 Apr;16(1):1-21 [FREE Full text] [CrossRef] [Medline]
    28. Spruijt-Metz D, Wen CKF, O'Reilly G, Li M, Lee S, Emken BA, et al. Innovations in the use of interactive technology to support weight management. Curr Obes Rep 2015 Dec;4(4):510-519 [FREE Full text] [CrossRef] [Medline]
    29. Thomas JG, Bond DS. Behavioral response to a just-in-time adaptive intervention (JITAI) to reduce sedentary behavior in obese adults: implications for JITAI optimization. Health Psychol 2015 Dec;34:1261-1276 [FREE Full text] [CrossRef] [Medline]
    30. Fleming GA, Petrie JR, Bergenstal RM, Holl RW, Peters AL, Heinemann L. Diabetes digital app technology: benefits, challenges, and recommendations. A consensus report by the European Association for the Study of Diabetes (EASD) and the American Diabetes Association (ADA) Diabetes Technology Working Group. Diabetes Care 2020 Jan;43(1):250-260. [CrossRef] [Medline]
    31. Digital diabetes care market 2020: going beyond diabetes management. Research2Guidance. Berlin, Germany: Research2Guidance; 2020.   URL: https:/​/research2guidance.​com/​product/​the-global-digital-diabetes-care-market-2020-going-beyond-diabetes-management/​ [accessed 2022-01-04]
    32. Klonoff DC, Evans B, Zweig M, Day S, Kerr D. Is digital health for diabetes in an investment bubble? J Diabetes Sci Technol 2020 Jan;14(1):165-169. [CrossRef] [Medline]
    33. Crunchbase.   URL: https://www.crunchbase.com/ [accessed 2020-07-23]
    34. PitchBook.   URL: https://pitchbook.com/ [accessed 2020-07-23]
    35. Retterath A, Braun R. Benchmarking venture capital databases. SSRN Journal 2020 Nov:1-47 [FREE Full text] [CrossRef]
    36. Safavi K, Mathews SC, Bates DW, Dorsey ER, Cohen AB. Top-funded digital health companies and their impact on high-burden, high-cost conditions. Health Aff (Millwood) 2019 Jan;38(1):115-123. [CrossRef] [Medline]
    37. Smartphone market share. IDC.   URL: https://www.idc.com/promo/smartphone-market-share/os [accessed 2021-12-22]
    38. Covidence Systematic Review Software. Melbourne, Australia: Veritas Health Innovation   URL: https://www.covidence.org/ [accessed 2020-07-20]
    39. Procedure Manual Section 4. Evidence Review Development. United States: U.S. Preventive Services Task Force (USPSTF)   URL: https:/​/uspreventiveservicestaskforce.​org/​uspstf/​about-uspstf/​methods-and-processes/​procedure-manual/​procedure-manual-section-4-evidence-review-development [accessed 2020-11-29]
    40. Cornet VP, Holden RJ. Systematic review of smartphone-based passive sensing for health and wellbeing. J Biomed Inform 2018 Jan;77:120-132. [CrossRef] [Medline]
    41. Sensors overview. Developers.: Developers Android   URL: https://developer.android.com/guide/topics/sensors/sensors_overview [accessed 2020-07-07]
    42. ioS security guide. Apple Platform Security.   URL: https://support.apple.com/en-gb/guide/security/welcome/web [accessed 2020-07-07]
    43. National Diabetes Prevention Program. United States: Centers for Disease Control and Prevention   URL: https://www.cdc.gov/diabetes/prevention/index.html [accessed 2021-08-15]
    44. Diabetes Prevention Recognition Program: Standards and Operating Procedures. United States: Centers for Disease Control and Prevention   URL: https://nationaldppcsc.cdc.gov/s/article/DPRP-Standards-and-Operating-Procedures [accessed 2021-05-25]
    45. Toro-Ramos T, Michaelides A, Anton M, Karim Z, Kang-Oh L, Argyrou C, et al. Mobile delivery of the diabetes prevention program in people with prediabetes: randomized controlled trial. JMIR Mhealth Uhealth 2020 Jul;8(7):e17842 [FREE Full text] [CrossRef] [Medline]
    46. Johansen MY, MacDonald CS, Hansen KB, Karstoft K, Christensen R, Pedersen M, et al. Effect of an intensive lifestyle intervention on glycemic control in patients with type 2 diabetes: a randomized clinical trial. JAMA 2017 Dec;318(7):637-646. [CrossRef] [Medline]
    47. Quinn CC, Shardell MD, Terrin ML, Barr EA, Ballew SH, Gruber-Baldini AL. Cluster-randomized trial of a mobile phone personalized behavioral intervention for blood glucose control. Diabetes Care 2011 Sep;34(9):1934-1942 [FREE Full text] [CrossRef] [Medline]
    48. Amante DJ, Harlan DM, Lemon SC, McManus DD, Olaitan OO, Pagoto SL, et al. Evaluation of a diabetes remote monitoring program facilitated by connected glucose meters for patients with poorly controlled type 2 diabetes: randomized crossover trial. JMIR Diabetes 2021 Mar;6(1):e25574 [FREE Full text] [CrossRef] [Medline]
    49. FAQ:CDC's Diabetes Prevention Recognition Program. United States: Centers for Disease Control and Prevention   URL: https:/​/nationaldppcsc.​cdc.gov/​s/​article/​FAQ-CDCs-Diabetes-Prevention-Recognition-Program-1526419472100 [accessed 2021-08-15]
    50. Little RR, Rohlfing CL. The long and winding road to optimal HbA1c measurement. Clin Chim Acta 2013 Mar;418:63-71 [FREE Full text] [CrossRef] [Medline]
    51. Wu X, Guo X, Zhang Z. The efficacy of mobile phone apps for lifestyle modification in diabetes: systematic review and meta-analysis. JMIR Mhealth Uhealth 2019 Jan;7(1):e12297 [FREE Full text] [CrossRef] [Medline]
    52. Veazie S, Winchell K, Gilbert J, Paynter R, Ivlev I, Eden KB, et al. Rapid evidence review of mobile applications for self-management of diabetes. J Gen Intern Med 2018 Jul;33(7):1167-1176. [CrossRef] [Medline]
    53. Mehraeen E, Noori T, Nazeri Z, Heydari M, Mehranfar A, Moghaddam HR, et al. Identifying features of a mobile-based application for self-care of people living with T2DM. Diabetes Res Clin Pract 2021 Jan;171:108544. [CrossRef] [Medline]
    54. Salari R, Niakan Kalhori SR, Fatehi F, Ghazisaeedi M, Nazari M. Determining minimum set of features for diabetes mobile apps. J Diabetes Metab Disord 2019 Dec;18(2):333-340 [FREE Full text] [CrossRef] [Medline]
    55. Shiffman S, Stone AA, Hufford MR. Ecological momentary assessment. Annu Rev Clin Psychol 2008 Apr;4:1-32. [CrossRef] [Medline]
    56. Wang L, Miller LC. Just-in-the-moment adaptive interventions (JITAI): a meta-analytical review. Health Commun 2019 Sep:1-14. [CrossRef] [Medline]
    57. Sharmin M, Raij A, Epstien D, Nahum-Shani I, Beck JG, Vhaduri S, et al. Visualization of time-series sensor data to inform the design of just-in-time adaptive stress interventions. Proc ACM Int Conf Ubiquitous Comput 2015 Sep;2015:505-516 [FREE Full text] [CrossRef] [Medline]
    58. Milat AJ, King L, Bauman AE, Redman S. The concept of scalability: increasing the scale and potential adoption of health promotion interventions into policy and practice. Health Promot Int 2013 Sep;28(3):285-298 [FREE Full text] [CrossRef] [Medline]
    59. Bickmore TW, Trinh H, Olafsson S, O'Leary TK, Asadi R, Rickles NM, et al. Patient and consumer safety risks when using conversational assistants for medical information: an observational study of Siri, Alexa, and Google Assistant. J Med Internet Res 2018 Sep;20(9):e11510 [FREE Full text] [CrossRef] [Medline]
    60. Tay W, Kaur B, Quek R, Lim J, Henry CJ. Current developments in digital quantitative volume estimation for the optimisation of dietary assessment. Nutrients 2020 Apr;12(4):1167 [FREE Full text] [CrossRef] [Medline]
    61. Bonoto BC, de Araújo VE, Godói IP, de Lemos LLP, Godman B, Bennie M, et al. Efficacy of mobile apps to support the care of patients with diabetes mellitus: a systematic review and meta-analysis of randomized controlled trials. JMIR Mhealth Uhealth 2017 Mar;5(3):e4 [FREE Full text] [CrossRef] [Medline]
    62. Hou C, Carter B, Hewitt J, Francisa T, Mayor S. Do mobile phone applications improve glycemic control (HbA1c) in the self-management of diabetes? A systematic review, meta-analysis, and GRADE of 14 randomized trials. Diabetes Care 2016 Nov;39(11):2089-2095. [CrossRef] [Medline]
    63. Kebede MM, Peters M, Heise TL, Pischke CR. Comparison of three meta-analytic methods using data from digital interventions on type 2 diabetes. Diabetes Metab Syndr Obes 2018 Dec;12:59-73 [FREE Full text] [CrossRef] [Medline]
    64. Kebede MM, Zeeb H, Peters M, Heise TL, Pischke CR. Effectiveness of digital interventions for improving glycemic control in persons with poorly controlled type 2 diabetes: a systematic review, meta-analysis, and meta-regression analysis. Diabetes Technol Ther 2018 Nov;20(11):767-782. [CrossRef] [Medline]
    65. Drincic A, Prahalad P, Greenwood D, Klonoff DC. Evidence-based mobile medical applications in diabetes. Endocrinol Metab Clin North Am 2016 Dec;45(4):943-965 [FREE Full text] [CrossRef] [Medline]
    66. Teepe GW, Da Fonseca A, Kleim B, Jacobson NC, Salamanca Sanabria A, Tudor Car L, et al. Just-in-time adaptive mechanisms of popular mobile apps for individuals with depression: systematic app search and literature review. J Med Internet Res 2021 Sep;23(9):e29412 [FREE Full text] [CrossRef] [Medline]

    ‎
    CAs: conversational agents
    CDC: Center for Disease Control and Prevention
    DBCIs: digital behavior change interventions
    DPRP: Diabetes Prevention Recognition Program
    HbA1c: glycated hemoglobin A1c
    JTAI: just-in-time adaptive intervention
    RCTs: randomized controlled trials

    Edited by G Eysenbach; submitted 06.09.21; peer-reviewed by K Pal; comments to author 28.09.21; revised version received 22.10.21; accepted 15.11.21; published 07.01.22

    Copyright

    ©Roman Keller, Sven Hartmann, Gisbert Wilhelm Teepe, Kim-Morgaine Lohse, Aishah Alattas, Lorainne Tudor Car, Falk Müller-Riemenschneider, Florian von Wangenheim, Jacqueline Louise Mair, Tobias Kowatsch. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 07.01.2022.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.