Original Paper
Abstract
Background: Gastrointestinal diseases are associated with substantial cost in health care. In times of the COVID-19 pandemic and further digitalization of gastrointestinal tract health care, mobile health apps could complement routine health care. Many gastrointestinal health care apps are already available in the app stores, but the quality, data protection, and reliability often remain unclear.
Objective: This systematic review aimed to evaluate the quality characteristics as well as the privacy and security measures of mobile health apps for the management of gastrointestinal diseases.
Methods: A web crawler systematically searched for mobile health apps with a focus on gastrointestinal diseases. The identified mobile health apps were evaluated using the Mobile Application Rating Scale (MARS). Furthermore, app characteristics, data protection, and security measures were collected. Classic user star rating was correlated with overall mobile health app quality.
Results: The overall quality of the mobile health apps (N=109) was moderate (mean 2.90, SD 0.52; on a scale ranging from 1 to 5). The quality of the subscales ranged from low (mean 1.89, SD 0.66) to good (mean 4.08, SD 0.57). The security of data transfer was ensured only by 11 (10.1%) mobile health apps. None of the mobile health apps had an evidence base. The user star rating did not correlate with the MARS overall score or with the individual subdimensions of the MARS (all P>.05).
Conclusions: Mobile health apps might have a positive impact on diagnosis, therapy, and patient guidance in gastroenterology in the future. We conclude that, to date, data security and proof of efficacy are not yet given in currently available mobile health apps.
doi:10.2196/37497
Keywords
Introduction
Gastrointestinal diseases are associated with substantial morbidity and health care costs worldwide [
- ]. For example, in the United States, the annual health care expenditures for gastrointestinal diseases were US $135.9 billion in total, with more than 54.4 million ambulatory visits with a primary diagnosis for gastrointestinal disease and 3.0 million hospital admissions [ ]. Additional indirect costs arise due to substantial levels of personal disability, work absenteeism, and loss of productivity [ - ]. Therefore, health care systems are challenged to provide equitable and affordable solutions for patients with digestive diseases [ , ].In particular, for the successful treatment of chronic gastrointestinal diseases (eg, inflammatory bowel disease [IBD] and irritable bowel syndrome), the patient’s adherence and compliance are crucial [
- ]. Treatment recommendations are extensive, consisting of medical and psychological measures [ - ]. Moreover, they include high-demand interventions such as health behavior changes (eg, dietary adjustments or stress management) that cannot be addressed adequately in routine health care [ , - ]. Additionally, the COVID-19 pandemic with consecutive lockdown forced the health care institutions to uptake contactless approaches [ - ]. Therefore, the implementation of mobile health (mHealth) apps might be a promising approach [ - ].A recent US study showed that 58.2% of smartphone users had at least 1 mHealth app downloaded on their device [
]. Fitness and nutrition apps were the most commonly downloaded mHealth apps [ ]. However, mHealth solutions might also have a potential impact in prevention, diagnostics, and therapy in gastrointestinal disorders [ ].Unfortunately, there is a relevant gap between the high number of available mHealth apps to manage gastrointestinal diseases and the low number of reliable scientific studies in this field [
, , ]. This gap is concerning as the use of mHealth apps is accompanied with potential risks and side effects such as insufficient data protection and a lack of privacy, as well as treatment without informed consent [ ]. Other potential hazards such as misinformation, nonavailability in emergencies, and data misuse have been reported for mHealth apps [ , ].Due to the rapid development in technology, users and health care providers have difficulties in identifying relevant, high-quality mHealth apps, because they have to rely on the information provided in the stores such as user star ratings and app descriptions [
]. Previous studies have already indicated that user star ratings are potentially misleading because they are influenced by user-friendliness and functionality rather than by content quality [ ]. Furthermore, they might be biased due to fake ratings or older versions of the app [ - ]. Therefore, user star ratings might not be a valid orientation aid for selecting a mHealth app, and other strategies to support users and health care providers select an appropriate mHealth app to manage health care issues should be considered.Additionally, many scientifically tested apps developed by universities and research projects do not enter the app market [
]. In contrast, many available mHealth apps developed by commercial providers have never been tested for their effectiveness and efficacy [ ]. Therefore, the quality of publicly available mHealth apps for gastrointestinal diseases is not evident in the literature. Due to increasing public interest in the use of mHealth apps, reliable reviews and analyses are mandatory [ ].Quality-measuring instruments for mHealth apps such as the multidimensional Mobile Application Rating Scale (MARS) are available in several languages, validated, and used worldwide [
- ]. MARS is an expert rating tool that allows researchers to reliably assess and compare mHealth apps regarding user engagement, functionality, aesthetics, and the quality of information [ - ]. Furthermore, it offers a descriptive section in which aims, methods, theoretical background, and cost, etc, can be assessed [ , ]. The MARS was widely used to assess app quality systematically (eg, weight management, rheumatoid arthritis, chronic back pain, mindfulness, heart failure, chronic pain, posttraumatic stress disorder, medication adherence, depression, and smoking cessation, etc) [ , - ].The aim of this study was to systematically search for mHealth apps for gastrointestinal diseases in the app stores and evaluate their quality, content, and characteristics using the MARS [
]. Furthermore, mHealth app characteristics such as theoretical background, the content of the apps, affiliation, and price were assessed. Moreover, the accordance with gastroenterological guidelines and evidence base of the included mHealth apps were investigated.Methods
Study Design
This systematic review was oriented on the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines [
].Search Strategy and Procedure
An automatic search engine (Mobile Health App Database [MHAD] web crawler [
]) was used to systematically screen the Google Play and Apple App stores for eligible mHealth apps [ ] between October 24, 2020, and June 12, 2021. The applied search terms were defined by conducting focus groups with patients with gastrointestinal disorders and health care providers at the University Hospital Ulm and Freiburg to mimic lay and professional searches. The final search terms included “digestive problems,” “stomach pain,” “constipation,” “CED,” “ulcerative colitis,” “Crohn’s disease,” “inflammatory bowel disease,” “reflux,” “bloating,” “diarrhea,” “celiac disease,” “food intolerances,” and “malabsorption.” The search terms were entered separately because logical operations and truncation cannot be used in the Google Play and Apple App stores.All found mHealth apps were registered in a central database, and duplicates were automatically removed. All identified apps were screened regarding whether their title, description, given images, and comments of app users indicated that the app (1) was developed for gastrointestinal health issues, (2) provided in the German or English language, (3) was downloadable in the official Google Play or Apple App store, (4) was functional to enable an assessment (no device problems), and (5) met no other exclusion criteria (app bundles, only usable with another device such as a smartwatch, or not active for download). In a second step, the apps were downloaded and checked regarding the aforementioned criteria.
Data Extraction, Evaluation Criteria, and Instruments
The included apps were evaluated by raters using the German version of the multidimensional MARS (MARS-G) [
]. Before starting with the evaluation process, the raters received standardized web-based training, which is publicly accessible and free of charge [ ]. For quality assurance, interrater reliability (IRR) between the 2 raters was calculated. Rater agreement was examined by intraclass correlation (ICC) based on a 2-way mixed-effect model. A minimum ICC of .75 was predefined as sufficient ICC [ ]. An additional reviewer was consulted when the IRR was below a value of .75 [ , ].Evaluation Tool MARS-G
The evaluation tool MARS-G is a reliable and valid procedure for the quality assessment of mHealth apps [
, ]. The MARS-G has a very good internal consistency for overall score (ω=.82, 95% CI 0.76-0.86) and high levels of IRR (2-way mixed ICC=.84, 95% CI 0.82-0.85) [ ].General Characteristics
For examining app characteristics, the classification page of the MARS-G was used. It contains (1) the app name; (2) app version; (3) platform; (4) content-related subcategory; (5) store link; (6) price; (7) user star rating; (8) the number of user star ratings; (9) theoretical background (eg, type of therapy); (10) aims; (11) methods (eg, information/education, monitoring and tracking, gamification, and reminder); (12) technical aspects (eg, allows sharing); (13) data protection and safety (eg, password protection); (14) field of application; and (15) certification [
, ]. The classification site of MARS-G was used to assess the content and functions of the included mHealth apps [ , ]. With the MARS-G, a descriptive assessment of privacy and security features is possible. All features were assessed based on the information included in the mHealth apps or app stores. External information was not evaluated.Quality Assessment
The multidimensional quality rating of the MARS-G consists of 6 different subdimensions with 19 items, which can be evaluated on a 5-point Likert scale (1=inadequate, 2=poor, 3=acceptable, 4=good, and 5=excellent): (1) engagement (entertainment, interest, individual adaptability, interactivity, and target group); (2) functionality (performance, usability, navigation, motor, and gestural design); (3) aesthetics (layout, graphics, and visual appeal); and (4) information (accuracy of app description, goals, quality and quantity of information, quality of visual information, credibility, and evidence base); (5) subjective quality (recommendable, probability of using the app in the next 12 months, payment, and star rating); and (6) perceived impact (increased awareness, increased knowledge, attitudes, fosters intention to change, empowers help-seeking behavior, and fosters behavior change) [
, ]. For the assessment of the overall quality, the total score was calculated from the 4 main subdimensions (engagement, functionality, aesthetics, and information) [ ]. The ratings of the reviewers were averaged for all calculations. Mean scores and SDs were calculated for the MARS overall score and subdimensions.Quality Rating on Evidence
To verify whether empirical studies were available for the mHealth apps, item 19 on the information subscale of the MARS was used. This item was examined by searching the mHealth apps’ name in Google, Google Scholar, PubMed, and the developers or providers’ website for existing efficacy and effectiveness studies [
].User Star Rating
The user star ratings were extracted from the app stores. The user star rating from Google Play and Apple App stores is rated on a scale of 1 to 5 stars. It is presented as a cumulative average of individual ratings in the app stores [
]. Pearson correlation coefficient between user star ratings and MARS-G ratings were calculated. For all analysis, an α level of 5% was defined [ ].Results
The web crawler identified 658 mHealth apps, of which 109 were eligible for inclusion after screening and eligibility check (
).General Characteristics
Of the 109 mHealth apps, 79 (72.5%) were from the Google Play store, and 30 (27.5%) were from the Apple App store; 53 (48.6%) had a user star rating, whereas 56 (51.4%) were not rated by store users. The mean user star rating was 3.96 (SD 0.80), ranging from 2.00 to 5.00.
Most apps (n=93, 85.3%) were free of charge, and the prices of fee-based mHealth apps ranged from €0.69 to €8.99 (mean €4.0, SD €2.25; from US $0.84 to US $10.91; mean US $4.86, SD US $2.73). The 109 mHealth apps for gastrointestinal disorders were identified in the following Google Play or Apple App store categories (multiple categories can be assigned to 1 mHealth app): “health and fitness” (n=76, 69.7%); “medical” (n=33, 30.3%); “food and drinks” (n=11, 10.1%); “lifestyle” (n=3, 2.8%); “books and references” (n=2, 1.8%); “education” (n=2, 1.8%); “entertainment” (n=3, 2.8%); and “parenting” (n=1, (0.9%;
).The included mHealth apps targeted the following aims (multiple aims may be selected for 1 mHealth app): “improvement of general well-being” (n=92, 84.4%); “promotion of physical health” (n=86, 78.9%); “entertainment” (n=3, 2.8%); “support for behavioral changes” (n=33, 30.3%); “support in achieving individual goals” (n=27, 24.8%), “reduction of stress” (n=7, 6.4%); “reduction of fear” (n=4, 3.7%), “improvement of social behavior” (n=2, 1.8%); and “other aims” (n=16, 14.7%)—for example, “information” (n=3, 2.8%) or “education” (n=2, 1.8%;
).App store category | App (N=109), n (%) |
Parenting | 1 (0.9) |
Medical | 33 (30.3) |
Lifestyle | 3 (2.8) |
Health and fitness | 76 (69.7) |
Food and drinks | 11 (10.1) |
Entertainment | 3 (2.8) |
Education | 2 (1.8) |
Books and references | 2 (1.8) |
Aim | App (N=109), n (%) |
Improvement of general well-being | 92 (84.4) |
Promotion of physical health | 86 (78.9) |
Entertainment | 3 (2.8) |
Support for behavioral changes | 33 (30.3) |
Support in achieving individual goals | 27 (24.8) |
Reduction of stress | 7 (6.4) |
Reduction of fear | 4 (3.7) |
Improvement of social behavior | 2 (1.8) |
Other aims | 16 (14.7) |
Content and Functions
Of the 109 mHealth apps, almost all (n=91, 83.5%) focused on educational information about gastrointestinal diseases; over half (n=71, 65.1%) offered specific “tips and advice”; and the following methods were also frequent: “monitoring and tracking” (n=22, 20.2%), “alternative medical intervention elements” (n=18, 16.5%), “data collection and measurement” (n=13, 11.9%), feedback (n=13, 11.9%), and “memory, reminder, and amplifier” (n=7, 6.4%). The frequency of the methods used is summarized in
.Almost all mHealth apps (n=101, 92.7%) had “treatment” as their field of application. Other frequent fields were “prevention of disease” (n=73, 67%), “rehabilitation” (n=51, 46.8%), and “aftercare” (n=45, 41.3%).
Method | App (N=109), n (%) |
Information and education | 91 (83.5) |
Tips and advice | 71 (65.1) |
Monitoring and tracking | 22 (20.2) |
Alternative intervention elements | 18 (16.5) |
Data collection and measurement | 13 (11.9) |
Feedback | 13 (11.9) |
Memory, reminder, and amplifier | 7 (6.4) |
Pursuing own goals | 5 (4.6) |
Traditional medicine | 4 (3.7) |
Strategies, skills, and training | 2 (1.8) |
Relaxing exercises | 2 (1.8) |
Gamification | 2 (1.8) |
Tailored interventions and real-time feedback | 2 (1.8) |
Other | 1 (0.9) |
Physical exercises | 1 (0.9) |
Mindfulness and gratefulness | 1 (0.9) |
Acceptance | 1 (0.9) |
Privacy and Security Features
Of the 109 mHealth apps, 9 (8.2%) had no privacy and security features; 69 (63.3%) had an imprint, and 54 (49.5%) had a visible privacy policy; 16 (14.7%) required consent to data collection in an active form, and 54 (49.5%) in a passive form; and 11 (10.1%) ensured the security of data transfer, 11 (10.1%) required a log-in, 13 (11.9%) offered a password protection system, 7 (6.4%) informed about the conflicts of interests or financial background, and 1 (0.9%) had an emergency function.
Quality Rating
The overall quality of mobile health apps was average (mean 2.90, SD 0.52; ranging from 1.84 to 4.47). The top 10 ranked mHealth apps with the highest overall quality are listed in
and . Concordance between raters was good to excellent (ICC from 0.76, 95%CI 0.70-0.81 to 0.93, 95% CI 0.92-0.94).The average quality ratings of all included mHealth apps of the MARS subscales were the following: engagement, 2.47 (SD 0.74; range 1.10-5.00); functionality, 4.08 (SD 0.57; range 2.25-5.00); aesthetics, 3.19 (SD 0.76; range 1.17-4.83); and information quality, 1.89 (SD 0.66; range 0.57-3.79). The subjective quality was 2.16 (SD 0.79; range 1.00-4.50) and the perceived impact was 2.33 (SD 0.63; range 1.15-4.08;
).App | Rating, mean | Targeta | Developer | Categoryb |
vyoapp - Die CED-App | 4.47 | Digestive problems | Takeda Pharma Vertriebs GMbH & Co. KG | Medical |
My IBD Manager from AGA | 4.18 | Ulcerative colitis | @Point of care | Health and fitness |
MyColitis | 4.05 | Ulcerative colitis | myColitis | Health and fitness |
My IBD Care | 3.86 | Inflammatory bowel disease | Ampersand health limited | Medicine and health and fitness |
Cliexa-IBD | 3.85 | Inflammatory bowel disease | CN4CE, Inc | Medical |
Poop Tracker – Toilet Login | 3.82 | Digestive problems | Appstronaut Studios | Health and fitness |
Doc4Me – IBD Doctor Search | 3.71 | Inflammatory bowel disease | The North American Society for Pediatric Gastroenterology, Hepatology and Nutrition and Gotomo GmbH | Medical and health and fitness |
Food Navi – Coeliac | 3.71 | Celiac disease | Goe GmbH | Health and fitness and food and drink |
Histamin, Fructose & Co. | 3.69 | Food intolerance | Baliza GmbH | Health and fitness and food and drink |
Reflux Tracker | 3.68 | Digestive problems | Gotomo GmbH | Health and fitness |
aTarget disease or search term.
bCategory in the Apple App or Google Play store.
App | Privacy policya | Informed consentb | Certificationc | Price, € (US $) |
vyoapp - Die CED-App | Yes | No | No | 0 (0) |
My IBD Manager from AGA | Yes | Yes | American Gastroenterological Association | 0 (0) |
MyColitis | Yes | No | No | 0 (0) |
My IBD Care | Yes | Yes | No | 0 (0) |
Cliexa-IBD | Yes | Yes | No | 0 (0) |
Poop Tracker – Toilet Login | Yes | No | No | 0 (0) |
Doc4Me – IBD Doctor Search | Yes | Yes | No | 0 (0) |
Food Navi – Coeliac | No | No | No | 3.49 (4.24) |
Histamin, Fructose & Co. | Yes | No | No | 5.99 (7.27) |
Reflux Tracker | No | No | No | 0 (0) |
aMobile health app had a privacy policy that could be accessed.
bInformed consent was actively obtained.
cMobile health app was certified or developed under professional surveillance.
Variable | Rating, mean (SD) |
Subjective quality rating | 2.35 (0.84) |
Recommendable | 2.17 (0.94) |
Probability of using the app in the next 12 months | 2.53 (1.06) |
Payment | 1.31 (0.58) |
Star rating | 2.63 (0.89) |
Perceived impact | 2.31 (0.64) |
Increased awareness | 2.46 (0.90) |
Increased knowledge | 2.60 (1.00) |
Attitudes | 2.14 (0.65) |
Fosters intention to change | 2.10 (0.83) |
Empowers help-seeking behavior | 2.22 (1.17) |
Fosters behavior change | 2.49 (0.83) |
Quality Rating on Evidence
Only 2 (1.8%) of the 109 mHealth apps were certified and developed in concordance with guidelines published by the American Gastroenterological Association. None of the mHealth apps had an evidence base.
Correlation Patterns
The user star rating did not correlate with the MARS overall score or the individual subdimensions (overall: r=–0.03; P=.86; engagement: r=–0.11; P=.46; functionality: r=–0.17; P=.23; aesthetics: r=0.15; P=.28; information: r=0.02; P=.87; subjective quality: r=0.07; P=.61; perceived impact: r=–0.12; P=.39).
Discussion
Principal Findings
This study is the first that comprehensively and systematically reviewed mHealth apps for different gastrointestinal disorders available in the Google Play and Apple App stores [
]. The quality of the mHealth apps was investigated by standardized expert ratings using the MARS-G [ ]. In total, 109 mHealth apps with a focus on gastrointestinal disorders were included. Therefore, this analysis offers the first comprehensive systematic expert review of mHealth apps in the field of gastroenterology.The majority of the mHealth apps were found in the categories “health and fitness” and “medical.” The average quality of the included apps was moderate, according to the applied quality criteria. Only 2 mHealth apps were certified and developed in concordance with approved guidelines such as those from the American Gastroenterological Association. This fact is alarming because the concordance of a mHealth app with approved guidelines is crucial to prevent mistreatment and misinformation. A similar lack of adherence to well-established medical guidelines was found in mHealth app quality reviews for depression and posttraumatic stress disorder [
, ]. Moreover, our data show that user star ratings did not correlate with the experts’ MARS ratings. However, this finding is in accordance with a previous study on mHealth apps for posttraumatic stress disorder and in contradiction to a systematic review of mHealth apps for mindfulness [ , ]. These findings underline the need for systematic reviews to empower patients and health care providers in informed health care decisions. Freely available platforms, which display expert quality ratings of mHealth apps such as the MHAD [ ], Psyberguide [ ], or KVAppradar [ ], have been installed as a possible solution to empower patients and health care providers. In addition to these platforms that offer an evaluation of available mHealth apps based on the general criteria of scientific evidence, professional gastroenterological societies should participate in the development and assessment of mHealth apps in consideration of established guidelines. Regarding the rapid progress in the methods of disease monitoring and therapy of gastrointestinal disorders, suitable apps should be constantly updated for adequate support. In particular, for long-term gastrointestinal disorders, such as IBD, which are characterized by an unstable disease course with recurrent remission and exacerbation, mHealth apps could be a promising approach for symptom monitoring with an early detection of disease relapse. As previous studies have shown that self-reporting symptom diaries correlate with disease activity index for Crohn disease [ , ], validated symptom assessment questionnaires could be implemented in future mHealth apps.From the patients and health care providers’ perspectives, mHealth interventions could demonstrate a great potential to facilitate the monitoring of symptoms, improve self-management–related physical or psychosocial consequences, and maintain compliance [
- ]. Rapid advancement in mobile technology may enable real-time data capture and exchange between patient self-monitoring devices and a remote monitoring system, which creates promising opportunities to provide prompt feedback to patient-generated alerts and specific needs [ ].Besides the lack of mHealth apps for adequate symptom monitoring, our results showed that none of the evaluated apps were designed to evaluate adverse drug reactions that occur during disease therapy. Giraud et al [
] have demonstrated that 40.9% (N=1179) of patients with IBD that participated in the IBDREAM registry had at least 1 adverse drug reaction, and 24 new adverse drug reactions were found based on their analysis. These findings suggest that the evaluation of adverse events during maintenance therapy in IBD and possibly other gastrointestinal diseases should be monitored closely to timely change or adapt drug dose or substance choice for individual-tailored therapy. The use of mHealth apps for the monitoring of adverse drug reactions, especially during the start of a new therapeutical agent, could be a new field for the implementation of mHealth apps in clinical practice. The clinical monitoring of disease activity and drug compatibility could be further enhanced by wearable devices that track physical parameters and by noninvasive biomarker monitoring (eg, c-reactive protein or interleukin-1 for IBD from sweat [ ]). In their comprehensive review, Chong and Woo [ ] have demonstrated that approaches for the implementation of wearable sensor systems for gastrointestinal disease already exist and could change clinical practice in the near future [ ].Furthermore, the results highlight the need for a comprehensive evaluation of clinical effectiveness and economic effects. In particular, the long-term effects and cost-effectiveness of mHealth apps to manage gastrointestinal diseases should be elaborated in future studies [
]. Currently, studies that have evaluated the cost-effectiveness of telemedicine-directed treatment and monitoring of IBD show a reduction of hospitalization and therapy costs [ ] but remain controversial regarding the total cost-effectiveness of telemedical interventions [ ]. Since the use of biologicals has been identified as the major cost driver for IBD [ ], mHealth apps could help to early de-escalate and optimize biological treatment after constant disease remission and enhance conventional therapy admission to prevent unnecessary therapy escalation to expensive biologicals. To date (2022), in Germany, a central register for Conformité Européenne–certified eHealth apps with scientifically proven benefit for patients has been established. Apps that are listed in the national digitale Gesundheitsanwendungen (digital health care app in German) register are prescriptible by health care professionals. The costs could be reimbursed by the patient’s health insurance companies, which might be a step toward the implementation of trustworthy, certified apps into daily health care.Additionally, the review revealed that data security is not always guaranteed when using mHealth apps. As health data are highly sensitive, this lack of guarantee is one reason why the use of mHealth apps in the management of gastrointestinal diseases cannot be clearly recommended currently. We found that the security of data transfer was only ensured in 14% of the mHealth apps. As patient safety is paramount, data security is a keystone for adopting mobile technologies into health care. In this field, respect for privacy, security, the disclosure of data sharing, traceability, and the guarantee of transparency are essential factors. These factors are in line with other reviews of the data security and privacy of mHealth apps for smoking cessation, depression, and older adults [
, , ].When using and implementing mHealth technologies into health care systems, it will be important to know how these technologies will fit within the existing organizational framework, which may involve changes in business structure and culture, workflow, and staff. In this context, the primarily legal aspects of mHealth app use play a substantial role. National regulations for mHealth approaches such as the act on medical devices—the Medical Devices Directive—for the European Union or the Food and Drug Administration regulation body for the United States exist. The harmonization of the regulation instruments is crucial for the sufficient uptake of mHealth solutions worldwide. Such worldwide standards for the safe use of mHealth apps in gastroenterology should include (1) being based on current standards and medical guidelines, (2) randomized controlled trial testing for effectiveness, (3) high standards for data security, and (4) minimal and economic data recording.
We acknowledge several limitations regarding this review. First, due to the rapid growth and dynamic changes in mHealth apps available on the global market, this study can only represent a snapshot view of the available mHealth apps as of July 2021 for the management of gastrointestinal disorders. The continuous monitoring of the market is mandatory to reliably inform users and health care providers. Second, the main focus was on English- and German-language medical mHealth apps, which might have impaired the generalizability of the results, as the quality of mHealth apps may vary between countries and continents. Third, the review included all types of gastrointestinal disorders with a focus on inflammatory and nutritive bowel diseases. An even more precise analysis of mHealth apps addressing the multiple subspecialties of gastrointestinal disorders could be promising. Furthermore, the analysis of mHealth apps for hepatobiliary disease and gastrointestinal cancer (eg, mHealth apps for the patient-related surveillance of adverse events due to chemotherapy) should be evaluated specifically in further studies. Fourth, the user star ratings in the app stores may refer to various versions of an mHealth app and are aggregated across the different versions. Therefore, the MARS rating and the user star rating could refer to different versions.
Conclusion
This systematic review of mHealth apps that manage gastrointestinal diseases found a moderate overall quality of mHealth apps available in app stores. The quality of user engagement and information quality was rated as poor, thus limiting the possible positive effects of mHealth app use to manage gastrointestinal diseases. Furthermore, data safety and privacy were mostly not given. Moreover, there were no efficacy studies on the included mHealth apps, and only 2 mHealth apps were following well-established guidelines for the treatment of gastrointestinal diseases. Taken together, these findings implicate a red flag of the use of currently available mHealth apps for the management of gastrointestinal diseases. Nevertheless, given the possible positive impact of mHealth apps in the routine care of individuals with gastrointestinal diseases, an improvement in the quality of medical content for mHealth apps and data safety is mandatory.
Acknowledgments
The authors would like to the thank Jiaxi Lin, Rüdiger Pryss, Robin Kraft, Pascal Damasch, and Philipp Dörzenbach for their support in the development of the search engine and their support in the Mobile Health App Database [MHAD] project. We would also like to thank Linda Armbruster for her assistance in the rating of the mobile health apps.
Data Availability
The primary data of the systematic review can be provided by the corresponding author on a reasonable request. Data will only be shared for scientific purposes. Data sharing agreements may have to be signed depending on the request.
Authors' Contributions
EMM, YT, LBS, BMW, and HB developed the study design. DS, LBS, AP, JK, and MS collected the data. AP and SS conducted the statistical evaluations. EMM, AP, and BMW wrote the first draft of the paper. All authors contributed to the current version of the paper and approved the final paper. EMM is the guarantor of the paper.
Conflicts of Interest
HB codeveloped and run the German Mobile Health App Database (MHAD) project. The MHAD is a self-funded project at Ulm University with no commercial interests. HB, LBS, and EMM received payments for talks and workshops as well as license fees in the context of e-mental health without a specific link to the mobile health apps rated in this paper. All other authors declare no other conflicts of interest.
References
- Beard JA, Franco DL, Click BH. The burden of cost in inflammatory bowel disease: a medical economic perspective and the future of value-based care. Curr Gastroenterol Rep 2020 Jan 30;22(2):6. [CrossRef] [Medline]
- Silverstein MD, Loftus EV, Sandborn WJ, Tremaine WJ, Feagan BG, Nietert PJ, et al. Clinical course and costs of care for Crohn's disease: Markov model analysis of a population-based cohort. Gastroenterology 1999 Jul;117(1):49-57. [CrossRef] [Medline]
- Cohen RD, Yu AP, Wu EQ, Xie J, Mulani PM, Chao J. Systematic review: the costs of ulcerative colitis in western countries. Aliment Pharmacol Ther 2010 Apr;31(7):693-707 [FREE Full text] [CrossRef] [Medline]
- Sperber AD, Bangdiwala SI, Drossman DA, Ghoshal UC, Simren M, Tack J, et al. Worldwide prevalence and burden of functional gastrointestinal disorders, results of Rome Foundation Global Study. Gastroenterology 2021 Jan;160(1):99-114.e3 [FREE Full text] [CrossRef] [Medline]
- Oka P, Parr H, Barberio B, Black CJ, Savarino EV, Ford AC. Global prevalence of irritable bowel syndrome according to Rome III or IV criteria: a systematic review and meta-analysis. Lancet Gastroenterol Hepatol 2020 Oct;5(10):908-917. [CrossRef] [Medline]
- Peery AF, Crockett SD, Murphy CC, Lund JL, Dellon ES, Williams JL, et al. Burden and cost of gastrointestinal, liver, and pancreatic diseases in the United States: update 2018. Gastroenterology 2019 Jan;156(1):254-272.e11 [FREE Full text] [CrossRef] [Medline]
- Seyedian SS, Nokhostin F, Malamir MD. A review of the diagnosis, prevention, and treatment methods of inflammatory bowel disease. J Med Life 2019;12(2):113-122 [FREE Full text] [CrossRef] [Medline]
- Kawalec P. Indirect costs of inflammatory bowel diseases: Crohn's disease and ulcerative colitis. a systematic review. Arch Med Sci 2016 Apr 01;12(2):295-302 [FREE Full text] [CrossRef] [Medline]
- Constantin J, Atanasov P, Wirth D, Borsi A. Indirect costs associated with ulcerative colitis: a systematic literature review of real-world data. BMC Gastroenterol 2019 Nov 09;19(1):179 [FREE Full text] [CrossRef] [Medline]
- Kuenzig ME, Lee L, El-Matary W, Weizman AV, Benchimol EI, Kaplan GG, et al. The impact of inflammatory bowel disease in Canada 2018: indirect costs of IBD care. J Can Assoc Gastroenterol 2019 Feb;2(Suppl 1):S34-S41 [FREE Full text] [CrossRef] [Medline]
- Buono JL, Carson RT, Flores NM. Health-related quality of life, work productivity, and indirect costs among patients with irritable bowel syndrome with diarrhea. Health Qual Life Outcomes 2017 Feb 14;15(1):35 [FREE Full text] [CrossRef] [Medline]
- Frändemark Å, Törnblom H, Jakobsson S, Simrén M. Work productivity and activity impairment in irritable bowel syndrome (IBS): a multifaceted problem. Am J Gastroenterol 2018 Oct;113(10):1540-1549. [CrossRef] [Medline]
- Park KT, Colletti RB, Rubin DT, Sharma BK, Thompson A, Krueger A. Health insurance paid costs and drivers of costs for patients with Crohn's disease in the United States. Am J Gastroenterol 2016 Jan;111(1):15-23. [CrossRef] [Medline]
- Herman ML, Kane SV. Treatment nonadherence in inflammatory bowel disease: identification, scope, and management strategies. Inflamm Bowel Dis 2015 Dec;21(12):2979-2984. [CrossRef] [Medline]
- Tabibian A, Tabibian JH, Beckman LJ, Raffals LL, Papadakis KA, Kane SV. Predictors of health-related quality of life and adherence in Crohn's disease and ulcerative colitis: implications for clinical management. Dig Dis Sci 2015 May 6;60(5):1366-1374. [CrossRef] [Medline]
- Roditi D, Robinson ME. The role of psychological interventions in the management of patients with chronic pain. Psychol Res Behav Manag 2011;4:41-49 [FREE Full text] [CrossRef] [Medline]
- Chan W, Chen A, Tiao D, Selinger C, Leong R. Medication adherence in inflammatory bowel disease. Intest Res 2017 Oct;15(4):434-445 [FREE Full text] [CrossRef] [Medline]
- Lenti MV, Selinger CP. Medication non-adherence in adult patients affected by inflammatory bowel disease: a critical review and update of the determining factors, consequences and possible interventions. Expert Rev Gastroenterol Hepatol 2017 Mar;11(3):215-226. [CrossRef] [Medline]
- Bager P, Julsgaard M, Vestergaard T, Christensen LA, Dahlerup JF. Adherence and quality of care in IBD. Scand J Gastroenterol 2016 Nov;51(11):1326-1331. [CrossRef] [Medline]
- Feingold J, Murray HB, Keefer L. Recent advances in cognitive behavioral therapy For digestive disorders and the role of applied positive psychology across the spectrum of GI care. J Clin Gastroenterol 2019 Aug;53(7):477-485. [CrossRef] [Medline]
- Montero AM, Jones S. Roles and impact of psychologists in interdisciplinary gastroenterology care. Clin Gastroenterol Hepatol 2020 Feb;18(2):290-293. [CrossRef] [Medline]
- Basnayake C, Kamm MA, Stanley A, Wilson-O'Brien A, Burrell K, Lees-Trinca I, et al. Standard gastroenterologist versus multidisciplinary treatment for functional gastrointestinal disorders (MANTRA): an open-label, single-centre, randomised controlled trial. Lancet Gastroenterol Hepatol 2020 Oct;5(10):890-899. [CrossRef] [Medline]
- Black CJ, Thakur ER, Houghton LA, Quigley EMM, Moayyedi P, Ford AC. Efficacy of psychological therapies for irritable bowel syndrome: systematic review and network meta-analysis. Gut 2020 Aug;69(8):1441-1451. [CrossRef] [Medline]
- Black CJ, Drossman DA, Talley NJ, Ruddy J, Ford AC. Functional gastrointestinal disorders: advances in understanding and management. Lancet 2020 Nov 21;396(10263):1664-1674. [CrossRef] [Medline]
- BinDhim NF, Shaman AM, Trevena L, Basyouni MH, Pont LG, Alhawassi TM. Depression screening via a smartphone app: cross-country user characteristics and feasibility. J Am Med Inform Assoc 2015 Jan 17;22(1):29-34 [FREE Full text] [CrossRef] [Medline]
- Palsson OS, Ballou S. Hypnosis and cognitive behavioral therapies for the management of gastrointestinal disorders. Curr Gastroenterol Rep 2020 Jun 03;22(7):31. [CrossRef] [Medline]
- Spinelli A, Pellino G. COVID-19 pandemic: perspectives on an unfolding crisis. Br J Surg 2020 Jun;107(7):785-787 [FREE Full text] [CrossRef] [Medline]
- Ohannessian R, Duong TA, Odone A. Global telemedicine implementation and integration within health systems to fight the COVID-19 pandemic: a call to action. JMIR Public Health Surveill 2020 Apr 02;6(2):e18810 [FREE Full text] [CrossRef] [Medline]
- Bokolo AJ. Use of telemedicine and virtual care for remote treatment in response to COVID-19 pandemic. J Med Syst 2020 Jun 15;44(7):132 [FREE Full text] [CrossRef] [Medline]
- Vidal-Alaball J, Acosta-Roja R, Pastor Hernández N, Sanchez Luque U, Morrison D, Narejos Pérez S, et al. Telemedicine in the face of the COVID-19 pandemic. Aten Primaria 2020;52(6):418-422 [FREE Full text] [CrossRef] [Medline]
- Bashshur R, Doarn CR, Frenk JM, Kvedar JC, Woolliscroft JO. Telemedicine and the COVID-19 pandemic, lessons for the future. Telemed J E Health 2020 May;26(5):571-573. [CrossRef] [Medline]
- Ananthakrishnan AN, Singh S. The doctor will call you now! telemedicine in the midst of a pandemic. Clin Gastroenterol Hepatol 2020 Jul;18(8):1688-1690 [FREE Full text] [CrossRef] [Medline]
- Kelso M, Feagins L. Can smartphones help deliver smarter care for patients with inflammatory bowel disease? Inflamm Bowel Dis 2018 Jun 08;24(7):1453-1459. [CrossRef] [Medline]
- Helsel BC, Williams JE, Lawson K, Liang J, Markowitz J. Telemedicine and mobile health technology are effective in the management of digestive diseases: a systematic review. Dig Dis Sci 2018 Jun 16;63(6):1392-1408. [CrossRef] [Medline]
- Yin AL, Hachuel D, Pollak JP, Scherl EJ, Estrin D. Digital health apps in the clinical care of inflammatory bowel disease: scoping review. J Med Internet Res 2019 Aug 19;21(8):e14630 [FREE Full text] [CrossRef] [Medline]
- Kernebeck S, Busse TS, Böttcher MD, Weitz J, Ehlers J, Bork U. Impact of mobile health and medical applications on clinical practice in gastroenterology. World J Gastroenterol 2020 Aug 07;26(29):4182-4197 [FREE Full text] [CrossRef] [Medline]
- Krebs P, Duncan DT. Health app use among US mobile phone owners: a national survey. JMIR mHealth uHealth 2015 Nov 04;3(4):e101 [FREE Full text] [CrossRef] [Medline]
- Riaz MS, Atreja A. Personalized technologies in chronic gastrointestinal disorders: self-monitoring and remote sensor technologies. Clin Gastroenterol Hepatol 2016 Dec;14(12):1697-1705 [FREE Full text] [CrossRef] [Medline]
- Con D, de Cruz P. Mobile phone apps for inflammatory bowel disease self-management: a systematic assessment of content and tools. JMIR mHealth uHealth 2016 Feb 01;4(1):e13 [FREE Full text] [CrossRef] [Medline]
- Huckvale K, Torous J, Larsen ME. Assessment of the data sharing and privacy practices of smartphone apps for depression and smoking cessation. JAMA Netw Open 2019 Apr 05;2(4):e192542 [FREE Full text] [CrossRef] [Medline]
- Grundy Q, Chiu K, Held F, Continella A, Bero L, Holz R. Data sharing practices of medicines related apps and the mobile ecosystem: traffic, content, and network analysis. BMJ 2019 Mar 20;364:l920 [FREE Full text] [CrossRef] [Medline]
- Armstrong S. Which app should I use? BMJ 2015 Sep 09;351:h4597. [CrossRef] [Medline]
- Bardus M, van Beurden SB, Smith JR, Abraham C. A review and content analysis of engagement, functionality, aesthetics, information quality, and change techniques in the most popular commercial apps for weight management. Int J Behav Nutr Phys Act 2016 Mar 10;13:35 [FREE Full text] [CrossRef] [Medline]
- Nicholas J, Larsen ME, Proudfoot J, Christensen H. Mobile apps for bipolar disorder: a systematic review of features and content quality. J Med Internet Res 2015 Aug 17;17(8):e198 [FREE Full text] [CrossRef] [Medline]
- Rathner EM, Probst T. Mobile Applikationen in der psychotherapeutischen Praxis: Chancen und Grenzen. Mobile applications in psychotherapeutic practice: opportunities and risks. Psychotherapie im Dialog 2018 Nov 28;19(04):51-55. [CrossRef]
- Portenhauser AA, Terhorst Y, Schultchen D, Sander LB, Denkinger MD, Stach M, et al. Mobile apps for older adults: systematic search and evaluation within online stores. JMIR Aging 2021 Feb 19;4(1):e23313 [FREE Full text] [CrossRef] [Medline]
- Domnich A, Arata L, Amicizia D, Signori A, Patrick B, Stoyanov S, et al. Development and validation of the Italian version of the Mobile Application Rating Scale and its generalisability to apps targeting primary prevention. BMC Med Inform Decis Mak 2016 Jul 07;16(1):83 [FREE Full text] [CrossRef] [Medline]
- Messner E, Terhorst Y, Barke A, Baumeister H, Stoyanov S, Hides L, et al. The German version of the Mobile App Rating Scale (MARS-G): development and validation study. JMIR mHealth uHealth 2020 Mar 27;8(3):e14479 [FREE Full text] [CrossRef] [Medline]
- Payo MR, Fernandez Álvarez MM, Blanco Díaz M, Cuesta Izquierdo M, Stoyanov S, Llaneza Suárez E. Spanish adaptation and validation of the Mobile Application Rating Scale questionnaire. Int J Med Inform 2019 Sep;129:95-99. [CrossRef] [Medline]
- Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR mHealth uHealth 2015 Mar 11;3(1):e27 [FREE Full text] [CrossRef] [Medline]
- Bakker D, Kazantzis N, Rickwood D, Rickard N. Mental health smartphone apps: review and evidence-based recommendations for future developments. JMIR Ment Health 2016 Mar 01;3(1):e7 [FREE Full text] [CrossRef] [Medline]
- Terhorst Y, Philippi P, Sander LB, Schultchen D, Paganini S, Bardus M, et al. Validation of the Mobile Application Rating Scale (MARS). PLoS One 2020 Nov 2;15(11):e0241480 [FREE Full text] [CrossRef] [Medline]
- Grainger R, Townsley H, White B, Langlotz T, Taylor WJ. Apps for people with rheumatoid arthritis to monitor their disease activity: a review of apps for best practice and quality. JMIR mHealth uHealth 2017 Feb 21;5(2):e7 [FREE Full text] [CrossRef] [Medline]
- Machado GC, Pinheiro MB, Lee H, Ahmed OH, Hendrick P, Williams C, et al. Smartphone apps for the self-management of low back pain: a systematic review. Best Pract Res Clin Rheumatol 2016 Dec;30(6):1098-1109. [CrossRef] [Medline]
- Masterson Creber RM, Maurer MS, Reading M, Hiraldo G, Hickey KT, Iribarren S. Review and analysis of existing mobile phone apps to support heart failure symptom monitoring and self-care management using the Mobile Application Rating Scale (MARS). JMIR mHealth uHealth 2016 Jun 14;4(2):e74 [FREE Full text] [CrossRef] [Medline]
- Salazar A, de Sola H, Failde I, Moral-Munoz JA. Measuring the quality of mobile apps for the management of pain: systematic search and evaluation using the Mobile App Rating Scale. JMIR mHealth uHealth 2018 Oct 25;6(10):e10718 [FREE Full text] [CrossRef] [Medline]
- Terhorst Y, Rathner E, Baumeister H, Sander L. «Hilfe aus dem App-Store?»: Eine systematische Übersichtsarbeit und Evaluation von Apps zur Anwendung bei Depressionen. 'Help from the app store?': a systematic review of depression apps in German app stores. Verhaltenstherapie 2018 May 8;28(2):101-112. [CrossRef]
- Thornton L, Quinn C, Birrell L, Guillaumier A, Shaw B, Forbes E, et al. Free smoking cessation mobile apps available in Australia: a quality review and content analysis. Aust N Z J Public Health 2017 Dec;41(6):625-630. [CrossRef] [Medline]
- Sander LB, Schorndanner J, Terhorst Y, Spanhel K, Pryss R, Baumeister H, et al. 'Help for trauma from the app stores?' a systematic review and standardised rating of apps for post-traumatic stress disorder (PTSD). Eur J Psychotraumatol 2020 Jan 09;11(1):1701788 [FREE Full text] [CrossRef] [Medline]
- Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, PRISMA-P Group. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev 2015 Jan 01;4(1):1 [FREE Full text] [CrossRef] [Medline]
- Mobile Health App Database. MHAD. URL: http://mhad.science/ [accessed 2022-08-25]
- Stach M, Kraft R, Probst T, Messner E, Terhorst Y, Baumeister H, et al. Mobile health app database - a repository for quality ratings of mHealth apps. 2020 Sep 01 Presented at: 2020 IEEE 33rd International Symposium on Computer-Based Medical Systems (CBMS); July 28-30, 2020; Rochester, MN p. 427-432. [CrossRef]
- MARS - Mobile Anwendungen Rating Skala. MARS-Rating Universität Ulm YouTube page. 2019 Jul 31. URL: https://www.youtube.com/watch?v=5vwMiCWC0Sc [accessed 2022-08-25]
- Fleiss JL. Design and Analysis of Clinical Experiments. Hoboken, NJ: John Wiley & Sons; 2011.
- Mojica Ruiz IJ, Nagappan M, Adams B, Berger T, Dienst S, Hassan AE. Examining the rating system used in mobile-app stores. IEEE Softw 2016 Nov;33(6):86-92. [CrossRef]
- Zar JH. Significance testing of the Spearman rank correlation coefficient. J Am Stat Assoc 1972 Sep;67(339):578-580. [CrossRef]
- Schultchen D, Terhorst Y, Holderied T, Stach M, Messner E, Baumeister H, et al. Stay present with your phone: a systematic review and standardized rating of mindfulness apps in European app stores. Int J Behav Med 2021 Oct 20;28(5):552-560 [FREE Full text] [CrossRef] [Medline]
- Apps and digital health resources reviewed by experts. One Mind PsyberGuide. URL: https://onemindpsyberguide.org [accessed 2022-08-25]
- Informationen zu Gesundheits-Apps. KVAppradar. URL: https://www.kvappradar.de [accessed 2022-08-25]
- Kim ES, Park KS, Cho KB, Kim KO, Jang BI, Kim EY, Daegu–Gyeongbuk Gastrointestinal Study Group (DGSG). Development of a web-based, self-reporting symptom diary for Crohn's Disease, and its correlation with the Crohn's Disease Activity Index. J Crohns Colitis 2017 Dec 04;11(12):1449-1455. [CrossRef] [Medline]
- Echarri A, Vera I, Ollero V, Arajol C, Riestra S, Robledo P, et al. The Harvey-Bradshaw index adapted to a mobile application compared with in-clinic assessment: the MediCrohn study. Telemed J E Health 2020 Jan;26(1):80-88 [FREE Full text] [CrossRef] [Medline]
- Aitken M, Lyle M. Patient Adoption of mHealth: Use, Evidence and Remaining Barriers to Mainstream Acceptance. Parsippany, NJ: IMS Institute for Healthcare Informatics; 2015.
- Endl R, Jäschke T, Thiel C, Wickinghoff DV. mHealth im Kontext des elektronischen Patientendossiersine Studie im Auftrag von eHealth Suisse. mHealth in the context of the electronic patient record: a study commissioned by eHealth Suisse. Fachhochschule St Gall. 2015 Mar 19. URL: https://e-health-com.de/fileadmin/user_upload/dateien/Downloads/Studie_mHealth_Maerz_2015.pdf [accessed 2022-08-25]
- Kuhn B, Amelung V. Kapitel 4. Gesundheits-Apps und besondere Herausforderungen. Chapter 4. health apps and special challenges. In: Albrecht UV, editor. Chancen und Risiken von Gesundheits-Apps (CHARISMHA). Hannover, Germany: Medizinische Hochschule Hannover; 2016:100-114.
- Nasi G, Cucciniello M, Guerrazzi C. The role of mobile technologies in health care processes: the case of cancer supportive care. J Med Internet Res 2015 Feb 12;17(2):e26 [FREE Full text] [CrossRef] [Medline]
- Price M, Yuen EK, Goetter EM, Herbert JD, Forman EM, Acierno R, et al. mHealth: a mechanism to deliver more accessible, more effective mental health care. Clin Psychol Psychother 2014;21(5):427-436 [FREE Full text] [CrossRef] [Medline]
- Dicianno BE, Parmanto B, Fairman AD, Crytzer TM, Yu DX, Pramana G, et al. Perspectives on the evolution of mobile (mHealth) technologies and application to rehabilitation. Phys Ther 2015 Mar;95(3):397-405 [FREE Full text] [CrossRef] [Medline]
- Giraud EL, Thomas PWA, van Lint JA, van Puijenbroek EP, Römkens TEH, West RL, IBDREAM registry. Adverse drug reactions from real-world data in inflammatory bowel disease patients in the IBDREAM Registry. Drug Saf 2021 May;44(5):581-588 [FREE Full text] [CrossRef] [Medline]
- Jagannath B, Lin K, Pali M, Sankhala D, Muthukumar S, Prasad S. A sweat-based wearable enabling technology for real-time monitoring of IL-1β and CRP as potential markers for inflammatory bowel disease. Inflamm Bowel Dis 2020 Sep 18;26(10):1533-1542. [CrossRef] [Medline]
- Chong KPL, Woo BKP. Emerging wearable technology applications in gastroenterology: a review of the literature. World J Gastroenterol 2021 Mar 28;27(12):1149-1160 [FREE Full text] [CrossRef] [Medline]
- de Jong MJ, Boonen A, van der Meulen-de Jong AE, Romberg-Camps MJ, van Bodegraven AA, Mahmmod N, et al. Cost-effectiveness of telemedicine-directed specialized vs standard care for patients with inflammatory bowel diseases in a randomized trial. Clin Gastroenterol Hepatol 2020 Jul;18(8):1744-1752. [CrossRef] [Medline]
- Ankersen DV, Weimers P, Marker D, Teglgaard Peters-Lehm C, Bennedsen M, Rosager Hansen M, et al. Costs of electronic health vs. standard care management of inflammatory bowel disease across three years of follow-up-a Danish register-based study. Scand J Gastroenterol 2021 May 28;56(5):520-529. [CrossRef] [Medline]
- Park KT, Ehrlich OG, Allen JI, Meadows P, Szigethy EM, Henrichsen K, et al. Inflamm Bowel Dis 2020 Jan 01;26(1):1-10 [FREE Full text] [CrossRef] [Medline]
Abbreviations
IBD: inflammatory bowel disease |
ICC: intraclass correlation |
IRR: interrater reliability |
MARS: Mobile Application Rating Scale |
MARS-G: German version of the Mobile Application Rating Scale |
MHAD: Mobile Health App Database |
mHealth: mobile health |
PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses |
Edited by G Eysenbach; submitted 23.02.22; peer-reviewed by U Bork, L Birrell; comments to author 17.03.22; revised version received 30.05.22; accepted 29.07.22; published 05.10.22
Copyright©Eva-Maria Messner, Niklas Sturm, Yannik Terhorst, Lasse B Sander, Dana Schultchen, Alexandra Portenhauser, Simone Schmidbaur, Michael Stach, Jochen Klaus, Harald Baumeister, Benjamin M Walter. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 05.10.2022.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.