Review
Abstract
Background: There are numerous mobile health (mHealth) interventions for treatment adherence and self-management; yet, little is known about user engagement or interaction with these technologies.
Objective: This systematic review aimed to answer the following questions: (1) How is user engagement defined and measured in studies of mHealth interventions to promote adherence to prescribed medical or health regimens or self-management among people living with a health condition? (2) To what degree are patients engaging with these mHealth interventions? (3) What is the association between user engagement with mHealth interventions and adherence or self-management outcomes? (4) How often is user engagement a research end point?
Methods: Scientific database (Ovid MEDLINE, Embase, Web of Science, PsycINFO, and CINAHL) search results (2016-2021) were screened for inclusion and exclusion criteria. Data were extracted in a standardized electronic form. No risk-of-bias assessment was conducted because this review aimed to characterize user engagement measurement rather than certainty in primary study results. The results were synthesized descriptively and thematically.
Results: A total of 292 studies were included for data extraction. The median number of participants per study was 77 (IQR 34-164). Most of the mHealth interventions were evaluated in nonrandomized studies (157/292, 53.8%), involved people with diabetes (51/292, 17.5%), targeted medication adherence (98/292, 33.6%), and comprised apps (220/292, 75.3%). The principal findings were as follows: (1) >60 unique terms were used to define user engagement; “use” (102/292, 34.9%) and “engagement” (94/292, 32.2%) were the most common; (2) a total of 11 distinct user engagement measurement approaches were identified; the use of objective user log-in data from an app or web portal (160/292, 54.8%) was the most common; (3) although engagement was inconsistently evaluated, most of the studies (99/195, 50.8%) reported >1 level of engagement due to the use of multiple measurement methods or analyses, decreased engagement across time (76/99, 77%), and results and conclusions suggesting that higher engagement was associated with positive adherence or self-management (60/103, 58.3%); and (4) user engagement was a research end point in only 19.2% (56/292) of the studies.
Conclusions: The results revealed major limitations in the literature reviewed, including significant variability in how user engagement is defined, a tendency to rely on user log-in data over other measurements, and critical gaps in how user engagement is evaluated (infrequently evaluated over time or in relation to adherence or self-management outcomes and rarely considered a research end point). Recommendations are outlined in response to our findings with the goal of improving research rigor in this area.
Trial Registration: PROSPERO International Prospective Register of Systematic Reviews CRD42022289693; https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42022289693
doi:10.2196/50508
Keywords
Introduction
Background
As smartphones have become an integral part of modern daily life [
, ], mobile health (mHealth) interventions for treatment adherence and self-management promotion have rapidly developed. These interventions often use existing smartphone features, such as sending SMS text notifications as cues to take prescribed medications [ ]; others may integrate external technologies, such as a Bluetooth-enabled glucometer linked to a smartphone app to track blood glucose levels over time with the goal of supporting diabetes management [ ]. In general, more frequent engagement, or interaction, with mHealth tools is expected to result in improved treatment adherence or self-management [ ]. However, mHealth tools are frequently abandoned by users. Among mobile phone users in the United States, more than half reportedly downloaded an mHealth app but nearly half also stopped using the app due to high data entry burden, low interest, and costs [ ].There is a disconnect between research findings supporting positive correlations between engagement and adherence or self-management and user tendencies to stop using mHealth tools. This discrepancy may reflect an argument put forth by Arigo et al [
] that the mHealth field “lacks a science of engagement.” Specifically, there is (1) a lack of consensus in how mHealth user engagement is measured, defined, and reported; (2) no consensus on the optimal level of mHealth user engagement to facilitate meaningful behavior change; and (3) infrequent consideration of user engagement as a research end point. Not treating user engagement as a research end point suggests that this domain is poorly defined and haphazardly evaluated, particularly in terms of how user engagement might evolve over the course of the intervention or relate to behavioral and health outcomes. While the tendency for mHealth use to decline over time suggests that users will not experience maximum benefit from accessing these tools, poor measurement of user engagement has presented a challenge to researchers’ abilities to characterize exactly how and why engagement may decrease and how these decreases may affect intervention outcomes. These critical gaps in the science of user engagement significantly limit the utility, effectiveness, uptake, and scalability of mHealth interventions for adherence and self-management promotion.Recent systematic reviews have examined aspects of user engagement with mHealth interventions for specific diagnoses, including hypertension [
], physical activity [ , ], depressive symptoms [ , ], and mental health conditions [ ]. The applicability of these reviews to adherence and self-management mHealth interventions is significantly limited by the small number of studies included and a lack of unified focus on adherence and self-management behaviors. These prior reviews have been further limited by using a very broad definition of engagement to include usability, feasibility, user satisfaction, and acceptability [ ], limiting the review to studies in which only postassessment retention data were obtained [ ] (excludes interventions earlier in the design phase), and focusing on design features associated with user engagement rather than the evaluation of user engagement itself [ ]. Another review identified a range of valid and reliable measurement approaches for evaluating user engagement with mHealth interventions for behavior change but used a snowballing method to identify sources rather than a rigorous systematic review of the literature [ ]. To encourage the continued use of, and optimal engagement with, mHealth interventions to facilitate adherence and self-management behavior change, it is imperative to comprehensively and systematically evaluate the recent scientific landscape of mHealth user engagement with a clear focus on adherence and self-management behavior.Objectives
In response to gaps identified in the current scientific literature [
], our registered systematic review aimed to (1) characterize user engagement with interventions promoting mHealth treatment adherence or self-management for adults and youth with health conditions and (2) generate user engagement–focused research recommendations. “User engagement” with mHealth tools can be conceptualized as both behavioral (the extent of use) and experiential (the subjective experience of interacting with the technology) [ ]. To enhance the practical application of our review findings, we focused on the behavioral aspects of user engagement to evaluate the degree of use and interaction with the mHealth tool [ ] among users with chronic health conditions. Users’ behavioral interaction with mHealth tools, features, and associated behavior change components is known as “Little e” engagement. In theory, increased “Little e” engagement is expected to contribute to increased engagement in the desired health behavior, known as “Big E” [ ]. Thus, better precision in how behavioral interaction, or “Little e” engagement, is empirically evaluated could help to facilitate greater changes in “Big E” outcomes, thus improving the overall efficacy of mHealth interventions for adherence and self-management. A systematic review approach was selected due to expected heterogeneity in both the measurement of user engagement and adherence and self-management outcomes, which precludes the use of a meta-analysis [ - ]. We specifically aimed to answer the following research questions: (1) How is user engagement defined and measured in studies of mHealth interventions to promote adherence to prescribed medical or health regimens or self-management among people living with a health condition? (2) To what degree are patients engaging with these mHealth interventions? (3) What is the association between user engagement with mHealth interventions and adherence or self-management outcomes? (4) How often is user engagement a research end point?We also developed the following exploratory question: are there differences in user engagement measurement approaches and levels between studies that provide monetary compensation and those that do not?
Methods
This systematic review was registered with PROSPERO (CRD42022289693) and prepared in accordance with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. The review team prepared and followed a standard manual of procedures designed for this systematic review.
Ethical Considerations
Institutional review board approval was not required because the study was not considered human participant research.
Information Sources and Search Strategy
The search strategy (
) was developed by the first and last authors (CE and KR) in collaboration with an informationist at Johns Hopkins Libraries; implemented in Ovid MEDLINE, Embase, Web of Science, PsycINFO, and CINAHL; and restricted to manuscripts published between 2016 and 2021. All citations returned from the search were imported into our Covidence (Veritas Health Innovation Ltd) [ ] database for screening and data extraction.Eligibility Criteria
The inclusion and exclusion criteria are presented in
.Inclusion criteria
- Peer-reviewed manuscripts reporting on original qualitative or quantitative investigations published in English between 2016 and 2021
- Participants followed a medical or health regimen or engaged in adherence or self-management activities for a chronic physical or mental health condition
- A mobile health (mHealth) intervention was used by these participants or their caregivers in a home setting, was at least partially automated (could not only include manual 2-way SMS text messaging or video web conferencing), and was accessible on a mobile device (smartphone or tablet device, including internet browser–based programs)
- The primary intervention target was treatment adherence (eg, taking medication, exercising, or following a diet); or self-management of the health condition, often measured by a health outcome associated with treatment adherence behavior (eg, glycated hemoglobin test, viral load, or BMI)
- User engagement (use and interaction) with the mHealth intervention was a measured study outcome, either by objective (eg, app-recorded log-in data) or subjective (eg, user self-report or qualitative interviews) metrics
Exclusion criteria
- Meta-analyses, systematic reviews, published abstracts, dissertations, and published protocols, as well as studies reporting on usability testing or intervention development only
Selection Process
Citations were imported into Covidence; duplicate citations were removed; and title and abstract screening was conducted, followed by a full-text review. At each level of review, 2 separate review team members evaluated each article against the inclusion and exclusion criteria, with discrepancies resolved by CE and N Muthusamy. Any study meeting the inclusion criteria after the full-text review progressed to the data extraction phase (detailed in the next subsection).
Data Extraction
Overview
Data extraction was performed by 2 separate review team members independently of each other using a standard data extraction form developed by the study team, with discrepancies resolved by CE and N Muthusamy. For each study, the reviewers recorded both quantitative and qualitative data relevant to study design (eg, randomized controlled trial and case-control) and methodology (eg, monetary compensation for participation); demographic characteristics of participants; mHealth intervention targets and characteristics; measurement of user engagement, including whether it was a research end point (a key outcome being measured and potentially impacted by participation in the intervention); and the terminology used to describe the behavioral aspects of user engagement (researcher-evaluated user interactions with the mHealth technology).
Study results were summarized as described in the following subsections.
Level of Engagement With the Intervention
This was categorized as “high,” “medium,” “low,” “>1 level reported due to the use of multiple measurement or analytic approaches,” or “not characterized.” Categorizations were assigned based on the language used by the authors to characterize users’ level of engagement with the mHealth intervention (eg, the authors described user engagement with the mHealth intervention as “high”).
Change in Level of Engagement
This was categorized as “increased,” “no change,” “decreased,” “>1 direction reported due to the use of multiple measurement or analytic approaches,” or “not assessed.” For studies that assessed change in engagement over time, categorizations were assigned based on the data presented by the authors (eg, the authors presented data showing that the user engagement measurement decreased over time).
Association With Treatment Adherence or Self-Management Study Outcomes
This was categorized as “higher engagement, positive treatment adherence or self-management outcomes”; “moderate engagement, positive treatment adherence or self-management outcome)”; “lower engagement, positive treatment adherence or self-management outcomes”; “no association”; “>1 association reported due to the use of multiple measurement or analytic approaches”; or “not assessed.” For studies that assessed this association, categorizations were assigned based on how the authors reported and framed the study results and conclusions (eg, the authors’ reporting and framing of study results and conclusions suggested that higher engagement with the mHealth intervention was associated with positive study outcomes, such as higher treatment adherence or improved self-management outcome or outcomes).
Technology Dosage
This was categorized as “yes, given” (the researchers told participants how often or in what way or ways they should use the mHealth intervention components, such as complete 1 module per week and log medication administration in the app every day) or “no, not given.”
Minimum Engagement Research Benchmark
This was categorized as “yes, selected” (the researchers reported in their manuscript that a minimum cutoff for technology engagement was set as an empirical outcome to denote adequate participant engagement; eg, to be adequately engaged, a participant needed to use the Bluetooth-enabled glucometer at least once a day during the study period) or “no, not selected.”
No Formal Risk-of-Bias Assessment
We decided not to conduct a formal risk-of-bias assessment, given that the primary aim of this review was to characterize the evaluation and measurement of user engagement rather than certainty in the primary study results. Therefore, it was deemed inappropriate to evaluate the studies using standard risk-of-bias assessment tools.
Synthesis Methods
Statistical analyses were conducted using SPSS software (version 28.0; IBM Corp) [
]. The extracted data were summarized using frequencies and percentages. Methods of measuring user engagement with the mHealth intervention were thematically grouped into discrete measurement categories. Subgroup sensitivity analyses were conducted to examine studies involving pediatric samples (participants aged 0-18 y or aged up to 25 y if the sample was characterized as “pediatric” by the authors) separately from those involving adults only (participants aged >18 y). In these age-based subgroup analyses, of the 292 included studies, 5 (1.7%) were excluded due to including both pediatric and adult participants, and 1 (0.3%) was excluded due to not reporting participant ages. Given that this investigation was designed as a systematic review, no effect measures or meta-regressions were used. No missing summary statistics or data conversions were used.Results
Search Results and Screening Process
presents the PRISMA flow diagram of the screening process. The initial search returned 3955 citations, from which 70 (1.77%) duplicates were removed. During title and abstract screening, the remaining 3885 studies were screened, and 2736 (70.42%) were excluded. During full-text screening, the remaining 1149 studies were evaluated, and 857 (74.59%) were excluded. The primary reasons for exclusion were as follows: ineligible manuscript type (eg, published abstract; 330/857, 38.5%), user engagement with the mHealth intervention was not measured (206/857, 24%), and ineligible participant population (111/857, 12.9%). The final review included 292 studies [ - ] (refer to for all included studies and characteristics).
Basic Study and mHealth Intervention Characteristics
Nearly half of the studies (135/292, 46.2%) were conducted in the United States and used a randomized controlled trial design. The median number of participants was 77 (IQR 34-164). Nearly half (135/292, 46.2%) were considered feasibility studies. The median study length was 90 (IQR 60-180) days. Diabetes (51/292, 17.5%) and mental health conditions (35/292, 11.9%) were the most common diagnoses. Study characteristics were similar between adult and pediatric studies, with the exception of health conditions, reflecting expected age-based differences in diagnoses more common among adults than among children (eg, type 2 diabetes and substance use were more commonly studied in adult samples than in pediatric samples).
Table S1 in
contains specific details on the mHealth interventions’ adherence or self-management targets, intervention components, and intended users. The most frequently targeted adherence or self-management concern was taking medication (98/292, 33.6%), followed by exercise (93/292, 31.8%) and diet (73/292, 25%). Nearly all mHealth interventions were used by the patient (291/292, 99.7%), but some of them included health care providers (58/292, 19.9%) or caregivers (20/292, 6.8%). The majority of mHealth interventions comprised a mobile app (220/292, 75.3%), SMS text messaging or push notifications (74/292, 25.3%), websites or web portals not within a mobile app (48/292, 16.4%), and nonwearable monitoring devices (47/292, 16.1%). Interventions that did not include a mobile app primarily comprised text messaging, a wearable device, a nonwearable device, video web conferencing or telephone calls, or a website or web portal not within a mobile app. Nearly three-quarters of the interventions (216/292, 74%) prompted users to engage with the mHealth intervention. Less than half of the studies (124/292, 42.5%) provided monetary compensation for participation. Only 10.6% (31/292) allowed users to continue using the mHealth intervention after the formal study period. Intervention characteristics were generally similar between adult and pediatric studies, with the exception of intervention target behavior, reflecting expected age-based differences in health concerns more common among adults than among children (eg, exercise, mental health management, and drug or alcohol use or abuse were more commonly targeted in adult samples than in pediatric samples).How Is User Engagement Defined and Measured?
Definition
Terminology defining user engagement varied widely (Table S2 in
). There were 33 unique terms used to define engagement that appeared in at least 2 (0.7%) of the 292 studies. Of the 292 studies, 31 (10.6%) studies each used a unique term that appeared in only that 1 study. “Use” (102/292, 34.9%) and “engagement” (94/292, 32.2%) were the most common terms. Although most terms were synonymous with “use,” “engagement,” or “interaction” with the technology (reflecting our a priori definition of behavioral user engagement and our search strategy), other studies notably used disparate terms, including “acceptability” (26/292, 8.9%), “fidelity” (5/292, 1.7%), “satisfaction” (6/292, 2%), and “perception” (6/292, 2%).Measurement
Across all studies, 11 distinct user engagement measurement approaches emerged, comprising both objective (n=9, 82%) and subjective (n=2, 18%) methods. User engagement was most frequently evaluated via objective user log-in data from the app or web portal (eg, number of log-ins; 160/292, 54.8%), followed by manually entering data in an app (77/292, 26.4%), qualitative interviews (54/292, 18.5%), and responding to text notifications (49/292, 16.8%). There were “other objective measures” that did not fall into any of the 11 main categories (15/292, 5.1%; eg, notification reading rate or downloading podcasts). These results were similar between adult and pediatric studies (
; Table S3 in ).Measurement methods | Examples | Studies, n (%)a | |||
Objective measures | |||||
User log-in data retrieved from app or website |
| 160 (54.8) | |||
Manual user data entry in app-or website-based self-monitoring diaries |
| 77 (26.4) | |||
Response to SMS text messages or push notifications |
| 49 (16.8) | |||
Number or proportion of intervention program modules completed within app or website |
| 48 (16.4) | |||
Interacting via chats, phone calls, or social media posts |
| 33 (11.3) | |||
Wearing an electronic monitoring device |
| 26 (8.9) | |||
Using a nonwearable electronic monitoring device |
| 26 (8.9) | |||
Submitting videos via app |
| 5 (1.7) | |||
Other objective measures |
| 13 (4.5) | |||
Subjective measures | |||||
Qualitative interview |
| 54 (18.5) | |||
Participant-reported survey |
| 29 (9.9) |
aPercentages do not add up to 100% because studies could fall into >1 category.
bmHealth: mobile health.
When examining engagement definitions by measurement approaches, “use” (7/9, 78%) and “engagement” (9/9, 100%) were most commonly used across the nine objective measurement approaches. The exceptions were “wearing an electronic monitoring device” and “submitting videos via app” for which “adherence” (11/26, 42%, 2/5, 40%, respectively) was most commonly used within the measurement approach. Qualitative interviews had the widest range of terminologies used, with “user experience” being the most common (21/54, 39%;
).Evaluation methods | Termsa used to define user engagement, n (%)b |
User log-in data retrieved from app or website (n=160) |
|
Manual user data entry in app- or website-based self-monitoring diaries (n=77) |
|
Response to SMS text messages or push notifications (n=49) |
|
Number or proportion of intervention program modules completed within app or website (n=48) |
|
Interacting via chats, phone calls, or social media posts (n=33) |
|
Wearing an electronic monitoring device (n=26) |
|
Using a nonwearable electronic monitoring device (n=26) |
|
Submitting videos via app (n=5) |
|
Other objective measures (n=13) |
|
Qualitative interview (n=54) |
|
Participant-reported survey (n=29) |
|
aWe report terms used to describe user engagement in at least 10% of the studies using a given evaluation method; this cutoff was selected to enhance interpretability due to the wide range of terms used to describe user engagement (refer to Table S2 in
for details of user engagement definitions).bPercentages within categories do not add up to 100% because studies could fall into >1 category.
The use of user log-in data was the most common measurement method across mHealth intervention components, except for SMS text messaging or push notifications and wearable devices. When SMS text messaging or push notifications was an intervention component, response to SMS text messaging or push notifications was the most common metric (38/74, 51%). When a wearable device was an intervention component, wearing an electronic monitoring device was the most common metric (26/39, 67%; Table S4 in
).To What Degree Are Participants Engaging With These mHealth Interventions?
User Engagement Level
User engagement level was characterized in two-thirds of the reviewed studies (195/292, 66.8%), of which a little more than half (99/195, 50.8%) reported >1 level of engagement due to the use of multiple measurement methods or analyses. Only one-third of the studies (99/292, 33.9%) examined change in engagement over time; when it was examined, engagement tended to decrease (76/99, 77%). These results were similar between adult and pediatric studies (
).Characteristic | All studies (n=292), n (%) | Adult studies (n=241), n (%) | Pediatric studies (n=45), n (%) | |
User engagement level | ||||
High | 63 (21.6) | 55 (22.8) | 7 (15.6) | |
Medium | 6 (2.1) | 4 (1.7) | 2 (4.4) | |
Low | 27 (9.2) | 19 (7.9) | 6 (13.3) | |
>1a level reported | 99 (33.9) | 81 (33.6) | 18 (40.0) | |
Not characterized | 97 (33.2) | 82 (34.0) | 12 (26.7) | |
Change in user engagement level | ||||
Increased | 3 (1.0) | 3 (0.01) | 0 (0) | |
No change | 15 (5.1) | 13 (5.4) | 1 (2.2) | |
Decreased | 76 (26.0) | 61 (25.3) | 13 (28.9) | |
>1 direction reported | 5 (1.7) | 4 (1.7) | 1 (2.2) | |
Not assessed | 193 (66.1) | 160 (66.4) | 30 (66.7) | |
Association with adherence or SMb outcomes | ||||
Higher engagement, positive adherence or SM outcomes | 60 (20.5) | 49 (20.3) | 8 (17.8) | |
Moderate engagement, positive adherence or SM outcomes | 1 (0.3) | 1 (0.4) | 0 (0) | |
Lower engagement, positive adherence or SM outcomes | 1 (0.3) | 1 (0.4) | 0 (0) | |
No association | 18 (6.2) | 15 (6.2) | 3 (6.7) | |
>1 association reported | 23 (7.9) | 18 (7.5) | 5 (11.1) | |
Not assessed | 189 (64.7) | 157 (65.1) | 29 (64.4) |
aCategories with “>1” finding reflect the use of multiple measurements or analyses, leading to multiple results in different directions (eg, for “Change in user engagement level,” engagement is shown to increase and decrease depending on the measurement used).
bSM: self-management.
Measurement Approach by User Engagement Level
Compared to studies characterized as having high user engagement, studies with low user engagement tended to measure (≥10% difference) engagement with user log-in data (19/27, 70% vs 36/63, 57%) and module completion (7/27, 26% vs 9/63, 14%). Compared to studies characterized as having low user engagement, studies with high user engagement tended to measure engagement with response to text notifications (14/63, 22% vs 1/27, 4%); interacting via chats, phone calls, or social media posts (13/63, 21% vs 1/27, 4%); wearing an electronic monitoring device (6/63, 10% vs 0); using a nonwearable electronic monitoring device (7/63, 11% vs 0); and qualitative interviews (12/63, 19% vs 2/27, 7%;
).Measurement | Characterization of user engagement level with intervention | ||||
Low (n=27), n (%)a | Medium (n=6), n (%)a | High (n=63), n (%)a | >1 (n=99), n (%)a | Not characterized (n=97), n (%)a | |
User log-in data retrieved from app or website | 19 (70) | 5 (83) | 36 (57) | 57 (57) | 43 (44) |
Manual user data entry in app-or website-based self-monitoring diaries | 8 (29) | 2 (33) | 15 (24) | 29 (29) | 23 (24) |
Response to SMS text messages or push notifications | 1 (4) | 0 (0) | 14 (22) | 14 (14) | 20 (21) |
Number or proportion of intervention program modules completed within app or website | 7 (26) | 2 (33) | 9 (14) | 16 (16) | 14 (14) |
Interacting via chats, phone calls, or social media posts | 1 (4) | 0 (0) | 13 (21) | 10 (10) | 9 (33) |
Wearing an electronic monitoring device | 0 (0) | 0 (0) | 6 (10) | 9 (9) | 11 (11) |
Using a nonwearable electronic monitoring device | 0 (0) | 0 (0) | 7 (11) | 11 (11) | 8 (8) |
Submitting videos via app | 2 (7) | 0 (0) | 0 (0) | 2 (20) | 1 (20) |
Other objective measures | 2 (7) | 0 (0) | 3 (5) | 5 (5) | 3 (3) |
Qualitative interview | 2 (7) | 1 (17) | 12 (19) | 16 (16) | 23 (24) |
Participant-reported survey | 1 (4) | 2 (33) | 4 (6) | 10 (10) | 12 (12) |
aPercentages within categories do not add up to 100% because studies could fall into >1 category.
Technology Dosages and Minimum Engagement Research Benchmarks
Technology dosages denote when researchers provided participants with specific recommendations for mHealth intervention use (eg, log in to the app at least 3 times a week). Minimum engagement research benchmarks denoted when researchers set a minimum research cutoff for adequate participant engagement (eg, a participant who responded to ≥75% of SMS text messages during the study period was considered by the researchers to be adequately engaged with the mHealth intervention). A research benchmark could be set without giving a technology dosage and vice versa. Technology dosages were given less than half the time to participants by the researchers across all studies (119/292, 40.8%) and when examined by age group. Whether technology dosages were given or not, researchers characterized engagement level as “low” (14/27, 52% vs 13/27, 48%) and “high” (29/63, 46% vs 34/63, 54%) in relatively equal proportions (<10% difference;
and ).All studies (n=292), n (%) | Adult studies (n=241), n (%) | Pediatric studies (n=45), n (%) | ||
Technology dosage given to participants | ||||
Yes | 119 (40.8) | 96 (39.8) | 22 (48.9) | |
No | 173 (59.2) | 145 (60.2) | 23 (51.1) | |
Minimum engagement research benchmark set | ||||
Yes | 81 (27.7) | 71 (29.4) | 10 (22.2) | |
No | 211 (72.3) | 170 (70.5) | 35 (77.8) |
Low (n=27), n (%) | Medium (n=6), n (%) | High (n=63), n (%) | >1 (n=99), n (%) | Not characterized (n=97), n (%) | ||
Dosage given to participants | ||||||
Yes | 14 (52) | 2 (33) | 29 (46) | 43 (43) | 31 (32) | |
No | 13 (48) | 4 (67) | 34 (54) | 56 (57) | 66 (68) | |
Minimum engagement research benchmark set | ||||||
Yes | 11 (41) | 2 (33) | 15 (24) | 38 (38) | 15 (15) | |
No | 16 (59) | 4 (67) | 48 (76) | 61 (62) | 82 (85) |
A minimum engagement research benchmark was set as the outcome criterion less than one-third of the time across all studies (81/292, 27.7%) and when examined by age group. When a minimum engagement research benchmark was set, researchers tended to characterize user engagement levels as “low” (11/27, 41%) rather than “high” (15/63, 24%). When no minimum engagement research benchmark was set, researchers tended to characterize user engagement as “high” (48/63, 76%) rather than “low” (16/27, 59%;
).Among studies that had a minimum engagement research benchmark (81/292, 27.7%), less than half (35/81, 43%) gave a technology dosage to participants. Among the studies that gave a technology dosage to participants (119/292, 40.8%), only 29.4% (35/119) also had a minimum engagement research benchmark.
Of the 292 studies, 35 (12%) gave both a technology dosage and set a minimum engagement research benchmark; these indices matched in 94% (33/35) of the studies. Of these 35 studies, 29 (83%) characterized engagement level, of which the majority (n=13, 45%) reported >1 level of engagement due to the use of multiple measurement methods or analyses.
When a minimum engagement research benchmark was set or a recommended technology dosage was given, engagement tended to be measured with user log-in data (48/81, 59% and 69/119, 58%, respectively), manual data entry (26/81, 32% and 32/119, 26.9%, respectively), or module completion (16/81, 20% and 21/119, 17.6%, respectively;
).Measurements | User engagement level set by researchers | |
Minimum engagement research benchmark (n=81), n (%)a | Technology dosage given (n=119), n (%)a | |
User log-in data retrieved from app or website | 48 (59.3) | 69 (58.0) |
Manual user data entry in app- or website-based self-monitoring diaries | 26 (32.1) | 32 (26.9) |
Response to SMS text messages or push notifications | 9 (11.1) | 15 (12.6) |
Number or proportion of intervention program modules completed within app or website | 16 (19.8) | 21 (17.6) |
Interacting via chats, phone calls, or social media posts | 12 (14.8) | 14 (11.8) |
Wearing an electronic monitoring device | 10 (12.3) | 18 (15.1) |
Using a nonwearable electronic monitoring device | 10 (12.3) | 14 (11.8) |
Submitting videos via app | 2 (2.5) | 5 (4.2) |
Other objective measures | 4 (4.9) | 7 (5.9) |
Qualitative interview | 9 (11.1) | 16 (13.4) |
Participant-reported survey | 1 (0.01) | 12 (10.1) |
aPercentages within categories do not add up to 100% because studies could fall into >1 category.
What Is the Association Between User Engagement With mHealth Interventions and Adherence or Self-Management Outcomes?
The association between engagement and treatment adherence or self-management outcomes was only assessed in a little more than one-third of the studies (103/292, 35.3%). Among these 103 studies, 60 (58.3%) tended to report and frame results and conclusions to suggest that higher engagement was associated with positive adherence or self-management outcomes. These results were similar between adult and pediatric studies (
).How Often Is User Engagement a Research End Point?
User engagement was a research end point in only 19.2% (56/292) of the reviewed studies, with similar results in adult (44/241, 18.3%) and pediatric (11/45, 24%) studies. Of these 56 studies, 30 (54%) used nonrandomized experimental designs, and 27 (48%) were feasibility studies. User engagement was typically defined as “engagement” (24/56, 43%), “adherence” (16/56, 29%), or “use” (16/56, 29%; Table S2 in
) and was most frequently measured with user log-in data (31/56, 55%) or manual data entry (22/56, 39%; Table S5 in ).Exploratory Question: What Is the Association Between Providing Study Participants With Monetary Compensation and User Engagement Level?
Whether study participants were provided monetary compensation for their participation or not (or if compensation was not reported), user engagement measurement methods were used in similar proportions (<10% difference). Similarly, user engagement levels were observed in similar proportions between studies that provided monetary compensation and those that did not (or did not report compensation; Table S6 in
).Of the 292 studies, 10 (3.4%) included as an intervention component financial incentives for using the technology or meeting mHealth intervention goals. Of these 10 studies, 7 (70%) reported user engagement levels. Among these 7 studies, in 1 (14%), the user engagement level was characterized as “high”; in 1 (14%) as “medium”; and in 1 (14%), as “low”; and 4 (57%) reported >1 level due to multiple measurement or analytic approaches.
Discussion
Principal Findings
The principal findings relative to our specific research questions are provided in the following subsections.
How Is User Engagement Defined and Measured in Studies of mHealth Interventions to Promote Adherence to Prescribed Medical or Health Regimens or Self-Management Among People Living With a Health Condition?
Terms used to describe user engagement outcomes were wide ranging, but the most commonly used were “use” (102/292, 34.9%) and “engagement” (94/292, 32.2%). Across all studies reviewed, 11 distinct user engagement measurement approaches were identified, comprising both objective and subjective methods. The most common methods were user log-in data from the app or web portal (160/292, 54.8%), manually entering data in an app (77/292, 26.4%), qualitative interviews (54/292, 18.4%), and responding to SMS text messages or push notifications (49/292, 16.8%).
To What Degree Are Patients Engaging With These mHealth Interventions?
User engagement level was difficult to quantify because it was only characterized in two-thirds of the reviewed studies (195/292, 66.8%), of which a little more than half (99/195, 50.8%) reported >1 level of engagement due to the use of multiple measurement methods or analyses. Only one-third of the studies (99/292, 33.9%) evaluated change in engagement over time, which tended to decrease.
What Is the Association Between User Engagement With mHealth Interventions and Adherence or Self-Management Outcomes?
Only one-third of the studies (103/292, 35.3%) evaluated the association between engagement and treatment adherence or self-management outcomes. When evaluated, the study authors tended to report and frame results and conclusions to suggest that higher engagement was associated with positive adherence or self-management outcomes.
How Often Is User Engagement a Research End Point?
User engagement was rarely considered a research end point (56/292, 19.2%).
Exploratory Question: Are There Differences in User Engagement Measurement Approaches and Levels in Studies That Provide Monetary Compensation Compared to Those That Do Not?
No; whether study participants were provided monetary compensation for their participation or not (or if compensation was not reported), user engagement methods were used in similar proportions, and user engagement levels were observed in similar proportions.
Implications and Future Directions
Despite immense focus in both commercial and research sectors on using mHealth to support chronic illness treatment adherence and self-management [
- ], people do not remain engaged with mHealth interventions in the long term [ ]. Our systematic review also found that user engagement tends to decline over time. Consistent with the “Little e, Big E framework” [ ], mHealth intervention success hinges on the expectation that people will interact with the technology and thereby experience intended behavior changes that will lead to better overall health. Most importantly, our systematic review revealed critical limitations with how user engagement is defined and evaluated, which significantly impedes our ability to (1) communicate about this topic and (2) draw strong conclusions about how much user engagement is necessary to achieve desired behavior and health changes.A principal finding of our review was that there is no agreed-upon definition of mHealth user engagement, which is a direct barrier to interdisciplinary communication about this topic. We found >60 terms used to define user engagement, even when limiting inclusion criteria to the behavioral evaluation of this concept [
]. While “use” (102/292, 34.9%) and “engagement” (94/292, 32.2%) were the most common terms, “adherence” (59/292, 20.2%) also appeared frequently. “Adherence” as a term for mHealth user engagement can be problematic because it is closely tied to treatment adherence [ ], a key target of many of the mHealth interventions included in this systematic review. “Adherence” can apply to engaging with the mHealth technology as intended, such as logging in to an app [ ] or responding to SMS text messages [ ] rather than following a prescribed treatment regimen. Engaging with the technology can have a direct connection to treatment adherence (eg, using a Bluetooth-enabled blood pressure cuff reflects adherence to a key part of the hypertension management regimen as well as engaging with the mHealth technology [ , ]). However, such interchangeability and a lack of consistency in terminology will continue to be a barrier to communicating within and outside the field and add to existing challenges with defining and evaluating this domain. The extremely wide range of terms used to define user engagement likely reflects a major critique of mHealth research—that there is a lack of a science of engagement [ ]. We encourage standardization in terminology used when the intention is to evaluate users’ behavioral engagement with mHealth technology, rather than treatment regimen, with the most common terms found in this systematic review: “use” or “engagement.” Integrating standard user engagement language in an internationally adopted clinical terminology system, such as the Systematized Nomenclature of Medicine–Clinical Terms, could help facilitate standardization efforts.Another key finding was that the use of user log-in data was the default mHealth user engagement outcome, except for wearing a device when the intervention involved a wearable device component and responding to SMS text messages and push notifications when the intervention involved SMS text messaging and push notifications. Reliance on user log-in data over the other 10 major measurement approaches likely reflects that these data can be relatively straightforward to extract from a web portal. A strength of the use of user log-in data is that it may indicate more effortful and deliberate interactions with the technology (the user likely needs sufficient motivation to open and navigate an app) compared with, for example, quickly responding to a SMS text message or wearing a pedometer on the wrist. User log-in data may be a more accurate reflection of engagement behavior than self-report, which is potentially subject to social desirability and recall bias. The tendency for engagement assessed using user log-in data to be characterized as “low” may reflect the higher user burden of logging in to, and interacting with an, app, in addition to the overwhelming selection of this method for measuring user engagement. Reliance on user log-in data may bias interpretations of user engagement to favor higher quantities of engagement at the expense of higher-quality engagement (eg, infrequent access of a particularly effective app feature that users perceive as interesting, helpful, or motivating may be higher-quality engagement compared with frequent log-ins to the app homepage). Given the ubiquitous selection of user log-in data and the heterogeneity of adherence and self-management outcomes in this systematic review, it is not possible to evaluate which user engagement metric is best. In general, investigators should select the user engagement metric reflecting essential interactions with the mHealth intervention’s key technology needed to facilitate behavior and health changes.
We found that the exact degree of user engagement with the interventions reviewed in this study was difficult to estimate and that the association between user engagement and adherence or self-management outcomes were rarely evaluated. Both findings may relate to an important secondary finding that researchers rarely set a priori benchmarks for how much user engagement is considered scientifically adequate (no minimum engagement research benchmark set). Concerningly, when no minimum research benchmark was set, researchers tended to characterize user engagement as “high,” suggesting overoptimism about study results in the absence of any hypothesized lower boundary for what constituted minimally acceptable mHealth use. Setting cut points for how much user engagement is hypothesized to be adequate would also help to guide how much and in what ways users should interact with the mHealth intervention components to experience meaningful improvements in target outcomes. Matching technology dosages to minimum engagement research benchmarks, when possible, could inform whether engagement recommendations were met and allow researchers to evaluate whether exceeding expectations is associated with even greater improvement in behavior or health outcomes. Of note, studies with technology dosages or minimum engagement research benchmarks seemed to demand more from participants, as evidenced by the more common use of user log-in data and manual data entry to evaluate user engagement. User engagement burden should be considered when setting mHealth engagement expectations.
Setting minimum engagement research benchmarks could also account for variability in user engagement–level characterization depending on the metric selected and help to define what constitutes effective and meaningful engagement. Specifically, engagement assessed using user log-in data tended to be characterized as “low.” By contrast, responding to text notifications or interacting via chats, phone calls, or social media posts, which may be more socially rewarding and less effortful to complete, tended to be characterized as “high.” A similarly higher pattern of user engagement was observed in studies evaluating the use of wearable (6/63, 10% vs 0) and nonwearable devices (7/63, 11% vs 0), which is often part of the users’ regular self-management routines (eg, Bluetooth-enabled pill bottle or glucometer) or passively worn (eg, pedometer) and thus may be less burdensome to use. A higher SMS text message response rate and comparatively lower app log-in rate may both be minimally acceptable and potentially meaningful levels of engagement to effectively facilitate behavior or health change, particularly considering the level of effort and motivation involved in each type of interaction. Given the inconsistencies in how investigators characterize engagement levels, setting minimum engagement research benchmarks could inform whether user engagement is adequate across metrics and associated with key adherence and self-management outcomes. This approach could also improve precision in how engagement levels are characterized (ie, what level of engagement is considered “low” vs “high”?). Such efforts during the study planning phase could reduce the tendency to characterize user engagement at multiple levels due to the use of multiple metrics and analyses. Rethinking engagement levels as “adequate,” “acceptable,” “effective,” or “meaningful” versus “high” or “low” may better inform how much people should realistically use mHealth technology and evaluate whether engagement level is associated with behavior and health changes.
In the mHealth trials reviewed, an important secondary finding was that participants were rarely told how much they should aim to engage with the technology (no technology dosages). This is in contrast to drug trials in which participants are instructed to take a specific dosage of medication on a strict schedule and trials of in-person behavior change interventions (traditional therapy) in which participants are given therapy regimens and expectations for participation (eg, attend 12 therapy sessions and complete assigned homework each week of treatment) [
]. Although an early-phase research goal may be to see how much people interact with the technology in the absence of recommendations, an important future goal is to understand how much engagement is needed to maximize behavior and health changes. To this end, recommending in what ways and how much users should aim to engage with the technology is necessary. Giving technology dosages would also allow for experimental evaluation of different levels of recommended technology use to see what recommendation helps users achieve the most positive behavior and health changes. Furthermore, improvements in health and wellness can take time, and mHealth users may not observe immediate benefits to using mHealth interventions, which could contribute to premature abandonment of the tool. Providing users with clearer guidance on how much and what type of mHealth intervention use is needed to begin effecting positive behavior and health changes could help encourage sustained use.Another primary finding was that user engagement was rarely considered a research end point. This is a problem because it is generally expected that users will need to interact with the mHealth technology to experience clinical benefit. Thus, user engagement behavior is a critical aspect of the mHealth intervention itself. Without designating user engagement as a research end point, mHealth intervention trials risk lacking the necessary empirical data and results to help end users understand how to optimally use the technology to see maximal clinical benefit. Lacking these data and results may also be a barrier to informing how these digital tools can be incorporated into regular clinical practice and policy [
]. Thus, in addition to carefully measuring the treatment adherence, self-management behavior, and associated health outcomes directly targeted by the mHealth intervention, equal care should be given to evaluating user engagement, such as how user engagement with the technology may change over time and potentially influence outcomes. Shifting user engagement from afterthought data to an actual research end point would likely improve the quality and rigor of mHealth research and help develop mHealth interventions that motivate users to interact with the technology [ ], and, ideally, experience greater clinical benefit.Our exploratory analysis of studies that provided monetary compensation for study participation versus those that did not (or did not report monetary compensation) showed that engagement-level characterizations were similar between the groups. It is possible that the monetary compensation was provided primarily for completing study procedures (eg, completing study surveys) rather than engaging with the mHealth intervention. In the studies of interventions comprising financial incentives for using the technology or meeting mHealth intervention goals (10/292, 3.4%), no clear pattern emerged for user engagement levels, although this likely reflects the small number of studies incorporating this mHealth component. User engagement evaluation methods were used in similar proportions between the groups, suggesting that monetary compensation was not associated with user engagement measurement selection. An important avenue for future mHealth engagement research is to improve the understanding of how monetary compensation is associated with user engagement levels, particularly when compensation is directed toward mHealth intervention use.
Limitations
This systematic review is among the most comprehensive reviews on this topic, but it has some limitations. First, due to heterogeneity in the study outcomes, we did not conduct a meta-analysis. Thus, this systematic review cannot conclude which user engagement outcome is associated with the most effective interventions. Second, although we found that study authors tended to frame their results and conclusions to suggest that higher user engagement was associated with positive intervention outcomes, this finding should be considered preliminary and hypothesis generating and does not prove that higher engagement leads to better adherence or self-management, particularly given that study authors may have a tendency to report favorable results and frame their findings in a positive light. However, this is an important area to examine in future research to better understand the characteristics of users with higher mHealth engagement as it relates to adherence and self-management outcomes (eg, highly engaged users may represent a patient group with already high adherence and self-management). Third, we did not exclude studies on the basis of their attrition rate; a future direction for improving the science of engagement is to consider how dropout and withdrawal may influence the characterization of user engagement levels. Fourth, a traditional risk-of-bias assessment [
, ] was not conducted due to our interest in user engagement rather than the primary study results targeting adherence and self-management. If user engagement becomes more commonly designated as a research end point, such evaluations of study quality specific to the evaluation of user engagement will be warranted. Fifth, we included a range of medical and mental health conditions but, due to small sample sizes, were unable to conduct subgroup analyses by diagnosis; as the literature on user engagement grows, it may be possible to explore such differences by diagnosis. Sixth, we focused on the behavioral evaluation of user engagement, although this domain likely involves more than behavior alone [ , ], and these other aspects of user engagement may be examined in a future systematic review. Seventh, our interest was in the measurement and evaluation of mHealth user engagement; thus, we did not consider the numerous individual-level factors that could be related to user engagement. Eighth, although study location was not part of the inclusion criteria, nearly half of the reviewed studies (135/292, 46.2%) were conducted in the United States, which may have influenced the types of intervention studies and approaches to evaluating user engagement. Ninth, we conducted our search in specific scientific databases and did not review gray literature or unpublished results; although our search resulted in 292 studies meeting our inclusion criteria, this systematic review may not be generalizable to all mHealth interventions. Finally, it is necessary to select a cutoff date when conducting a systematic review; yet, new studies are constantly being published. An updated review of the mHealth user engagement literature may be warranted in the future. As the science of mHealth user engagement improves, an important next step is to evaluate how factors related to diversity, equity, and inclusion relate to user engagement to promote wider mHealth use and access.Recommendations for Future Researchers
Our systematic review on mHealth user engagement highlighted critical gaps in mHealth adherence and self-management literature as well as opportunities to improve research in this important area of digital health. mHealth researchers need to prioritize the evaluation of user engagement during the study planning phases. Strengthening mHealth user engagement methodological rigor would likely lead to higher-quality data and more impactful study results to guide practice and policy and ultimately encourage the uptake of interventions promoting mHealth adherence or self-management. Furthermore, improved user engagement evaluation may help researchers to identify effective strategies for supporting meaningful user engagement and sustained interest to help users fully experience the intended behavioral and health benefits of the mHealth intervention [
]. Such research is critical for building the evidence base needed to integrate mHealth interventions into regular clinical care and practice guidelines.The following recommendations for studies of mHealth user engagement are offered:
- Use consistent terminology. Reflecting the most common trends in the literature reviewed, we recommend referring to the measurement of behavioral mHealth use, interaction, or engagement as “use” or “engagement.” Greater consistency in terminology could help improve rigor and consistency in the measurement itself and facilitate comparisons between studies as well as the evaluation of user engagement in meta-analyses.
- Select mHealth user engagement metrics that reflect interactions with the intervention’s key technology components hypothesized to facilitate behavior and health changes.
- Provide mHealth users with expectations for how much they should aim to interact with the technology (give technology dosages when possible).
- Set minimum engagement research benchmarks to scientifically denote the hypothesized user engagement level for a participant to be considered adequately, acceptably, or meaningfully engaged in the intervention.
- Characterize user engagement levels as adequate or acceptable with minimum engagement research benchmarks to help address issues with engagement being characterized as “high” or “low” depending on the metric selected and consider whether the engagement is adequate, meaningful, or effective across metrics (eg, a higher SMS text message response rate and comparatively lower app log-in rate may both be acceptable and meaningful levels of engagement).
- Designate mHealth user engagement as a research end point to help improve the quality and rigor of the mHealth research and the data collected from these studies. Focusing research efforts on user engagement could lead to mHealth engagement recommendations that could ultimately lead to greater clinical improvement.
Acknowledgments
This systematic review was supported by the National Institute of Diabetes and Digestive and Kidney Diseases of the National Institutes of Health (K23DK128573: CE; R01DK125780: N Mathioudakis). The authors thank Valentina Vanos and Jacob White for their contributions to this systematic review.
Data Availability
Select review materials are available as multimedia appendices in this manuscript. The manual of procedures and the data sets generated and analyzed during this study are available from the corresponding author on reasonable request. The authors did not use generative AI to write any portions of this manuscript.
Authors' Contributions
CE was responsible for conceptualization, data curation, formal analysis, funding acquisition, investigation, methodology, project administration, resources, supervision, writing the original draft, and reviewing and editing the manuscript. NV, XM, JW, and RR were responsible for data curation, investigation, writing the original draft, and reviewing and editing the manuscript. N Muthusamy was responsible for data curation, investigation, and reviewing and editing the manuscript. N Mathioudakis and KR were responsible for conceptualization, methodology, and reviewing and editing the manuscript.
Conflicts of Interest
CE serves as an mHealth Advisory Group Member for the Success with Therapies Research Consortium (Cystic Fibrosis Foundation).
Search strategy.
PDF File (Adobe PDF File), 23 KBIncluded studies and characteristics.
XLSX File (Microsoft Excel File), 140 KBSupplementary tables.
DOCX File , 38 KBPRISMA Checklist for Systematic Reviews.
PDF File (Adobe PDF File), 119 KBReferences
- Teens, social media and technology 2018. Pew Research Center. May 31, 2018. URL: https://www.pewresearch.org/internet/2018/05/31/teens-social-media-technology-2018/#vast-majority-of-teens-have-access-to-a-home-computer-or-smartphone [accessed 2024-02-18]
- Mobile fact sheet. Pew Research Center. Jan 31, 2024. URL: https://www.pewresearch.org/internet/fact-sheet/mobile/ [accessed 2024-06-18]
- Eaton C, Comer M, Pruette C, Psoter K, Riekert K. Text messaging adherence intervention for adolescents and young adults with chronic kidney disease: pilot randomized controlled trial and stakeholder interviews. J Med Internet Res. Aug 14, 2020;22(8):e19861. [FREE Full text] [CrossRef] [Medline]
- Osborn CY, Hirsch A, Sears LE, Heyman M, Raymond J, Huddleston B, et al. One drop app with an activity tracker for adults with type 1 diabetes: randomized controlled trial. JMIR Mhealth Uhealth. Sep 17, 2020;8(9):e16745. [FREE Full text] [CrossRef] [Medline]
- Rowland SP, Fitzgerald JE, Holme T, Powell J, McGregor A. What is the clinical value of mHealth for patients? NPJ Digit Med. Jan 13, 2020;3(1):4. [FREE Full text] [CrossRef] [Medline]
- Krebs P, Duncan DT. Health app use among US mobile phone owners: a national survey. JMIR Mhealth Uhealth. Nov 04, 2015;3(4):e101. [FREE Full text] [CrossRef] [Medline]
- Arigo D, Jake-Schoffman DE, Wolin K, Beckjord E, Hekler EB, Pagoto SL. The history and future of digital health in the field of behavioral medicine. J Behav Med. Feb 2019;42(1):67-83. [FREE Full text] [CrossRef] [Medline]
- Cao W, Milks MW, Liu X, Gregory ME, Addison D, Zhang P, et al. mHealth interventions for self-management of hypertension: framework and systematic review on engagement, interactivity, and tailoring. JMIR Mhealth Uhealth. Mar 02, 2022;10(3):e29415. [FREE Full text] [CrossRef] [Medline]
- Yang Y, Boulton E, Todd C. Measurement of adherence to mHealth physical activity interventions and exploration of the factors that affect the adherence: scoping review and proposed framework. J Med Internet Res. Jun 08, 2022;24(6):e30817. [FREE Full text] [CrossRef] [Medline]
- Schwarz A, Winkens LH, de Vet E, Ossendrijver D, Bouwsema K, Simons M. Design features associated with engagement in mobile health physical activity interventions among youth: systematic review of qualitative and quantitative studies. JMIR Mhealth Uhealth. Mar 06, 2023;11:e40898. [FREE Full text] [CrossRef] [Medline]
- Lipschitz JM, Van Boxtel R, Torous J, Firth J, Lebovitz JG, Burdick KE, et al. Digital mental health interventions for depression: scoping review of user engagement. J Med Internet Res. Oct 14, 2022;24(10):e39204. [FREE Full text] [CrossRef] [Medline]
- Molloy A, Anderson PL. Engagement with mobile health interventions for depression: a systematic review. Internet Interv. Dec 2021;26:100454. [FREE Full text] [CrossRef] [Medline]
- Ng MM, Firth J, Minen M, Torous J. User engagement in mental health apps: a review of measurement, reporting, and validity. Psychiatr Serv. Jul 01, 2019;70(7):538-544. [FREE Full text] [CrossRef] [Medline]
- Short CE, DeSmet A, Woods C, Williams SL, Maher C, Middelweerd A, et al. Measuring engagement in eHealth and mHealth behavior change interventions: viewpoint of methodologies. J Med Internet Res. Nov 16, 2018;20(11):e292. [FREE Full text] [CrossRef] [Medline]
- Perski O, Blandford A, West R, Michie S. Conceptualising engagement with digital behaviour change interventions: a systematic review using principles from critical interpretive synthesis. Transl Behav Med. Jun 2017;7(2):254-267. [FREE Full text] [CrossRef] [Medline]
- Cole-Lewis H, Ezeanochie N, Turgiss J. Understanding health behavior technology engagement: pathway to measuring digital behavior change interventions. JMIR Form Res. Oct 10, 2019;3(4):e14052. [FREE Full text] [CrossRef] [Medline]
- Nieuwlaat R, Wilczynski N, Navarro T, Hobson N, Jeffery R, Keepanasseril A, et al. Interventions for enhancing medication adherence. Cochrane Database Syst Rev. Nov 20, 2014;2014(11):CD000011. [FREE Full text] [CrossRef] [Medline]
- Mellon L, Doyle F, Hickey A, Ward KD, de Freitas DG, McCormick P, et al. Interventions for increasing immunosuppressant medication adherence in solid organ transplant recipients. Cochrane Database Syst Rev. Sep 12, 2022;9(9):CD012854. [FREE Full text] [CrossRef] [Medline]
- Al-Aqeel S, Gershuni O, Al-Sabhan J, Hiligsmann M. Strategies for improving adherence to antiepileptic drug treatment in people with epilepsy. Cochrane Database Syst Rev. Oct 22, 2020;10(10):CD008312. [FREE Full text] [CrossRef] [Medline]
- Covidence systematic review software. Covidence. URL: https://www.covidence.org/ [accessed 2024-04-29]
- IBM SPSS statistics for Windows. IBM Corp. URL: https://www.ibm.com/products/spss-statistics [accessed 2024-04-29]
- Forbes G, Newton S, Cantalapiedra Calvete C, Birch J, Dodds J, Steed L, et al. MEMPHIS: a smartphone app using psychological approaches for women with chronic pelvic pain presenting to gynaecology clinics: a randomised feasibility trial. BMJ Open. Mar 12, 2020;10(3):e030164. [FREE Full text] [CrossRef] [Medline]
- Pagoto S, Waring ME. A call for a science of engagement: comment on Rus and Cameron. Ann Behav Med. Oct 2016;50(5):690-691. [CrossRef] [Medline]
- Sterne JA, Savović J, Page MJ, Elbers RG, Blencowe NS, Boutron I, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ. Aug 28, 2019;366:l4898. [FREE Full text] [CrossRef] [Medline]
- Sterne JA, Hernán MA, Reeves BC, Savović J, Berkman ND, Viswanathan M, et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ. Oct 12, 2016;355:i4919. [FREE Full text] [CrossRef] [Medline]
- Torous J, Michalak EE, O'Brien HL. Digital health and engagement-looking behind the measures and methods. JAMA Netw Open. Jul 01, 2020;3(7):e2010918. [FREE Full text] [CrossRef] [Medline]
- Achtyes ED, Ben-Zeev D, Luo Z, Mayle H, Burke B, Rotondi AJ, et al. Off-hours use of a smartphone intervention to extend support for individuals with schizophrenia spectrum disorders recently discharged from a psychiatric hospital. Schizophr Res. Apr 2019;206:200-208. [CrossRef] [Medline]
- Adams ZW, Sieverdes JC, Brunner-Jackson B, Mueller M, Chandler J, Diaz V, et al. Meditation smartphone application effects on prehypertensive adults' blood pressure: dose-response feasibility trial. Health Psychol. Sep 2018;37(9):850-860. [FREE Full text] [CrossRef] [Medline]
- Agarwal G, Gaber J, Richardson J, Mangin D, Ploeg J, Valaitis R, et al. Pilot randomized controlled trial of a complex intervention for diabetes self-management supported by volunteers, technology, and interprofessional primary health care teams. Pilot Feasibility Stud. Oct 27, 2019;5(1):118. [FREE Full text] [CrossRef] [Medline]
- Agarwal P, Mukerji G, Desveaux L, Ivers NM, Bhattacharyya O, Hensel JM, et al. Mobile app for improved self-management of type 2 diabetes: multicenter pragmatic randomized controlled trial. JMIR Mhealth Uhealth. Jan 10, 2019;7(1):e10321. [FREE Full text] [CrossRef] [Medline]
- Agboola S, Jethwani K, Lopez L, Searl M, O'Keefe S, Kvedar J. Text to move: a randomized controlled trial of a text-messaging program to improve physical activity behaviors in patients with type 2 diabetes mellitus. J Med Internet Res. Nov 18, 2016;18(11):e307. [FREE Full text] [CrossRef] [Medline]
- Aharonovich E, Stohl M, Cannizzaro D, Hasin D. HealthCall delivered via smartphone to reduce co-occurring drug and alcohol use in HIV-infected adults: a randomized pilot trial. J Subst Abuse Treat. Dec 2017;83:15-26. [FREE Full text] [CrossRef] [Medline]
- Amorim AB, Pappas E, Simic M, Ferreira ML, Jennings M, Tiedemann A, et al. Integrating mobile-health, health coaching, and physical activity to reduce the burden of chronic low back pain trial (IMPACT): a pilot randomised controlled trial. BMC Musculoskelet Disord. Feb 11, 2019;20(1):71. [FREE Full text] [CrossRef] [Medline]
- Angellotti E, Wong JB, Pierce A, Hescott B, Pittas AG. Combining wireless technology and behavioral economics to engage patients (WiBEEP) with cardiometabolic disease: a pilot study. Pilot Feasibility Stud. Jan 15, 2019;5(1):7. [FREE Full text] [CrossRef] [Medline]
- Anzaldo-Campos MC, Contreras S, Vargas-Ojeda A, Menchaca-Díaz R, Fortmann A, Philis-Tsimikas A. Dulce wireless Tijuana: a randomized control trial evaluating the impact of project dulce and short-term mobile technology on glycemic control in a family medicine clinic in Northern Mexico. Diabetes Technol Ther. Apr 2016;18(4):240-251. [FREE Full text] [CrossRef] [Medline]
- Arean PA, Hallgren KA, Jordan JT, Gazzaley A, Atkins DC, Heagerty PJ, et al. The use and effectiveness of mobile apps for depression: results from a fully remote clinical trial. J Med Internet Res. Dec 20, 2016;18(12):e330. [FREE Full text] [CrossRef] [Medline]
- Arnold C, Williams A, Thomas N. Engaging With a web-based psychosocial intervention for psychosis: qualitative study of user experiences. JMIR Ment Health. Jun 19, 2020;7(6):e16730. [FREE Full text] [CrossRef] [Medline]
- Ashford MT, Olander EK, Rowe H, Fisher JR, Ayers S. Feasibility and acceptability of a web-based treatment with telephone support for postpartum women with anxiety: randomized controlled trial. JMIR Ment Health. Apr 20, 2018;5(2):e19. [FREE Full text] [CrossRef] [Medline]
- Athilingam P, Jenkins B, Johansson M, Labrador M. A mobile health intervention to improve self-care in patients with heart failure: pilot randomized control trial. JMIR Cardio. Aug 11, 2017;1(2):e3. [FREE Full text] [CrossRef] [Medline]
- Babbage DR, van Kessel K, Drown J, Thomas S, Sezier A, Thomas P, et al. MS energize: field trial of an app for self-management of fatigue for people with multiple sclerosis. Internet Interv. Dec 2019;18:100291. [FREE Full text] [CrossRef] [Medline]
- Bailey JF, Agarwal V, Zheng P, Smuck M, Fredericson M, Kennedy DJ, et al. Digital care for chronic musculoskeletal pain: 10,000 participant longitudinal cohort study. J Med Internet Res. May 11, 2020;22(5):e18250. [FREE Full text] [CrossRef] [Medline]
- Batch BC, Spratt SE, Blalock DV, Benditz C, Weiss A, Dolor RJ, et al. General behavioral engagement and changes in clinical and cognitive outcomes of patients with type 2 diabetes using the Time2Focus mobile app for diabetes education: pilot evaluation. J Med Internet Res. Jan 20, 2021;23(1):e17537. [FREE Full text] [CrossRef] [Medline]
- Belanger HG, Toyinbo P, Barrett B, King E, Sayer NA. Concussion coach for postconcussive symptoms: a randomized, controlled trial of a smartphone application with Afghanistan and Iraq war Veterans. Clin Neuropsychol. Nov 29, 2022;36(8):2093-2119. [CrossRef] [Medline]
- Ben-Zeev D, Brian RM, Jonathan G, Razzano L, Pashka N, Carpenter-Song E, et al. Mobile health (mHealth) versus clinic-based group intervention for people with serious mental illness: a randomized controlled trial. Psychiatr Serv. Sep 01, 2018;69(9):978-985. [CrossRef] [Medline]
- Bennell K, Nelligan RK, Schwartz S, Kasza J, Kimp A, Crofts SJ, et al. Behavior change text messages for home exercise adherence in knee osteoarthritis: randomized trial. J Med Internet Res. Sep 28, 2020;22(9):e21749. [FREE Full text] [CrossRef] [Medline]
- Bentley CL, Otesile O, Bacigalupo R, Elliott J, Noble H, Hawley MS, et al. Feasibility study of portable technology for weight loss and HbA1c control in type 2 diabetes. BMC Med Inform Decis Mak. Jul 15, 2016;16(1):92. [FREE Full text] [CrossRef] [Medline]
- Bentley CL, Powell L, Potter S, Parker J, Mountain GA, Bartlett YK, et al. The use of a smartphone app and an activity tracker to promote physical activity in the management of chronic obstructive pulmonary disease: randomized controlled feasibility study. JMIR Mhealth Uhealth. Jun 03, 2020;8(6):e16203. [FREE Full text] [CrossRef] [Medline]
- Benzo RP, Kramer KM, Hoult JP, Anderson PM, Begue IM, Seifert SJ. Development and feasibility of a home pulmonary rehabilitation program with health coaching. Respir Care. Feb 24, 2018;63(2):131-140. [FREE Full text] [CrossRef] [Medline]
- Berry D, Blonquist T, Nayak M, Grenon N, Momani T, McCleary N. Self-care support for patients with gastrointestinal cancer: iCancerHealth. Appl Clin Inform. Oct 21, 2018;9(4):833-840. [FREE Full text] [CrossRef] [Medline]
- Bhatia A, Kara J, Janmohamed T, Prabhu A, Lebovic G, Katz J, et al. User engagement and clinical impact of the manage my pain app in patients with chronic pain: a real-world, multi-site trial. JMIR Mhealth Uhealth. Mar 04, 2021;9(3):e26528. [FREE Full text] [CrossRef] [Medline]
- Birney AJ, Gunn R, Russell JK, Ary DV. MoodHacker mobile web app with email for adults to self-manage mild-to-moderate depression: randomized controlled trial. JMIR Mhealth Uhealth. Jan 26, 2016;4(1):e8. [FREE Full text] [CrossRef] [Medline]
- Blonigen DM, Harris-Olenak B, Kuhn E, Timko C, Humphreys K, Smith JS, et al. Using peers to increase veterans' engagement in a smartphone application for unhealthy alcohol use: a pilot study of acceptability and utility. Psychol Addict Behav. Nov 2021;35(7):829-839. [FREE Full text] [CrossRef] [Medline]
- Boal AL, Abroms LC, Simmens S, Graham AL, Carpenter KM. Combined quitline counseling and text messaging for smoking cessation: a quasi-experimental evaluation. Nicotine Tob Res. May 31, 2016;18(5):1046-1053. [CrossRef] [Medline]
- Bobrow K, Farmer AJ, Springer D, Shanyinde M, Yu L, Brennan T, et al. Mobile phone text messages to support treatment adherence in adults with high blood pressure (SMS-Text Adherence Support [StAR]): a single-blind, randomized trial. Circulation. Feb 09, 2016;133(6):592-600. [FREE Full text] [CrossRef] [Medline]
- Boer L, Bischoff E, van der Heijden M, Lucas P, Akkermans R, Vercoulen J, et al. A smart mobile health tool versus a paper action plan to support self-management of chronic obstructive pulmonary disease exacerbations: randomized controlled trial. JMIR Mhealth Uhealth. Oct 09, 2019;7(10):e14408. [FREE Full text] [CrossRef] [Medline]
- Boettcher J, Magnusson K, Marklund A, Berglund E, Blomdahl R, Braun U, et al. Adding a smartphone app to internet-based self-help for social anxiety: a randomized controlled trial. Comput Human Behav. Oct 2018;87(6):98-108. [CrossRef]
- Boisseau CL, Schwartzman CM, Lawton J, Mancebo MC. App-guided exposure and response prevention for obsessive compulsive disorder: an open pilot trial. Cogn Behav Ther. Nov 05, 2017;46(6):447-458. [CrossRef] [Medline]
- Bonar EE, Cunningham RM, Sweezea EC, Blow FC, Drislane LE, Walton MA. Piloting a brief intervention plus mobile boosters for drug use among emerging adults receiving emergency department care. Drug Alcohol Depend. Apr 01, 2021;221:108625. [FREE Full text] [CrossRef] [Medline]
- Bonato M, Turrini F, De Zan V, Meloni A, Plebani M, Brambilla E, et al. A mobile application for exercise intervention in people living with HIV. Med Sci Sports Exerc. Feb 2020;52(2):425-433. [CrossRef] [Medline]
- Boon M, Calvo-Lerma J, Claes I, Havermans T, Asseiceira I, Bulfamante A, et al. Use of a mobile application for self-management of pancreatic enzyme replacement therapy is associated with improved gastro-intestinal related quality of life in children with cystic fibrosis. J Cyst Fibros. Jul 2020;19(4):562-568. [FREE Full text] [CrossRef] [Medline]
- Børøsund E, Varsi C, Clark MM, Ehlers SL, Andrykowski MA, Sleveland HR, et al. Pilot testing an app-based stress management intervention for cancer survivors. Transl Behav Med. Aug 07, 2020;10(3):770-780. [FREE Full text] [CrossRef] [Medline]
- Bradway M, Pfuhl G, Joakimsen R, Ribu L, Grøttland A, Årsand E. Analysing mHealth usage logs in RCTs: explaining participants' interactions with type 2 diabetes self-management tools. PLoS One. Aug 30, 2018;13(8):e0203202. [FREE Full text] [CrossRef] [Medline]
- Bricker JB, Copeland W, Mull KE, Zeng EY, Watson NL, Akioka KJ, et al. Drug Alcohol Depend. Jan 01, 2017;170:37-42. [FREE Full text] [CrossRef] [Medline]
- Bricker JB, Levin M, Lappalainen R, Mull K, Sullivan B, Santiago-Torres M. Mechanisms of smartphone apps for cigarette smoking cessation: results of a serial mediation model from the iCanQuit randomized trial. JMIR Mhealth Uhealth. Nov 09, 2021;9(11):e32847. [FREE Full text] [CrossRef] [Medline]
- Bricker JB, Watson NL, Mull KE, Sullivan BM, Heffner JL. Efficacy of smartphone applications for smoking cessation: a randomized clinical trial. JAMA Intern Med. Nov 01, 2020;180(11):1472-1480. [FREE Full text] [CrossRef] [Medline]
- Britto MT, Rohan JM, Dodds CM, Byczkowski TL. A randomized trial of user-controlled text messaging to improve asthma outcomes: a pilot study. Clin Pediatr (Phila). Dec 2017;56(14):1336-1344. [CrossRef] [Medline]
- Browne S, Kechadi MT, O'Donnell S, Dow M, Tully L, Doyle G, et al. Mobile health apps in pediatric obesity treatment: process outcomes from a feasibility study of a multicomponent intervention. JMIR Mhealth Uhealth. Jul 08, 2020;8(7):e16925. [FREE Full text] [CrossRef] [Medline]
- Bucci S, Barrowclough C, Ainsworth J, Machin M, Morris R, Berry K, et al. Actissist: proof-of-concept trial of a theory-driven digital intervention for psychosis. Schizophr Bull. Aug 20, 2018;44(5):1070-1080. [FREE Full text] [CrossRef] [Medline]
- Bughin F, Bui G, Ayoub B, Blervaque L, Saey D, Avignon A, et al. Impact of a mobile telerehabilitation solution on metabolic health outcomes and rehabilitation adherence in patients with obesity: randomized controlled trial. JMIR Mhealth Uhealth. Dec 06, 2021;9(12):e28242. [FREE Full text] [CrossRef] [Medline]
- Buis LR, Roberson DN, Kadri R, Rockey NG, Plegue MA, Danak SU, et al. Understanding the feasibility, acceptability, and efficacy of a clinical pharmacist-led mobile approach (BPTrack) to hypertension management: mixed methods pilot study. J Med Internet Res. Aug 11, 2020;22(8):e19882. [FREE Full text] [CrossRef] [Medline]
- Buscemi J, Buitrago D, Iacobelli F, Penedo F, Maciel C, Guitleman J, et al. Feasibility of a smartphone-based pilot intervention for Hispanic breast cancer survivors: a brief report. Transl Behav Med. Jul 16, 2019;9(4):638-645. [FREE Full text] [CrossRef] [Medline]
- Butryn ML, Martinelli MK, Crane NT, Godfrey K, Roberts SR, Zhang F, et al. Counselor surveillance of digital self-monitoring data: a pilot randomized controlled trial. Obesity (Silver Spring). Dec 23, 2020;28(12):2339-2346. [FREE Full text] [CrossRef] [Medline]
- Canan CE, Waselewski ME, Waldman AL, Reynolds G, Flickinger TE, Cohn WF, et al. Long term impact of PositiveLinks: clinic-deployed mobile technology to improve engagement with HIV care. PLoS One. Jan 6, 2020;15(1):e0226870. [FREE Full text] [CrossRef] [Medline]
- Cartujano-Barrera F, Peña-Vargas CI, Arana-Chicas E, Pérez-Ramos JG, Mattei J, Hurtado-de-Mendoza A, et al. Decídetexto: feasibility and acceptability of a mobile smoking cessation intervention in Puerto Rico. Int J Environ Res Public Health. Feb 03, 2021;18(4):1379. [FREE Full text] [CrossRef] [Medline]
- Cartujano-Barrera F, Rodríguez-Bolaños R, Arana-Chicas E, Gallegos-Carrillo K, N Flores Y, Pérez-Rubio G, et al. Enhancing nicotine replacement therapy usage and adherence through a mobile intervention: secondary data analysis of a single-arm feasibility study in Mexico. Tob Induc Dis. May 4, 2020;18(May):36. [FREE Full text] [CrossRef] [Medline]
- Castensøe-Seidenfaden P, Husted GR, Jensen AK, Hommel E, Olsen B, Pedersen-Bjergaard U, et al. Testing a smartphone app (young with diabetes) to improve self-management of diabetes over 12 months: randomized controlled trial. JMIR Mhealth Uhealth. Jun 26, 2018;6(6):e141. [FREE Full text] [CrossRef] [Medline]
- Cedars A, Blackmore C. Use of a disease-specific mobile health application in the care of adults with congenital heart disease. Proc (Bayl Univ Med Cent). Jul 10, 2019;32(3):336-339. [FREE Full text] [CrossRef] [Medline]
- Chavez K, Palfai TP. Feasibility of a mobile messaging-enhanced brief intervention for high risk heavy drinking MSM: a pre-pilot study. Alcohol Treat Q. Aug 14, 2020;38(1):87-105. [FREE Full text] [CrossRef] [Medline]
- Chen J, Kaye L, Tuffli M, Barrett MA, Jones-Ford S, Shenouda T, et al. Passive monitoring of short-acting beta-agonist use via digital platform in patients with chronic obstructive pulmonary disease: quality improvement retrospective analysis. JMIR Form Res. Oct 23, 2019;3(4):e13286. [FREE Full text] [CrossRef] [Medline]
- Cho H, Flynn G, Saylor M, Gradilla M, Schnall R. Use of the FITT framework to understand patients' experiences using a real-time medication monitoring pill bottle linked to a mobile-based HIV self-management app: a qualitative study. Int J Med Inform. Nov 2019;131:103949. [FREE Full text] [CrossRef] [Medline]
- Cho H, Porras T, Baik D, Beauchemin M, Schnall R. Understanding the predisposing, enabling, and reinforcing factors influencing the use of a mobile-based HIV management app: a real-world usability evaluation. Int J Med Inform. Sep 2018;117:88-95. [FREE Full text] [CrossRef] [Medline]
- Choi SA, Lim K, Baek H, Yoo S, Cho A, Kim H, et al. Impact of mobile health application on data collection and self-management of epilepsy. Epilepsy Behav. Jun 2021;119:107982. [CrossRef] [Medline]
- Clements MA, Staggs VS. A mobile app for synchronizing glucometer data: impact on adherence and glycemic control among youths with type 1 diabetes in routine care. J Diabetes Sci Technol. May 09, 2017;11(3):461-467. [FREE Full text] [CrossRef] [Medline]
- Coorey G, Peiris D, Scaria A, Mulley J, Neubeck L, Hafiz N, et al. An internet-based intervention for cardiovascular disease management integrated with primary care electronic health records: mixed methods evaluation of implementation fidelity and user engagement. J Med Internet Res. Apr 26, 2021;23(4):e25333. [FREE Full text] [CrossRef] [Medline]
- Côté J, Rouleau G, Ramirez-Garcia MP, Auger P, Thomas R, Leblanc J. Effectiveness of a web-based intervention to support medication adherence among people living with HIV: web-based randomized controlled trial. JMIR Public Health Surveill. Apr 20, 2020;6(2):e17733. [FREE Full text] [CrossRef] [Medline]
- Coughlin LN, Nahum-Shani I, Philyaw-Kotov ML, Bonar EE, Rabbi M, Klasnja P, et al. Developing an adaptive mobile intervention to address risky substance use among adolescents and emerging adults: usability study. JMIR Mhealth Uhealth. Jan 15, 2021;9(1):e24424. [FREE Full text] [CrossRef] [Medline]
- Crafoord M, Fjell M, Sundberg K, Nilsson M, Langius-Eklöf A. Engagement in an interactive app for symptom self-management during treatment in patients with breast or prostate cancer: mixed methods study. J Med Internet Res. Aug 10, 2020;22(8):e17058. [FREE Full text] [CrossRef] [Medline]
- Crane D, Garnett C, Michie S, West R, Brown J. A smartphone app to reduce excessive alcohol consumption: identifying the effectiveness of intervention components in a factorial randomised control trial. Sci Rep. Mar 12, 2018;8(1):4384. [FREE Full text] [CrossRef] [Medline]
- Creary S, Chisolm D, Stanek J, Hankins J, O'Brien SH. A multidimensional electronic hydroxyurea adherence intervention for children with sickle cell disease: single-arm before-after study. JMIR Mhealth Uhealth. Aug 08, 2019;7(8):e13452. [FREE Full text] [CrossRef] [Medline]
- Dahne J, Collado A, Lejuez CW, Risco CM, Diaz VA, Coles L, et al. Pilot randomized controlled trial of a Spanish-language behavioral activation mobile app (¡Aptívate!) for the treatment of depressive symptoms among united states Latinx adults with limited English proficiency. J Affect Disord. May 01, 2019;250:210-217. [FREE Full text] [CrossRef] [Medline]
- Dahne J, Lejuez C, Diaz VA, Player MS, Kustanowitz J, Felton JW, et al. Pilot randomized trial of a self-help behavioral activation mobile app for utilization in primary care. Behav Ther. Jul 2019;50(4):817-827. [FREE Full text] [CrossRef] [Medline]
- Davies EH, Fieggen K, Wilmshurst J, Anyanwu O, Burman RJ, Komarzynski S. Demonstrating the feasibility of digital health to support pediatric patients in South Africa. Epilepsia Open. Dec 02, 2021;6(4):653-662. [FREE Full text] [CrossRef] [Medline]
- Davis SR, Peters D, Calvo RA, Sawyer SM, Foster JM, Smith LD. A consumer designed smartphone app for young people with asthma: pilot of engagement and acceptability. J Asthma. Feb 06, 2021;58(2):253-261. [CrossRef] [Medline]
- Davoudi A, Lee NS, Chivers C, Delaney T, Asch EL, Reitz C, et al. Patient interaction phenotypes with an automated remote hypertension monitoring program and their association with blood pressure control: observational study. J Med Internet Res. Dec 03, 2020;22(12):e22493. [FREE Full text] [CrossRef] [Medline]
- Dawson J, Campbell KL, Craig JC, Tong A, Teixeira-Pinto A, Brown MA, et al. A text messaging intervention for dietary behaviors for people receiving maintenance hemodialysis: a feasibility study of KIDNEYTEXT. Am J Kidney Dis. Jul 2021;78(1):85-95.e1. [FREE Full text] [CrossRef] [Medline]
- de Jong M, van der Meulen-de Jong A, Romberg-Camps M, Degens J, Becx M, Markus T, et al. Development and feasibility study of a telemedicine tool for all patients with IBD: MyIBDcoach. Inflamm Bowel Dis. Apr 2017;23(4):485-493. [CrossRef] [Medline]
- de la Vega R, Ritterband L, Palermo TM. Assessing digital health implementation for a pediatric chronic pain intervention: comparing the RE-AIM and BIT frameworks against real-world trial data and recommendations for future studies. J Med Internet Res. Sep 01, 2020;22(9):e19898. [FREE Full text] [CrossRef] [Medline]
- DeFulio A, Devoto A, Traxler H, Cosottile D, Fingerhood M, Nuzzo P, et al. Smartphone-based incentives for promoting adherence to antiretroviral therapy: a randomized controlled trial. Prev Med Rep. Mar 2021;21:101318. [FREE Full text] [CrossRef] [Medline]
- Desteghe L, Kluts K, Vijgen J, Koopman P, Dilling-Boer D, Schurmans J, et al. The health buddies app as a novel tool to improve adherence and knowledge in atrial fibrillation patients: a pilot study. JMIR Mhealth Uhealth. Jul 19, 2017;5(7):e98. [FREE Full text] [CrossRef] [Medline]
- Desveaux L, Shaw J, Saragosa M, Soobiah C, Marani H, Hensel J, et al. A mobile app to improve self-management of individuals with type 2 diabetes: qualitative realist evaluation. J Med Internet Res. Mar 16, 2018;20(3):e81. [FREE Full text] [CrossRef] [Medline]
- Dietrich JE, Yee DL, Santos XM, Bercaw-Pratt JL, Kurkowski J, Soni H, et al. Assessment of an electronic intervention in young women with heavy menstrual bleeding. J Pediatr Adolesc Gynecol. Apr 2017;30(2):243-246. [CrossRef] [Medline]
- Dillingham R, Ingersoll K, Flickinger TE, Waldman AL, Grabowski M, Laurence C, et al. PositiveLinks: a mobile health intervention for retention in HIV care and clinical outcomes with 12-month follow-up. AIDS Patient Care STDS. Jun 2018;32(6):241-250. [FREE Full text] [CrossRef] [Medline]
- Dombrowski SU, McDonald M, van der Pol M, Grindle M, Avenell A, Carroll P, et al. Game of Stones: feasibility randomised controlled trial of how to engage men with obesity in text message and incentive interventions for weight loss. BMJ Open. Feb 25, 2020;10(2):e032653. [FREE Full text] [CrossRef] [Medline]
- Downs DS, Savage JS, Rivera DE, Pauley AM, Leonard KS, Hohman EE, et al. Adaptive, behavioral intervention impact on weight gain, physical activity, energy intake, and motivational determinants: results of a feasibility trial in pregnant women with overweight/obesity. J Behav Med. Oct 2021;44(5):605-621. [FREE Full text] [CrossRef] [Medline]
- Dunn CG, Turner-McGrievy GM, Wilcox S, Hutto B. Dietary self-monitoring through calorie tracking but not through a digital photography app is associated with significant weight loss: the 2SMART pilot study-a 6-month randomized trial. J Acad Nutr Diet. Sep 2019;119(9):1525-1532. [FREE Full text] [CrossRef] [Medline]
- Dyal N, McAssey K, Agarwal G. Evaluation of a computerized self-management tool for children with type 1 diabetes: a pilot project. Can J Diabetes. Apr 2017;41(2):124-128. [CrossRef] [Medline]
- Ellis TD, Cavanaugh JT, DeAngelis T, Hendron K, Thomas CA, Saint-Hilaire M, et al. Comparative effectiveness of mHealth-supported exercise compared with exercise alone for people with Parkinson disease: randomized controlled pilot study. Phys Ther. Feb 01, 2019;99(2):203-216. [CrossRef] [Medline]
- Escobar-Viera C, Zhou Z, Morano JP, Lucero R, Lieb S, McIntosh S, et al. The Florida mobile health adherence project for people living with HIV (FL-mAPP): longitudinal assessment of feasibility, acceptability, and clinical outcomes. JMIR Mhealth Uhealth. Jan 08, 2020;8(1):e14557. [FREE Full text] [CrossRef] [Medline]
- Fedele DA, Thomas JG, McConville A, McQuaid EL, Voorhees S, Janicke DM, et al. Using mobile health to improve asthma self-management in early adolescence: a pilot randomized controlled trial. J Adolesc Health. Dec 2021;69(6):1032-1040. [CrossRef] [Medline]
- Ferrante JM, Devine KA, Bator A, Rodgers A, Ohman-Strickland PA, Bandera EV, et al. Feasibility and potential efficacy of commercial mHealth/eHealth tools for weight loss in African American breast cancer survivors: pilot randomized controlled trial. Transl Behav Med. Oct 08, 2020;10(4):938-948. [FREE Full text] [CrossRef] [Medline]
- Fogarty AS, Proudfoot J, Whittle EL, Clarke J, Player MJ, Christensen H, et al. Preliminary evaluation of a brief web and mobile phone intervention for men with depression: men's positive coping strategies and associated depression, resilience, and work and social functioning. JMIR Ment Health. Aug 10, 2017;4(3):e33. [FREE Full text] [CrossRef] [Medline]
- Forman EM, Goldstein SP, Crochiere RJ, Butryn ML, Juarascio AS, Zhang F, et al. Randomized controlled trial of OnTrack, a just-in-time adaptive intervention designed to enhance weight loss. Transl Behav Med. Nov 25, 2019;9(6):989-1001. [CrossRef] [Medline]
- Garofalo R, Kuhns LM, Hotton A, Johnson A, Muldoon A, Rice D. A randomized controlled trial of personalized text message reminders to promote medication adherence among HIV-positive adolescents and young adults. AIDS Behav. May 2016;20(5):1049-1059. [FREE Full text] [CrossRef] [Medline]
- Gazit T, Gutman M, Beatty AL. Assessment of hypertension control among adults participating in a mobile technology blood pressure self-management program. JAMA Netw Open. Oct 01, 2021;4(10):e2127008. [FREE Full text] [CrossRef] [Medline]
- Gentili C, Zetterqvist V, Rickardsson J, Holmström L, Simons LE, Wicksell RK. ACTsmart: guided smartphone-delivered acceptance and commitment therapy for chronic pain-a pilot trial. Pain Med. Feb 23, 2021;22(2):315-328. [FREE Full text] [CrossRef] [Medline]
- Gimbel RW, Rennert LM, Crawford P, Little JR, Truong K, Williams JE, et al. Enhancing patient activation and self-management activities in patients with type 2 diabetes using the US Department of Defense mobile health care environment: feasibility study. J Med Internet Res. May 26, 2020;22(5):e17968. [FREE Full text] [CrossRef] [Medline]
- Gire N, Caton N, McKeown M, Mohmed N, Duxbury J, Kelly J, et al. Care co-ordinator in my pocket': a feasibility study of mobile assessment and therapy for psychosis (TechCare). BMJ Open. Nov 16, 2021;11(11):e046755. [FREE Full text] [CrossRef] [Medline]
- Godersky ME, Klein JW, Merrill JO, Blalock KL, Saxon AJ, Samet JH, et al. Acceptability and feasibility of a mobile health application for video directly observed therapy of buprenorphine for opioid use disorders in an office-based setting. J Addict Med. 2020;14(4):319-325. [FREE Full text] [CrossRef] [Medline]
- Godino JG, Golaszewski NM, Norman GJ, Rock CL, Griswold WG, Arredondo E, et al. Text messaging and brief phone calls for weight loss in overweight and obese English- and Spanish-speaking adults: a 1-year, parallel-group, randomized controlled trial. PLoS Med. Sep 2019;16(9):e1002917. [FREE Full text] [CrossRef] [Medline]
- Gordon JS, Armin J, D Hingle M, Giacobbi P, Cunningham JK, Johnson T, et al. Development and evaluation of the See Me Smoke-Free multi-behavioral mHealth app for women smokers. Transl Behav Med. Jun 2017;7(2):172-184. [FREE Full text] [CrossRef] [Medline]
- Goyal S, Nunn CA, Rotondi M, Couperthwaite AB, Reiser S, Simone A, et al. A mobile app for the self-management of type 1 diabetes among adolescents: a randomized controlled trial. JMIR Mhealth Uhealth. Jun 19, 2017;5(6):e82. [FREE Full text] [CrossRef] [Medline]
- Greer JA, Jacobs JM, Pensak N, Nisotel LE, Fishbein JN, MacDonald JJ, et al. Randomized trial of a smartphone mobile app to improve symptoms and adherence to oral therapy for cancer. J Natl Compr Canc Netw. Feb 2020;18(2):133-141. [CrossRef] [Medline]
- Guarino H, Acosta M, Marsch LA, Xie H, Aponte-Melendez Y. A mixed-methods evaluation of the feasibility, acceptability, and preliminary efficacy of a mobile intervention for methadone maintenance clients. Psychol Addict Behav. Feb 2016;30(1):1-11. [FREE Full text] [CrossRef] [Medline]
- Guo X, Gu X, Jiang J, Li H, Duan R, Zhang Y, et al. A hospital-community-family-based telehealth program for patients with chronic heart failure: single-arm, prospective feasibility study. JMIR Mhealth Uhealth. Dec 13, 2019;7(12):e13229. [FREE Full text] [CrossRef] [Medline]
- Guthrie NL, Berman MA, Edwards KL, Appelbaum KJ, Dey S, Carpenter J, et al. Achieving rapid blood pressure control with digital therapeutics: retrospective cohort and machine learning study. JMIR Cardio. Mar 12, 2019;3(1):e13030. [FREE Full text] [CrossRef] [Medline]
- Haas K, Martin A, Park KT. Text message intervention (TEACH) improves quality of life and patient activation in celiac disease: a randomized clinical trial. J Pediatr. Jun 2017;185:62-7.e2. [FREE Full text] [CrossRef] [Medline]
- Hammond AS, Sweeney MM, Chikosi TU, Stitzer ML. Digital delivery of a contingency management intervention for substance use disorder: a feasibility study with DynamiCare Health. J Subst Abuse Treat. Jul 2021;126:108425. [FREE Full text] [CrossRef] [Medline]
- Han A, Min SI, Ahn S, Min S, Hong H, Han N, et al. Mobile medication manager application to improve adherence with immunosuppressive therapy in renal transplant recipients: a randomized controlled trial. PLoS One. 2019;14(11):e0224595. [FREE Full text] [CrossRef] [Medline]
- Hardcastle SJ, Jiménez-Castuera R, Maxwell-Smith C, Bulsara MK, Hince D. Fitbit wear-time and patterns of activity in cancer survivors throughout a physical activity intervention and follow-up: exploratory analysis from a randomised controlled trial. PLoS One. Oct 19, 2020;15(10):e0240967. [FREE Full text] [CrossRef] [Medline]
- Harzand A, Witbrodt B, Davis-Watts ML, Alrohaibani A, Goese D, Wenger NK, et al. Feasibility of a smartphone-enabled cardiac rehabilitation program in male veterans with previous clinical evidence of coronary heart disease. Am J Cardiol. Nov 01, 2018;122(9):1471-1476. [FREE Full text] [CrossRef] [Medline]
- Heale LD, Dover S, Goh YI, Maksymiuk VA, Wells GD, Feldman BM. A wearable activity tracker intervention for promoting physical activity in adolescents with juvenile idiopathic arthritis: a pilot study. Pediatr Rheumatol Online J. Oct 22, 2018;16(1):66. [FREE Full text] [CrossRef] [Medline]
- Hébert ET, Ra CK, Alexander AC, Helt A, Moisiuc R, Kendzor DE, et al. A mobile just-in-time adaptive intervention for smoking cessation: pilot randomized controlled trial. J Med Internet Res. Mar 09, 2020;22(3):e16907. [FREE Full text] [CrossRef] [Medline]
- Heminger CL, Boal AL, Zumer M, Abroms LC. Text2Quit: an analysis of participant engagement in the mobile smoking cessation program. Am J Drug Alcohol Abuse. Jul 27, 2016;42(4):450-458. [CrossRef] [Medline]
- Herbec A, Brown J, Shahab L, West R, Raupach T. Pragmatic randomised trial of a smartphone app (NRT2Quit) to improve effectiveness of nicotine replacement therapy in a quit attempt by improving medication adherence: results of a prematurely terminated study. Trials. Sep 02, 2019;20(1):547. [FREE Full text] [CrossRef] [Medline]
- Herbert LJ, Collier S, Stern A, Monaghan M, Streisand R. A pilot test of the self-management and research technology project: a text message-based diabetes self-management program for adolescents. J Child Health Care. Dec 26, 2016;20(4):456-463. [CrossRef] [Medline]
- Hightow-Weidman L, Muessig KE, Egger JR, Vecchio A, Platt A. Epic Allies: a gamified mobile app to improve engagement in HIV care and antiretroviral adherence among young men who have sex with men. AIDS Behav. Aug 2021;25(8):2599-2617. [FREE Full text] [CrossRef] [Medline]
- Hightow-Weidman L, Muessig K, Knudtson K, Srivatsa M, Lawrence E, LeGrand S, et al. A gamified smartphone app to support engagement in care and medication adherence for HIV-positive young men who have sex with men (AllyQuest): development and pilot study. JMIR Public Health Surveill. Apr 30, 2018;4(2):e34. [FREE Full text] [CrossRef] [Medline]
- Hilliard ME, Cao VT, Eshtehardi SS, Minard CG, Saber R, Thompson D, et al. Type 1 doing well: pilot feasibility and acceptability study of a strengths-based mHealth app for parents of adolescents with type 1 diabetes. Diabetes Technol Ther. Nov 2020;22(11):835-845. [FREE Full text] [CrossRef] [Medline]
- Himelhoch S, Kreyenbuhl J, Palmer-Bacon J, Chu M, Brown C, Potts W. Pilot feasibility study of Heart2HAART: a smartphone application to assist with adherence among substance users living with HIV. AIDS Care. Jul 03, 2017;29(7):898-904. [CrossRef] [Medline]
- Hoffman V, Söderström L, Samuelsson E. Self-management of stress urinary incontinence via a mobile app: two-year follow-up of a randomized controlled trial. Acta Obstet Gynecol Scand. Oct 2017;96(10):1180-1187. [FREE Full text] [CrossRef] [Medline]
- Hommel KA, Carmody J, Hershey AD, Holbein C, Kabbouche-Samaha M, Peugh J, et al. Digital therapeutic self-management intervention in adolescents with migraine: feasibility and preliminary efficacy of "migraine manager". Headache. Jun 22, 2020;60(6):1103-1110. [FREE Full text] [CrossRef] [Medline]
- Hood A, Nwankwo C, Walton A, McTate E, Joffe N, Quinn CT, et al. Mobile health use predicts self-efficacy and self-management in adolescents with sickle cell disease. Transl Behav Med. Oct 23, 2021;11(10):1823-1831. [FREE Full text] [CrossRef] [Medline]
- Horner GN, Agboola S, Jethwani K, Tan-McGrory A, Lopez L. Designing patient-centered text messaging interventions for increasing physical activity among participants with type 2 diabetes: qualitative results from the text to move intervention. JMIR Mhealth Uhealth. Apr 24, 2017;5(4):e54. [FREE Full text] [CrossRef] [Medline]
- Horvath KJ, Lammert S, MacLehose RF, Danh T, Baker JV, Carrico AW. A pilot study of a mobile app to support HIV antiretroviral therapy adherence among men who have sex with men who use stimulants. AIDS Behav. Nov 15, 2019;23(11):3184-3198. [FREE Full text] [CrossRef] [Medline]
- Huang Z, Tan E, Lum E, Sloot P, Boehm BO, Car J. A smartphone app to improve medication adherence in patients with type 2 diabetes in Asia: feasibility randomized controlled trial. JMIR Mhealth Uhealth. Sep 12, 2019;7(9):e14914. [FREE Full text] [CrossRef] [Medline]
- Huberty JL, Green J, Puzia ME, Larkey L, Laird B, Vranceanu A, et al. Testing a mindfulness meditation mobile app for the treatment of sleep-related symptoms in adults with sleep disturbance: a randomized controlled trial. PLoS One. Jan 7, 2021;16(1):e0244717. [FREE Full text] [CrossRef] [Medline]
- Huh U, Tak YJ, Song S, Chung SW, Sung SM, Lee CW, et al. Feedback on physical activity through a wearable device connected to a mobile phone app in patients with metabolic syndrome: pilot study. JMIR Mhealth Uhealth. Jun 18, 2019;7(6):e13381. [FREE Full text] [CrossRef] [Medline]
- Hunt M, Miguez S, Dukas B, Onwude O, White S. Efficacy of Zemedy, a mobile digital therapeutic for the self-management of irritable bowel syndrome: crossover randomized controlled trial. JMIR Mhealth Uhealth. May 20, 2021;9(5):e26152. [FREE Full text] [CrossRef] [Medline]
- Huo X, Krumholz HM, Bai X, Spatz ES, Ding Q, Horak P, et al. Effects of mobile text messaging on glycemic control in patients with coronary heart disease and diabetes mellitus: a randomized clinical trial. Circ Cardiovasc Qual Outcomes. Sep 2019;12(9):e005805. [CrossRef] [Medline]
- Hutchesson MJ, Tan CY, Morgan P, Callister R, Collins C. Enhancement of self-monitoring in a web-based weight loss program by extra individualized feedback and reminders: randomized trial. J Med Internet Res. Apr 12, 2016;18(4):e82. [FREE Full text] [CrossRef] [Medline]
- Irizarry T, Allen M, Suffoletto BP, Einhorn J, Burke LE, Kamarck TW, et al. Development and preliminary feasibility of an automated hypertension self-management system. Am J Med. Sep 2018;131(9):1125.e1-1125.e8. [FREE Full text] [CrossRef] [Medline]
- Ivanova E, Lindner P, Ly KH, Dahlin M, Vernmark K, Andersson G, et al. Guided and unguided acceptance and commitment therapy for social anxiety disorder and/or panic disorder provided via the internet and a smartphone application: a randomized controlled trial. J Anxiety Disord. Dec 2016;44:27-35. [CrossRef] [Medline]
- Jácome C, Almeida R, Pereira AM, Amaral R, Mendes S, Alves-Correia M, et al. Feasibility and acceptability of an asthma app to monitor medication adherence: mixed methods study. JMIR Mhealth Uhealth. May 25, 2021;9(5):e26442. [FREE Full text] [CrossRef] [Medline]
- Jaimini U, Thirunarayan K, Kalra M, Venkataraman R, Kadariya D, Sheth A. "How is my child's asthma?" Digital phenotype and actionable insights for pediatric asthma. JMIR Pediatr Parent. Dec 14, 2018;1(2):e11988. [FREE Full text] [CrossRef] [Medline]
- Jamison RN, Mei A, Ross EL. Longitudinal trial of a smartphone pain application for chronic pain patients: Predictors of compliance and satisfaction. J Telemed Telecare. Feb 2018;24(2):93-100. [CrossRef] [Medline]
- Johansson M, Berman AH, Sinadinovic K, Lindner P, Hermansson U, Andréasson S. Effects of internet-based cognitive behavioral therapy for harmful alcohol use and alcohol dependence as self-help or with therapist guidance: three-armed randomized trial. J Med Internet Res. Nov 24, 2021;23(11):e29666. [FREE Full text] [CrossRef] [Medline]
- Jonassaint CR, Kang C, Prussien KV, Yarboi J, Sanger MS, Wilson JD, et al. Feasibility of implementing mobile technology-delivered mental health treatment in routine adult sickle cell disease care. Transl Behav Med. Feb 03, 2020;10(1):58-67. [FREE Full text] [CrossRef] [Medline]
- Jonathan G, Carpenter-Song EA, Brian RM, Ben-Zeev D. Life with FOCUS: a qualitative evaluation of the impact of a smartphone intervention on people with serious mental illness. Psychiatr Rehabil J. Jun 2019;42(2):182-189. [FREE Full text] [CrossRef] [Medline]
- Juarascio AS, Hunt RA, Lantz Lesser E, Engel SG, Pisetsky EM, Peterson CB, et al. Enhancing integrative cognitive-affective therapy with ecological momentary interventions: a pilot trial. Eur Eat Disord Rev. Jan 26, 2021;29(1):152-158. [CrossRef] [Medline]
- Kählke F, Berger T, Schulz A, Baumeister H, Berking M, Auerbach RP, et al. Efficacy of an unguided internet-based self-help intervention for social anxiety disorder in university students: a randomized controlled trial. Int J Methods Psychiatr Res. Jun 27, 2019;28(2):e1766. [FREE Full text] [CrossRef] [Medline]
- Kanera IM, Bolman CA, Willems RA, Mesters I, Lechner L. Lifestyle-related effects of the web-based Kanker Nazorg Wijzer (Cancer Aftercare Guide) intervention for cancer survivors: a randomized controlled trial. J Cancer Surviv. Oct 2016;10(5):883-897. [FREE Full text] [CrossRef] [Medline]
- Kanera IM, Willems RA, Bolman CA, Mesters I, Zambon V, Gijsen BC, et al. Use and appreciation of a tailored self-management eHealth intervention for early cancer survivors: process evaluation of a randomized controlled trial. J Med Internet Res. Aug 23, 2016;18(8):e229. [FREE Full text] [CrossRef] [Medline]
- Kanera IM, Willems RA, Bolman CA, Mesters I, Verboon P, Lechner L. Long-term effects of a web-based cancer aftercare intervention on moderate physical activity and vegetable consumption among early cancer survivors: a randomized controlled trial. Int J Behav Nutr Phys Act. Feb 10, 2017;14(1):19. [FREE Full text] [CrossRef] [Medline]
- Kassavou A, A'Court CE, Chauhan J, Brimocombe JD, Bhattacharya D, Naughton F, et al. Assessing the acceptability of a text messaging service and smartphone app to support patient adherence to medications prescribed for high blood pressure: a pilot study. Pilot Feasibility Stud. Sep 21, 2020;6(1):134. [FREE Full text] [CrossRef] [Medline]
- Kaushal T, Katz LE, Joseph J, Marowitz M, Morales KH, Atkins D, et al. A text messaging intervention with financial incentive for adolescents with type 1 diabetes. J Diabetes Sci Technol. Jan 30, 2022;16(1):120-127. [FREE Full text] [CrossRef] [Medline]
- Kauw D, Koole MA, Winter MM, Dohmen DA, Tulevski II, Blok S, et al. Advantages of mobile health in the management of adult patients with congenital heart disease. Int J Med Inform. Dec 2019;132:104011. [FREE Full text] [CrossRef] [Medline]
- Kay MC, Burroughs J, Askew S, Bennett GG, Armstrong S, Steinberg DM. Digital weight loss intervention for parents of children being treated for obesity: a prospective cohort feasibility trial. J Med Internet Res. Dec 20, 2018;20(12):e11093. [FREE Full text] [CrossRef] [Medline]
- Kelechi TJ, Prentice MA, Mueller M, Madisetti M, Vertegel A. A lower leg physical activity intervention for individuals with chronic venous leg ulcers: randomized controlled trial. JMIR Mhealth Uhealth. May 15, 2020;8(5):e15015. [FREE Full text] [CrossRef] [Medline]
- Kenyon CC, Sundar KG, Gruschow SM, Quarshie WO, Feudtner C, Bryant-Stephens TC, et al. Tailored medication adherence incentives for high-risk children with asthma: a pilot study. J Asthma. Dec 2020;57(12):1372-1378. [CrossRef] [Medline]
- Kim H, Faw M, Michaelides A. Mobile but connected: harnessing the power of self-efficacy and group support for weight loss success through mHealth intervention. J Health Commun. May 24, 2017;22(5):395-402. [CrossRef] [Medline]
- Kim MY, Lee SY, Jo EJ, Lee S, Kang M, Song W, et al. Feasibility of a smartphone application based action plan and monitoring in asthma. Asia Pac Allergy. Jul 2016;6(3):174-180. [FREE Full text] [CrossRef] [Medline]
- King-Dowling S, Psihogios AM, Hill-Kayser C, Szalda D, O'Hagan B, Darabos K, et al. Acceptability and feasibility of survivorship care plans and an accompanying mobile health intervention for adolescent and young adult survivors of childhood cancer. Pediatr Blood Cancer. Mar 08, 2021;68(3):e28884. [FREE Full text] [CrossRef] [Medline]
- Klausen SH, Andersen LL, Søndergaard L, Jakobsen JC, Zoffmann V, Dideriksen K, et al. Effects of eHealth physical activity encouragement in adolescents with complex congenital heart disease: the PReVaiL randomized clinical trial. Int J Cardiol. Oct 15, 2016;221:1100-1106. [CrossRef] [Medline]
- Kliemann N, Croker H, Johnson F, Beeken RJ. Development of the top tips habit-based weight loss app and preliminary indications of its usage, effectiveness, and acceptability: mixed-methods pilot study. JMIR Mhealth Uhealth. May 10, 2019;7(5):e12326. [FREE Full text] [CrossRef] [Medline]
- Kooij L, Vos PJ, Dijkstra A, van Harten WH. Effectiveness of a mobile health and self-management app for high-risk patients with chronic obstructive pulmonary disease in daily clinical practice: mixed methods evaluation study. JMIR Mhealth Uhealth. Feb 04, 2021;9(2):e21977. [FREE Full text] [CrossRef] [Medline]
- Koot D, Goh PS, Lim RS, Tian Y, Yau TY, Tan NC, et al. A mobile lifestyle management program (GlycoLeap) for people with type 2 diabetes: single-arm feasibility study. JMIR Mhealth Uhealth. May 24, 2019;7(5):e12965. [FREE Full text] [CrossRef] [Medline]
- Korus M, Cruchley E, Calic M, Gold A, Anthony SJ, Parekh RS, et al. Assessing the acceptability and efficacy of teens taking charge: transplant-a pilot randomized control trial. Pediatr Transplant. Feb 19, 2020;24(1):e13612. [CrossRef] [Medline]
- Kosse RC, Bouvy ML, Belitser SV, de Vries TW, van der Wal PS, Koster ES. Effective engagement of adolescent asthma patients with mobile health-supporting medication adherence. JMIR Mhealth Uhealth. Mar 27, 2019;7(3):e12411. [FREE Full text] [CrossRef] [Medline]
- Krishnakumar A, Verma R, Chawla R, Sosale A, Saboo B, Joshi S, et al. Evaluating glycemic control in patients of South Asian origin with type 2 diabetes using a digital therapeutic platform: analysis of real-world data. J Med Internet Res. Mar 25, 2021;23(3):e17908. [FREE Full text] [CrossRef] [Medline]
- Kubo A, Aghaee S, Kurtovich EM, Nkemere L, Quesenberry CP, McGinnis MK, et al. mHealth mindfulness intervention for women with moderate-to-moderately-severe antenatal depressive symptoms: a pilot study within an integrated health care system. Mindfulness (N Y). 2021;12(6):1387-1397. [FREE Full text] [CrossRef] [Medline]
- Kumar S, Moseson H, Uppal J, Juusola JL. A diabetes mobile app with in-app coaching from a certified diabetes educator reduces A1C for individuals with type 2 diabetes. Diabetes Educ. Jun 2018;44(3):226-236. [CrossRef] [Medline]
- Lakshminarayana R, Wang D, Burn D, Chaudhuri KR, Galtrey C, Guzman NV, Ben James, et al. Using a smartphone-based self-management platform to support medication adherence and clinical consultation in Parkinson's disease. NPJ Parkinsons Dis. 2017;3:2. [FREE Full text] [CrossRef] [Medline]
- Lalloo C, Hundert A, Harris L, Pham Q, Campbell F, Chorney J, et al. Capturing daily disease experiences of adolescents with chronic pain: mHealth-mediated symptom tracking. JMIR Mhealth Uhealth. Jan 17, 2019;7(1):e11838. [FREE Full text] [CrossRef] [Medline]
- Lambert SD, Grover S, Laizner AM, McCusker J, Belzile E, Moodie EE, et al. Adaptive web-based stress management programs among adults with a cardiovascular disease: a pilot Sequential Multiple Assignment Randomized Trial (SMART). Patient Educ Couns. Jun 2022;105(6):1587-1597. [CrossRef] [Medline]
- Leach CR, Hudson SV, Diefenbach MA, Wiseman KP, Sanders A, Coa K, et al. Cancer health self-efficacy improvement in a randomized controlled trial. Cancer. Feb 01, 2022;128(3):597-605. [FREE Full text] [CrossRef] [Medline]
- Lee H, Uhm KE, Cheong IY, Yoo JS, Chung SH, Park YH, et al. Patient satisfaction with mobile health (mHealth) application for exercise intervention in breast cancer survivors. J Med Syst. Nov 06, 2018;42(12):254. [CrossRef] [Medline]
- Lee KW, Kim HB, Lee SH, Ha HK. Changes in weight and health-related behavior using smartphone applications in patients with colorectal polyps. J Nutr Educ Behav. May 2019;51(5):539-546. [CrossRef] [Medline]
- Lee MK, Lee DY, Ahn HY, Park CY. A novel user utility score for diabetes management using tailored mobile coaching: secondary analysis of a randomized controlled trial. JMIR Mhealth Uhealth. Feb 24, 2021;9(2):e17573. [FREE Full text] [CrossRef] [Medline]
- Lee SE, Park SK, Park YS, Kim KA, Choi HS, Oh SW. Effects of short-term mobile application use on weight reduction for patients with type 2 diabetes. J Obes Metab Syndr. Dec 30, 2021;30(4):345-353. [FREE Full text] [CrossRef] [Medline]
- Lefler LL, Rhoads SJ, Harris M, Funderburg AE, Lubin SA, Martel ID, et al. Evaluating the use of mobile health technology in older adults with heart failure: mixed-methods study. JMIR Aging. Dec 04, 2018;1(2):e12178. [FREE Full text] [CrossRef] [Medline]
- Leon N, Namadingo H, Cooper S, Bobrow K, Mwantisi C, Nyasulu M, et al. Process evaluation of a brief messaging intervention to improve diabetes treatment adherence in sub-Saharan Africa. BMC Public Health. Aug 21, 2021;21(1):1576. [FREE Full text] [CrossRef] [Medline]
- Leonard S, Anderson LM, Jonassaint J, Jonassaint C, Shah N. Utilizing a novel mobile health "selfie" application to improve compliance to iron chelation in pediatric patients receiving chronic transfusions. J Pediatr Hematol Oncol. Apr 2017;39(3):223-229. [CrossRef] [Medline]
- Levin JB, Sajatovic M, Rahman M, Aebi ME, Tatsuoka C, Depp C, et al. Outcomes of psychoeducation and a text messaging adherence intervention among individuals with hypertension and bipolar disorder. Psychiatr Serv. Jul 01, 2019;70(7):608-612. [FREE Full text] [CrossRef] [Medline]
- Lewis S, Ainsworth J, Sanders C, Stockton-Powdrell C, Machin M, Whelan P, et al. Smartphone-enhanced symptom management in psychosis: open, randomized controlled trial. J Med Internet Res. Aug 13, 2020;22(8):e17019. [FREE Full text] [CrossRef] [Medline]
- Loeckx M, Rabinovich RA, Demeyer H, Louvaris Z, Tanner R, Rubio N, et al. Smartphone-based physical activity telecoaching in chronic obstructive pulmonary disease: mixed-methods study on patient experiences and lessons for implementation. JMIR Mhealth Uhealth. Dec 21, 2018;6(12):e200. [FREE Full text] [CrossRef] [Medline]
- Lopez KE, Salvy SJ, Fink C, Werner J, Wee CP, Hegedus E, et al. Executive functioning, depressive symptoms, and intervention engagement in a sample of adolescents enrolled in a weight management program. Child Obes. Jun 01, 2021;17(4):281-290. [FREE Full text] [CrossRef] [Medline]
- Malte CA, Dulin PL, Baer JS, Fortney JC, Danner AN, Lott AM, et al. Usability and acceptability of a mobile app for the self-management of alcohol misuse among Veterans (Step Away): pilot cohort study. JMIR Mhealth Uhealth. Apr 08, 2021;9(4):e25927. [FREE Full text] [CrossRef] [Medline]
- Mamykina L, Heitkemper EM, Smaldone AM, Kukafka R, Cole-Lewis H, Davidson PG, et al. Structured scaffolding for reflection and problem solving in diabetes self-management: qualitative study of mobile diabetes detective. J Am Med Inform Assoc. Jan 14, 2016;23(1):129-136. [FREE Full text] [CrossRef] [Medline]
- Mantani A, Kato T, Furukawa TA, Horikoshi M, Imai H, Hiroe T, et al. Smartphone cognitive behavioral therapy as an adjunct to pharmacotherapy for refractory depression: randomized controlled trial. J Med Internet Res. Nov 03, 2017;19(11):e373. [FREE Full text] [CrossRef] [Medline]
- Mayberry LS, Berg CA, Greevy RA, Nelson LA, Bergner EM, Wallston KA, et al. Mixed-methods randomized evaluation of FAMS: a mobile phone-delivered intervention to improve family/friend involvement in adults' type 2 diabetes self-care. Ann Behav Med. Mar 16, 2021;55(2):165-178. [FREE Full text] [CrossRef] [Medline]
- McClure JB, Anderson ML, Bradley K, An LC, Catz SL. Evaluating an adaptive and interactive mHealth smoking cessation and medication adherence program: a randomized pilot feasibility study. JMIR Mhealth Uhealth. Aug 03, 2016;4(3):e94. [FREE Full text] [CrossRef] [Medline]
- McGill DE, Volkening LK, Butler DA, Wasserman RM, Anderson BJ, Laffel LM. Text-message responsiveness to blood glucose monitoring reminders is associated with HbA benefit in teenagers with type 1 diabetes. Diabet Med. May 25, 2019;36(5):600-605. [FREE Full text] [CrossRef] [Medline]
- McGillicuddy JW, Chandler JL, Sox LR, Taber DJ. Exploratory analysis of the impact of an mHealth medication adherence intervention on tacrolimus trough concentration variability: post hoc results of a randomized controlled trial. Ann Pharmacother. Dec 08, 2020;54(12):1185-1193. [FREE Full text] [CrossRef] [Medline]
- Melilli E, Cestone G, Revuelta I, Meneghini M, Lladó L, Montero N, et al. Adoption of a novel smart mobile-health application technology to track chronic immunosuppression adherence in solid organ transplantation: Results of a prospective, observational, multicentre, pilot study. Clin Transplant. May 16, 2021;35(5):e14278. [CrossRef] [Medline]
- Melissant HC, Verdonck-de Leeuw IM, Lissenberg-Witte BI, Konings IR, Cuijpers P, Van Uden-Kraan CF. 'Oncokompas', a web-based self-management application to support patient activation and optimal supportive care: a feasibility study among breast cancer survivors. Acta Oncol. Jul 2018;57(7):924-934. [CrossRef] [Medline]
- Merwin RM, Moskovich AA, Babyak M, Feinglos M, Honeycutt LK, Mooney J, et al. An open trial of app-assisted acceptance and commitment therapy (iACT) for eating disorders in type 1 diabetes. J Eat Disord. Jan 06, 2021;9(1):6. [FREE Full text] [CrossRef] [Medline]
- Minen MT, Adhikari S, Padikkala J, Tasneem S, Bagheri A, Goldberg E, et al. Smartphone-delivered progressive muscle relaxation for the treatment of migraine in primary care: a randomized controlled trial. Headache. Nov 2020;60(10):2232-2246. [FREE Full text] [CrossRef] [Medline]
- Minen MT, Schaubhut KB, Morio K. Smartphone based behavioral therapy for pain in multiple sclerosis (MS) patients: a feasibility acceptability randomized controlled study for the treatment of comorbid migraine and MS pain. Mult Scler Relat Disord. Nov 2020;46:102489. [FREE Full text] [CrossRef] [Medline]
- Moberg C, Niles A, Beermann D. Guided self-help works: randomized waitlist controlled trial of pacifica, a mobile app integrating cognitive behavioral therapy and mindfulness for stress, anxiety, and depression. J Med Internet Res. Jun 08, 2019;21(6):e12556. [FREE Full text] [CrossRef] [Medline]
- Mollard E, Michaud K. A mobile app with optical imaging for the self-management of hand rheumatoid arthritis: pilot study. JMIR Mhealth Uhealth. Oct 29, 2018;6(10):e12221. [FREE Full text] [CrossRef] [Medline]
- Mollerup A, Harboe G, Johansen JD. User evaluation of patient counselling, combining nurse consultation and eHealth in hand eczema. Contact Dermatitis. Apr 29, 2016;74(4):205-216. [CrossRef] [Medline]
- Moore DJ, Pasipanodya EC, Umlauf A, Rooney AS, Gouaux B, Depp CA, et al. Individualized texting for adherence building (iTAB) for methamphetamine users living with HIV: a pilot randomized clinical trial. Drug Alcohol Depend. Aug 01, 2018;189:154-160. [FREE Full text] [CrossRef] [Medline]
- Morita PP, Yeung MS, Ferrone M, Taite AK, Madeley C, Stevens Lavigne A, et al. A patient-centered mobile health system that supports asthma self-management (breathe): design, development, and utilization. JMIR Mhealth Uhealth. Jan 28, 2019;7(1):e10956. [FREE Full text] [CrossRef] [Medline]
- Moyano D, Morelli D, Santero M, Belizan M, Irazola V, Beratarrechea A. Perceptions and acceptability of text messaging for diabetes care in primary care in Argentina: exploratory study. JMIR Diabetes. Mar 18, 2019;4(1):e10350. [FREE Full text] [CrossRef] [Medline]
- Mulvaney SA, Vaala S, Hood KK, Lybarger C, Carroll R, Williams L, et al. Mobile momentary assessment and biobehavioral feedback for adolescents with type 1 diabetes: feasibility and engagement patterns. Diabetes Technol Ther. Jul 2018;20(7):465-474. [FREE Full text] [CrossRef] [Medline]
- Muralidharan S, Ranjani H, Mohan Anjana R, Jena S, Tandon N, Gupta Y, et al. Engagement and weight loss: results from the mobile health and diabetes trial. Diabetes Technol Ther. Sep 2019;21(9):507-513. [CrossRef] [Medline]
- Murphy J, McSharry J, Hynes L, Molloy GJ. A smartphone app to support adherence to inhaled corticosteroids in young adults with asthma: multi-methods feasibility study. JMIR Form Res. Sep 01, 2021;5(9):e28784. [FREE Full text] [CrossRef] [Medline]
- Nelson LA, Greevy RA, Spieker A, Wallston KA, Elasy TA, Kripalani S, et al. Effects of a tailored text messaging intervention among diverse adults with type 2 diabetes: evidence from the 15-month REACH randomized controlled trial. Diabetes Care. Jan 2021;44(1):26-34. [FREE Full text] [CrossRef] [Medline]
- Nelson LA, Mulvaney SA, Gebretsadik T, Ho Y, Johnson KB, Osborn CY. Disparities in the use of a mHealth medication adherence promotion intervention for low-income adults with type 2 diabetes. J Am Med Inform Assoc. Jan 2016;23(1):12-18. [FREE Full text] [CrossRef] [Medline]
- Nelson LA, Spieker A, Greevy R, LeStourgeon LM, Wallston KA, Mayberry LS. User engagement among diverse adults in a 12-month text message-delivered diabetes support intervention: results from a randomized controlled trial. JMIR Mhealth Uhealth. Jul 21, 2020;8(7):e17534. [FREE Full text] [CrossRef] [Medline]
- Nichols M, Miller S, Treiber F, Ruggiero K, Dawley E, Teufel Ii R. Patient and parent perspectives on improving pediatric asthma self-management through a mobile health intervention: pilot study. JMIR Form Res. Jul 03, 2020;4(7):e15295. [FREE Full text] [CrossRef] [Medline]
- Nilsson A, Sörman K, Klingvall J, Ovelius E, Lundberg J, Hellner C. MyCompass in a Swedish context - lessons learned from the transfer of a self-guided intervention targeting mental health problems. BMC Psychiatry. Jan 31, 2019;19(1):51. [FREE Full text] [CrossRef] [Medline]
- Oehler C, Scholze K, Reich H, Sander C, Hegerl U. Intervention use and symptom change with unguided internet-based cognitive behavioral therapy for depression during the COVID-19 pandemic: log data analysis of a convenience sample. JMIR Ment Health. Jul 16, 2021;8(7):e28321. [FREE Full text] [CrossRef] [Medline]
- Olalla J, García de Lomas JM, Márquez E, González FJ, Del Arco A, De La Torre J, et al. Experience of using an app in HIV patients older than 60 years: pilot program. JMIR Mhealth Uhealth. Mar 06, 2019;7(3):e9904. [FREE Full text] [CrossRef] [Medline]
- Ong SW, Jassal SV, Miller JA, Porter EC, Cafazzo JA, Seto E, et al. Integrating a smartphone-based self-management system into usual care of advanced CKD. Clin J Am Soc Nephrol. Jun 06, 2016;11(6):1054-1062. [FREE Full text] [CrossRef] [Medline]
- Osborn CY, van Ginkel JR, Rodbard D, Heyman M, Marrero DG, Huddleston B, et al. One Drop | Mobile: an evaluation of hemoglobin A1c improvement linked to app engagement. JMIR Diabetes. Aug 24, 2017;2(2):e21. [FREE Full text] [CrossRef] [Medline]
- Oser M, Wallace ML, Solano F, Szigethy EM. Guided digital cognitive behavioral program for anxiety in primary care: propensity-matched controlled trial. JMIR Ment Health. Apr 04, 2019;6(4):e11981. [FREE Full text] [CrossRef] [Medline]
- Pagan-Ortiz ME, Goulet P, Kogelman L, Levkoff SE, Weitzman PF. Feasibility of a texting intervention to improve medication adherence among older HIV+ African Americans: A mixed-method pilot study. Gerontol Geriatr Med. Jun 27, 2019;5:2333721419855662. [FREE Full text] [CrossRef] [Medline]
- Pagoto S, Tulu B, Waring ME, Goetz J, Bibeau J, Divito J, et al. Slip Buddy app for weight management: randomized feasibility trial of a dietary lapse tracking app. JMIR Mhealth Uhealth. Apr 01, 2021;9(4):e24249. [FREE Full text] [CrossRef] [Medline]
- Palermo TM, de la Vega R, Murray C, Law E, Zhou C. A digital health psychological intervention (WebMAP Mobile) for children and adolescents with chronic pain: results of a hybrid effectiveness-implementation stepped-wedge cluster randomized trial. Pain. Dec 10, 2020;161(12):2763-2774. [FREE Full text] [CrossRef] [Medline]
- Patel ML, Hopkins CM, Brooks TL, Bennett GG. Comparing self-monitoring strategies for weight loss in a smartphone app: randomized controlled trial. JMIR Mhealth Uhealth. Feb 28, 2019;7(2):e12209. [FREE Full text] [CrossRef] [Medline]
- Perski O, Watson NL, Mull KE, Bricker JB. Identifying content-based engagement patterns in a smoking cessation website and associations with user characteristics and cessation outcomes: a sequence and cluster analysis. Nicotine Tob Res. Jun 08, 2021;23(7):1103-1112. [FREE Full text] [CrossRef] [Medline]
- Phillips S, Kanter J, Mueller M, Gulledge A, Ruggiero K, Johnson M, et al. Feasibility of an mHealth self-management intervention for children and adolescents with sickle cell disease and their families. Transl Behav Med. Apr 07, 2021;11(3):724-732. [FREE Full text] [CrossRef] [Medline]
- Poort H, Ryan A, MacDougall K, Malinowski P, MacDonald A, Markin Z, et al. Feasibility and acceptability of a mobile phone app intervention for coping with cancer as a young adult: pilot trial and thematic analysis. J Med Internet Res. Jun 11, 2021;23(6):e25069. [FREE Full text] [CrossRef] [Medline]
- Prasad M, Fine K, Gee A, Nair N, Popp CJ, Cheng B, et al. A smartphone intervention to promote time restricted eating reduces body weight and blood pressure in adults with overweight and obesity: a pilot study. Nutrients. Jun 23, 2021;13(7):2148. [FREE Full text] [CrossRef] [Medline]
- Psihogios AM, King-Dowling S, O'Hagan B, Darabos K, Maurer L, Young J, et al. Contextual predictors of engagement in a tailored mHealth intervention for adolescent and young adult cancer survivors. Ann Behav Med. Nov 18, 2021;55(12):1220-1230. [FREE Full text] [CrossRef] [Medline]
- Rabbi M, Aung MS, Gay G, Reid MC, Choudhury T. Feasibility and acceptability of mobile phone-based auto-personalized physical activity recommendations for chronic pain self-management: pilot study on adults. J Med Internet Res. Oct 26, 2018;20(10):e10147. [FREE Full text] [CrossRef] [Medline]
- Ramsey SE, Ames EG, Uber J, Habib S, Clark S, Waldrop D. A preliminary test of an mHealth facilitated health coaching intervention to improve medication adherence among persons living with HIV. AIDS Behav. Nov 12, 2021;25(11):3782-3797. [FREE Full text] [CrossRef] [Medline]
- Reading M, Baik D, Beauchemin M, Hickey K, Merrill J. Factors influencing sustained engagement with ECG self-monitoring: perspectives from patients and health care providers. Appl Clin Inform. Oct 10, 2018;9(4):772-781. [FREE Full text] [CrossRef] [Medline]
- Redfern J, Coorey G, Mulley J, Scaria A, Neubeck L, Hafiz N, et al. A digital health intervention for cardiovascular disease management in primary care (CONNECT) randomized controlled trial. NPJ Digit Med. Sep 10, 2020;3(1):117. [FREE Full text] [CrossRef] [Medline]
- Reyes AT, Bhatta TR, Muthukumar V, Gangozo WJ. Testing the acceptability and initial efficacy of a smartphone-app mindfulness intervention for college student veterans with PTSD. Arch Psychiatr Nurs. Apr 2020;34(2):58-66. [CrossRef] [Medline]
- Rico TM, Dos Santos Machado K, Fernandes VP, Madruga SW, Noguez PT, Barcelos CR, et al. Text messaging (SMS) helping cancer care in patients undergoing chemotherapy treatment: a pilot study. J Med Syst. Oct 09, 2017;41(11):181. [CrossRef] [Medline]
- Rizvi SL, Hughes CD, Thomas MC. The DBT coach mobile application as an adjunct to treatment for suicidal and self-injuring individuals with borderline personality disorder: a preliminary evaluation and challenges to client utilization. Psychol Serv. Nov 2016;13(4):380-388. [CrossRef] [Medline]
- Rodriguez Hermosa JL, Fuster Gomila A, Puente Maestu L, Amado Diago CA, Callejas González FJ, Malo De Molina Ruiz R, et al. Compliance and utility of a smartphone app for the detection of exacerbations in patients with chronic obstructive pulmonary disease: cohort study. JMIR Mhealth Uhealth. Mar 19, 2020;8(3):e15699. [FREE Full text] [CrossRef] [Medline]
- Rosenberger EM, DeVito Dabbs AJ, DiMartini AF, Landsittel DP, Pilewski JM, Dew MA. Long-term follow-up of a randomized controlled trial evaluating a mobile health intervention for self-management in lung transplant recipients. Am J Transplant. May 2017;17(5):1286-1293. [FREE Full text] [CrossRef] [Medline]
- Ross EL, Jamison RN, Nicholls L, Perry BM, Nolen KD. Clinical integration of a smartphone app for patients with chronic pain: retrospective analysis of predictors of benefits and patient engagement between clinic visits. J Med Internet Res. Apr 16, 2020;22(4):e16939. [FREE Full text] [CrossRef] [Medline]
- Rudolf I, Pieper K, Nolte H, Junge S, Dopfer C, Sauer-Heilborn A, et al. Assessment of a mobile app by adolescents and young adults with cystic fibrosis: pilot evaluation. JMIR Mhealth Uhealth. Nov 21, 2019;7(11):e12442. [FREE Full text] [CrossRef] [Medline]
- Rygh P, Asklund I, Samuelsson E. Real-world effectiveness of app-based treatment for urinary incontinence: a cohort study. BMJ Open. Jan 04, 2021;11(1):e040819. [FREE Full text] [CrossRef] [Medline]
- Saberi P, Lisha NE, Erguera XA, Hudes ES, Johnson MO, Ruel T, et al. A mobile health app (WYZ) for engagement in care and antiretroviral therapy adherence among youth and young adults living with HIV: single-arm pilot intervention study. JMIR Form Res. Aug 31, 2021;5(8):e26861. [FREE Full text] [CrossRef] [Medline]
- Santiago-Torres M, Mull KE, Sullivan BM, Kwon D, Nollen NL, Zvolensky MJ, et al. Efficacy and utilization of an acceptance and commitment therapy-based smartphone application for smoking cessation among Black adults: secondary analysis of the iCanQuit randomized trial. Addiction. Mar 09, 2022;117(3):760-771. [FREE Full text] [CrossRef] [Medline]
- Santiago-Torres M, Mull KE, Sullivan BM, Kwon DM, Nez Henderson P, Nelson LA, et al. Efficacy and utilization of smartphone applications for smoking cessation among American Indians and Alaska Natives: results from the iCanQuit trial. Nicotine Tob Res. Mar 01, 2022;24(4):544-554. [FREE Full text] [CrossRef] [Medline]
- Schlosser DA, Campellone TR, Truong B, Anguera JA, Vergani S, Vinogradov S, et al. The feasibility, acceptability, and outcomes of PRIME-D: a novel mobile intervention treatment for depression. Depress Anxiety. Jun 18, 2017;34(6):546-554. [FREE Full text] [CrossRef] [Medline]
- Schnall R, Cho H, Mangone A, Pichon A, Jia H. Mobile health technology for improving symptom management in low income persons living with HIV. AIDS Behav. Oct 3, 2018;22(10):3373-3383. [FREE Full text] [CrossRef] [Medline]
- Schneider T, Baum L, Amy A, Marisa C. I have most of my asthma under control and I know how my asthma acts: users' perceptions of asthma self-management mobile app tailored for adolescents. Health Informatics J. Mar 2020;26(1):342-353. [FREE Full text] [CrossRef] [Medline]
- Scott CK, Dennis ML, Johnson KA, Grella CE. A randomized clinical trial of smartphone self-managed recovery support services. J Subst Abuse Treat. Oct 2020;117:108089. [FREE Full text] [CrossRef] [Medline]
- Selter A, Tsangouri C, Ali SB, Freed D, Vatchinsky A, Kizer J, et al. An mHealth app for self-management of chronic lower back pain (Limbr): pilot study. JMIR Mhealth Uhealth. Sep 17, 2018;6(9):e179. [FREE Full text] [CrossRef] [Medline]
- Seng EK, Prieto P, Boucher G, Vives-Mestres M. Anxiety, incentives, and adherence to self-monitoring on a mobile health platform: a naturalistic longitudinal cohort study in people with headache. Headache. Nov 18, 2018;58(10):1541-1555. [FREE Full text] [CrossRef] [Medline]
- Serlachius A, Schache K, Kieser A, Arroll B, Petrie K, Dalbeth N. Association between user engagement of a mobile health app for gout and improvements in self-care behaviors: randomized controlled trial. JMIR Mhealth Uhealth. Aug 13, 2019;7(8):e15021. [FREE Full text] [CrossRef] [Medline]
- Serper M, Barankay I, Chadha S, Shults J, Jones LS, Olthoff KM, et al. A randomized, controlled, behavioral intervention to promote walking after abdominal organ transplantation: results from the LIFT study. Transpl Int. Jun 12, 2020;33(6):632-643. [FREE Full text] [CrossRef] [Medline]
- Shaw RJ, Yang Q, Barnes A, Hatch D, Crowley MJ, Vorderstrasse A, et al. Self-monitoring diabetes with multiple mobile health devices. J Am Med Inform Assoc. May 01, 2020;27(5):667-676. [FREE Full text] [CrossRef] [Medline]
- Shebib R, Bailey JF, Smittenaar P, Perez DA, Mecklenburg G, Hunter S. Randomized controlled trial of a 12-week digital care program in improving low back pain. NPJ Digit Med. 2019;2:1. [FREE Full text] [CrossRef] [Medline]
- Shingleton RM, Pratt EM, Gorman B, Barlow DH, Palfai TP, Thompson-Brenner H. Motivational text message intervention for eating disorders: a single-case alternating treatment design using ecological momentary assessment. Behav Ther. May 2016;47(3):325-338. [CrossRef] [Medline]
- Siengsukon CF, Silveira Beck Jr E, Drerup M. Feasibility and treatment effect of a web-based cognitive behavioral therapy for insomnia program in individuals with multiple sclerosis: a pilot randomized controlled trial. Int J MS Care. 2021;23(3):107-113. [FREE Full text] [CrossRef] [Medline]
- Signal V, McLeod M, Stanley J, Stairmand J, Sukumaran N, Thompson D, et al. A mobile- and web-based health intervention program for diabetes and prediabetes self-management (BetaMe/Melon): process evaluation following a randomized controlled trial. J Med Internet Res. Dec 01, 2020;22(12):e19150. [FREE Full text] [CrossRef] [Medline]
- Slepian PM, Peng M, Janmohamed T, Kotteeswaran Y, Manoo V, Blades AM, et al. Engagement with manage my pain mobile health application among patients at the transitional pain service. Digit Health. Nov 2020;6(7):2055207620962297. [FREE Full text] [CrossRef] [Medline]
- Spring B, Pellegrini CA, Pfammatter A, Duncan JM, Pictor A, McFadden HG, et al. Effects of an abbreviated obesity intervention supported by mobile technology: the ENGAGED randomized clinical trial. Obesity (Silver Spring). Jul 2017;25(7):1191-1198. [FREE Full text] [CrossRef] [Medline]
- St-Jules DE, Woolf K, Goldfarb DS, Pompeii ML, Li H, Wang C, et al. Feasibility and acceptability of mHealth interventions for managing hyperphosphatemia in patients undergoing hemodialysis. J Ren Nutr. Jul 2021;31(4):403-410. [CrossRef] [Medline]
- Steare T, O'Hanlon P, Eskinazi M, Osborn D, Lloyd-Evans B, Jones R, et al. Smartphone-delivered self-management for first-episode psychosis: the ARIES feasibility randomised controlled trial. BMJ Open. Aug 26, 2020;10(8):e034927. [FREE Full text] [CrossRef] [Medline]
- Steinert A, Eicher C, Haesner M, Steinhagen-Thiessen E. Effects of a long-term smartphone-based self-monitoring intervention in patients with lipid metabolism disorders. Assist Technol. 2020;32(2):109-116. [CrossRef] [Medline]
- Stolz T, Schulz A, Krieger T, Vincent A, Urech A, Moser C, et al. A mobile app for social anxiety disorder: a three-arm randomized controlled trial comparing mobile and PC-based guided self-help interventions. J Consult Clin Psychol. Jun 2018;86(6):493-504. [CrossRef] [Medline]
- Strauss C, Dunkeld C, Cavanagh K. Is clinician-supported use of a mindfulness smartphone app a feasible treatment for depression? A mixed-methods feasibility study. Internet Interv. Sep 2021;25:100413. [FREE Full text] [CrossRef] [Medline]
- Stubbins R, He T, Yu X, Puppala M, Ezeana CF, Chen S, et al. A behavior-modification, clinical-grade mobile application to improve breast cancer survivors' accountability and health outcomes. JCO Clin Cancer Inform. Dec 2018;2:1-11. [FREE Full text] [CrossRef] [Medline]
- Su J, Dugas M, Guo X, Gao G. Influence of personality on mHealth use in patients with diabetes: prospective pilot study. JMIR Mhealth Uhealth. Aug 10, 2020;8(8):e17709. [FREE Full text] [CrossRef] [Medline]
- Sundström C, Gajecki M, Johansson M, Blankers M, Sinadinovic K, Stenlund-Gens E, et al. Guided and unguided internet-based treatment for problematic alcohol use - a randomized controlled pilot trial. PLoS One. 2016;11(7):e0157817. [FREE Full text] [CrossRef] [Medline]
- Swendeman D, Sumstine S, Aguilar E, Gorbach P, Comulada W, Gelberg L. Feasibility and acceptability of mobile phone self-monitoring and automated feedback to enhance telephone coaching for people with risky substance use: the QUIT-mobile pilot study. J Addict Med. Apr 01, 2021;15(2):120-129. [FREE Full text] [CrossRef] [Medline]
- Talboom-Kamp EP, Verdijk NA, Kasteleyn MJ, Harmans LM, Talboom IJ, Numans ME, et al. High level of integration in integrated disease management leads to higher usage in the e-Vita study: self-management of chronic obstructive pulmonary disease with web-based platforms in a parallel cohort design. J Med Internet Res. May 31, 2017;19(5):e185. [FREE Full text] [CrossRef] [Medline]
- Talboom-Kamp EP, Holstege MS, Chavannes NH, Kasteleyn MJ. Effects of use of an eHealth platform e-Vita for COPD patients on disease specific quality of life domains. Respir Res. Jul 10, 2019;20(1):146. [FREE Full text] [CrossRef] [Medline]
- Talboom-Kamp EP, Verdijk NA, Kasteleyn MJ, Harmans LM, Talboom IJ, Numans ME, et al. Effect of a combined education and eHealth programme on the control of oral anticoagulation patients (PORTALS study): a parallel cohort design in Dutch primary care. BMJ Open. Sep 27, 2017;7(9):e017909. [FREE Full text] [CrossRef] [Medline]
- Tighe J, Shand F, Ridani R, Mackinnon A, De La Mata N, Christensen H. Ibobbly mobile health intervention for suicide prevention in Australian Indigenous youth: a pilot randomised controlled trial. BMJ Open. Jan 27, 2017;7(1):e013518. [FREE Full text] [CrossRef] [Medline]
- Tincopa MA, Lyden A, Wong J, Jackson EA, Richardson C, Lok AS. Impact of a pilot structured mobile technology based lifestyle intervention for patients with nonalcoholic fatty liver disease. Dig Dis Sci. Feb 03, 2022;67(2):481-491. [FREE Full text] [CrossRef] [Medline]
- Tombor I, Beard E, Brown J, Shahab L, Michie S, West R. Randomized factorial experiment of components of the SmokeFree Baby smartphone application to aid smoking cessation in pregnancy. Transl Behav Med. Jul 16, 2019;9(4):583-593. [FREE Full text] [CrossRef] [Medline]
- Tsui JI, Leroux BG, Radick AC, Schramm ZA, Blalock K, Labelle C, et al. Video directly observed therapy for patients receiving office-based buprenorphine - a pilot randomized controlled trial. Drug Alcohol Depend. Oct 01, 2021;227:108917. [FREE Full text] [CrossRef] [Medline]
- Tu YZ, Chang YT, Chiou HY, Lai K. The effects of continuous usage of a diabetes management app on glycemic control in real-world clinical practice: retrospective analysis. J Med Internet Res. Jul 15, 2021;23(7):e23227. [FREE Full text] [CrossRef] [Medline]
- Turner-McGrievy GM, Wilcox S, Boutté A, Hutto BE, Singletary C, Muth ER, et al. The Dietary Intervention to Enhance Tracking with Mobile Devices (DIET Mobile) study: a 6-month randomized weight loss trial. Obesity (Silver Spring). Aug 2017;25(8):1336-1342. [FREE Full text] [CrossRef] [Medline]
- Van Blarigan EL, Chan H, Van Loon K, Kenfield SA, Chan JM, Mitchell E, et al. Self-monitoring and reminder text messages to increase physical activity in colorectal cancer survivors (Smart Pace): a pilot randomized controlled trial. BMC Cancer. Mar 11, 2019;19(1):218. [FREE Full text] [CrossRef] [Medline]
- Van Blarigan EL, Kenfield SA, Chan JM, Van Loon K, Paciorek A, Zhang L, et al. Feasibility and acceptability of a web-based dietary intervention with text messages for colorectal cancer: a randomized pilot trial. Cancer Epidemiol Biomarkers Prev. Apr 2020;29(4):752-760. [FREE Full text] [CrossRef] [Medline]
- Van Tiem J, Moeckli J, Suiter N, Fuhrmeister L, Pham K, Dindo L, et al. "A link to the outside:" patient perspectives on a mobile texting program to improve depression self-management. Patient Educ Couns. Sep 2021;104(9):2154-2158. [CrossRef] [Medline]
- Vorrink S, Huisman C, Kort H, Troosters T, Lammers J. Perceptions of patients with chronic obstructive pulmonary disease and their physiotherapists regarding the use of an eHealth intervention. JMIR Hum Factors. Sep 19, 2017;4(3):e20. [FREE Full text] [CrossRef] [Medline]
- Wadensten T, Nyström E, Franzén K, Lindam A, Wasteson E, Samuelsson E. A mobile app for self-management of urgency and mixed urinary incontinence in women: randomized controlled trial. J Med Internet Res. Apr 05, 2021;23(4):e19439. [FREE Full text] [CrossRef] [Medline]
- Ware P, Dorai M, Ross HJ, Cafazzo JA, Laporte A, Boodoo C, et al. Patient adherence to a mobile phone-based heart failure telemonitoring program: a longitudinal mixed-methods study. JMIR Mhealth Uhealth. Feb 26, 2019;7(2):e13259. [FREE Full text] [CrossRef] [Medline]
- Waselewski ME, Flickinger TE, Canan C, Harrington W, Franklin T, Otero KN, et al. A mobile health app to support patients receiving medication-assisted treatment for opioid use disorder: development and feasibility study. JMIR Form Res. Feb 23, 2021;5(2):e24561. [FREE Full text] [CrossRef] [Medline]
- Watterson JL, Rodriguez HP, Shortell SM, Aguilera A. Improved diabetes care management through a text-message intervention for low-income patients: mixed-methods pilot study. JMIR Diabetes. Oct 30, 2018;3(4):e15. [FREE Full text] [CrossRef] [Medline]
- Wei KS, Ibrahim NE, Kumar AA, Jena S, Chew V, Depa M, et al. Habits heart app for patient engagement in heart failure management: pilot feasibility randomized trial. JMIR Mhealth Uhealth. Jan 20, 2021;9(1):e19465. [FREE Full text] [CrossRef] [Medline]
- Werner-Seidler A, Wong Q, Johnston L, O'Dea B, Torok M, Christensen H. Pilot evaluation of the Sleep Ninja: a smartphone application for adolescent insomnia symptoms. BMJ Open. May 27, 2019;9(5):e026502. [FREE Full text] [CrossRef] [Medline]
- Wright AA, Raman N, Staples P, Schonholz S, Cronin A, Carlson K, et al. The HOPE pilot study: harnessing patient-reported outcomes and biometric data to enhance cancer care. JCO Clin Cancer Inform. Dec 2018;2:1-12. [FREE Full text] [CrossRef] [Medline]
- Xu R, Xing M, Javaherian K, Peters R, Ross W, Bernal-Mizrachi C. Improving HbA with glucose self-monitoring in diabetic patients with EpxDiabetes, a phone call and text message-based telemedicine platform: a randomized controlled trial. Telemed J E Health. Jun 01, 2020;26(6):784-793. [FREE Full text] [CrossRef] [Medline]
- Yanez B, Oswald LB, Baik SH, Buitrago D, Iacobelli F, Perez-Tamayo A, et al. Brief culturally informed smartphone interventions decrease breast cancer symptom burden among Latina breast cancer survivors. Psychooncology. Jan 15, 2020;29(1):195-203. [FREE Full text] [CrossRef] [Medline]
- Yang K, Oh D, Noh JM, Yoon HG, Sun J, Kim HK, et al. Feasibility of an interactive health coaching mobile app to prevent malnutrition and muscle loss in esophageal cancer patients receiving neoadjuvant concurrent chemoradiotherapy: prospective pilot study. J Med Internet Res. Aug 27, 2021;23(8):e28695. [CrossRef]
- Yang Q, Hatch D, Crowley MJ, Lewinski AA, Vaughn J, Steinberg D, et al. Digital phenotyping self-monitoring behaviors for individuals with type 2 diabetes mellitus: observational study using latent class growth analysis. JMIR Mhealth Uhealth. Jun 11, 2020;8(6):e17730. [FREE Full text] [CrossRef] [Medline]
- Yang Y, Lee EY, Kim HS, Lee SH, Yoon KH, Cho JH. Effect of a mobile phone-based glucose-monitoring and feedback system for type 2 diabetes management in multiple primary care clinic settings: cluster randomized controlled trial. JMIR Mhealth Uhealth. Feb 26, 2020;8(2):e16266. [FREE Full text] [CrossRef] [Medline]
- Yen S, Ranney ML, Tezanos KM, Chuong A, Kahler CW, Solomon JB, et al. Skills to enhance positivity in suicidal adolescents: results from an open development trial. Behav Modif. Mar 2019;43(2):202-221. [FREE Full text] [CrossRef] [Medline]
- Yingling L, Allen NA, Litchman ML, Colicchio V, Gibson BS. An evaluation of digital health tools for diabetes self-management in Hispanic adults: exploratory study. JMIR Diabetes. Jul 16, 2019;4(3):e12936. [FREE Full text] [CrossRef] [Medline]
- Yoo HJ, Suh EE. Effects of a smartphone-based self-care health diary for heart transplant recipients: a mixed methods study. Appl Nurs Res. Apr 2021;58:151408. [CrossRef] [Medline]
- You C, Chen Y, Chen CH, Lee C, Kuo P, Huang M, et al. Smartphone-based support system (SoberDiary) coupled with a bluetooth breathalyser for treatment-seeking alcohol-dependent patients. Addict Behav. Feb 2017;65:174-178. [CrossRef] [Medline]
- Young MD, Morgan PJ. Effect of a gender-tailored eHealth weight loss program on the depressive symptoms of overweight and obese men: pre-post study. JMIR Ment Health. Jan 09, 2018;5(1):e1. [FREE Full text] [CrossRef] [Medline]
- Zaslavsky O, Thompson HJ, McCurry SM, Landis CA, Kitsiou S, Ward TM, et al. Use of a wearable technology and motivational interviews to improve sleep in older adults with osteoarthritis and sleep disturbance: a pilot study. Res Gerontol Nurs. Jul 01, 2019;12(4):167-173. [FREE Full text] [CrossRef] [Medline]
- Zeng EY, Heffner JL, Copeland WK, Mull KE, Bricker JB. Get with the program: adherence to a smartphone app for smoking cessation. Addict Behav. Dec 2016;63:120-124. [FREE Full text] [CrossRef] [Medline]
- Zeng Y, Guo Y, Li L, Hong YA, Li Y, Zhu M, et al. Relationship between patient engagement and depressive symptoms among people living with HIV in a mobile health intervention: secondary analysis of a randomized controlled trial. JMIR Mhealth Uhealth. Oct 29, 2020;8(10):e20847. [FREE Full text] [CrossRef] [Medline]
- Zhang L, He X, Shen Y, Yu H, Pan J, Zhu W, et al. Effectiveness of smartphone app-based interactive management on glycemic control in Chinese patients with poorly controlled diabetes: randomized controlled trial. J Med Internet Res. Dec 09, 2019;21(12):e15401. [FREE Full text] [CrossRef] [Medline]
- Zhang S, Hamburger E, Kahanda S, Lyttle M, Williams R, Jaser SS. Engagement with a text-messaging intervention improves adherence in adolescents with type 1 diabetes: brief report. Diabetes Technol Ther. May 2018;20(5):386-389. [FREE Full text] [CrossRef] [Medline]
- Zhang Y, Liu C, Luo S, Huang J, Li X, Zhou Z. Effectiveness of Lilly Connected Care Program (LCCP) app-based diabetes education for patients with type 2 diabetes treated with insulin: retrospective real-world study. JMIR Mhealth Uhealth. Mar 06, 2020;8(3):e17455. [FREE Full text] [CrossRef] [Medline]
- Zhang Y, Liu C, Luo S, Huang J, Yang Y, Ma X, et al. Effectiveness of the family portal function on the Lilly Connected Care Program (LCCP) for patients with type 2 diabetes: retrospective cohort study with propensity score matching. JMIR Mhealth Uhealth. Feb 05, 2021;9(2):e25122. [FREE Full text] [CrossRef] [Medline]
- Zheng X, Spatz ES, Bai X, Huo X, Ding Q, Horak P, et al. Effect of text messaging on risk factor management in patients with coronary heart disease: the CHAT randomized clinical trial. Circ Cardiovasc Qual Outcomes. Apr 2019;12(4):e005616. [CrossRef] [Medline]
- Nguyen E, Bugno L, Kandah C, Plevinsky J, Poulopoulos N, Wojtowicz A, et al. Is there a good app for that? Evaluating m-Health apps for strategies that promote pediatric medication adherence. Telemed J E Health. Nov 2016;22(11):929-937. [CrossRef] [Medline]
- Carmody JK, Denson LA, Hommel KA. Content and usability evaluation of medication adherence mobile applications for use in pediatrics. J Pediatr Psychol. Apr 01, 2019;44(3):333-342. [FREE Full text] [CrossRef] [Medline]
- Hatem S, Long JC, Best S, Fehlberg Z, Nic Giolla Easpaig B, Braithwaite J. Mobile apps for people with rare diseases: review and quality assessment using mobile app rating scale. J Med Internet Res. Jul 26, 2022;24(7):e36691. [FREE Full text] [CrossRef] [Medline]
- Adherence to long-term therapies?: evidence for action. World Health Organization. 2003. URL: https://apps.who.int/iris/handle/10665/42682 [accessed 2024-06-18]
- Röhricht F, Padmanabhan R, Binfield P, Mavji D, Barlow S. Simple mobile technology health management tool for people with severe mental illness: a randomised controlled feasibility trial. BMC Psychiatry. Jul 16, 2021;21(1):357. [FREE Full text] [CrossRef] [Medline]
- Gordon K, Dainty KN, Steele Gray C, DeLacy J, Shah A, Resnick M, et al. Experiences of complex patients with telemonitoring in a nurse-led model of care: multimethod feasibility study. JMIR Nurs. Sep 29, 2020;3(1):e22118. [FREE Full text] [CrossRef] [Medline]
- Zha P, Qureshi R, Porter S, Chao Y, Pacquiao D, Chase S, et al. Utilizing a mobile health intervention to manage hypertension in an underserved community. West J Nurs Res. Mar 2020;42(3):201-209. [CrossRef] [Medline]
- McLeod C, Norman R, Litton E, Saville BR, Webb S, Snelling TL. Choosing primary endpoints for clinical trials of health care interventions. Contemp Clin Trials Commun. Dec 2019;16:100486. [FREE Full text] [CrossRef] [Medline]
Abbreviations
mHealth: mobile health |
PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses |
Edited by N Cahill; submitted 18.07.23; peer-reviewed by A Leichtle, W Wei, E Vashishtha, H Veldandi, A Bucher; comments to author 24.01.24; revised version received 27.02.24; accepted 29.07.24; published 24.09.24.
Copyright©Cyd Eaton, Natalie Vallejo, Xiomara McDonald, Jasmine Wu, Rosa Rodríguez, Nishanth Muthusamy, Nestoras Mathioudakis, Kristin A Riekert. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 24.09.2024.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research (ISSN 1438-8871), is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.