Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Journal Description

The Journal of Medical Internet Research (JMIR) is the pioneer open access eHealth journal, and is the flagship journal of JMIR Publications. It is a leading health services and digital health journal globally in terms of quality/visibility (Journal Impact Factor™ 5.8 (Clarivate, 2024)), ranking Q1 in both the 'Medical Informatics' and 'Health Care Sciences & Services' categories, and is also the largest journal in the field. The journal is ranked #1 on Google Scholar in the 'Medical Informatics' discipline. The journal focuses on emerging technologies, medical devices, apps, engineering, telehealth and informatics applications for patient education, prevention, population health and clinical care.

JMIR is indexed in all major literature indices including National Library of Medicine(NLM)/MEDLINE, Sherpa/Romeo, PubMed, PMCScopus, Psycinfo, Clarivate (which includes Web of Science (WoS)/ESCI/SCIE), EBSCO/EBSCO Essentials, DOAJ, GoOA and others. The Journal of Medical Internet Research received a CiteScore of 14.4, placing it in the 95th percentile (#7 of 138) as a Q1 journal in the field of Health Informatics. It is a selective journal complemented by almost 30 specialty JMIR sister journals, which have a broader scope, and which together receive over 10,000 submissions a year. 

As an open access journal, we are read by clinicians, allied health professionals, informal caregivers, and patients alike, and have (as with all JMIR journals) a focus on readable and applied science reporting the design and evaluation of health innovations and emerging technologies. We publish original research, viewpoints, and reviews (both literature reviews and medical device/technology/app reviews). Peer-review reports are portable across JMIR journals and papers can be transferred, so authors save time by not having to resubmit a paper to a different journal but can simply transfer it between journals. 

We are also a leader in participatory and open science approaches, and offer the option to publish new submissions immediately as preprints, which receive DOIs for immediate citation (eg, in grant proposals), and for open peer-review purposes. We also invite patients to participate (eg, as peer-reviewers) and have patient representatives on editorial boards.

As all JMIR journals, the journal encourages Open Science principles and strongly encourages publication of a protocol before data collection. Authors who have published a protocol in JMIR Research Protocols get a discount of 20% on the Article Processing Fee when publishing a subsequent results paper in any JMIR journal.

Be a widely cited leader in the digital health revolution and submit your paper today!

 

Recent Articles:

  • AI-generated image, in response to request "A abstract image illustrating 'Readdressing the Ongoing Challenge of Missing Data in Youth Ecological Momentary Assessment Studies: A Meta-Analysis Update." (Generator: DALL-E3/OpenAI August 23, 2024; Requestor: Konstantin Drexl). Source: Created with DALL-E, AN AI system by OpenAI; Copyright: N/A (AI_generated image); URL: https://www.jmir.org/2025/1/e65710/; License: Public Domain (CC0).

    Readdressing the Ongoing Challenge of Missing Data in Youth Ecological Momentary Assessment Studies: Meta-Analysis Update

    Abstract:

    Background: Ecological momentary assessment (EMA) is pivotal in longitudinal health research in youth, but potential bias associated with nonparticipation, omitted reports, or dropout threatens its clinical validity. Previous meta-analytic evidence is inconsistent regarding specific determinants of missing data. Objective: This meta-analysis aimed to update and expand upon previous research by examining key participation metrics—acceptance, compliance, and retention—in youth EMA studies. In addition, it sought to identify potential moderators among sample and design characteristics, with the goal of better understanding and mitigating the impact of missing data. Methods: We used a bibliographic database search to identify EMA studies involving children and adolescents published from 2001 to November 2023. Eligible studies used mobile-delivered EMA protocols in samples with an average age up to 18 years. We conducted separate meta-analyses for acceptance, compliance, and retention rates, and performed meta-regressions to address sample and design characteristics. Furthermore, we extracted and pooled sample-level effect sizes related to correlates of response compliance. Risk of publication bias was assessed using funnel plots, regression tests, and sensitivity analyses targeting inflated compliance rates. Results: We identified 285 samples, including 17,441 participants aged 5 to 17.96 years (mean age 14.22, SD 2.24 years; mean percentage of female participants 55.7%). Pooled estimates were 67.27% (k=88, 95% CI 62.39-71.96) for acceptance, 71.97% (k=216, 95% CI 69.83-74.11) for compliance, and 96.57% (k=169, 95% CI 95.42-97.56) for retention. Despite overall poor moderation of participation metrics, acceptance rates decreased as the number of EMA items increased (log-transformed b=−0.115, SE 0.036; 95% CI −0.185 to −0.045; P=.001; R2=19.98), compliance rates declined by 0.8% per year of publication (SE 0.25, 95% CI −1.3 to −0.3; P=.002; R2=4.17), and retention rates dropped with increasing study duration (log-transformed b=−0.061, SE 0.015; 95% CI −0.091 to 0.032; P<.001; R2=10.06). The benefits of monetary incentives on response compliance diminished as the proportion of female participants increased (b=−0.002, SE 0.001; 95% CI −0.003 to −0.001; P=.003; R2=9.47). Within-sample analyses showed a small but significant effect indicating higher compliance in girls compared to boys (k=25; g=0.18; 95% CI 0.06-0.31; P=.003), but no significant age-related effects were found (k=14; z score=0.05; 95% CI −0.01 to 0.16). Conclusions: Despite a 5-fold increase in included effect sizes compared to the initial review, the variability in rates of missing data that one can expect based on specific sample and design characteristics remains substantial. The inconsistency in identifying robust moderators highlights the need for greater attention to missing data and its impact on study results. To eradicate any health-related bias in EMA studies, researchers should collectively increase transparent reporting practices, intensify primary methodological research, and involve participants’ perspectives on missing data. Clinical Trial: PROSPERO CRD42022376948; https://www.crd.york.ac.uk/PROSPERO/view/CRD42022376948

  • Source: Freepik; Copyright: pressfoto; URL: https://www.freepik.com/free-photo/top-view-unrecognizable-hacker-performing-cyberattack-night_5698343.htm; License: Licensed by JMIR.

    Accuracy of Large Language Models When Answering Clinical Research Questions: Systematic Review and Network Meta-Analysis

    Abstract:

    Background: Large language models (LLMs) have flourished and gradually become an important research and application direction in the medical field. However, due to the high degree of specialization, complexity, and specificity of medicine, which results in extremely high accuracy requirements, controversy remains about whether LLMs can be used in the medical field. More studies have evaluated the performance of various types of LLMs in medicine, but the conclusions are inconsistent. Objective: This study uses a network meta-analysis (NMA) to assess the accuracy of LLMs when answering clinical research questions to provide high-level evidence-based evidence for its future development and application in the medical field. Methods: In this systematic review and NMA, we searched PubMed, Embase, Web of Science, and Scopus from inception until October 14, 2024. Studies on the accuracy of LLMs when answering clinical research questions were included and screened by reading published reports. The systematic review and NMA were conducted to compare the accuracy of different LLMs when answering clinical research questions, including objective questions, open-ended questions, top 1 diagnosis, top 3 diagnosis, top 5 diagnosis, and triage and classification. The NMA was performed using Bayesian frequency theory methods. Indirect intercomparisons between programs were performed using a grading scale. A larger surface under the cumulative ranking curve (SUCRA) value indicates a higher ranking of the corresponding LLM accuracy. Results: The systematic review and NMA examined 168 articles encompassing 35,896 questions and 3063 clinical cases. Of the 168 studies, 40 (23.8%) were considered to have a low risk of bias, 128 (76.2%) had a moderate risk, and none were rated as having a high risk. ChatGPT-4o (SUCRA=0.9207) demonstrated strong performance in terms of accuracy for objective questions, followed by Aeyeconsult (SUCRA=0.9187) and ChatGPT-4 (SUCRA=0.8087). ChatGPT-4 (SUCRA=0.8708) excelled at answering open-ended questions. In terms of accuracy for top 1 diagnosis and top 3 diagnosis of clinical cases, human experts (SUCRA=0.9001 and SUCRA=0.7126, respectively) ranked the highest, while Claude 3 Opus (SUCRA=0.9672) performed well at the top 5 diagnosis. Gemini (SUCRA=0.9649) had the highest rated SUCRA value for accuracy in the area of triage and classification. Conclusions: Our study indicates that ChatGPT-4o has an advantage when answering objective questions. For open-ended questions, ChatGPT-4 may be more credible. Humans are more accurate at the top 1 diagnosis and top 3 diagnosis. Claude 3 Opus performs better at the top 5 diagnosis, while for triage and classification, Gemini is more advantageous. This analysis offers valuable insights for clinicians and medical practitioners, empowering them to effectively leverage LLMs for improved decision-making in learning, diagnosis, and management of various clinical scenarios. Trial Registration: PROSPERO CRD42024558245; https://www.crd.york.ac.uk/PROSPERO/view/CRD42024558245

  • Source: freepik; Copyright: freepik; URL: https://www.freepik.com/free-photo/anxious-man-indoors-front-view_32407617.htm; License: Licensed by JMIR.

    Potential Harms of Feedback After Web-Based Depression Screening: Secondary Analysis of Negative Effects in the Randomized Controlled DISCOVER Trial

    Abstract:

    Background: Web-based depression screening followed by automated feedback of results is frequently used and promoted by mental health care providers. However, criticism points to potential associated harms. Systematic empirical evidence on postulated negative effects is missing. Objective: We aimed to examine whether automated feedback after web-based depression screening is associated with misdiagnosis, mistreatment, deterioration in depression severity, deterioration in emotional response to symptoms, and deterioration in suicidal ideation at 1 and 6 months after screening. Methods: This is a secondary analysis of the German-wide, web-based, randomized controlled DISCOVER trial. Affected but undiagnosed individuals screening positive for depression (9-item Patient Health Questionnaire [PHQ-9] ≥10 points) were randomized 1:1:1 to receive nontailored feedback, tailored feedback, or no feedback on their screening result. Misdiagnosis and mistreatment were operationalized as having received a depression diagnosis by a health professional and as having started guideline-based depression treatment since screening (self-report), respectively, while not having met the Diagnostic and Statistical Manual of Mental Disorders (Fifth Edition) (DSM-V) criteria of a major depressive disorder at baseline (Structured Clinical Interview for DSM-V Disorders). Deterioration in depression severity was defined as a pre-post change of ≥4.4 points in the PHQ-9, deterioration in emotional response to symptoms as a pre-post change of ≥3.1 points in a composite scale of the Brief Illness Perception Questionnaire, and deterioration in suicidal ideation as a pre-post change of ≥1 point in the PHQ-9 suicide item. Outcome rates were compared between each feedback arm and the no feedback arm in terms of relative risks (RRs). Results: In the per protocol sample of 948 participants (n=685, 72% female; mean age of 37.3, SD 14.1 years), there was no difference in rates of misdiagnosis (ranging from 3.5% to 4.9% across all study arms), mistreatment (7.2%-8.3%), deterioration in depression severity (2%-6.8%), deterioration in emotional response (0.7%-2.9%), and deterioration in suicidal ideation at 6 months (6.8%-13.1%) between the feedback arms and the no feedback arm (RRs ranging from 0.46 to 1.96; P values ≥.13). The rate for deterioration in suicidal ideation at 1 month was increased in the nontailored feedback arm (RR 1.92; P=.01) but not in the tailored feedback arm (RR 1.26; P=.43), with rates of 12.3%, 8.1%, and 6.4% in the nontailored, tailored, and no feedback arms, respectively. All but 1 sensitivity analyses as well as subgroup analyses for false-positive screens supported the findings. Conclusions: The results indicate that feedback after web-based depression screening is not associated with negative effects such as misdiagnosis, mistreatment, and deterioration in depression severity or in emotional response to symptoms. However, it cannot be ruled out that nontailored feedback may increase the risk of deterioration in suicidal ideation. Robust prospective research on negative effects and particularly suicidal ideation is needed and should inform current practice. Trial Registration: ClinicalTrials.gov NCT04633096; https://clinicaltrials.gov/study/NCT04633096; Open Science Framework 10.17605/OSF.IO/TZYRD; https://osf.io/tzyrd

  • Source: Freepik; Copyright: freepik; URL: https://www.freepik.com/free-photo/medical-record-report-healthcare-document-concept_17076148.htm; License: Licensed by JMIR.

    Harnessing an Artificial Intelligence–Based Large Language Model With Personal Health Record Capability for Personalized Information Support in Postsurgery...

    Abstract:

    Background: Myocardial infarction (MI) remains a leading cause of morbidity and mortality worldwide. Although postsurgical cardiac interventions have improved survival rates, effective management during recovery remains challenging. Traditional informational support systems often provide generic guidance that does not account for individualized medical histories or psychosocial factors. Recently, artificial intelligence (AI)–based large language models (LLM) tools have emerged as promising interventions to deliver personalized health information to post-MI patients. Objective: We aim to explore the user experiences and perceptions of an AI-based LLM tool (iflyhealth) with integrated personal health record functionality in post-MI care, assess how patients and their family members engaged with the tool during recovery, identify the perceived benefits and challenges of using the technology, and to understand the factors promoting or hindering continued use. Methods: A purposive sample of 20 participants (12 users and 8 nonusers) who underwent MI surgery within the previous 6 months was recruited between July and August 2024. Data were collected through semistructured, face-to-face interviews conducted in a private setting, using an interview guide to address participants’ first impressions, usage patterns, and reasons for adoption or nonadoption of the iflyhealth app. The interviews were audio-recorded, transcribed verbatim, and analyzed using Colaizzi method. Results: Four key themes revealed included: (1) participants’ experiences varied based on digital literacy, prior exposure to health technologies, and individual recovery needs; (2) users appreciated the app’s enhanced accessibility to professional health information, personalized advice tailored to their clinical conditions, and the tool’s responsiveness to health status changes; (3) challenges such as difficulties with digital literacy, usability concerns, and data privacy issues were significant barriers; and (4) nonusers and those who discontinued use primarily cited complexity of the interface and perceived limited relevance of the advice as major deterrents. Conclusions: iflyhealth, an LLM AI app with a built-in personal health record functionality, shows significant potential in assisting post-MI patients. The main benefits reported by iflyhealth users include improved access to personalized health information and an enhanced ability to respond to changing health conditions. However, challenges such as digital literacy, usability, and privacy and security concerns persist. Overcoming the barriers may further enhance the use of the iflyhealth app, which can play an important role in patient-centered, personalized post-MI management. Trial Registration:

  • Source: freepik; Copyright: Freepik; URL: https://www.freepik.com/free-photo/medical-banner-with-woman-wearing-vr-glasses_30555933.htm; License: Licensed by JMIR.

    The Influence of Previous Experience on Virtual Reality Adoption in Medical Rehabilitation and Overcoming Knowledge Gaps Among Health Care Professionals:...

    Abstract:

    Background: Virtual reality (VR) technologies in health care, particularly in medical rehabilitation, have demonstrated effectiveness by enabling patient remobilization in virtual environments, offering real-time feedback, enhancing physical function and quality of life, and allowing patients to exercise autonomously. Nevertheless, VR technologies are facing slow adoption in routine rehabilitative practice due to health care professionals’ concerns regarding data security, lack of time, or perceived cost. Objective: This study aimed to explore how previous experience with VR technologies influences health care professionals’ decisions to adopt or reject these technologies in medical rehabilitation. Methods: We conducted 23 semistructured interviews with health care professionals from different rehabilitative fields in Germany, whom we grouped into VR-experienced “innovators” and nonexperienced “laggards” according to their level of innovativeness. When analyzing the interviews, we applied qualitative content analysis techniques and derived 56 preliminary categories from the transcripts. Results: We merged the preliminary categories into 26 adoption and rejection factors, which were grouped under the 4 overarching categories of the diffusion of innovation theory by Rogers. In addition to the pure identification of context-specific influencing factors, we were able to identify differences between these factors concerning the two different adopter groups. VR-experienced innovators exhibited key characteristics such as openness to new technologies, solution-oriented thinking, and opinion leadership, whereas nonexperienced laggards focused on barriers and relied on top-down knowledge transfer. Despite these differences, both groups agreed on the factors that promote the adoption of VR technologies. Our results indicate that addressing the unique needs of both groups is crucial for wider VR acceptance in health care. Conclusions: This study demonstrates the importance of distinguishing between VR-experienced and nonexperienced health care professionals, providing actionable insights for developing adopter-specific communication strategies to overcome barriers and foster broader diffusion of VR technologies in the health care sector.

  • Source: Freepik; Copyright: Freepik; URL: https://www.freepik.com/free-photo/mom-teaching-child-use-phone_6364978.htm; License: Licensed by JMIR.

    Mobile Health Interventions for Modifying Indigenous Maternal and Child–Health Related Behaviors: Systematic Review

    Abstract:

    Background: Mobile health (mHealth) interventions promoting healthy lifestyle changes offer an adaptable and inexpensive method for accessing health information but require cultural appropriateness and suitability for acceptance and effectiveness in Indigenous populations. No systematic review on effective mHealth interventions for Indigenous women during pregnancy and the early childhood years has been conducted. Objective: This review evaluated the effectiveness of mHealth interventions promoting healthy behaviors for Indigenous mothers and children from conception to 5 years post partum. It also aimed to explore the observed effectiveness differences based on participant engagement, intervention design, and provision of context. Further, the review explored if the interventions were co-designed. Methods: A systematic search of 5 databases was conducted: SCOPUS, MEDLINE, CINAHL, PsycINFO, and ProQuest (Dissertation or Thesis). Studies were included if they were either a randomized controlled trial, pre-post comparison, or a cohort study using mHealth with Indigenous women for maternal and child health following a preregistered PROSPERO protocol (CRD42023395710). HealthInfoNet was searched for gray literature and the reference lists of included studies were hand searched. The initial title and abstract screen for eligibility were performed by 1 reviewer. A full-text screen of eligible studies and a quality appraisal of included studies was performed by 2 reviewers independently. The appraisal tools used were the Mixed Methods Quality Appraisal Tool and the Centre of Excellence in Aboriginal Chronic Disease Knowledge Translation and Exchange (CREATE). A descriptive synthesis of the extracted data was performed. Results: Of the 663 articles screened, only 3 met the eligibility criteria. Each paper evaluated a different mHealth intervention: Remote Prenatal Education; the SMS Parent Action Intervention (two-way text messaging); and the Screening, Brief Intervention and Referral to Treatment (SBIRT) eCHECKUP To Go (web-based screening and intervention). Statistically significant changes were reported in some outcomes, including an increase in the parental participation rate in face-to-face prenatal education; increased rate of breastfeeding initiation and exclusive breastfeeding (2-12 months); improved overall children’s behavior related to sleep, diet, physical activity, screen time, and intake of sugary beverages; improved individual children’s behavior related to physical activity and sleep; and decrease in alcohol drinks per week and binge drinking episodes per 2 weeks due to time effect. However, no study provided a sample size calculation for the reported significant outcomes. Also, due to the small number of included studies and each study evaluating a different intervention, it was not possible to combine results to ascertain if the participant engagement, intervention design, or community context had any impact on the effectiveness. Conclusions: Due to the lack of sample size calculation, it was not possible to establish whether differences in the effectiveness were due to the interventions or a type I statistical error. Therefore, caution is required in the interpretation of these findings. Trial Registration: PROSPERO CRD42023395710; https://www.crd.york.ac.uk/PROSPERO/view/CRD42023395710

  • Source: freepik; Copyright: freepik; URL: https://www.freepik.com/free-photo/man-with-vr-glasses-couch_14962082.htm; License: Licensed by JMIR.

    Effects of Virtual Reality–Based Interventions on Preoperative Anxiety in Patients Undergoing Elective Surgery With Anesthesia: Systematic Review and...

    Abstract:

    Background: Preoperative anxiety is a common yet often neglected problem for patients undergoing surgery. Virtual reality (VR)–based intervention is a promising alternative with benefits for managing preoperative anxiety. However, the components of VR-based intervention and its effectiveness on preoperative anxiety in patients undergoing elective surgery with anesthesia remain unclear. Objective: This study aimed to identify the major components (ie, device, medium, format, and duration) of VR-based interventions and summarize evidence regarding their effectiveness in reducing preoperative anxiety in patients undergoing elective surgery with anesthesia. Methods: Allied and Complementary Medicine, Chinese University of Hong Kong Full Text Journals, CINAHL via EBSCOhost, Cochrane Library, Joanna Briggs Institute EBP Database, EMBASE, MEDLINE via OvidSP, PubMed, PsychINFO, Scopus, China Journal Net, and WanFang Data Chinese Dissertations Database were searched from inception to February 2025. Randomized controlled trials (RCTs) of VR-based interventions for patients undergoing elective surgery with anesthesia were included. The Cochrane Collaboration’s tool was used for risk of bias assessment. A random effect model was used for pooling the results. Results: A total of 35 RCTs with 3341 patients (female: n=1474, 44.1%) were included in this review, of which 29 RCTs were included for meta-analysis. Compared with usual care, VR-based interventions showed substantial benefits in decreasing preoperative anxiety in patients undergoing elective surgery (standardized mean difference [SMD] 0.65, 95% CI 0.37-0.92; P<.001). Regarding the subgroup analysis, VR-based intervention showed significant but moderate effects on preoperative anxiety in the pediatric population (SMD 0.77, 95% CI 0.32-1.22; P<.001) compared to the adult population (SMD 0.58, 95% CI 0.23-0.93; P=.001). The distraction approach showed more significant effects (SMD 0.73, 95% CI 0.24-1.21; P=.004) on preoperative anxiety than the exposure approach (SMD 0.61, 95% CI 0.27-0.95; P<.001). Conclusions: Patients undergoing elective surgery with anesthesia may benefit from VR as a novel alternative to reduce preoperative anxiety, especially pediatric patients via the distraction approach. However, more rigorous research is needed to confirm VR’s effectiveness.

  • mHealth real-world implementation. Source: Freepik; Copyright: peoplecreations; URL: https://www.freepik.com/free-photo/male-doctor-discussing-with-patient-digital-tablet_1008361.htm; License: Licensed by JMIR.

    Real-World Mobile Health Implementation and Patient Safety: Multicenter Qualitative Study

    Abstract:

    Background: Mobile health (mHealth) is increasingly being used in contemporary health care provision owing to its portability, accessibility, ability to facilitate communication, improved interprofessional collaboration, and benefits for health outcomes. However, there is limited discourse on patient safety in real-world mHealth implementation, especially as care settings extend beyond traditional center-based technology usage to home-based care. Objective: This study aimed to explore health care professionals’ perspectives on the safety aspects of mHealth integration in real-world service provision, focusing on Hong Kong Special Administrative Region (SAR) and Wuhan city in mainland China. In Hong Kong SAR, real-world mHealth care provision is largely managed by the Hospital Authority, which has released various mobile apps for home-based care, such as Stoma Care, Hip Fracture, and HA Go. In contrast, mHealth care provision in Wuhan is institutionally directed, with individual hospitals or departments using consultation apps, WeChat mini-programs, and the WeChat Official Accounts Platform (a subapp within the WeChat ecosystem). Methods: A multicenter qualitative study design was used. A total of 27 participants, including 22 nurses and 5 physicians, from 2 different health care systems were interviewed individually. Thematic analysis was used to analyze the data. Results: The mean age of the participants was 32.19 (SD 3.74) years, and the mean working experience was 8.04 (SD 4.05) years. Most participants were female (20/27, 74%). Nearly half of the participants had a bachelor’s degree (13/27, 48%), some had a master’s degree (9/27, 33%), and few had a diploma degree (3/27, 11%) or a doctoral degree (2/27, 7%). Four themes emerged from the data analysis. Considering the current uncertainties surrounding mHealth implementation, participants emphasized “liability” concerns when discussing patient safety. They emphasized the need for “change management,” which includes appropriate referral processes, adequate resources and funding, informed mHealth usage, and efficient working processes. They cautioned about the risks in providing mHealth information without ensuring understanding, appreciated the current regulations available, and identified additional regulations that should be considered to ensure information security. Conclusions: As health care systems increasingly adopt mHealth solutions globally to enhance both patient care and operational efficiency, it becomes crucial to understand the implications for patient safety in these new care models. Health care professionals recognized the importance of patient safety in making mHealth usage reliable and sustainable. The promotion of mHealth should be accompanied by the standardization of mHealth services with institutional, health care system, and policy-level support. This includes fostering mHealth acceptance among health care professionals to encourage appropriate referrals, accommodate changes, ensure patient comprehension, and proactively identify and address threats to information security.

  • Photograph of a medical consultation conducted via telehealth at one of the Primary Healthcare Units participating in the study. Source: Image created by the authors; Copyright: The Authors; URL: https://www.jmir.org/2025/1/e68434/; License: Creative Commons Attribution (CC-BY).

    Telehealth Initiative to Enhance Primary Care Access in Brazil (UBS+Digital Project): Multicenter Prospective Study

    Abstract:

    Background: Brazil faces significant inequities in health care access, particularly in remote communities. The Brazilian Unified Health System is struggling to deliver adequate health care to its vast population. Telehealth, regulated in Brazil starting in 2022, emerged as a solution to improve access and quality of care. Thus, the Hospital das Clínicas da Faculdade de Medicina da Universidade de São Paulo, in partnership with the Agência Brasileira de Apoio à Gestão do Sistema Único de Saúde, created the Unidade Básica de Saúde (UBS)+Digital project, which aimed to mitigate the lack of medical care in remote areas of Brazil by providing teleconsultation in primary health units (PHUs) across the country. Through teletraining and digital health strategies, the initiative enabled health care professionals to provide remote assistance, improving access to medical care. Objective: To describe the implementation and results of the UBS+Digital project, a telehealth initiative focused on training health care professionals, providing teleconsultations, and monitoring key performance indicators among PHUs in Brazil. Methods: The study examined 15 Brazilian PHUs using a multicenter, prospective design. Data were collected through anonymous surveys of patients and physicians, which were recorded in the REDCap (Research Electronic Data Capture) database. PHUs were selected based on criteria such as the absence of an on-site physician and existing technological infrastructure. Synchronous and asynchronous training was provided, focusing on digital health and teleconsultation skills. In loco training included workshops and community events to share experiences and foster local engagement. A community of practice facilitated ongoing knowledge exchange. Teleconsultations followed the person-centered clinical method and Calgary-Cambridge methodology. Key performance indicators were monitored by a dashboard to guide continuous improvement. The transition of operations was managed based on physician availability and project duration. Microcosting analysis assessed the project’s economic impact using Brazilian guidelines, with statistical analysis performed using Jamovi software. Results: From March to November 2023, the project conducted 6312 telehealth sessions. A total of 342 professionals were trained, including participants from all three training modalities that were implemented. The Net Promoter Score for teleconsultations was 97, indicating excellent service quality. Of the teleconsultations, 65.3% (4009/6140) were prescheduled, and 34.7% (2130/6140) were on demand, depending on the family health team organization. Teleconsultations resolved 85% (5219/6140) of cases, with 15% (921/6140) requiring in-person referrals or emergency care. The average absenteeism rate was 15% (1083/7223), and consultation durations were between 15 and 20 minutes, suggesting potential adjustments in scheduling. Conclusions: The results highlight the effectiveness of telehealth programs in primary care settings with limited medical professionals. The UBS+Digital project demonstrated that telehealth can enhance health care access, presenting a pioneering model within the Brazilian Unified Health System for digital primary care.

  • Source: Freepik; Copyright: freepik; URL: https://www.freepik.com/free-photo/medium-shot-group-friends-phones_10175408.htm; License: Licensed by JMIR.

    Social Media Activities With Different Content Characteristics and Adolescent Mental Health: Cross-Sectional Survey Study

    Abstract:

    Background: Adolescent mental health concerns are rising in the United States, with social media often cited as a contributing factor, although research findings remain mixed. A key limitation is the simplistic view of social media use, which fails to consistently predict well-being. Scholars call for a more nuanced framework and a better understanding of how social media use influences adolescent mental health through various psychosocial mechanisms. Objective: Using the Multidimensional Model of Social Media Use, we explored how 4 activities with various content characteristics (intimate directed communication, intimate broadcasting, positive broadcasting, and positive content consumption) are associated with depression and anxiety through 3 psychosocial mediators: social support, approval anxiety, and social comparison. Methods: Cross-sectional survey data were collected through Qualtrics’ panel service from a sample of adolescents whose gender and racial or ethnic distributions were nationally representative (N=2105; mean age 15.39, SD 1.82 years). Participants passed attention checks to ensure data validity. Measures included 9 validated scales (Cronbach α=0.83-0.91): 4 social media activities (intimate directed communication, intimate broadcasting, positive broadcasting, and positive content consumption), 3 mediators (social support, approval anxiety, and social comparison), and 2 mental health outcomes (depression and anxiety). Using Mplus, we performed 2-step structural equation modeling. Confirmatory factor analysis established scale validity, and path analysis tested the hypothesized and exploratory associations between social media activities, mediators, and mental health, controlling for demographic covariates and the amount of phone use. Model fit criteria (comparative fit index and Tucker-Lewis index were close to or greater than 0.95; root mean square error of approximation was less than 0.08) were met. Significance was determined using a false discovery rate control, with the familywise type 1 error rate set at 0.05. Results: Our findings showed that positive broadcasting was associated with lower depression (β=–.14; P<.001) and anxiety (β=–.06; P=.03), mainly through the direct paths. The other 3 activities were related to more mental health problems. Specifically, intimate directed communication was associated with greater depression (β=.06; P=.03) and anxiety (β=.06; P=.04); intimate broadcasting was associated with greater anxiety (β=.07; P=.02); and positive content consumption was related to higher depression (β=.13; P<.001). Approval anxiety or social comparison played a salient role in these total effects. Conclusions: The findings highlight the importance of distinguishing social media activities when assessing risks and benefits. Intimate directed communication, intimate broadcasting, and positive content consumption became risk factors for increased anxiety and depression through approval anxiety, social comparison, or both. Positive broadcasting was related to better mental health because of its direct associations with lower depression and anxiety.

  • Source: Freepik; Copyright: Freepik; URL: https://www.freepik.com/free-photo/person-working-html-computer_36190665.htm; License: Licensed by JMIR.

    A System Model and Requirements for Transformation to Human-Centric Digital Health

    Abstract:

    Digital transformation is widely understood as a process where technology is used to modify an organization’s products and services and to create new ones. It is rapidly advancing in all sectors of society. Researchers have shown that it is a multidimensional process determined by human decisions based on ideologies, ideas, beliefs, goals, and the ways in which technology is used. In health care and health, the end result of digital transformation is digital health. In this study, a detailed literature review covering 560 research articles published in major journals was performed, followed by an analysis of ideas, beliefs, and goals guiding digital transformation and their possible consequences for privacy, human rights, dignity, and autonomy in health care and health. Results of literature analyses demonstrated that from the point of view of privacy, dignity, and human rights, the current laws, regulations, and system architectures have major weaknesses. One possible model of digital health is based on the dominant ideas and goals of the business world related to the digital economy and neoliberalism, including privatization of health care services, monetization and commodification of health data, and personal responsibility for health. These ideas represent meaningful risks to human rights, privacy, dignity, and autonomy. In this paper, we present an alternative solution for digital health called human-centric digital health (HCDH). Using system thinking and system modeling methods, we developed a system model for HCDH. It uses 5 views (ideas, health data, principles, regulation, and organizational and technical innovations) to align with human rights and values and support dignity, privacy, and autonomy. To make HCDH future proof, extensions to human rights, the adoption of the principle of restricted informational ownership of health data, and the development of new duties, responsibilities, and laws are needed. Finally, we developed a system-oriented, architecture-centric, ontology-based, and policy-driven approach to represent and manage HCDH ecosystems.

  • Source: The authors / Mockupbro; Copyright: The authors / Mockupbro; URL: https://www.jmir.org/2025/1/e64007/; License: Licensed by the authors.

    Uncovering Social States in Healthy and Clinical Populations Using Digital Phenotyping and Hidden Markov Models: Observational Study

    Abstract:

    Background: Brain-related disorders are characterized by observable behavioral symptoms, for example, social withdrawal. Smartphones can passively collect behavioral data reflecting digital activities such as communication app usage and calls. These data are collected objectively in real time, avoiding recall bias, and may, therefore, be a useful tool for measuring behaviors related to social functioning. Despite promising clinical utility, analyzing smartphone data is challenging as datasets often include a range of temporal features prone to missingness. Objective: Hidden Markov models (HMMs) provide interpretable, lower-dimensional temporal representations of data, allowing for missingness. This study aimed to investigate the HMM as a method for modeling smartphone time series data. Methods: We applied an HMM to an aggregate dataset of smartphone measures designed to assess phone-related social functioning in healthy controls (HCs) and participants with schizophrenia, Alzheimer disease (AD), and memory complaints. We trained the HMM on a subset of HCs (91/348, 26.1%) and selected a model with socially active and inactive states. Then, we generated hidden state sequences per participant and calculated their “total dwell time,” that is, the percentage of time spent in the socially active state. Linear regression models were used to compare the total dwell time to social and clinical measures in a subset of participants with available measures, and logistic regression was used to compare total dwell times between diagnostic groups and HCs. We primarily reported results from a 2-state HMM but also verified results in HMMs with more hidden states and trained on the whole participant dataset. Results: We identified lower total dwell times in participants with AD (26/257, 10.1%) versus withheld HCs (156/257, 60.7%; odds ratio 0.95, 95% CI 0.92-0.97; false discovery rate [FDR]–corrected P<.001), as well as in participants with memory complaints (57/257, 22.2%; odds ratio 0.97, 95% CI 0.96-0.99; FDR-corrected P=.004). The result in the AD group was very robust across HMM variations, whereas the result in the memory complaints group was less robust. We also observed an interaction between the AD group and total dwell time when predicting social functioning (FDR-corrected P=.02). No significant relationships regarding total dwell time were identified for participants with schizophrenia (18/257, 7%; P>.99). Conclusions: We found the HMM to be a practical, interpretable method for digital phenotyping analysis, providing an objective phenotype that is a possible indicator of social functioning.

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Latest Submissions Open for Peer-Review:

View All Open Peer Review Articles
  • Bridging the AI-literacy gap in healthcare: a qualitative analysis of the Flanders case-study

    Date Submitted: Apr 29, 2025

    Open Peer Review Period: Apr 30, 2025 - Jun 25, 2025

    Background: The integration of Artificial Intelligence (AI) in healthcare is advancing rapidly, promising to enhance clinical decision-making, streamline administrative tasks, and personalize patient...

    Background: The integration of Artificial Intelligence (AI) in healthcare is advancing rapidly, promising to enhance clinical decision-making, streamline administrative tasks, and personalize patient care. However, many healthcare professionals report a lack of confidence in understanding, critically evaluating, and ethically applying AI technologies. In regions like Flanders, Belgium—recognized for innovation yet facing moderate lifelong learning participation—these challenges are pronounced, especially amid an aging healthcare workforce and resource disparities between professions. Objective: This study aimed to explore the requirements, obstacles, and prospects of AI adoption among healthcare professionals, and to identify the specific training priorities needed to bridge the AI-literacy gap in clinical practice in the Flanders region. Methods: A multi-stage qualitative methodology was employed. First, 15 semi-structured interviews with key informants were conducted to inform the survey design. Then, a survey was distributed to healthcare professionals across Flanders, gathering 134 valid responses. Finally, three focus groups involving 39 participants were conducted to co-interpret the survey findings. Thematic analysis and descriptive statistics were used to synthesize insights across stages. Results: Healthcare professionals recognized AI’s potential to reduce administrative burdens and enhance clinical care but reported low self-perceived AI literacy, especially among older and non-physician staff. Interest in AI training was high, particularly for practical applications and basic AI knowledge, rather than technical coding or standalone ethics courses. Differences emerged based on occupation, age, and perceived job security. Nurses and younger professionals were especially concerned about the risks and opportunities of AI adoption. A lack of legally approved AI tools and practical hands-on training were identified as major barriers. Focus group discussions highlighted disparities in access to AI training between doctors and nurses, skepticism about private-sector-led courses, and the need for hospital management support in facilitating AI education. Conclusions: A one-size-fits-all approach to AI training in healthcare is inadequate. Training programs must be stratified by occupation, age, and resource availability, emphasizing immediate practical applications while embedding ethical considerations within broader curricula. Addressing barriers to training accessibility and clarifying regulatory frameworks will be crucial to scaling AI integration in healthcare systems, starting in Flanders and potentially informing broader European initiatives under frameworks like the EU AI Act.

  • The feasibility and effectiveness of smartwatch device on the adherence to the home-based cardiac rehabilitation in patients with coronary heart disease: A randomized controlled trial.

    Date Submitted: Apr 29, 2025

    Open Peer Review Period: Apr 30, 2025 - Jun 25, 2025

    Background: Digital technologies have the potential to address many of the challenges associated with the traditional center-based CR (CBCR), but the remote home-based cardiac rehabilitation(HBCR) mod...

    Background: Digital technologies have the potential to address many of the challenges associated with the traditional center-based CR (CBCR), but the remote home-based cardiac rehabilitation(HBCR) model remains a challenge. Objective: This study is designed to investigate the feasibility, and efficacy of a smartwatch-facilitated HBCR model in patients with coronary heart disease (CHD). Methods: It was a single-center, randomized, non-blind, and parallel-controlled study. We recruited patients aged 18 years or older with coronary heart disease from a tertiary hospital in Jilin Province, China. The intervention group received a 3-month smartwatch-based HBCR program involving remotely delivered real-time feedback, supervision, and education. The control group received conventional HBCR. Adherence is the primary outcome of the trial, assessed by the Home-Based Cardiac Rehabilitation Exercise Adherence Scale. The secondary outcomes include cardiopulmonary function, measured by cardiopulmonary exercise testing, anxiety (General Anxiety Disorder-7), depression(Patient Health Questionnaire-9), and quality of life (36-Item Short Form Health Survey) at 3 months. Results: Between January 1, 2023, and December 30, 2023, 62 patients (mean age 59.93±10.06 years), of whom 33.3% were female and 66.% were male, were recruited and subsequently randomly assigned to the smartwatch group (n=32) or control group (n=30). No difference was detected in the baseline characteristics between the two groups. After the intervention, the subjects in the smartwatch group performed significantly better in peak VO2, home-based cardiac rehabilitation adherence, GAD-7, PHQ-9, and some other parameters than those in the control group. Conclusions: This feasibility study showed that the smartwatch device was well-accepted and effective in supporting a home-based cardiac rehabilitation model for patients with coronary heart disease (CHD). Clinical Trial: ChiCTR2400088039; https://www.chictr.org.cn/bin/project/edit?pid=215602

  • Medico-economic Evaluation of a Telehealth Platform for Elective Outpatient Surgeries: A Randomized Controlled Trial

    Date Submitted: Apr 29, 2025

    Open Peer Review Period: Apr 30, 2025 - Jun 25, 2025

    Background: The increasing prevalence of ambulatory surgeries has highlighted the need for effective postoperative follow-up. While telemedicine represents a promising option for perioperative support...

    Background: The increasing prevalence of ambulatory surgeries has highlighted the need for effective postoperative follow-up. While telemedicine represents a promising option for perioperative support and postoperative monitoring, evidence of its actual benefits remains limited. Objective: To evaluate the medico-economic impact of a personalized telemedicine platform for postoperative follow-up in day-surgery patients in terms of cost-effectiveness and cost-utility. Methods: Design and Setting: This single-blinded with two-group randomized controlled trial was conducted at the Centre hospitalier de l’Université de Montréal (CHUM) from August 2022 to September 2023. Participants: Adults undergoing elective day surgery were randomized into two groups: the intervention group, which received postoperative follow-up via the LeoMed® telemedicine platform, and the control group, which received standard care. The study adhered to ethical standards and was registered with ClinicalTrials.gov (NCT04948632). Intervention: The intervention group used a personalized telehealth platform offering preoperative education, psychological support, and postoperative monitoring through daily follow-up forms sent to patients’ smartphones. Alerts generated by patient responses were reviewed by CHUM’s telehealth support unit. Main Outcomes and Measures: The primary outcome was unanticipated healthcare utilization, including emergency visits, readmissions, and medical consultations within 30 days post-procedure. Secondary outcomes included gained quality-adjusted life years (QALY), patient satisfaction, healthcare costs, and greenhouse gas emissions. Results: Of 1,411 patients screened, 1,214 were randomized, with 436 in the intervention group and 445 in the control group analyzed. No significant differences in unanticipated healthcare utilization or costs were observed. The intervention group demonstrated a statistically significant QALY gain at postoperative day 14 (0.002, p = 0.013), but the difference was no longer significant at day 30 (0.001, p = 0.143). However, patient satisfaction was significantly higher in the intervention group at both days 14 (p = 0.018) and 30 (p < 0.001). Conclusions: This trial demonstrates the potential of telemedicine platforms to enhance postoperative care in ambulatory surgery settings. While no significant reductions in healthcare utilization were observed, the intervention improved QALYs and patient satisfaction, suggesting potential cost-utility benefits. Larger trials are needed to confirm these findings and explore the impact on long-term recovery and healthcare savings. Clinical Trial: ClinicalTrials.gov Identifier: NCT04948632

  • Costs and Cost Effectiveness of an Enhanced Web-Based Physical Activity Intervention for Latinas: 12- and 24-Month Findings from Pasos Hacia La Salud II

    Date Submitted: Apr 29, 2025

    Open Peer Review Period: Apr 30, 2025 - Jun 25, 2025

    Background: Increasing adherence to physical activity (PA) guidelines could prevent chronic disease morbidity and mortality, save considerable healthcare costs, and reduce health disparities. We previ...

    Background: Increasing adherence to physical activity (PA) guidelines could prevent chronic disease morbidity and mortality, save considerable healthcare costs, and reduce health disparities. We previously established the efficacy and cost-effectiveness of a web-based PA intervention for Latina women, which increased PA but few participants met PA guidelines and long-term maintenance was not examined. A new version with enhanced intervention features was found to outperform the original intervention in long-term guideline adherence. Objective: to determine the costs and cost-effectiveness of the enhanced multi-technology PA intervention vs. the original web-based intervention in increasing minutes of activity and adherence to guidelines Methods: Latina adults (N=195) were randomly assigned to receive a Spanish language individually tailored web-based PA intervention (Original), or the same intervention additional phone calls and interactive text messaging (Enhanced). PA was measured at baseline, 12 months (end of active intervention), and 24 months (end of tapered maintenance) using self-report (7-Day Physical Activity Recall Interview) and ActiGraph accelerometers. Costs were estimated from a payer perspective and included all features needed to deliver the intervention, including staff, materials, and technology. Cost effectiveness was calculated as the cost per additional minute of PA added over the intervention, and the incremental cost effectiveness ratios of each additional person meeting guidelines. Results: at 12 months, the costs of delivering the interventions were $16/person/month and $13/person/month in the Enhanced and Original arms, respectively. These costs fell to $14 and $8 at 24 months. At 12 months, each additional minute of self-reported activity in the Enhanced group cost $0.09 vs. $0.11 in Original ($0.19 vs. $0.16 for ActiGraph), with incremental costs of $0.05 per additional minute in Enhanced beyond Original. At the end of maintenance (24 months), costs per additional minute fell to $0.06 and $0.05 ($0.12 vs. $0.10 for ActiGraph), with incremental costs of $0.08 per additional minute in Enhanced ($0.20 for ActiGraph). Costs of meeting PA guidelines at 12 months were $705 vs. $503 in Enhanced vs. Original, and increased to $812 and $601 at 24 months. The ICER for meeting guidelines at 24 months was $1837 (95% CI $730.89-$2673.89) per additional person in the Enhanced vs. Original arm. Conclusions: As expected, the Enhanced intervention was more expensive, but yielded better long-term maintenance of activity. Both conditions were low costs relative to other medical interventions. The Enhanced intervention may be preferable in high risk populations, where more investment in meeting guidelines could yield more cost savings. Clinical Trial: NCT03491592

  • Leveraging Large Language Models for Enhanced Quality Assessment of Nutrition and Health Dashboards

    Date Submitted: Apr 29, 2025

    Open Peer Review Period: Apr 30, 2025 - Jun 25, 2025

    Background: Data dashboards have become an essential tool in food and nutrition surveillance, enabling integration, visualization, and dissemination of multi-faceted data. While dashboards enhance dat...

    Background: Data dashboards have become an essential tool in food and nutrition surveillance, enabling integration, visualization, and dissemination of multi-faceted data. While dashboards enhance data accessibility and decision-making, inconsistencies in data quality, standardization, and responsible conduct, along with misleading visualizations, limit their reliability and usefulness. Large Language Models (LLMs) could offer opportunities to assist in dashboard evaluation, yet their effectiveness compared to human expert assessments remains uncertain. Objective: In this study, we evaluate the potential of LLMs in assessing nutrition and health dashboards by comparing ChatGPT-generated evaluations with expert reviews. We examine the alignment and discrepancies in scoring across dashboards and key dashboard quality indicators. Methods: We developed a structured evaluation framework based on the 4E principles—Evidence, Efficiency, Emphasis, and Ethics—comprising 45 criteria. Seven publicly available nutrition and health dashboards were selected for evaluation. ChatGPT-4o was prompted to assess dashboards using extracted textual and visual content, generating scores and justifications for each criterion. Results were compared to previously published expert evaluations, analyzing ranking consistency and differences in dashboards and indicator-specific criteria. Results: ChatGPT-4o successfully generated scores and justifications in accordance with the instructions provided in the prompt we designed. ChatGPT-4o rankings were well aligned with expert evaluations for dashboards included in our study (Spearman correlation = 0.79). When comparing average scores across all dashboards for specific evaluation criteria, granularity and completeness had high consistency, with both AI and human experts assigning relatively lower scores. However, ChatGPT assigned lower scores for standardization and higher scores for responsible conduct compared to human experts. Conclusions: ChatGPT-4o could offer structured, scalable dashboard evaluations, showing reasonable alignment with expert assessments, especially in objective criteria like readability and accessibility. However, inconsistencies in assessing standardization, platform capability, and ethical considerations reveal limitations in contextual reasoning. While LLMs can enhance evaluation efficiency, expert oversight remains essential for accuracy and depth. Future research should explore diverse dashboards, compare multiple LLM models, and integrate multimodal capabilities to better assess interactivity and visualization integrity.

  • Addressing the implementation gap in digital health adoption: A systems engineering perspective

    Date Submitted: Apr 29, 2025

    Open Peer Review Period: Apr 30, 2025 - Jun 25, 2025

    In the NHS, as in other health systems, it is generally agreed that difficulties in achieving digital transformation lie less in problems with the technical (hardware and software) aspects of digital...

    In the NHS, as in other health systems, it is generally agreed that difficulties in achieving digital transformation lie less in problems with the technical (hardware and software) aspects of digital solutions than the “soft” system issues relating to institutional context, organisational complexity and what are broadly described as “human factors”. A range of approaches have been explored within digital health research to better understand and address the complex series of factors that have given rise to the implementation gap. Focusing on the need to deploy digital health technologies to support the “shift left” (from hospital to community, sickness to prevention, analogue to digital) agenda, this paper explores how a systems engineering approach could provide the cross-disciplinary, holistic framework that is required to address what could be described as a very messy problem. Our framework combines methods such as Digital Twins to simulate complex care pathways with Living Labs that enable interdisciplinary collaboration, co-design, and iterative pilot testing. When combined, these methods could help align interests, integrate end-user needs, embed design for successful implementation and iteratively adapt and improve digital health technologies, as well as offering an evaluation strategy that emphasizes safety, effectiveness and cost-efficiency.