This paper is in the following e-collection/theme issue:

eHealth Literacy / Digital Literacy (390) Social Determinants of Health (33) Vulnerable Populations in Health Research (99) Demographics of Users, Social & Digital Divide (739) E-Health / Health Services Research and New Models of Care (517) Health Services Research (482) Email Communication, Web-Based Communication, Secure Messaging (160) Clinical Communication, Electronic Consultation and Telehealth (590)

Published on in Vol 26 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/57040, first published .
How Do Scholars Conceptualize and Conduct Health and Digital Health Literacy Research? Survey of Federally Funded Scholars

How Do Scholars Conceptualize and Conduct Health and Digital Health Literacy Research? Survey of Federally Funded Scholars

How Do Scholars Conceptualize and Conduct Health and Digital Health Literacy Research? Survey of Federally Funded Scholars

Authors of this article:

Mayank Sakhuja1, 2 Author Orcid Image ;   Brooks Yelton3 Author Orcid Image ;   Simone Kavarana3 Author Orcid Image ;   Lauren Schaurer3 Author Orcid Image ;   Jancham Rachel Rumthao3 Author Orcid Image ;   Samuel Noblet4 Author Orcid Image ;   Michelle A Arent5 Author Orcid Image ;   Mark M Macauda3, 6 Author Orcid Image ;   Lorie Donelle7 Author Orcid Image ;   Daniela B Friedman3 Author Orcid Image
Article Authors Cited by Tweetations (1) Metrics

    Original Paper

    1UNC Lineberger Comprehensive Cancer Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, United States

    2Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, NC, United States

    3Department of Health Promotion, Education, and Behavior, Arnold School of Public Health, University of South Carolina, Columbia, SC, United States

    4Envera Health, Richmond, VA, United States

    5Department of Athletics, University of South Carolina, Columbia, SC, United States

    6Center for Applied Research and Evaluation, Arnold School of Public Health, University of South Carolina, Columbia, SC, United States

    7Department of Biobehavioral Health and Nursing Science, College of Nursing, University of South Carolina, Columbia, SC, United States

    Corresponding Author:

    Mayank Sakhuja, PhD

    UNC Lineberger Comprehensive Cancer Center

    University of North Carolina at Chapel Hill

    323A Rosenau Hall

    Chapel Hill, NC, 27599-7295

    United States

    Phone: 1 8034468063

    Email: msakhuja@unc.edu


    Background: The concept of health literacy (HL) is constantly evolving, and social determinants of health (SDoH) have been receiving considerable attention in public health scholarship. Since a 1-size-fits-all approach for HL fails to account for multiple contextual factors and as a result poses challenges in improving literacy levels, there is a need to develop a deeper understanding of the current state of HL and digital health literacy (DHL) research.

    Objective: This study examined scholars’ conceptualization and scope of work focused on HL and DHL.

    Methods: Using a search string, investigators (N=2042) focusing on HL, DHL, or both were identified from the grantee websites of the National Institutes of Health RePORTER (RePORT Expenditures and Results) and the Canadian Institutes of Health Research. The investigators were emailed a survey via Qualtrics. Survey questions examined the focus of work; whether the investigators studied HL/DHL in combination with other SDoH; the frameworks, definitions, and approaches used; and research settings. We analyzed survey data using SPSS Statistics version 28 and descriptive analysis, including frequencies and percentages, was conducted. Chi-square tests were performed to explore the association between the focus of work, settings, and age groups included in the investigators’ research.

    Results: A total of 193 (9.5%) of 2042 investigators responded to the online survey. Most investigators (76/153, 49.7%) were from public health, 83/193 (43%) reported their research focused on HL alone, 46/193 (23.8%) mentioned DHL, and 64/193 (33.2%) mentioned both. The majority (133/153, 86.9%) studied HL/DHL in combination with other SDoH, 106/135 (78.5%) conducted HL/DHL work in a community setting, and 100/156 (64.1%) reported not using any specific definition to guide their work. Digital tools (89/135, 65.9%), plain-language materials (82/135, 60.7%), and visual guides (56/135, 41.5%) were the top 3 approaches used. Most worked with adults (131/139, 94.2%) and all races and ethnicities (47/121, 38.8%).

    Conclusions: HL and DHL research largely considered SDoH. Multiple HL tools and approaches were used that support the examination and improvement of literacy and communication surrounding health care issues.

    J Med Internet Res 2024;26:e57040

    doi:10.2196/57040

    Keywords

    health literacy; digital health literacy; eHealth literacy; social determinants of health; SDoH; research scholarship; health care; public health research; digital health tools; community health 


    Background

    The concept of health literacy (HL) is constantly evolving. The Healthy People 2030 initiative defines HL as “the degree to which individuals have the ability to find, understand and use information and services to inform health-related decisions and actions for themselves and others.” [1]. It refers to individuals’ using their cognitive and social skills for gaining access to, understanding, and using information for promoting and maintaining good health for themselves and for others around them [2]. According to the United Nations Educational, Scientific and Cultural Institution, about 388 million adults in South and Southwest Asian countries continue to grapple with illiteracy, coupled with a lack of basic HL [3]. Even though many high-income nations, such as the United States, Canada, the United Kingdom, and Australia, have included HL in their national agenda [4], more than one-third of individuals in the United States still have limited HL, which consequently results in misunderstanding of medical information, increased health care–related costs, and poor health outcomes [5,6]. Individuals who face difficulty in understanding health-related materials may experience shame and discomfort in interacting or sharing their medical concerns and questions with health professionals [7].

    Health Literacy as a Social Determinant of Health

    HL functions as a critical component within the context of other social determinants of health (SDoH), such as education, socioeconomic status, access to quality health care, neighborhood and built environments, and social support networks [8,9]. Low literacy levels impact an individual’s ability to access and use health care services by making it challenging for them to navigate health systems, understand health insurance information, and adhere to treatment plans resulting in delayed or inadequate care [10,11]. Individuals with a low socioeconomic status often have low HL levels, leading to difficulties in understanding providers’ instructions, managing illness, and making informed health care choices for themselves [12]. Although studies indicate education may be associated with HL, the data cannot speak to a direct cause and effect tying higher education levels to higher HL [13]. Education is not a reliable proxy for determining literacy, as individuals with higher education may still have difficulty in understanding information pertaining to their health or the health of their families.

    Navigating Health Care and Health Information

    HL plays an important role in reducing health disparities, empowering individuals, and improving patient-provider communication and health outcomes. Individuals who possess high levels of HL are in a better position to understand medical instructions provided by their doctors, actively participate in decisions related to their health, and navigate the complex health care system. Changes within the health care environment, specifically the increased use of digital communication platforms, have transformed health care delivery and highlighted additional concerns around optimal patient-provider engagement. Digital health literacy (DHL) has become a significant component of HL with the increasing use of digital technologies in health care, including telehealth platforms, wearable devices, and mobile health apps and websites [14]. Although DHL shares core conceptual elements of HL, it differs as it requires an individual to possess additional skills to use technological devices, such as mobile phones and computers, and skills to use those devices to search and evaluate health-related information available online through multiple sources [14]. It is therefore essential for individuals to possess DHL skills to navigate digital technologies, access accurate and reliable online health information, and engage with telehealth platforms.

    New Challenges and Directions

    Despite the recognition of HL and DHL as essential factors of health care quality and outcomes, challenges exist in achieving optimal levels of literacy skills nationally and internationally [15]. Additionally, the increasing focus on DHL interventions poses new challenges in improving DHL, such as possessing skills to use new digital health technologies and identifying credible sources of information online [16]. Furthermore, a 1-size-fits-all approach for HL and DHL fails to account for cultural and linguistic diversity, age and generational differences, multiple health conditions and contexts, unequal access to digital resources, and diverse HL levels [17]. To develop a deeper understanding of the current state of HL and DHL research, we reported the results of a survey of HL and DHL researchers in this study. The aim was to comprehensively examine researchers’ conceptualization of and approaches to HL and DHL work, identify strategies, and highlight areas for further investigation and intervention. This research addressed the following research questions:

    • What concepts, definitions, and frameworks guide researchers’ HL and DHL research?
    • What specific settings and methods are used by HL and DHL researchers?
    • Which SDoH are addressed in HL and DHL research?
    • Who are the participants in HL and DHL research?

    Survey Development and Measures

    We used an iterative approach to develop the survey as per CHERRIES (Checklist for Reporting Results of Internet E-Surveys) [18]. Two team members drafted the initial list of questions, and all team members, including experts in HL and DHL, weighed in on multiple drafts. To ensure the survey’s reliability, we consulted content experts to design survey questions and response options that were appropriately worded and meaningful to study participants. Since we did not aim to measure any specific constructs, we did not conduct the type of survey validation that we would have done otherwise. Survey questions examined researchers’ specific focus (HL, DHL, or both); funding sources for HL and DHL research; and definitions, conceptual frameworks, and approaches used to study HL and DHL. We were also interested in understanding whether respondents studied HL/DHL in combination with other SDoH, as well as the research settings and geographic locations of their research. We asked about their main discipline/affiliation, number of years studying HL or DHL, educational qualification, and place of employment. Finally, we inquired about the data collection methods used in their research, whether they had ever received mentorship in HL/DHL work, or whether they provided mentorship to others. Respondents could select more than 1 response option for several of the survey questions.

    Ethics Approval

    This study was considered exempt by the University of South Carolina (USC) Office of Research Compliance under approval number Pro00124306.

    Participant Recruitment and Survey Dissemination

    We applied a search string (“literacy” or “health literacy” or “digital health literacy” or “e literacy” or “e health” or “m health” or “e health literacy”) to project titles, project terms, and project abstracts on the grantee website of the National Institutes of Health (NIH) RePORTER (RePORT Expenditures and Results) and the Canadian Institutes of Health Research in November 2022. Project investigators (PIs) of studies matching those parameters were included in the sample. We obtained the email addresses of the PIs directly from the NIH RePORTER website and manually searched for email addresses of the PIs selected from the Canadian Institutes of Health Research grantee website. We excluded PIs for whom email addresses were unavailable on the NIH RePORTER grantee website, as well as PIs from the Canadian Institutes of Health Research whose email addresses could not be located through manual searches. The final sample included 2042 individual investigators. We also distributed the survey link via 2 organizational listservs consisting of members focused on health communication and health promotion research and practice.

    We programmed the survey questions in Qualtrics [19]. Next, we prepared separate email lists for NIH and Canadian Institutes of Health Research PIs in Qualtrics, and invitations to participate in the survey were sent on January 23, 2023. The invitation email included a brief description and purpose of the study and a link to the Qualtrics survey and informed participants that survey completion would take approximately 15-20 minutes. Five email reminders were sent from Qualtrics at regular intervals to encourage participation and completion of the survey before its scheduled closure on April 23, 2023. All survey respondents were entered into a random drawing for 1 of 5 US $25 Amazon gift cards.

    Data Analysis

    Data were downloaded into Microsoft Excel. IBM SPSS Statistics version 28 [20] was used to conduct descriptive analysis including frequencies and percentages, and chi-square tests with a significance level of P<.05 were performed to explore the association between respondents’ research focus (HL, DHL, both) and the settings and age groups with whom they conducted their research. We included responses from all 193 respondents and did not eliminate surveys that had missing responses. Analysis was conducted in a way that the results for each survey question contained only the valid responses for that question with the relevant denominator.


    Survey Respondent Characteristics

    A total of 193 respondents answered the survey questions. Almost half (76/153, 49.7%) reported public health as their main discipline, 41/153 (26.8%) reported medicine, 38/153 (24.8%) reported health services/policy, 21/153 (13.7%) were from education, and 17/153 (11.1%) identified nursing as their academic discipline. Most had a PhD (98/132, 74.2%), 16/132 (12.1%) were MDs, and 13/132 (9.8%) had a master’s degree as their highest educational qualification. Employment settings ranged from university (93/132, 70.5%), hospital system (12/132, 9.1%), or research institution (10/132, 7.6%). Most (106/132, 80.3%) of the respondents had never received any formal mentorship in HL or DHL. Those who had received formal mentorship reported receiving training from an academic mentor, professional organization seminars, or professional training. Just over half (73/142, 51.4%) reported that they had been studying HL or DHL for 1-5 years, and 37/142 (26.1%) indicated more than 10 years of experience studying HL or DHL.

    Focus of Research

    Regarding the scope of work, 83 (43%) of 193 respondents reported that most of their work focused on HL, while 46 (23.8%) reported DHL, and the remaining 64 (33.2%) indicated a dual focus including both HL and DHL. When asked about the specific topics of focus, 87/139 (62.6%) respondents reported that they had a general focus on HL/health communication, 61/139 (43.9%) focused on topics around social justice/health equity, 48/139 (34.5%) focused on face-to-face patient-provider communication, 41/139 (29.5%) focused on misinformation/disinformation, 37/139 (26.6%) focused on virtual patient-provider communication, 36/139 (25.9%) focused on peer-to-peer health conversations, and 27/139 (19.4%) focused on policy development. Respondents had almost equal focus on specific health behaviors, including healthful eating (36/139, 25.9%), physical activity (36/139, 25.9%), and cancer screening (33/139, 23.7%).

    Concepts and Frameworks Used in HL or DHL Research

    About two-thirds (100/156, 64.1%) of the respondents reported not using any specific definition of HL or DHL to guide their work. Of those who did follow a specific definition (n=56, 35.9%), roughly 19 (33.9%) indicated using the Institute of Medicine’s [21] definition. Other definitions cited were by Nutbeam [22], the World Health Organization [23], U.S. Department of Health and Human Services [1,24], among others, as described in Table 1. Research by about one-third (46/143, 32.2%) of the respondents was guided by the Healthy People 2030 framework [1]; 35/143 (24.5%) used the Nutbeam framework that describes HL as functional, interactive, and critical [22]; 27/143 (18.9%) used the HL skills framework by Squiers et al [25]; and 18/143 (12.6%) used the HL systems capacity framework by Sorenson et al [26]. Regarding DHL research, 17/143 (11.9%) respondents used the electronic health literacy (eHL) framework by Bautista [27], 12/143 (8.4%) used the eHL definition and the Lily model by Norman and Skinner [14], 12/143 (8.4%) used the eHL framework by Norgaard et al [28], and 10/143 (7%) used the consumer eHL taxonomy by Chan et al [29]. Some respondents (6/143, 4.2%) did not follow any framework, whereas others mentioned they used dissemination and implementation science–based, collaborator-informed socioecological models and environmental HL frameworks. Frameworks used in HL and DHL research are presented in Table 2.

    Table 1. Definitions used in HLa and DHLb research provided by respondents.
    Definition guiding HL and DHL researchRespondents (n=56), n (%)Source
    The individuals’ capacity to obtain, process, and understand basic health information and services needed to make appropriate health decisions.19 (33.9)Institute of Medicine [21]
    HL represents the personal knowledge and competencies that accumulate through daily activities and social interactions across generations. Personal knowledge and competencies are mediated by organizational structures and availability of resources that enable people to access, understand, appraise, and use information and services in ways that promote and maintain good health and well-being for themselves and those around them.3 (5.4)World Health Organization [23]
    The degree to which individuals have the capacity to obtain, process, and understand basic health information and services needed to make appropriate health decisions.3 (5.4)U.S. Department of Health and Human Services [24]
    Personal HL is the degree to which individuals have the ability to find, understand, and use information and services to inform health-related decisions and actions for themselves and others. Organizational HL is the degree to which organizations equitably enable individuals to find, understand, and use information and services to inform health-related decisions and actions for themselves and others.3 (5.4)U.S. Department of Health and Human Services [1]
    The degree to which individuals and groups can obtain process, understand, evaluate, and act upon information needed to make public health decisions that benefit the community.3 (5.4)Freedman et al [30]
    The personal, cognitive, and social skills that determine the ability of individuals to gain access to, understand, and use information to promote and maintain good health.2 (3.6)Nutbeam [22]
    The cognitive and social skills that determine the motivation and ability of individuals to gain access to, understand, and use information in ways that promote and maintain good health.2 (3.6)Nutbeam [31]
    The knowledge, skills, and abilities that pertain to interactions with the health care system.2 (3.6)Ishikawa and Yano [32]
    The ability to seek, find, understand, and appraise health information from electronic sources and apply the knowledge gained to addressing or solving a health problem.2 (3.6)Norman and Skinner [14]
    DHL involves the context and ability to use digital technologies to access, understand, and use health information in a timely manner to improve health outcomes.1 (1.8)Norman and Skinner [14]
    DHL is defined as the ability to appraise health information from electronic sources and apply the knowledge gained to address or solve a health-related problem and as such has emerged as an important component of greater HL. Although DHL shares core aspects of HL, DHL is distinguished by additional skills: computer literacy, the ability to use computers and related technology efficiently to accomplish tasks, media literacy to use search engines, and information literacy to evaluate a wide variety of sources.1 (1.8)Smith and Magnani [16]
    The ability to understand and interpret the meaning of health information in written, spoken, or digital form and how this motivates people to embrace or disregard actions relating to health.1 (1.8)Adams et al [33]
    The capacity to obtain, interpret, and understand basic health information and services and the competence to use such information to enhance health.1 (1.8)Pavlekovic [34]
    At its most basic, environmental HL has been described as an ability to make connections between environmental exposures and human health. Representations of environmental HL tend to start with individual understanding of specific risks and then lead to broader understanding, including strategies that empower people to reduce or eliminate environmental exposures that can harm health.1 (1.8)Finn and O’Fallon [35]
    HL is defined as the ability to access, understand, and use information to make health decisions. It is well known that low HL is associated with poorer health outcomes.1 (1.8)Berkman et al [36]
    The knowledge and skills required to understand and use information relating to health issues, such as drugs and alcohol, disease prevention and treatment, safety, accident prevention, first aid, emergencies, and staying healthy.1 (1.8)Australian Bureau of Statistics [37]
    Knowledge and beliefs about mental disorders that aid their recognition, management, or prevention. It is a multidimensional concept that includes (1) an ability to recognize specific disorders or types of psychological distress, (2) knowledge and beliefs about risk factors and prevention, (3) knowledge and attitudes that facilitate help seeking, and (4) knowledge and beliefs regarding formal and informal intervention approaches. DHL focuses more on knowledge and skills related to technology-based approaches to digital health.1 (1.8)Jorm [38]
    The ability to access, understand, evaluate, and communicate information as a way to promote, maintain, and improve health in a variety of settings across the life course.1 (1.8)Rootman and Gordon-El-Bihbety [39]
    The ability to make sound health decision(s) in the context of everyday life: at home, in the community, at the workplace, in the health care system, in the marketplace and in the political arena. It is a critical empowerment strategy to increase people’s control over their health, their ability to seek out information, and their ability to take responsibility.1 (1.8)Kickbusch et al [40]
    The wide range of skills and competencies that people develop to seek out, comprehend, evaluate, and use health information and concepts to make informed choices, reduce health risks, and increase the quality of life.1 (1.8)Zarcadoolas et al [41]
    An emerging field in the intersection of medical informatics, public health, and business, referring to health services and information delivered or enhanced through the internet and related technologies. It is also a state of mind, a way of thinking, an attitude, and a commitment for networked, global thinking, to improve health care locally, regionally, and worldwide by using information and communication technology.1 (1.8)Eysenbach [42]
    We define mental HL as the extent to which individuals are knowledgeable about mental health problems and their treatment.1 (1.8)N/Ac
    Individuals’ ability to apply for/maintain health coverage and navigate the health care system to have their health needs met.1 (1.8)N/A
    Functional HL is a person’s ability to comprehend patient education materials to make an informed decision about their health.1 (1.8)N/A
    We used an internal definition (unpublished) focused on literacy related to health, research, medicine, and insurance to guide our work.1 (1.8)N/A

    aHL: health literacy.

    bDHL: digital health literacy.

    cN/A: not applicable.

    Table 2. Frameworks used in HLa and DHLb research.
    Conceptual framework guiding HL and DHL researchRespondents (n=143), n (%)c
    Healthy People 2030 (U.S. Department of Health and Human Services [1])46 (32.2)
    HL as functional, interactive, and critical (Nutbeam [22])35 (24.5)
    HL skills framework (Squiers et al [25])27 (18.9)
    HL systems capacity (Sorenson et al [26])18 (12.6)
    eHL (Bautista [27])17 (11.9)
    HL as an asset model (Nutbeam [43])15 (10.5)
    eHL and Lily model (Norman and Skinner [14])12 (8.4)
    eHL framework (Norgaard et al [28])12 (8.4)
    Consumer eHL (Chan et al [29])10 (7.0)
    eHL framework (Kayser et al [44])8 (5.6)
    Integrated model for cancer screening (Best et al [45])7 (4.9)
    Other frameworks34 (23.8)
    None6 (4.2)

    aHL: health literacy.

    bDHL: digital health literacy.

    cParticipants could select more than 1 response option, so the total percentage may be more than 100%.

    Methods and Settings Used in HL or DHL Research

    Table 3 presents the settings in which respondents conducted their research. Most conducted their HL/DHL work in a community setting (106/135, 78.5%); 49/135 (36.3%) reported a primary care setting; 44/135 (32.6%) reported a specialty care setting; 29/135 (21.5%) reported the virtual health care space, such as patient portals/provider portals; and 20/135 (14.8%) reported government-/policy-level settings. Chi-square tests indicated that of those (n=20, 14.8%) who conducted research in a government-/policy-level setting, 14 (70%) were focused on HL research, while 13 (44.8%) of the respondents who conducted research in the virtual health care space were focused on DHL. Only significant (P<.05) chi-square test results are presented in Table 4. When asked about the specific approaches that they used in their work, 89 (65.9%) respondents mentioned using digital tools, such as apps, websites, patient portals, virtual visits, and wearable devices; 82/135 (60.7%) reported using plain-language materials; 56/135 (41.5%) used visual guides, such as graphical decision tools; 39/135 (28.9%) used teach-back strategies; and 36/135 (26.7%) made use of a partnership with patient navigators. Most respondents used mixed methods (109/134, 81.3%) for their work. For data collection, 112/134 (83.6%) respondents reported that they collected data using interviews, 118/134 (88.1%) conducted surveys, 89/134 (66.4%) conducted focus groups, 50/134 (37.3%) conducted secondary data analysis, and 44/134 (32.8%) completed scoping and systematic reviews and meta-analysis. Other types of data collection methods included content analysis (33/134, 24.6%), comprehension testing (23/134, 17.2%), readability testing (25/134, 18.7%), and observational data (42/134, 31.3%).

    Table 3. Settings in which HLa and DHLb research is conducted.
    Research settingsRespondents (n=135), n (%)c
    Clinical setting 108 (80.0)

    		Primary care49 (36.3)

    		Specialty care44 (32.6)

    		Other15 (11.1)
    Community setting106 (78.5)
    Government-/policy-level setting20 (14.8)
    Virtual health care spaced29 (21.5)
    Other settingse16 (11.9)

    		Academia7 (5.2)

    		County hospital1 (0.7)

    		Higher education level1 (0.7)

    		Hospital1 (0.7)

    		Interactive internet to classrooms1 (0.7)

    		Medical center1 (0.7)

    		Mobile health1 (0.7)

    		School1 (0.7)

    		Smoking quitline1 (0.7)

    		Tribal health care organization1 (0.7)

    aHL: health literacy.

    bDHL: digital health literacy.

    cParticipants could select more than 1 response option, so the total percentage may be more than 100%.

    dPatient or provider portals.

    eRespondent write-in.

    Table 4. Chi-square tests between focus of research and research setting.
    FocusGovernment-/policy-level setting (n=20; P=.034), n (%)Virtual health care space (n=29; P=.006), n (%)Specialty care (n=44; P=.014), n (%)
    DHLa2 (10.0)13 (44.8)16 (36.4)
    HLb14 (70.0)6 (20.7)11 (25.0)
    Both4 (20.0)10 (34.5)17 (38.6)

    aDHL: digital health literacy.

    bHL: health literacy.

    Consideration of Social Determinants of Health

    Most respondents (133/153, 86.9%) reported that they studied HL/DHL in combination with other SDoH. Health care access and quality were studied with HL/DHL most often (93/133, 69.9%), followed by social and community contexts (80/133, 60.2%), education access and quality (57/133, 42.9%), neighborhood and built environment (44/133, 33.1%), and economic stability (40/133, 30.1%). Other SDoH, as reported by respondents, included equity, gender and caregiving support, insurance and employment status, language equity, mental health stigma, poverty, culture, environmental exposures, and other measures of socioeconomic status.

    Profile of Participants With Whom Respondents Conducted Research

    Respondents conducted research mostly with adult populations (131/139, 94.2%), 42/139 (30.2%) conducted research with adolescents (12-17 years old), and 23/139 (16.5%) conducted research with youth (<12 years old). There were no significant chi-square test results between the focus of research and the age categories of respondents’ research participants. Some respondents reported conducting research with all/diverse races (47/121, 38.8%), while others indicated a more limited approach. One-third (40/121, 33.1%) respondents conducted research with only Black, African American, or both populations; 31/121 (25.6%) reported research with White/Caucasian/European Americans; 32/121 (26.4%) reported research with Hispanic or LatinX populations; and 11/121 (9.1%) reported research with Asian, South Asian, and East Asian populations. Most respondents (83/137, 60.6%) reported that they conducted research with the general public, 43/137 (31.4%) reported research with general patients, and 58/137 (42.3%) reported research with patients of a specific health/medical specialty. About one-third (44/137, 32.1%) of the respondents conducted research with general clinical providers; 43/137 (31.4%) included physicians, nurse practitioners, and PAs as their research participants; and 27/137 (19.7%) worked with professionals who were from nursing and related clinical/health sciences backgrounds. Respondents also conducted research with specific communities who had a specific culture (33/137, 24.1%); the lesbian, gay, bisexual, transgender, queer, questioning, intersex, asexual, and other (LGBTQIA+) community (15/137, 10.9%); individuals without a shelter or stable housing (15/137, 10.9%); and individuals with disabilities (10/137, 7.3%).


    Principal Findings

    This study was a comprehensive examination of researchers’ conceptualization of and strategies for conducting HL and DHL research. Understanding principles and methods that guide the work in this area is critical for advancing the field, pursuing needed interventions in both clinical and community settings, and studying literacy in the context of additional social determinants that influence health behaviors and outcomes.

    Conceptualizing Health and Digital Health Literacy

    Most respondents reported not using any specific definition of HL or DHL to guide their work. Others suggested a variety of definitions and seminal papers from the field. Without the use of common definitions and measures, understanding a discipline will be limited to knowledge obtained from individual cases; however, it may not advance the field holistically so that we can create culturally and linguistically appropriate communication strategies to promote evidence-based programs, interventions, and policies [46,47].

    Most respondents reported that their research was generally focused on HL or health communication and on social justice or health equity, demonstrating the importance of studying HL and DHL within the context of other social factors. Over 85% of the respondents investigated HL/DHL in relation to other SDoH. Researchers’ attention to HL/DHL and SDoH is consistent with van Kessel et al [48], who claimed that the development of HL, and increasingly DHL, is a pre-requisite for enhanced health and well-being. Others have also highlighted the growing importance of DHL and contend that DHL and digital inclusion constitute the “super–SDoH,” especially given our widespread reliance on digital tools for health [49].

    Life contexts (eg, age, gender, income, employment, education, HL/DHL skills, social support, residential environments, health care access) create conditions for (in)equitable health and well-being [48,50]. Researchers in this study focused predominantly on the intersection of HL/DHL and health service system issues. One-third to half of the researchers addressed HL/DHL skills in relation to education, the neighborhood context, and economic stability. With agreement that HL and DHL constitute fundamental skills in support of equitable health and well-being, our findings suggest important opportunities to enhance research activity for greater insight into the impact of HL/DHL skills at the intersection of culturally diverse groups of individuals, those living in poverty, individuals with poor mental health, individuals without stable housing, individuals with disabilities, and across gender and sexual identities [51].

    Intended Audiences

    Almost 80% of the respondents conducted research in a community setting. Community-engaged HL and DHL research is critical to understanding diverse stakeholders’ needs, preferences, and pre-existing beliefs [52]. Effective education programs, interventions, and health communication materials are tailored and culturally relevant to different audiences, centering community-held values, imagery, and voices for both trust in the message/messenger and adoption of associated content and behaviors [53,54]. Codeveloping research, programs, and communication products with community members ensures stakeholder priorities are fully accounted for and increases member buy-in [55]. Although clinical interventions are necessary to improve health and digital literacy at the organizational level, design and delivery must balance pragmatic approaches to implementation with the utility and receptibility of a diverse patient population [56]. For improved prevention, it is also imperative that researchers meet stakeholders where they are, particularly among medically underserved populations that may only engage with the health care system in emergency situations.

    Despite the racial and ethnic variety of respondents’ research audiences, limited research was reportedly conducted with Asian, South Asian, or East Asian populations. This may be due, in part, to perceptions that health outcomes tend to be favorable among individuals of Asian descent in the United States and Canada [57], leading researchers to focus their efforts on communities perceived as being at higher risk for negative health disparities. However, researchers can inadvertently disadvantage population subgroups by aggregating groups of people into broad categories, masking heterogeneity and limiting research capacity, health education, and funding for groups that may have different risk profiles or poorer health outcomes than other groups within the same broad category [58,59]. In addition, researchers using a health equity lens must make deliberate strides to improve research participation among many population groups by centering aims around each population’s interests and goals, repairing and building trust, providing adequate compensation and incentive, and tailoring communication to meet the intended population’s language, source, and channel preferences [60]. Regardless, the tenets of value-based health promotion support the need to codevelop health and DHL with individuals and populations across the health-illness continuum, as HL can improve both knowledge of health risks and trust in health care. A smaller portion of respondents conducted research with communities who shared a specific culture, members of the LGBTQIA+ community, individuals without a shelter or stable housing, and individuals with disabilities. These populations are at higher risk for health care bias and other SDoH [61]; thus, it is imperative that they be engaged and appropriately consulted in the field of HL.

    It was not surprising that most of our survey respondents conducted research with adult populations (94.2%), whereas a smaller proportion worked with adolescents (30.2%) and the youth (16.5%). Additionally, none of the respondents mentioned using conceptual frameworks adapted for use with younger age groups. This is likely due to the fact that parental involvement and consent are required in adolescent health care and participation in research or other programs. However, it is important to understand and address health and DHL from a life course perspective, as early life experiences and cumulative disadvantages across the lifespan can lead to accumulated stress and uptake of unhealthy behavior, leading to poor health outcomes in adulthood [62]. The limited focus on HL among lower age groups has remained a significant gap requiring more research on HL instruments and interventions among younger age groups [63]. The limited literature focused on HL among adolescents and the youth impedes our understanding of the needs and preferences of HL and DHL in the context of younger age groups.

    Implications for Health Care Professionals

    Approximately three-quarters of the respondents reported public health and medicine as their academic and professional disciplines. Although the nursing profession is proportionately greater than the discipline of public health or medicine, only 11% of the respondents conducting HL research had a nursing background. Worldwide, nurses serve as critical partners in the health care encounter as they provide education and facilitate communication exchange, which can aid patient HL [64]. However, research demonstrates that nurses in the United States cannot identify patient communication behaviors that point toward low HL levels [65]. Engaging nursing professionals in HL and DHL research is important because nurses interact directly with patients, which makes them well positioned to develop and implement strategies to fully understand the needs and challenges of a diverse patient population. More involvement of nursing professionals would help in developing informed and tailored communication strategies for patient populations and help determine the most effective ways for communicating health information with patients of varying levels of literacy. HL research by nursing professionals would help in reducing disparities as understanding the challenges by patients from diverse backgrounds would allow nursing professionals to deliver more equitable health care.

    Limitations

    Our survey was distributed primarily via lists of researchers who had NIH funding in the United States or funding through the Canadian Institutes of Health Research; thus, our sample primarily reflects researchers who have been awarded through these funding streams. There are likely others in the field who have carried out their work using other funding streams. Since research agendas are, to some extent, directed by the priorities of funding agencies, this survey may have missed individuals conducting different kinds of HL work. Additionally, since we primarily searched the grantee websites of the NIH and the Canadian Institutes of Health Research, our sample of researchers was primarily based in high-income countries. As we could not reach out to researchers in low- and middle-income countries, our study findings cannot be generalized to other countries. Despite keeping the survey open for a period of 3 months and sending 5 reminder emails for completing the survey, the low response rate of our survey further restricts the generalizability of our study findings. As we did not conduct cognitive testing of our survey questions, there is a possibility that our questions did not address the most meaningful information. Finally, the majority of our questions were closed ended, which may fail to capture the complexity of the working definitions used by respondents, as well as the variety of work they engage in. Even though this study has limitations, we strongly believe that the study findings still provide important insights into the scope of and how researchers conceptualize HL and DHL research, which can inform future research directions. Understanding what funded researchers are doing in this area of research and with the growth in the need for research on SDoH, this study can help inform more comprehensive examination of this field of research.

    Conclusion

    The results of our survey indicate there is significant variation in how HL is researched and understood. Although a variety of approaches may add richness to the field, it also makes comparisons across studies and generalizability of findings more difficult. Further, few respondents reported receiving any formal mentorship in their study of HL or DHL, which may perpetuate inconsistencies in how HL is defined, since knowledge transfer from one generation of researchers to another may be limited. It is encouraging that the majority of survey respondents investigated HL along with other SDoH, given the inequality that is often pervasive within health systems and the importance of going beyond studies of readability to more contextual factors. However, the lack of work in the clinical setting is problematic, since it has been recognized that HL is a structural issue that the health sector must address. Given the somewhat limited consistency in how the concept is currently defined and the evolution of the field from the study of readability of documents to the exploration of literacy within the context of social factors and health equity, opportunities exist to leverage conferences, scientific meetings, and other professional spaces to learn from each other and create mentorship opportunities for junior scholars and those who may be moving into this area. This would facilitate continued discussion among practitioners and researchers to create common definitions and goals around HL, DHL, and their relationship to SDoH.

    Conflicts of Interest

    None declared.

    1. Health literacy in healthy people 2030. U.S. Department of Health and Human Services. URL: https://health.gov/healthypeople/priority-areas/health-literacy-healthy-people-2030 [accessed 2023-09-04]
    2. Health promotion. World Health Organization. URL: https:/​/www.​who.int/​teams/​health-promotion/​enhanced-wellbeing/​ninth-global-conference/​health-literacy [accessed 2023-08-09]
    3. Health literacy and sustainable development. United Nations. URL: https://www.un.org/en/chronicle/article/health-literacy-and-sustainable-development [accessed 2023-08-09]
    4. Qi S, Hua F, Xu S, Zhou Z, Liu F. Trends of global health literacy research (1995-2020): analysis of mapping knowledge domains based on citation data mining. PLoS One. Aug 9, 2021;16(8):e0254988. [FREE Full text] [CrossRef] [Medline]
    5. Friedman DB, Arent MA, Yelton B, Sakhuja M, Haynes VE, Noblet S, et al. Development of a clinical-academic-community collaboration to improve health literacy. J Prim Care Community Health. Sep 10, 2020;11:215013272095744. [CrossRef]
    6. Feinberg I, Greenberg D, Frijters J. Understanding health information seeking behaviors of adults with low literacy, numeracy, and problem solving skills: results from the 2012 US PIAAC study. Squarespace. 2015. URL: https:/​/static1.​squarespace.com/​static/​51bb74b8e4b0139570ddf020/​t/​54da7889e4b004762df45b52/​1423603849970/​Feinberg_Greenberg_Frijters_PIAAC.​pdf [accessed 2024-10-07]
    7. Mackert M, Donovan EE, Mabry A, Guadagno M, Stout PA. Stigma and health literacy: an agenda for advancing research and practice. Am J Health Behav. Sep 01, 2014;38(5):690-698. [CrossRef]
    8. Paasche-Orlow MK, Wolf MS. The causal pathways linking health literacy to health outcomes. Am J Health Behav. Jul 01, 2007;31(1):19-26. [CrossRef]
    9. Rikard RV, Thompson MS, McKinney J, Beauchamp A. Examining health literacy disparities in the United States: a third look at the National Assessment of Adult Literacy (NAAL). BMC Public Health. Sep 13, 2016;16(1):975. [FREE Full text] [CrossRef] [Medline]
    10. MacLeod S, Musich S, Gulyas S, Cheng Y, Tkatch R, Cempellin D, et al. The impact of inadequate health literacy on patient satisfaction, healthcare utilization, and expenditures among older adults. Geriatr Nurs. Jul 2017;38(4):334-341. [CrossRef]
    11. Quinlan P, Price KO, Magid SK, Lyman S, Mandl LA, Stone PW. The relationship among health literacy, health knowledge, and adherence to treatment in patients with rheumatoid arthritis. HSS J: Musculoskel J Hosp Special Surg. Feb 01, 2013;9(1):42-49. [CrossRef]
    12. Stormacq C, Van den Broucke S, Wosinski J. Does health literacy mediate the relationship between socioeconomic status and health disparities? Integrative review. Health Promot Int. Oct 01, 2019;34(5):e1-e17. [CrossRef] [Medline]
    13. Beauchamp A, Buchbinder R, Dodson S, Batterham RW, Elsworth GR, McPhee C, et al. Distribution of health literacy strengths and weaknesses across socio-demographic groups: a cross-sectional survey using the Health Literacy Questionnaire (HLQ). BMC Public Health. Jul 21, 2015;15(1):678. [FREE Full text] [CrossRef] [Medline]
    14. Norman CD, Skinner HA. eHealth literacy: essential skills for consumer health in a networked world. J Med Internet Res. Jun 16, 2006;8(2):e9,e506. [FREE Full text] [CrossRef] [Medline]
    15. Allen-Meares P, Lowry B, Estrella ML, Mansuri S. Health literacy barriers in the health care system: barriers and opportunities for the profession. Health Soc Work. Jan 07, 2020;45(1):62-64. [FREE Full text] [CrossRef] [Medline]
    16. Smith B, Magnani JW. New technologies, new disparities: the intersection of electronic health and digital health literacy. Int J Cardiol. Oct 01, 2019;292:280-282. [FREE Full text] [CrossRef] [Medline]
    17. Dias S. Health literacy promotion in complex systems: a paramount paradigm when “one-size-fits-all” is not enough. Port J Public Health. Dec 13, 2022;40(3):131-133. [CrossRef]
    18. Eysenbach G. Improving the quality of web surveys: the Checklist for Reporting Results of Internet E-Surveys (CHERRIES). J Med Internet Res. Sep 29, 2004;6(3):e34. [FREE Full text] [CrossRef] [Medline]
    19. Qualtrics AI + the XM platform. Qualtrics. URL: https://www.qualtrics.com/ [accessed 2024-10-07]
    20. IBM SPSS Statistics. IBM Corp. URL: https://www.ibm.com/products/spss-statistics [accessed 2021-10-08]
    21. Nielsen-Bohlman L, Panzer AM, Kindig DA. Health Literacy: A Prescription to End Confusion. Washington, DC. National Academies Press; 2004.
    22. Nutbeam D. Health literacy as a public health goal: a challenge for contemporary health education and communication strategies into the 21st century. Health Promot Int. 2000;15(3):259-267. [CrossRef]
    23. Health promotion glossary of terms 2021. World Health Organization. Dec 6, 2021. URL: https://www.who.int/publications/i/item/9789240038349 [accessed 2024-10-07]
    24. Healthy people 2020. U.S. Department of Health and Human Services. URL: https://www.cdc.gov/nchs/healthy_people/hp2020.htm [accessed 2024-10-15]
    25. Squiers L, Peinado S, Berkman N, Boudewyns V, McCormack L. The health literacy skills framework. J Health Commun. Oct 2012;17(Suppl 3):30-54. [CrossRef] [Medline]
    26. Sørensen K, Levin-Zamir D, Duong TV, Okan O, Brasil VV, Nutbeam D. Building health literacy system capacity: a framework for health literate systems. Health Promot Int. Dec 13, 2021;36(Supplement_1):i13-i23. [FREE Full text] [CrossRef] [Medline]
    27. Bautista JR. From solving a health problem to achieving quality of life: redefining eHealth literacy. J Lit Technol. 2015;16(2):33-54.
    28. Norgaard O. The e-health literacy framework: a conceptual framework for characterizing e-health users and their interaction with e-health systems. Knowl Manag E-Learn. 2015;7(4):522. [CrossRef]
    29. Chan CV, Matthews LA, Kaufman DR. A taxonomy characterizing complexity of consumer eHealth literacy. AMIA Annu Symp Proc. Nov 14, 2009;2009:86-90. [Medline]
    30. Freedman DA, Bess KD, Tucker HA, Boyd DL, Tuchman AM, Wallston KA. Public health literacy defined. Am J Prev Med. May 2009;36(5):446-451. [CrossRef] [Medline]
    31. Nutbeam D. Health promotion glossary. Health Promot Int. 1998;13(4):349-364. [CrossRef]
    32. Ishikawa H, Yano E. Patient health literacy and participation in the health-care process. Health Expect. Jun 2008;11(2):113-122. [CrossRef] [Medline]
    33. Adams RJ, Stocks NP, Wilson DH, Hill CL, Gravier S, Kickbusch I, et al. Health literacy--a new concept for general practice? Aust Fam Physician. Mar 2009;38(3):144-147. [Medline]
    34. Pavlekovic G. Health literacy. Programmes for training on research in public health for South Eastern Europe. In: Health Promotion and Disease Prevention: A Handbook for Teachers, Researchers, Health Professionals and Decision Makers. Lage, Germany. Hans Jacobs Publishing Company; 2007.
    35. Finn S, O'Fallon L. The emergence of environmental health literacy—from its roots to its future potential. Environ Health Perspect. Apr 2017;125(4):495-501. [FREE Full text] [CrossRef] [Medline]
    36. Berkman ND, Sheridan SL, Donahue KE, Halpern DJ, Crotty K. Low health literacy and health outcomes: an updated systematic review. Ann Intern Med. Jul 19, 2011;155(2):97-107. [CrossRef] [Medline]
    37. Australian Bureau of Statistics. Adult Literacy and Life Skills Survey. Summary Results. Canberra, Australia. Australian Bureau of Statistics; 2008:88.
    38. Jorm AF. Mental health literacy. Public knowledge and beliefs about mental disorders. Br J Psychiatry. Nov 2000;177:396-401. [CrossRef] [Medline]
    39. Rootman I, Gordon-El-Bihbety D. A Vision for a Health Literate Canada: Report of the Expert Panel on Health Literacy. Ottawa, Canada. Canadian Public Health Association; 2008.
    40. Kickbusch I, Wait S, Maag D, Banks I. Navigating Health: The Role of Health Literacy. UK. Alliance for Health and the Future, International Longevity Centre; 2006.
    41. Zarcadoolas C, Pleasant A, Greer DS. Understanding health literacy: an expanded model. Health Promot Int. Jun 2005;20(2):195-203. [CrossRef] [Medline]
    42. Eysenbach G. What is e-health? J Med Internet Res. 2001;3(2):E20. [FREE Full text] [CrossRef] [Medline]
    43. Nutbeam D. The evolving concept of health literacy. Soc Sci Med. Dec 2008;67(12):2072-2078. [CrossRef]
    44. Kayser L, Karnoe A, Furstrand D, Batterham R, Christensen KB, Elsworth G, et al. A multidimensional tool based on the eHealth literacy framework: development and initial validity testing of the eHealth Literacy Questionnaire (eHLQ). J Med Internet Res. Feb 12, 2018;20(2):e36. [FREE Full text] [CrossRef] [Medline]
    45. Best AL, Vamos C, Choi SK, Thompson EL, Daley E, Friedman DB. Increasing routine cancer screening among underserved populations through effective communication strategies: application of a health literacy framework. J Cancer Educ. Jun 8, 2017;32(2):213-217. [FREE Full text] [CrossRef] [Medline]
    46. Friedman DB, Becofsky K, Anderson LA, Bryant LL, Hunter RH, Ivey SL, et al. Public perceptions about risk and protective factors for cognitive health and impairment: a review of the literature. Int Psychogeriatr. Jan 16, 2015;27(8):1263-1275. [CrossRef]
    47. Koskan AM, Friedman DB, Brandt HM, Walsemann KM, Messias DKH. Preparing promotoras to deliver health programs for Hispanic communities: training processes and curricula. Health Promot Pract. May 14, 2013;14(3):390-399. [FREE Full text] [CrossRef] [Medline]
    48. van Kessel R, Wong BLH, Clemens T, Brand H. Digital health literacy as a super determinant of health: more than simply the sum of its parts. Internet Interv. Mar 2022;27:100500. [FREE Full text] [CrossRef] [Medline]
    49. Sieck CJ, Sheon A, Ancker JS, Castek J, Callahan B, Siefer A. Digital inclusion as a social determinant of health. NPJ Digit Med. Mar 17, 2021;4(1):52. [FREE Full text] [CrossRef] [Medline]
    50. Social determinants of health. World Health Organization. URL: https://www.who.int/health-topics/social-determinants-of-health#tab=tab_1 [accessed 2023-10-01]
    51. Schillinger D. Social determinants, health literacy, and disparities: intersections and controversies. Health Lit Res Pract. Jul 2021;5(3):e234-e243. [FREE Full text] [CrossRef] [Medline]
    52. Ross L, Johnson J, Smallwood SW, Luque JS, Tedders SH, Airhihenbuwa CO, MAN UP Prostate Cancer Advocates, et al. Using CBPR to extend prostate cancer education, counseling, and screening opportunities to urban-dwelling African-Americans. J Cancer Educ. Dec 8, 2016;31(4):702-708. [FREE Full text] [CrossRef] [Medline]
    53. Abbas MZ. Public understanding and voluntary responsibility to mitigate COVID-19 pandemic: role of local community organizations in information sharing and health literacy. Asia Pac J Public Health. May 17, 2021;33(4):451-452. [CrossRef] [Medline]
    54. Haidar A, Khoei A, Alex SE, Blick C, Lopez E, Wendt S, et al. Community-academic partnerships to promote health literacy and address social needs among low-income families during COVID-19. J Nutr Educ Behav. Jan 2021;53(1):75-78. [FREE Full text] [CrossRef] [Medline]
    55. Berge JM, Mendenhall TJ, Doherty WJ. Using community-based participatory research (CBPR) to target health disparities in families. Fam Relat. Oct 01, 2009;58(4):475-488. [FREE Full text] [CrossRef] [Medline]
    56. Nutbeam D, McGill B, Premkumar P. Improving health literacy in community populations: a review of progress. Health Promot Int. Oct 01, 2018;33(5):901-911. [CrossRef] [Medline]
    57. Singh GK, Daus GP, Allender M, Ramey CT, Martin EK, Perry C, et al. Social determinants of health in the United States: addressing major health inequality trends for the nation, 1935-2016. Int J MCH AIDS. Jan 15, 2017;6(2):139-164. [FREE Full text] [CrossRef] [Medline]
    58. Yom S, Lor M. Advancing health disparities research: the need to include Asian American subgroup populations. J Racial Ethn Health Disparities. Dec 17, 2022;9(6):2248-2282. [FREE Full text] [CrossRef] [Medline]
    59. Gordon NP, Lin TY, Rau J, Lo JC. Aggregation of Asian-American subgroups masks meaningful differences in health and health risks among Asian ethnicities: an electronic health record based cohort study. BMC Public Health. Nov 25, 2019;19(1):1551. [CrossRef]
    60. Liu Y, Elliott A, Strelnick H, Aguilar-Gaxiola S, Cottler LB. Asian Americans are less willing than other racial groups to participate in health research. J Clin Transl Sci. Jun 28, 2019;3(2-3):90-96. [FREE Full text] [CrossRef] [Medline]
    61. Casanova-Perez R, Apodaca C, Bascom E, Mohanraj D, Lane C, Vidyarthi D, et al. Broken down by bias: healthcare biases experienced by BIPOC and LGBTQ+ patients. AMIA Annu Symp Proc. 2021;2021:275-284. [FREE Full text] [Medline]
    62. Maindal HT, Aagaard-Hansen J. Health literacy meets the life-course perspective: towards a conceptual framework. Glob Health Action. Dec 31, 2020;13(1):1775063. [FREE Full text] [CrossRef] [Medline]
    63. Perry EL. Health literacy in adolescents: an integrative review. J Spec Pediatr Nurs. Jul 11, 2014;19(3):210-218. [CrossRef] [Medline]
    64. Wilandika A, Pandin MGR, Yusuf A. The roles of nurses in supporting health literacy: a scoping review. Front Public Health. Aug 16, 2023;11:1022803. [FREE Full text] [CrossRef] [Medline]
    65. Wittenberg E, Ferrell B, Kanter E, Buller H. Nurse communication challenges with health literacy support. Clin J Oncol Nurs. Feb 01, 2018;22(1):53-61. [FREE Full text] [CrossRef] [Medline]

    ‎
    DHL: digital health literacy
    eHL: electronic health literacy
    HL: health literacy
    LGBTQIA+: lesbian, gay, bisexual, transgender, queer, questioning, intersex, asexual, and other
    NIH: National Institutes of Health
    PI: project investigator
    RePORTER: RePORT Expenditures and Results
    SDoH: social determinants of health

    Edited by KJ( Craig; submitted 03.02.24; peer-reviewed by L Chinthala, R Marshall, Y-M Huang; comments to author 27.03.24; revised version received 22.05.24; accepted 17.09.24; published 31.10.24.

    Copyright

    ©Mayank Sakhuja, Brooks Yelton, Simone Kavarana, Lauren Schaurer, Jancham Rachel Rumthao, Samuel Noblet, Michelle A Arent, Mark M Macauda, Lorie Donelle, Daniela B Friedman. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 31.10.2024.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research (ISSN 1438-8871), is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.