Viewpoint
Abstract
The potential and threat of digital tools to achieve health equity has been highlighted for over a decade, but the success of achieving equitable access to health technologies remains challenging. Our paper addresses renewed concerns regarding equity in digital health access that were deepened during the COVID-19 pandemic. Our viewpoint is that (1) digital health tools have the potential to improve health equity if equitable access is achieved, and (2) improving access and equity in digital health can be strengthened by considering behavioral science–based strategies embedded in all phases of tool development. Using behavioral, equity, and access frameworks allowed for a unique and comprehensive exploration of current drivers of digital health inequities. This paper aims to present a compilation of strategies that can potentially have an actionable impact on digital health equity. Multilevel factors drive unequal access, so strategies require action from tool developers, individual delivery agents, organizations, and systems to effect change. Strategies were shaped with a behavioral medicine focus as the field has a unique role in improving digital health access; arguably, all digital tools require the user (individual, provider, and health system) to change behavior by engaging with the technology to generate impact. This paper presents a model that emphasizes using multilevel strategies across design, delivery, dissemination, and sustainment stages to advance digital health access and foster health equity.
J Med Internet Res 2024;26:e51355doi:10.2196/51355
Keywords
Introduction
Behavioral medicine plays a key role in testing and implementing newly developed digital health technologies and evaluating their use in care delivery, including recognizing unique opportunities and challenges to equitable health services [
, ]. Along with many other health-related specialties, behavioral medicine responded to the COVID-19 pandemic with the rapid deployment of digital health and faced concerns that digital health disparities deepened during the pandemic [ - ]. Digital health tools, which include mobile health, health information technology, wearable devices, telehealth, and telemedicine [ ], were rapidly implemented in lieu of in-person activities to limit the spread of COVID-19 while trying to ensure that access to care was uninterrupted [ ]. While benefits of digital health were seen in some population groups, the pandemic also exposed long-standing inequities in health and health care, especially access to care. Often described as the “digital divide” [ ], the gap between those with access to digital technologies and those without [ , ] came into stark relief during the pandemic. Thus, this again highlights the need to prioritize digital health equity while sustaining the momentum of the paradigm shift in health care delivery to digital health technology [ , ].Behavioral medicine brings unique perspectives to bridging the digital divide. Other health care fields join behavioral medicine in conceptualizing more comprehensive models to identify strategies that address barriers and enhance facilitators to ensure greater equity in digital health. A body of work within behavioral medicine has focused on improving access to care [
] and reducing health disparities [ ]. Alcaraz et al [ ] developed the ConNECT framework that links behavioral science with health equity and provides strategies, including harnessing technology, focused on marginalized subgroups to inform practice and policy to promote health equity. Harnessing technology can promote equity by, for example, bridging accessibility barriers; using seamless technological adaptations (eg, language, literacy, or cultural tailoring); or scaling treatment approaches. These considerations are critical given that digital technologies have been repeatedly shown to exacerbate health disparities if equity-promoting approaches are not considered at every stage of the design of digital tools [ ].Complementary models such as the Digital Health Equity Framework address multilevel dimensions of population access to health care and build from the socioecological model to demonstrate that multilevel factors such as digital literacy, community infrastructure, and policy must be addressed to mitigate inequities [
]. Access is described by Levesque et al [ ] in health care access conceptual framework as an individual’s opportunity and ease of using appropriate services in proportion to their needs [ ]. Although access is related to price, quality, and availability, it is also impacted by individuals’ behaviors; individuals must use the service, which depends on many factors, such as an individual’s preferences, values, knowledge, age, abilities, and level of clinical need.Bringing complementary models together can identify unique opportunities for digital health access that are more vital in addressing health inequity [
]. Behavioral scientists have contributed to this growing field of digital health equity in areas such as integration of equity principles into digital interventions [ ], inclusion of user-centered or co-design methods for cultural tailoring of digital health interventions [ ], development of new ways to engage historically marginalized groups [ ], and engagement of the community through formative evaluations when digitizing interventions for dissemination [ ]. As the proliferation of digital health technologies for behavior change continues, the potential for wide-scale public impact across disciplines (eg, engineering, psychology, nursing, and public health) and disease and illness foci (eg, diabetes, cancer, obesity, HIV, and mental health) could be further realized if strategies to promote equitable access are used at all levels of the socioecological model. Our viewpoint is that (1) digital health tools have the potential to improve health equity if equitable access is achieved, and (2) improving access and equity in digital health can be strengthened by considering behavioral science–based strategies embedded in all phases of tool development. Our paper is the first to integrate equity (ConNECT) and access frameworks (Levesque et al [ ]) to explore how dimensions of access impact digital health equity comprehensively. This paper aims to examine key drivers of inequities at multiple access levels and provides actionable strategies to promote digital health equity across stages of development, delivery, dissemination, and sustainment.Methods and Guiding Principles
Health equity is an important focus within behavioral medicine, specifically the Society of Behavioral Medicine [
]. This paper aims to articulate a behavioral medicine perspective to improve digital health equity. Coauthors represent a multidisciplinary group of behavioral scientists from the Society of Behavioral Medicine spanning academia, industry, and nonprofit organizations with expertise in informatics, health services research, dissemination and implementation science, and health disparities research. Leveraging our working group’s diverse experiences and expertise, we cataloged the key challenges of equitably implementing, disseminating, and sustaining digital health interventions among diverse populations and settings. As we compiled these challenges, six guiding principles emerged to generate a shared understanding critical to clarifying our perspectives that follow.First, the field of digital health requires the application of overarching ethical principles and several unique considerations as outlined in the Ethics Checklist for Digital Health Research: engagement of end users; informed consent; equity, diversity, and access; privacy and partnerships; regulation and law; and return of results [
].Second, beyond ethical considerations of technology, connectivity, monitoring, and data management, it is critical to consider social, cultural, economic, infrastructure, policy, and other intersectionalities to promote digital health equities.
Third, digital health tools can be designed for and disseminated directly to individuals (eg, wearable devices) or can be used or delivered by health care organizations and teams. These distribution pathways have unique implications for implementation, dissemination, and sustainability (eg, funding sources) that result in unique drivers of inequities at multiple socioecological levels (providers, individuals, health care systems, third-party payors, and public health).
Fourth, understanding the groups that are underserved by digital health is a critical step. This paper refers to these groups broadly as underserved populations. By this, we mean people and communities disadvantaged by our systems and policies, including racial and ethnic groups, non–US-born persons, people with lower incomes, rural communities, people with disabilities, lesbian, gay, bisexual, transgender, queer, intersex, and asexual communities, and people who are incarcerated. Our intention is to speak broadly and without stigma to advance digital health for all.
Fifth, behavior change is inherent to the success of digital health interventions. All digital tools require behavior change; in other words, they require the user (individual, provider, and health system) to use the technology to generate impact for positive health outcomes. Digital tools may also have behavior change (eg, blood pressure self-monitoring and promotion of physical activity) as their primary purpose. Sometimes, behavior change must occur at multiple levels to generate the intended outcome. For example, a clinical decision support tool to promote cancer screening requires the clinician to change the way in which they are delivering care and requires the patient to get screened.
Sixth, to achieve equity, multilevel strategies (individual-, developer-, organizational-, and policy-levels) are necessary to consider during the design, dissemination, implementation, and sustainment stages of digital health interventions.
Theoretical Framework: Limited Access Drives Digital Health Inequity
We propose that overlaying a behavioral medicine perspective with multilevel, intersecting strategies that address digital health access inequities can yield greater reach, adoption, and impact of digital health across diverse populations. Applying the access framework by Levesque et al [
] to the digital divide can promote equity by considering the multiple dimensions of access to digital health: approachability, acceptability, availability, affordability, and appropriateness. Our adaptation of this framework specifies a digital access application, rather than health care access more broadly, and integrates intersecting factors influencing digital health accessibility and accounting for the barriers experienced at multiple steps. We found the framework by Levesque et al [ ] useful for examining specific digital health inequities and presenting our application within the 5 access dimensions ( ). We adapted specific digital health access barriers, focusing on multilevel factors that may generate differences in one’s desire or perception of need and the ability to seek, reach, pay for, and engage with digital health [ , ]. Our framework uses a socioecological perspective to describe multilevel drivers of inequities and strategies to generate equitable access. This is critical, as digital health tools may be used by individuals and health care teams and disseminated through companies and organizations, as noted in principle 3 in the Methods and Guiding Principles section.Drivers of Digital Health Inequities Using the Health Care Access Conceptual Framework
Approachability: As a Driver of Digital Health Inequities
A digital health tool is approachable if an individual is aware of the tool and perceives a need for it. However, awareness of digital health tools may vary among social and geographical population groups. Levesque et al [
] propose that transparency of data collection or use, tool content, and outreach activities all contribute to the approachability of health care services. However, outreach activities are often not tailored to diverse subpopulations within the intended audience and, therefore, do not equally increase awareness and produce the intended outcome for all groups, especially underserved populations [ , ]. Additionally, Levesque et al [ ] indicate that individuals must perceive a need for care (ie, the digital health intervention), which is impacted by factors such as health knowledge and health-related beliefs. Individuals may lack a perceived need for a digital health tool that has not established credibility, particularly among underserved populations, and faces fundamental challenges with efficacy, validity, and compliance.Acceptability: As a Driver of Digital Health Access Inequities
The acceptability of a digital health tool influences the decision to initially adopt and continuously engage with the digital tool, which is a precursor to receiving the intended health benefit [
]. Acceptability is interconnected with the approachability of a digital health tool by influencing one’s perceptions of needing the tool as well as the willingness to share about the tool with others and influences one’s perceptions of the appropriateness. Differences in culture, values, digital health literacy, numeracy, physical ability, visual acuity, hearing, and structural impediments influence an individual’s acceptance and interactions with digital health tools [ ]. Digital health tools that do not account for unique social and cultural factors, particularly among historically underserved groups, are often less relatable [ ] and increase people’s hesitance to use and benefit from them. This discrepancy in the acceptance of the digital health tool may be due to the failure of digital developers to incorporate the diverse views of end user perspectives, including the individual user and those who may deliver (eg, health care teams) the tool, in the conceptualization and design phases [ - ]. This results in tools that are unintentionally designed with features that are unappealing or inaccessible for the individuals and communities for which they are intended [ ].People who are visually impaired, color blind, older adults, and people from different races, ethnicities, sexual orientations, or abilities all have unique needs and preferences that should be considered [
]. Beliefs about the efficacy of the digital tool may influence initial acceptance and continued use [ ]. For example, beliefs regarding the provider’s ability to deliver quality care using telehealth were associated with fewer telehealth visits during the COVID-19 pandemic among African American individuals with diabetes [ ], and overall, African American individuals have limited trust in the health benefits of digital health interventions [ ]. Concerns with data privacy and security also reduce trust or willingness to use digital tools, especially among African American individuals [ ].A critical consideration is whether the care team also believes in the ability and security of the tools to improve care and patient outcomes, specifically for underserved populations [
]. The care team may be aware and hold beliefs about digital health tools that reduce their acceptability and impact the health care team members’ and organizations’ readiness and willingness to use a digital tool or recommend one to the patient. If a care team member does not share about a digital health tool, it may reduce a patient’s awareness (approachability) of the tool. In addition, the continued lack of resources and support for use (eg, IT support and training) increases perceptions that digital tools disrupt workflows and delivery of care [ , ]. These fundamental challenges may compromise credibility among health care providers and executives and further impact the approachability and integration of digital health into the health care system.Availability: As a Driver of Digital Health Inequities
Availability is the ability to reach and use digital health tools in a timely manner. Availability is largely dictated by an individual’s access to devices (eg, smartphones and computers) and broadband internet. In 2021, 85% of Americans owned a smartphone, and 77% had broadband access, making smartphones and SMS text messaging intervention an appealing approach for widespread reach [
, ]. Access to broadband is so critical to health that it has been advocated for as a social determinant of health [ ]. Although broadband access continues to rise, limited access has been associated with specific racial minority groups, lower education, lower income, living in rural areas, and the process of digital redlining (ie, the creation and perpetuation of inequities between marginalized groups through technology) [ , ]. Access to broadband internet also impacts how health interventions are delivered. For example, individuals who lack access to the internet at minimum connection speeds will typically be unable to access digital interventions that depend on features such as streaming and video calls (eg, Zoom).At the organization and systems levels, enhanced access to services that support digital health is a concern. Health care facilities in underserved rural and urban communities have limited resources for implementing advanced digital functions, such as telehealth services [
]. This has increased disparities in access to mental health services among children in low-resourced areas where they are unable to access internet-based visits with providers [ ]. Availability within a clinic or organization may also be limited by poor design and implementation planning, which leads to failure to integrate the digital health tool into the workflow and inadequate training health care teams to deliver digital health interventions routinely [ ]. Lack of infrastructure and resources (eg, staff, IT support, internet access, and devices) within clinics has been cited as a continued barrier to using digital health tools despite their rapid growth [ , ]. Furthermore, academic researchers often rely on time-limited grants to develop digital health tools, and these grants provide limited financing for the long-term operation, hindering the scalability and availability of digital health tools beyond the pilot stage of the intervention.Affordability: As a Driver of Digital Health Access Inequities
Affordability is the economic capacity for people to spend resources and time to use appropriate services [
]. In digital health, this may be costs for the individual user (eg, patient), staff delivering care, and organization providing the digital health intervention (eg, clinic and hospital system). Costs may include obtaining digital devices or applications (eg, physical activity trackers, blood pressure monitors, or smartphones, and apps); connectivity for internet data transfer; and geolocation, which may be particularly prohibitive for individuals or organizations in underserved communities [ , - ].At the clinic level, disparities exist in the type of informatics systems afforded (eg, electronic health record [EHR] systems) and if and how new technologies can be easily adapted. For example, the digital infrastructure in community clinics may be less adaptable than the systems used by academic medical centers (eg, lack of skip logic, display logic in data collection forms, and lack of ability to place a referral from a questionnaire in the EHR). These system design challenges hamper health care by diminishing the process of collecting information, in particular, on patient social and behavioral determinants of health and making referral to appropriate services. Inequities may also stem from disparate costs during the development of digital health tools, as the necessary inclusion of end users in the design process of digital health solutions is time-intensive and costly [
]. In addition, consideration of the costs of maintaining digital health tools, the necessary digital infrastructure, and technical support is necessary for equitable, effective, and efficient digital care.The unique approach to affordability by Levesque et al [
] provides insight into costs not only as a mechanism of payment for a service or tool but also as indirect costs (eg, time to use the tool) and opportunity costs (eg, time needed to learn how to use a new digital health tool). In particular, populations with low digital literacy (eg, older generations) may require more time and support to learn how to use digital tools, and this increases the opportunity costs and limits their ability to access digital health tools at the same rate as other users [ , ].Appropriateness: As a Driver of Digital Health Access Inequities
Appropriateness refers to the ability of digital health tools to adequately address an individual’s needs. When a tool is appropriate, individuals remain engaged and experience the benefits. Personal factors (eg, digital health literacy, language, stigma, and age) and technological factors (eg, not adapted for different abilities, confusing interface, and lack of structure) drive inequities in engagement and effectiveness that impact the ability of a digital health tool to meet the needs of the user. The rapid digitization of health care has implications for health care providers who are serving these diverse populations, including older adults who are more likely to have low digital literacy and may not be as able to benefit from these technologies [
]. Furthermore, low levels of digital literacy among older adults increases loneliness and reduces health seeking behaviors and quality of life [ , ]. As an indicator of appropriateness, a systematic review on the usability of digital health interventions for anxiety, depression, and somatoform disorders found that participants’ initial beliefs and the amount of support and personalization that they received influenced engagement and dropout [ ].Appropriateness can also be conceptualized at a population level by evaluating who is accessing and benefiting and who may not be benefiting [
]. Digital health studies often lack both the measurement of social and digital determinants of health and the representation of people from underserved communities that would enable research evaluations on appropriateness and equitable effectiveness [ ]. By being excluded from intervention efficacy and effectiveness studies [ - ], underserved populations experience health data poverty [ ] or the inability for some individuals or groups to benefit from innovation due to lack of representation. In addition, data-driven interventions (eg, machine learning techniques) built from homogenous samples risk being ineffective or harmful to groups not included in the initial design process and could increase the digital divide [ ]. Without understanding who is accessing and benefiting, developers cannot design digital tools to improve health and well-being for everyone and risk creating biased or racist technology [ ]. Further exacerbating these issues are the systems-level issues such as racial disparities in research funding for behavioral medicine [ ] and a lack of scholar representation from underserved populations [ , ] that impact the equitability of research evaluation and ultimately impact the appropriateness of digital health interventions.Proposed Strategies to Improve Equitable Access
Overview
To address these drivers of inequitable access, we propose a strategic model (
) for advancing digital health access to foster health equity. The digital health model, adapted from the ConNECT framework [ ] and health care access conceptual framework by Levesque et al [ ], considers health inequities in access (far left), implementation stages and actors (middle), and subsequent influences on health behaviors and more equitable health outcomes (far right). Strategies to improve access are presented and summarized in [ , , , , , , - ]. These include design strategies followed by delivery, dissemination, and sustainability strategies to address digital health access inequities. Consideration of subsequent phases of delivery, dissemination, and sustainability during the design phase (ie, designing with the end in mind) can support sustained impact on health behaviors and health equity [ ]. Considerations of evaluation and ethics should be applied across all stages to further ensure equitable access. While many levels of influence exist, we focus primarily on the developers, delivery agents, and systems as key actors for proposed strategies. We consider developers to include academics, industry, and governmental or nongovernmental organizations that develop digital health solutions in collaboration with end users. Delivery agents include individuals who provide or deliver the solution to the end user (eg, clinicians and health care team members) and their organizations (eg, clinics, hospitals, broadband suppliers, and other organizations). Systems include the policies and funding structures in which users and suppliers are embedded.Design Strategies
Digital health tools designed using a theoretical basis, using behavior change techniques and in response to an end user’s needs and desires (eg, health issues perceived as critical) and background (eg, social identities, digital and health literacy, language, and stigma) can improve their acceptability, approachability, and appropriateness [
]. Developers improve access by determining and enlisting the input of their customers and target users, whether the tool serves a broad population or offers more personalized support to people with specific social identities (eg, health apps for different races, ethnic, or age groups) [ ]. Design approaches that strive for a one-size-fits-all end product may not address the unique challenges faced by different populations, ultimately reducing use and impact of the digital tool.Customer discovery and value proposition design, a form of stakeholder engagement based on marketing and LeanStartup business methods [
], can be used to understand the problem and articulate the product’s hypothesized unique value proposition relative to alternative options available to end users. This approach aims to identify a need or clinical problem requiring a solution, articulate a strong value proposition, and identify outcome measures that are meaningful to users to demonstrate efficacy and achieve buy-in [ , , ]. Customer discovery has been applied to sustaining health informatics innovation and is foundational to the Innovation-Corps program for academic entrepreneurs developed by the National Science Foundation and adapted for health researchers by the National Center for Advancing Translational Sciences [ , ].User-centered or participatory design methods may promote equitable access by designing tools that are relevant for different lived experiences and provide the information that individuals want, delivered how they like to receive it, and share it in a way that is secure and appeals to them in a user interface, resulting in a tool that is useful and accessible [
- ]. However, this approach is only successful when the intended users are broadly represented and engaged in the design process, underlying data, and product evaluation. Ensuring the intended audience is well-represented within design sessions and communicating who the tool was designed for can be challenging due to the intersectionality and diversity of individuals. Remaining cognizant of historical drivers of individual- and population-level inequities, including digital and health literacy and numeracy [ ]; linguistic barriers [ ]; and the uptake of a digital intervention for individuals with physical or cognitive limitations, including those more common among older adults age (eg, visual impairment), throughout design (and subsequent phases of implementation) is critical [ ].Equity of digital health tools is improved by undergoing usability testing by diverse, underserved individuals, including those of different generations, leveraging user experience methods, such as heuristic evaluations (does the tool meet the 10 general principles for user experience design and provide a usable experience?) and unmoderated tests (what is working and not working about the experience?). User testing may reveal technological aspects that can improve engagement from underserved groups, such as a simple interface, succinct content, reminders, feedback on progress, and acknowledgment of achievements [
]. The expansion of funding models to adequately support the described iterative design processes is critical to developing a product with the potential to be effective and equitable for underserved populations.Delivery Strategies
Intentional implementation and sustainability plans codeveloped with the end users are critical to the integration of these solutions into routine practice to make them an integral, consistent part of patients’ experience in health care. Ross et al [
] provide a nice example of using a systematic approach to implementation planning and execution. We urge others to share their implementation plan, including specific strategies, the plan development process, and adaptations made during delivery to generate a shared learning of the best approaches to implementing digital health solutions. The Expert Recommendations for Implementing Change provides discrete implementation strategies that are widely applicable and may be specified for digital health implementation in clinical care [ - ].Ethnography may be used to observe and generate workflows that clarify the “patient journey” and points in the care visit where and by whom digital health tools should be used [
]. In addition to workflows or process maps, implementation plans may include strategies to address device ownership, broadband access, and digital health literacy screening as part of routine practice [ ]. Understanding the ability of individuals to use a digital tool and the number and types of devices available in a household and whether those devices have sufficient bandwidth to support access such as telehealth conferencing is critical. Continued reimbursement for telehealth visits is necessary for successful implementation [ ]. Offering digital health interventions in various formats (eg, virtual, real-time web-based help, in-person, and home assistance programs) may improve the ability to engage diverse, underserved populations [ ].Adequate training and ongoing technical support are needed for the end user to engage and benefit from the digital health tool successfully. Some clinics use a community-based navigator who could be trained to explain digital solutions to patients; connect patients to low-cost desktop, tablet, and mobile equipment and broadband or mobile data via local partnerships and federal subsidies; and provide ongoing support. At a systems-level, health care organizations should partner with community colleges, public libraries, and other community-based organizations to develop education and skill-building programs to address digital literacy gaps among underserved populations. Capacity (eg, staffing and time) of health care and community-based organizations and funding may be a challenge to institute and sustain these types of partnerships.
Dissemination Strategies
Active and tailored dissemination of digital health tools to the target audience through determined channels and planned strategies will increase awareness (ie, approachability) and access to digital health solutions [
]. Communicating about digital health using audience segmentation, that is, the process of dividing your audience into segments and matching your communication channels and strategies to meet their preferences and needs, is necessary to increase awareness among historically underserved populations (eg, African American individuals and people living in rural communities) [ ].Forging a partnership between academics and industry is a unique strategy for academics to outsource the commercialization mindset and use strategies to improve widespread access. Using a flexible business and revenue model beyond the organization claiming intellectual property rights may reach more organizations and individuals [
]. One dissemination strategy may be to develop a platform, such as the one developed in Germany [ ], where evidence-based digital health tools can be easily found. Criteria for defining what classifies as evidence-based, generating buy-in from health care providers, and maintaining such platform for universal use may present challenges to implementing this strategy [ ]. Another crucial strategy is to support the early adopters of these innovations and to make their use of and benefit from the digital health tool observable. Strategies of crowdsourcing innovators and citizen science platforms support the sharing of tools that seek to solve scientific challenges that are important to the user [ - ]. Furthermore, involving health care workers from underserved populations as trusted messengers of digital health solutions may also increase reach and adoption among diverse groups [ ]. Finally, and perhaps most importantly, it is necessary to create and foster an organizational culture of tolerance and patience for change and adoption for new innovations within health care institutions because diffusing innovations from early adopters to other segments in society requires significant time and energy from all stakeholders [ , ].Sustainability Strategies
Addressing disparities in affordability is particularly critical to sustaining access to digital health solutions. When scaling up an effective digital health solution, a sustainable funding plan must be developed from the outset to support long-term growth, which may require private-public partnerships. Government subsidies for broadband subscriptions and data charges for mobile health applications may help reduce individual costs. Additionally, broadband access can be expanded through community infrastructure, such as broadband hot spots in public spaces, including libraries and community centers [
]. McCall et al [ ] recently outlined multilevel strategies to combat digital redlining (eg, intentional lack of investment in broadband) and expand broadband access and quality to all communities [ , ].At the policy-level, regulations are needed that ensure internet service providers build infrastructure that meets the minimum requirements for high-speed internet, as defined by the Federal Communications Commission [
]. Renewed funding of government subsidies and programs such as the Regional Health Information Technology Extension Centers, which successfully promoted the adoption of EHRs in community clinics nationwide up until 2015, should be renewed to support clinics in underserved communities [ , , ]. As the COVID-19 pandemic has highlighted, offering telehealth services can increase access to care and support underserved populations. Continued reimbursement for telehealth visits by both state Medicaid programs and the Centers for Medicare and Medicaid Services is critical to sustain improved access.Overarching Considerations: Evaluation and Ethics
Evaluating effectiveness of digital health interventions and sharing the results among underserved target populations is critical to improving approachability of digital health tools among these groups. Process evaluation that includes examination of metrics, such as acceptability, is critical throughout design, implementation, dissemination, and sustainment phases. Examination of acceptability, for example, may provide insights into reasons for low use or effectiveness and implications for the fidelity of both delivery and receipt of the intervention [
]. Evaluation ensures solutions are inclusive, equitable, and appropriate to address a health problem and to solve critical gaps in health care delivery. Implementation science and community-based participatory research literature can provide established approaches to consider in evaluation of digital health tools [ - ]. If digital health equity is to be realized, developers need a strong research focus with expanded funding mechanisms and support for implementing and evaluating innovative designs and analyses (eg, stepped-wedge designs, sequential multiple assignment randomized trial designs, and pragmatic randomized controlled trials) that simultaneously consider effectiveness and implementation (eg, engagement and integration in workflow) [ ]. Digital health companies are growing rapidly and should include research teams to use these methodologies to validate the effectiveness of these technologies on health and health equity outcomes. The need for collaboration by researchers and digital health companies has been acknowledged through funding mechanisms, such as the National Institutes for Health (NIH) Small Business Innovation Research and Small Business Technology Transfer, that support research or business collaboration. These NIH funding mechanisms provide great opportunities for digital health solutions created in the private sector to benefit from the research expertise of clinical scientists and evaluate their solutions early in the process.When considering the appropriateness of digital health tools for achieving the intended impacts across different demographic groups, we must also reduce health data poverty [
] by being advocates for populations who lack data, incorporating deliberative research and citizens’ juries (ie, inclusion of the community in decision-making), and communicating with people on how their data are being used and protected. It is critically important to create data sets that are representative of marginalized and underrepresented populations by using community-based participatory research methods and encouraging data sharing initiatives across digital health tools [ , ]. Justifying exclusion criteria should be provided to ensure that we are engaging diverse participants in digital behavioral health interventions and evaluation [ ]. In addition, to address structural issues, funders, regulators, and policy makers should require digital health interventions and tools to perform appropriately and be usable for different populations (especially historically underrepresented groups) and settings [ ]. In addition, and to act on multiple levers of change within the society, funders may also create separate funding mechanisms to specifically support the development or adaptation of digital health tools tailored for historically marginalized groups. In case successful digital health tools were already created for the mainstream population, these mechanisms can ensure that separate digital health tools with similar missions are available for marginalized groups with specific needs.All tools should use ethical principles and theories in design, including confidentiality, inclusivity, and transparency [
]. To increase trust in digital health tools, there needs to be greater transparency in transferring and sharing data collected using behavioral digital technology [ ] while maintaining privacy and security and returning results to patients or participants [ , , ]. Core elements of privacy to ensure when using personal and remote individual digital monitoring include safety and security in digital services for data collection, transfer, storage, management, and sharing [ , , , ]. The Connected and Open Research Ethics (CORE) tool may support researchers and institutional review boards with data privacy, transfer, and transparency to support digital health research [ ]. CORE may be used to find or share informational resources (eg, institutional review board and consent documents) or receive feedback from experts. Using approaches, such as CORE, to improve confidentiality and transparency are particularly important when working with historically marginalized populations who have faced ostracization, discrimination, and even physical danger from privacy violations. For example, during the HIV and AIDs epidemic, lesbian, gay, bisexual, transgender, and queer individuals were fearful that their HIV and AIDs status would be disclosed and that they would face stigma at work or risk losing their job. More recently, individuals who menstruate have expressed concerns regarding data privacy and security when using period-tracking apps and the potential harmful consequences of these data being misused in a post–Roe v. Wade era. Outside health care, data privacy has implications for discriminatory advertising, racially biased policing, and the outing or surveillance of historically marginalized populations. Intellectual property, policies, and data governance structures must be addressed to safeguard personal behavioral data and rights that adhere to policy and law, especially for historically marginalized populations [ , ].Discussion: Focusing Future Solutions for Equitable Digital Health Access
Overview
The “promises and perils” of digital tools to achieve health equity have been highlighted for over a decade [
, ], but success in achieving equitable access to health technologies remains challenging. Our paper addresses renewed concerns regarding equity in digital health access that were deepened during the COVID-19 pandemic [ - ]. Using behavioral, equity, and access frameworks allows for a unique and comprehensive exploration of current drivers of digital health inequities. It allowed a compilation of strategies that have the potential for actionable impact on digital health equity.We propose a model that emphasizes using multilevel strategies across stages of design, delivery, dissemination, and sustainment to advance digital health access and foster health equity. Strategies were shaped with a behavioral medicine focus, as the field has a unique role in improving digital health access; arguably, all digital tools require the user (individual, provider, and health system) to change behavior by engaging with the technology to generate impact. Furthermore, digital health tools targeting health behaviors (eg, physical activity and mental health apps) have recently exploded [
]. Finally, a breadth of behavioral research offers critical evidence to draw upon from individual to population effects, providing a myriad of behavior change tools and strategies that have been shown to be effective, to have broad reach, and to have the potential to be widely disseminated and sustained.Multilevel factors drive unequal access, so strategies require action from tool developers, individual delivery agents, organizations, and systems to effect change. We outline key strategies at multiple stages, albeit not exhaustive, to promote digital health equity to achieve the intended health outcomes and consequences (
). Multilevel solutions are highlighted for key producers of digital approaches and recommendations to engage diverse end users to develop representative, acceptable, and appropriate tools for the intended audiences. Once designed, digital health tools demonstrating usability and accessibility require further evaluation to address dissemination and implementation challenges at organizational and systems levels [ ]. Successful and sustainable digital health approaches are supported by multifaceted strategies, culturally and linguistically appropriate methods, tailoring, establishment of mutual partnerships, and community engagement.Implicit in our model is the potential for multidisciplinary and team-based approaches in applying recommended strategies. Given the important role of industry in creating new digital tools, exploring new models of academic, community, and industry partnerships is recommended to work upstream in addressing improved access [
- ]. While academics and industry approach development and evaluation differently [ ], synergy could be found in blending their strengths of evaluation and innovation. Academics focus on design, intervention, and efficacy testing, infusing behavioral theory and evidence before disseminating to end users for input. They often start with a targeted product that is personalized to a specific population or social identity and, even more often, is constrained by funding that requires this sequence of development. Conversely, industry develops a product for a broad audience and immediately disseminates it, iterating the functionality with user feedback and eventually examining effectiveness (if at all). The resulting products may be either effective but not widely used or engaging but not meaningfully effective to result in positive health outcomes. While the goal should be effectiveness, there are opportunities to design digital tools to improve the health and well-being for both everyone and for specific groups. This mixed approach is critical as different health providers and systems serve different populations, and the goal of health equity is to meet the specific needs of their population. While a combination of tools for both broad and specific populations is likely needed to achieve health equity, using ethical principles of transparency to state for whom the tool is designed and is proven to benefit and perhaps, more importantly, for whom the tool may not benefit is important to ensure adoption, use, and dissemination to the right individuals to achieve positive health impacts.Team science practices and experience can shape new ideas about forming digital health partnerships [
]. To begin, academics could consider hiring experienced commercial developers and designers on their team to infuse usability principles and integrate efforts toward sustainability from the outset of product development, and industry companies could consult with academic scientists or build an in-house team of experienced clinical researchers to integrate theory-based interventions and evidence-based practice. Behavioral science expertise could inform considerations of several issues, such as transparency and fairness in application software; how big data and self-monitoring may regulate or constrain behavior; how to obtain user consent for data use, especially by employers or insurance companies; and comparisons of in-person to digitally mediated health care [ ]. Developing meaningful collaborations with scholars from diverse underserved communities who are health equity experts is critical in addition to initiatives to transform institutional culture through programs such as NIH Build and the National Research Mentoring Network [ ]. Additionally, partnerships with community colleges, health departments, public libraries, and other community-based organizations are necessary for a bidirectional flow of information and resources that may support common goals of digital health access across systems, individuals, and national or state policies [ ]. These relationships can bridge multiple levels [ ] and consider and account for the interconnectedness and bidirectional nature of movement within and across internal (clinic or organization level) and external factors that shape digital health access.Limitations
While using behavioral, equity, and access frameworks allowed for a unique and comprehensive exploration of current drivers of digital health inequities and a compilation of strategies, a systematic literature search was not conducted. While the intent was to provide an overview of barriers, not using systematic methods may have limited our ability to generate content that is entirely comprehensive. This paper used a narrative search driven by the discussion and comparison of frameworks and drawn from the expertise of our multidisciplinary team. The authors are mainly behavioral scientists, and some are clinical providers; while they were culturally diverse, they may not reflect all perspectives across all demographic and cultural groups. This may limit or bias the perspectives of our report. To reduce biases, we were intentional about drawing from the literature and do acknowledge that this is a viewpoint paper that reflects some positionality of the authors.
Conclusions
Health equity is an ethical imperative that digital health equity can contribute to achieving. Digital health tools have the potential to reduce health inequities when equitable access is achieved. Applying behavioral science perspectives to better understand the multilevel factors driving unequal access can contribute to solving existing and emerging health disparities. Addressing concerns that threaten the widespread benefit from effective and validated digital health tools to society and further prevent benefit for historically marginalized communities needs urgent attention to bring these solutions to those most in need. Transdisciplinary teams that use this integrated digital health equity model (
) and strategies across design, delivery, dissemination, and sustainability stages may significantly improve digital health access and health equity.Acknowledgments
This group was formed from the Digital Equity and Implementation working group of the Society for Behavioral Medicine. The authors would like to acknowledge the support of the Behavioral Informatics and Technology and Healthy Equity special interests groups. MMK received funding that partially supported this project from the National Heart Lung and Blood Institute of the National Institutes of Health (K01HL167993) and the Centers for Disease Control and Prevention (U48DP006395). MMK and LMK were partially supported by the National Cancer Institute (P50CA244431). LAF was supported by the National Institute on Minority Health and Health Disparities of the National Institutes of Health (K01MD017630). NMA is the Canada Research Chair (tier 2) in Behavioural Health Intervention, Department of Psychology at Concordia University, and this work was funded, in part, by funds provided via the Canada Research Chair Program. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
Authors' Contributions
All authors contributed to the writing and editing of the manuscript. MMK and LMK led the conceptualization of the paper.
Conflicts of Interest
None declared.
Strategies for developers, delivery agents, and systems to improve access and promote digital health equity.
DOCX File , 26 KBReferences
- Alcaraz KI, Sly J, Ashing K, Fleisher L, Gil-Rivas V, Ford S, et al. The ConNECT Framework: a model for advancing behavioral medicine science and practice to foster health equity. J Behav Med. Feb 10, 2017;40(1):23-38. [FREE Full text] [CrossRef] [Medline]
- Pagoto S, Bennett GG. How behavioral science can advance digital health. Transl Behav Med. Sep 17, 2013;3(3):271-276. [FREE Full text] [CrossRef] [Medline]
- Chunara R, Zhao Y, Chen J, Lawrence K, Testa PA, Nov O, et al. Telemedicine and healthcare disparities: a cohort study in a large healthcare system in New York City during COVID-19. J Am Med Inform Assoc. Jan 15, 2021;28(1):33-41. [CrossRef] [Medline]
- Crawford A, Serhal E. Digital health equity and COVID-19: the innovation curve cannot reinforce the social gradient of health. J Med Internet Res. Jun 2, 2020;22(6):e19361. [CrossRef] [Medline]
- Dixit N, Van Sebille Y, Crawford GB, Ginex PK, Ortega PF, Chan RJ. Disparities in telehealth use: how should the supportive care community respond? Support Care Cancer. Feb 2022;30(2):1007-1010. [FREE Full text] [CrossRef] [Medline]
- Litchfield I, Shukla D, Greenfield S. Impact of COVID-19 on the digital divide: a rapid review. BMJ Open. Oct 12, 2021;11(10):e053440. [FREE Full text] [CrossRef] [Medline]
- What is digital health? U.S. Food & Drug Administration. Sep 22, 2020. URL: https://www.fda.gov/medical-devices/digital-health-center-excellence/what-digital-health [accessed 2024-07-04]
- Mohammed HT, Hyseni L, Bui V, Gerritsen B, Fuller K, Sung J, et al. Exploring the use and challenges of implementing virtual visits during COVID-19 in primary care and lessons for sustained use. PLoS One. Jun 24, 2021;16(6):e0253665. [FREE Full text] [CrossRef] [Medline]
- van Dijk J, Hacker K. The digital divide as a complex and dynamic phenomenon. Inf Soc. Sep 2003;19(4):315-326. [CrossRef]
- Bernhardt JM. Health education and the digital divide: building bridges and filling chasms. Health Educ Res. Oct 2000;15(5):527-531. [CrossRef] [Medline]
- Hall AK, Bernhardt JM, Dodd V, Vollrath MW. The digital health divide: evaluating online health information access and use among older adults. Health Educ Behav. Apr 25, 2015;42(2):202-209. [FREE Full text] [CrossRef] [Medline]
- Taylor CB, Fitzsimmons-Craft EE, Graham AK. Digital technology can revolutionize mental health services delivery: the COVID-19 crisis as a catalyst for change. Int J Eat Disord. Jul 25, 2020;53(7):1155-1157. [FREE Full text] [CrossRef] [Medline]
- Torous J, Wykes T. Opportunities from the coronavirus disease 2019 pandemic for transforming psychiatric care with telehealth. JAMA Psychiatry. Dec 01, 2020;77(12):1205-1206. [CrossRef] [Medline]
- Levesque JF, Harris MF, Russell G. Patient-centred access to health care: conceptualising access at the interface of health systems and populations. Int J Equity Health. Mar 11, 2013;12(1):18. [FREE Full text] [CrossRef] [Medline]
- Veinot TC, Mitchell H, Ancker JS. Good intentions are not enough: how informatics interventions can worsen inequality. J Am Med Inform Assoc. Aug 01, 2018;25(8):1080-1088. [FREE Full text] [CrossRef] [Medline]
- Bouchard LC, Yanez B, Dahn JR, Flury SC, Perry KT, Mohr DC, et al. Brief report of a tablet-delivered psychosocial intervention for men with advanced prostate cancer: acceptability and efficacy by race. Transl Behav Med. Jul 16, 2019;9(4):629-637. [FREE Full text] [CrossRef] [Medline]
- Verbiest M, Corrigan C, Dalhousie S, Firestone R, Funaki T, Goodwin D, et al. Using codesign to develop a culturally tailored, behavior change mHealth intervention for indigenous and other priority communities: a case study in New Zealand. Transl Behav Med. Jul 16, 2019;9(4):720-736. [CrossRef] [Medline]
- Hurtado-de-Mendoza A, Serrano A, Zhu Q, Graves K, Fernández N, Fernández A, et al. Engaging Latina breast cancer survivors in research: building a social network research registry. Transl Behav Med. Jul 17, 2018;8(4):565-574. [FREE Full text] [CrossRef] [Medline]
- Renfro T, Johnson E, Lambert DN, Wingood G, DiClemente RJ. The MEDIA model: an innovative method for digitizing and training community members to facilitate an HIV prevention intervention. Transl Behav Med. Nov 21, 2018;8(6):815-823. [CrossRef] [Medline]
- Lyles CR, Wachter RM, Sarkar U. Focusing on digital health equity. JAMA. Nov 09, 2021;326(18):1795-1796. [CrossRef] [Medline]
- Shen FX, Silverman BC, Monette P, Kimble S, Rauch SL, Baker JT. An ethics checklist for digital health research in psychiatry: viewpoint. J Med Internet Res. Feb 09, 2022;24(2):e31146. [FREE Full text] [CrossRef] [Medline]
- Cu A, Meister S, Lefebvre B, Ridde V. Assessing healthcare access using the Levesque's conceptual framework- a scoping review. Int J Equity Health. May 07, 2021;20(1):116. [FREE Full text] [CrossRef] [Medline]
- Alsan M, Stanford FC, Banerjee A, Breza E, Chandrasekhar AG, Eichmeyer S, et al. Comparison of knowledge and information-seeking behavior after general COVID-19 public health messages and messages tailored for Black and Latinx communities. Ann Intern Med. Apr 2021;174(4):484-492. [CrossRef]
- Evans WD, Thomas CN, Favatas D, Smyser J, Briggs J. Digital segmentation of priority populations in public health. Health Educ Behav. Dec 19, 2019;46(2_suppl):81-89. [FREE Full text] [CrossRef] [Medline]
- Kwasnicka D, Keller J, Perski O, Potthoff S, Ten Hoor GA, Ainsworth B, et al. White paper: open digital health - accelerating transparent and scalable health promotion and treatment. Health Psychol Rev. Dec 14, 2022;16(4):475-491. [FREE Full text] [CrossRef] [Medline]
- Bhattacharyya O, Mossman K, Gustafsson L, Schneider EC. Using human-centered design to build a digital health advisor for patients with complex needs: persona and prototype development. J Med Internet Res. May 09, 2019;21(5):e10318. [FREE Full text] [CrossRef] [Medline]
- Njie-Carr VP, Jones-Parker H, Massey C, Baker D, Nganga-Good C. Leveraging community engagement to develop a mobile health application for older women with HIV infection. J Obstet Gynecol Neonatal Nurs. Nov 2018;47(6):833-843. [CrossRef] [Medline]
- Wray TB, Kahler CW, Simpanen EM, Operario D. User-centered, interaction design research approaches to inform the development of health risk behavior intervention technologies. Internet Interv. Mar 2019;15:1-9. [FREE Full text] [CrossRef] [Medline]
- Njie-Carr VP, Zhu S, Williams GC, Corless IB, Himelhoch S. Evaluation of a technology-enhanced intervention for older women with HIV infection: a proof of concept study. AIDS Care. Aug 24, 2021;33(8):983-992. [CrossRef] [Medline]
- Svendsen MJ, Nicholl BI, Mair FS, Wood K, Rasmussen CD, Stochkendahl MJ. One size does not fit all: participants' experiences of the selfBACK app to support self-management of low back pain-a qualitative interview study. Chiropr Man Therap. Oct 03, 2022;30(1):41. [FREE Full text] [CrossRef] [Medline]
- Rovner BW, Casten RJ, Chang AM, Hollander JE, Rising K. Mistrust, neighborhood deprivation, and telehealth use in African Americans with diabetes. Popul Health Manag. Dec 01, 2021;24(6):699-700. [FREE Full text] [CrossRef] [Medline]
- Yao R, Zhang W, Evans R, Cao G, Rui T, Shen L. Inequities in health care services caused by the adoption of digital health technologies: scoping review. J Med Internet Res. Mar 21, 2022;24(3):e34144. [FREE Full text] [CrossRef] [Medline]
- Lai S, Tanner B. Examining the intersection of data privacy and civil rights. Brookings Institution. Jul 18, 2022. URL: https://www.brookings.edu/articles/examining-the-intersection-of-data-privacy-and-civil-rights/ [accessed 2023-05-30]
- Bondaronek P, Dicken SJ, Singh Jennings S, Mallion V, Stefanidou C. Barriers to and facilitators of the use of digital tools in primary care to deliver physical activity advice: semistructured interviews and thematic analysis. JMIR Hum Factors. Aug 30, 2022;9(3):e35070. [FREE Full text] [CrossRef] [Medline]
- Ross J, Stevenson F, Dack C, Pal K, May C, Michie S, et al. Developing an implementation strategy for a digital health intervention: an example in routine healthcare. BMC Health Serv Res. Oct 19, 2018;18(1):794. [FREE Full text] [CrossRef] [Medline]
- Whitelaw S, Pellegrini DM, Mamas MA, Cowie M, Van Spall HG. Barriers and facilitators of the uptake of digital health technology in cardiovascular care: a systematic scoping review. Eur Heart J Digit Health. Mar 2021;2(1):62-74. [FREE Full text] [CrossRef] [Medline]
- Internet, broadband fact sheet. Pew Research Center. Jan 31, 2024. URL: https://www.pewresearch.org/internet/fact-sheet/internet-broadband/ [accessed 2024-07-04]
- Willcox JC, Dobson R, Whittaker R. Old-fashioned technology in the era of "bling": is there a future for text messaging in health care? J Med Internet Res. Dec 20, 2019;21(12):e16630. [FREE Full text] [CrossRef] [Medline]
- Benda NC, Veinot TC, Sieck CJ, Ancker JS. Broadband internet access is a social determinant of health! Am J Public Health. Aug 2020;110(8):1123-1125. [CrossRef] [Medline]
- McCall T, Asuzu K, Oladele CR, Leung TI, Wang KH. A socio-ecological approach to addressing digital redlining in the United States: a call to action for health equity. Front Digit Health. Jul 18, 2022;4:897250. [FREE Full text] [CrossRef] [Medline]
- Eccles MP, Mittman BS. Welcome to implementation science. Implement Sci. Feb 22, 2006;1:1. [CrossRef]
- Smith-East M, Starks S. COVID-19 and mental health care delivery: a digital divide exists for youth with inadequate access to the internet. J Am Acad Child Adolesc Psychiatry. Jul 2021;60(7):798-800. [CrossRef] [Medline]
- Palacholla RS, Fischer N, Coleman A, Agboola S, Kirley K, Felsted J, et al. Provider- and patient-related barriers to and facilitators of digital health technology adoption for hypertension management: scoping review. JMIR Cardio. Mar 26, 2019;3(1):e11951. [FREE Full text] [CrossRef] [Medline]
- Brall C, Schröder-Bäck P, Maeckelberghe E. Ethical aspects of digital health from a justice point of view. Eur J Public Health. Oct 01, 2019;29(Supplement_3):18-22. [FREE Full text] [CrossRef] [Medline]
- McCall HC, Hadjistavropoulos HD, Loutzenhiser L. Reconsidering the ethics of exclusion criteria in research on digital mental health interventions. Ethics Behav. Oct 31, 2019;31(3):171-180. [CrossRef]
- Digital equity in health services: practice brief. National Collaborating Centre for Determinants of Health and Nova Scotia Health Authority. 2022. URL: https://nccdh.ca/resources/entry/digital-equity-in-health-services [accessed 2024-07-04]
- Brewer LC, Fortuna KL, Jones C, Walker R, Hayes SN, Patten CA, et al. Back to the future: achieving health equity through health informatics and digital health. JMIR Mhealth Uhealth. Jan 14, 2020;8(1):e14512. [FREE Full text] [CrossRef] [Medline]
- Azzopardi-Muscat N, Sørensen K. Towards an equitable digital public health era: promoting equity through a health literacy perspective. Eur J Public Health. Oct 01, 2019;29(Supplement_3):13-17. [FREE Full text] [CrossRef] [Medline]
- Rodriguez JA, Casillas A, Cook BL, Marlin RP. The language of equity in digital health: prioritizing the needs of limited English proficient communities in the patient portal 2.0. J Health Care Poor Underserved. 2021;32(2S):211-219. [CrossRef]
- Li Q, Yang C, Zhao Z, Yang C, Chen Z, Huang D, et al. The relationship between internet use and loneliness of middle-aged and older adult people: the moderating effect of residence. Front Public Health. Jan 31, 2024;12:1284180. [FREE Full text] [CrossRef] [Medline]
- Ngiam NH, Yee WQ, Teo N, Yow KS, Soundararajan A, Lim JX, et al. Building digital literacy in older adults of low socioeconomic status in Singapore (project wire up): nonrandomized controlled trial. J Med Internet Res. Dec 02, 2022;24(12):e40341. [FREE Full text] [CrossRef] [Medline]
- Patel S, Akhtar A, Malins S, Wright N, Rowley E, Young E, et al. The acceptability and usability of digital health interventions for adults with depression, anxiety, and somatoform disorders: qualitative systematic review and meta-synthesis. J Med Internet Res. Jul 06, 2020;22(7):e16228. [FREE Full text] [CrossRef] [Medline]
- Chastain DB, Osae SP, Henao-Martínez AF, Franco-Paredes C, Chastain JS, Young HN. Racial disproportionality in Covid clinical trials. N Engl J Med. Aug 27, 2020;383:e59. [CrossRef]
- Loree JM, Anand S, Dasari A, Unger JM, Gothwal A, Ellis LM, et al. Disparity of race reporting and representation in clinical trials leading to cancer drug approvals from 2008 to 2018. JAMA Oncol. Oct 01, 2019;5(10):e191870. [FREE Full text] [CrossRef] [Medline]
- Polo AJ, Makol BA, Castro AS, Colón-Quintana N, Wagstaff AE, Guo S. Diversity in randomized clinical trials of depression: a 36-year review. Clin Psychol Rev. Feb 2019;67:22-35. [CrossRef] [Medline]
- Ibrahim H, Liu X, Zariffa N, Morris AD, Denniston AK. Health data poverty: an assailable barrier to equitable digital health care. Lancet Digit Health. Apr 2021;3(4):e260-e265. [CrossRef]
- Rajkomar A, Hardt M, Howell MD, Corrado G, Chin MH. Ensuring fairness in machine learning to advance health equity. Ann Intern Med. Dec 04, 2018;169(12):866. [CrossRef]
- Obermeyer Z, Powers B, Vogeli C, Mullainathan S. Dissecting racial bias in an algorithm used to manage the health of populations. Science. Oct 25, 2019;366(6464):447-453. [CrossRef] [Medline]
- Patel V. Mental health research funding: too little, too inequitable, too skewed. Lancet Psychiatry. Mar 2021;8(3):171-172. [CrossRef]
- Ginther DK, Kahn S, Schaffer WT. Gender, race/ethnicity, and National Institutes of Health R01 research awards: is there evidence of a double bind for women of color? Acad Med. Aug 2016;91(8):1098-1107. [FREE Full text] [CrossRef] [Medline]
- The advisory committee to the director working group on diversity: racism in science report. National Institutes of Health. Feb 14, 2021. URL: https://acd.od.nih.gov/documents/presentations/02262021DiversityReport.pdf [accessed 2024-07-04]
- Chang LW, Njie-Carr V, Kalenge S, Kelly JF, Bollinger RC, Alamo-Talisuna S. Perceptions and acceptability of mHealth interventions for improving patient care at a community-based HIV/AIDS clinic in Uganda: a mixed methods study. AIDS Care. May 08, 2013;25(7):874-880. [FREE Full text] [CrossRef] [Medline]
- Morrato EH, Hamer MK, Sills M, Kwan B, Schilling LM. Applying a commercialization-readiness framework to optimize value for achieving sustainability of an electronic health data research network and its data capabilities: the SAFTINet experience. EGEMS (Wash DC). Aug 29, 2019;7(1):48. [FREE Full text] [CrossRef] [Medline]
- Gibson B, Kramer H, Weir C, Fiol G, Borbolla D, Schlechter CR, et al. Workflow analysis for design of an electronic health record-based tobacco cessation intervention in community health centers. JAMIA Open. Jul 2021;4(3):ooaa070. [FREE Full text] [CrossRef] [Medline]
- Kepper MM, Walsh-Bailey C, Brownson RC, Kwan BM, Morrato EH, Garbutt J, et al. Development of a health information technology tool for behavior change to address obesity and prevent chronic disease among adolescents: designing for dissemination and sustainment using the ORBIT model. Front Digit Health. Mar 10, 2021;3:648777. [FREE Full text] [CrossRef] [Medline]
- O'Cathain A, Croot L, Duncan E, Rousseau N, Sworn K, Turner KM, et al. Guidance on how to develop complex interventions to improve health and healthcare. BMJ Open. Aug 15, 2019;9(8):e029954. [FREE Full text] [CrossRef] [Medline]
- Burgermaster M, Rosenthal M, Tierney WM, Altillo BS, Nordquist E, Enriquez C, et al. Nutri: a behavioral science-based clinical decision support for chronic disease management. AMIA Annu Symp Proc. 2022;2022:299-308. [FREE Full text] [Medline]
- Goodson L, Vassar M. An overview of ethnography in healthcare and medical education research. J Educ Eval Health Prof. Apr 25, 2011;8:4. [FREE Full text] [CrossRef] [Medline]
- Jin KY, Reichert F, Cagasan LPJ, de la Torre J, Law N. Measuring digital literacy across three age cohorts: exploring test dimensionality and performance differences. Comput Educ. Nov 2020;157:103968. [CrossRef]
- Oh SS, Kim KA, Kim M, Oh J, Chu SH, Choi J. Measurement of digital literacy among older adults: systematic review. J Med Internet Res. Feb 03, 2021;23(2):e26145. [FREE Full text] [CrossRef] [Medline]
- Blanc J, Hahn K, Oliveira B, Phillips R, Duthely LM, Francois L, et al. Bringing health care equity to diverse and underserved populations in sleep medicine and research through a digital health equity framework. Sleep Med Clin. Sep 2023;18(3):255-267. [FREE Full text] [CrossRef] [Medline]
- Vaughan EM, Cardenas VJJ, Chan W, Amspoker AB, Johnston CA, Virani SS, et al. Implementation and evaluation of a mHealth-based community health worker feedback loop for Hispanics with and at risk for diabetes. J Gen Intern Med. Feb 06, 2024;39(2):229-238. [CrossRef] [Medline]
- Njie-Carr V, Kalengé S, Kelley J, Wilson A, Muliira JK, Nabirye RC, et al. Research capacity-building program for clinicians and staff at a community-based HIV clinic in Uganda: a pre/post evaluation. J Assoc Nurses AIDS Care. 2012;23(5):431-441. [FREE Full text] [CrossRef] [Medline]
- Kusters IS, Dean JM, Gutierrez AM, Sommer M, Klyueva A. Assessment of COVID-19 website communication in languages other than English by local health departments in the United States. Health Commun. Jul 29, 2023;38(8):1519-1529. [CrossRef] [Medline]
- Barbieri M, Andreoni G. mHealth market exploitation through the analysis of the related intellectual property rights. In: Andreoni G, Perego P, Frumento E, editors. m_Health Current and Future Applications. Cham, Switzerland. Springer; 2019.
- Wangler J, Jansky M. Two years of approved digital health applications in Germany - perspectives and experiences of general practitioners with an affinity for their use. Eur J Gen Pract. Dec 15, 2023;29(1):2186396. [FREE Full text] [CrossRef] [Medline]
- Connecting Americans to health care. Federal Communications Commission. URL: https://www.fcc.gov/connecting-americans-health-care [accessed 2024-07-04]
- Phan P, Mitragotri S, Zhao Z. Digital therapeutics in the clinic. Bioeng Transl Med. Jul 03, 2023;8(4):e10536. [FREE Full text] [CrossRef] [Medline]
- Brewer LC, Asiedu GB, Jones C, Richard M, Erickson J, Weis J, et al. Emergency preparedness and risk communication among African American churches: leveraging a community-based participatory research partnership COVID-19 initiative. Prev Chronic Dis. Dec 10, 2020;17:E158. [FREE Full text] [CrossRef] [Medline]
- Ho E, Jeon M, Lee M, Luo J, Pfammatter AF, Shetty V, et al. Fostering interdisciplinary collaboration: a longitudinal social network analysis of the NIH mHealth Training Institutes. J Clin Transl Sci. Sep 20, 2021;5(1):e191. [FREE Full text] [CrossRef] [Medline]
- Baptist A, Gibson-Scipio W, Carcone AI, Ghosh S, Jacques-Tiura AJ, Hall A, et al. Asthma and technology in emerging African American adults (the ATHENA project): protocol for a trial using the multiphase optimization strategy framework. JMIR Res Protoc. May 10, 2022;11(5):e37946. [FREE Full text] [CrossRef] [Medline]
- Burgermaster M, Desai PM, Heitkemper EM, Juul F, Mitchell EG, Turchioe M, et al. Who needs what (features) when? Personalizing engagement with data-driven self-management to improve health equity. J Biomed Inform. Aug 2023;144:104419. [CrossRef] [Medline]
- Health Data Research UK homepage. Health Data Research UK. URL: https://www.hdruk.ac.uk/ [accessed 2024-05-02]
- Shaw JA, Donia J. The sociotechnical ethics of digital health: a critique and extension of approaches from bioethics. Front Digit Health. Sep 23, 2021;3:725088. [FREE Full text] [CrossRef] [Medline]
- Mental health technology advisory committee. American Psychological Association. URL: https://www.apa.org/practice/mental-health-techology-advisory-committee [accessed 2024-05-02]
- Kwan BM, Brownson RC, Glasgow RE, Morrato EH, Luke DA. Designing for dissemination and sustainability to promote equitable impacts on health. Annu Rev Public Health. Apr 05, 2022;43(1):331-353. [FREE Full text] [CrossRef] [Medline]
- Webb TL, Joseph J, Yardley L, Michie S. Using the internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy. J Med Internet Res. Feb 17, 2010;12(1):e4. [FREE Full text] [CrossRef] [Medline]
- Samarasekera U. The rise of racial minority health apps. Lancet Digit Health. Apr 2022;4(4):e218-e219. [CrossRef]
- Why the lean start-up changes everything. Harvard Business Review. 2013. URL: https://hbr.org/2013/05/why-the-lean-start-up-changes-everything [accessed 2024-07-04]
- Czajkowski SM, Powell LH, Adler N, Naar-King S, Reynolds KD, Hunter CM, et al. From ideas to efficacy: the ORBIT model for developing behavioral treatments for chronic diseases. Health Psychol. Oct 2015;34(10):971-982. [FREE Full text] [CrossRef] [Medline]
- Morrato EH, Lennox LA, Sendro ER, Schuster AL, Pincus HA, Humensky J, et al. Scale-up of the Accrual to Clinical Trials (ACT) network across the Clinical and Translational Science Award Consortium: a mixed-methods evaluation of the first 18 months. J Clin Transl Sci. Jun 30, 2020;4(6):515-528. [FREE Full text] [CrossRef] [Medline]
- Labrique A, Vasudevan L, Weiss W, Wilson K. Establishing standards to evaluate the impact of integrating digital health into health systems. Glob Health Sci Pract. Oct 10, 2018;6(Supplement 1):S5-17. [CrossRef]
- Bamgboje-Ayodele A, Smith A, Short CE, Fardell JE, Shaw J, Beatty L, et al. Barriers and facilitators to the availability of efficacious self-directed digital health tools for adults living with cancer and their caregivers: a systematic literature review and author survey study. Patient Educ Couns. Oct 2021;104(10):2480-2489. [CrossRef] [Medline]
- Higgins KS, Tutelman PR, Chambers CT, Witteman HO, Barwick M, Corkum P, et al. Availability of researcher-led eHealth tools for pain assessment and management: barriers, facilitators, costs, and design. Pain Rep. Sep 2018;3(Suppl 1):e686. [FREE Full text] [CrossRef] [Medline]
- Young AS. Overcoming the barriers to dissemination and implementation. In: Wulfovich S, Meyers A, editors. Digital Health Entrepreneurship. Cham, Switzerland. Springer; Jun 21, 2019.
- Henni SH, Maurud S, Fuglerud KS, Moen A. The experiences, needs and barriers of people with impairments related to usability and accessibility of digital health solutions, levels of involvement in the design process and strategies for participatory and universal design: a scoping review. BMC Public Health. Jan 06, 2022;22(1):35. [FREE Full text] [CrossRef] [Medline]
- van der Vaart R, van Driel D, Pronk K, Paulussen S, Te Boekhorst S, Rosmalen JG, et al. The role of age, education, and digital health literacy in the usability of internet-based cognitive behavioral therapy for chronic pain: mixed methods study. JMIR Form Res. Nov 21, 2019;3(4):e12883. [FREE Full text] [CrossRef] [Medline]
- Graham AK, Lattie EG, Powell BJ, Lyon AR, Smith JD, Schueller SM, et al. Implementation strategies for digital mental health interventions in health care settings. Am Psychol. Nov 2020;75(8):1080-1092. [FREE Full text] [CrossRef] [Medline]
- Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the expert recommendations for implementing change (ERIC) project. Implement Sci. Feb 12, 2015;10:21. [FREE Full text] [CrossRef] [Medline]
- Perry CK, Damschroder LJ, Hemler JR, Woodson TT, Ono SS, Cohen DJ. Specifying and comparing implementation strategies across seven large implementation interventions: a practical application of theory. Implement Sci. Mar 21, 2019;14(1):32. [FREE Full text] [CrossRef] [Medline]
- Haggerty JL, Levesque JF. Development of a measure of health care affordability applicable in a publicly funded universal health care system. Can J Public Health. Feb 04, 2015;106(2):e66-e71. [FREE Full text] [CrossRef] [Medline]
- Eruchalu CN, Pichardo MS, Bharadwaj M, Rodriguez CB, Rodriguez JA, Bergmark RW, et al. The expanding digital divide: digital health access inequities during the COVID-19 pandemic in New York City. J Urban Health. Apr 2021;98(2):183-186. [FREE Full text] [CrossRef] [Medline]
- Proctor EK, Colditz GA, Brownson RC. Dissemination and Implementation Research in Health: Translating Science to Practice. New York, NY. Oxford University Press; 2012.
- Brownson RC, Eyler AA, Harris JK, Moore JB, Tabak RG. Getting the word out: new approaches for disseminating public health science. J Public Health Manag Pract. 2018;24(2):102-111. [FREE Full text] [CrossRef] [Medline]
- Hill C, Martin JL, Thomson S, Scott-Ram N, Penfold H, Creswell C. Navigating the challenges of digital health innovation: considerations and solutions in developing online and smartphone-application-based interventions for mental health disorders. Br J Psychiatry. Aug 2017;211(2):65-69. [CrossRef] [Medline]
- Lemmens R, Antoniou V, Hummer P, Potsiou C. Citizen science in the digital world of apps. In: Vohland K, editor. The Science of Citizen Science. Cham, Switzerland. Springer; Jan 12, 2021.
- Ranard BL, Ha YP, Meisel ZF, Asch DA, Hill SS, Becker LB, et al. Crowdsourcing--harnessing the masses to advance health and medicine, a systematic review. J Gen Intern Med. Jan 2014;29(1):187-203. [FREE Full text] [CrossRef] [Medline]
- Saez-Rodriguez J, Costello JC, Friend SH, Kellen MR, Mangravite L, Meyer P, et al. Crowdsourcing biomedical research: leveraging communities as innovation engines. Nat Rev Genet. Jul 15, 2016;17(8):470-486. [FREE Full text] [CrossRef] [Medline]
- Rumsfeld JS, Brooks SC, Aufderheide TP, Leary M, Bradley SM, Nkonde-Price C, et al. Use of mobile devices, social media, and crowdsourcing as digital strategies to improve emergency cardiovascular care: a scientific statement from the American Heart Association. Circulation. Aug 23, 2016;134(8):e87-108. [CrossRef] [Medline]
- Yee V, Bajaj SS, Stanford FC. Paradox of telemedicine: building or neglecting trust and equity. Lancet Digit Health. Jul 2022;4(7):e480-e481. [CrossRef]
- Berwick DM. Disseminating innovations in health care. JAMA. Apr 16, 2003;289(15):1969-1975. [CrossRef] [Medline]
- Rogers EM. Diffusion of Innovations, 4th Edition. New York, NY. The Free Press; 2010.
- Ankawi B, Clark J, Walsh EA, Wesolowicz DM. No patient left behind: ensuring we continue overcoming barriers in the age of telehealth. Society of Behavioral Medicine. 2022. URL: https://www.sbm.org/publications/outlook/issues/fall-2022/no-patient-left-behind-ensuring-we-continue-overcoming-barriers-in-the-age-of-telehealth/full-article [accessed 2024-07-04]
- Ford S, Buscemi J, Laitner M, Hirko K, Newton RJ, Jonassaint C, et al. Position statement: retain and enhance efforts to increase broadband internet availability for health care access in rural areas. Society of Behavioral Medicine. 2018. URL: https://www.sbm.org/UserFiles/file/RuralBroad_State18_v2.pdf [accessed 2024-07-04]
- Adler-Milstein J, Holmgren AJ, Kralovec P, Worzala C, Searcy T, Patel V. Electronic health record adoption in US hospitals: the emergence of a digital "advanced use" divide. J Am Med Inform Assoc. Nov 01, 2017;24(6):1142-1148. [FREE Full text] [CrossRef] [Medline]
- Apathy NC, Holmgren AJ, Adler-Milstein J. A decade post-HITECH: critical access hospitals have electronic health records but struggle to keep up with other advanced functions. J Am Med Inform Assoc. Aug 13, 2021;28(9):1947-1954. [FREE Full text] [CrossRef] [Medline]
- Sekhon M, Cartwright M, Francis JJ. Acceptability of healthcare interventions: an overview of reviews and development of a theoretical framework. BMC Health Serv Res. Jan 26, 2017;17(1):88. [FREE Full text] [CrossRef] [Medline]
- Chapter 36. Introduction to evaluation. Community Tool Box. URL: https://ctb.ku.edu/en/table-of-contents/evaluate/evaluation [accessed 2024-07-04]
- Murray E, Hekler EB, Andersson G, Collins LM, Doherty A, Hollis C, et al. Evaluating digital health interventions: key questions and approaches. Am J Prev Med. Nov 2016;51(5):843-851. [FREE Full text] [CrossRef] [Medline]
- Shelton RC, Chambers DA, Glasgow RE. An extension of RE-AIM to enhance sustainability: addressing dynamic context and promoting health equity over time. Front Public Health. May 12, 2020;8:134. [FREE Full text] [CrossRef] [Medline]
- Institute of Medicine. Digital Infrastructure for the Learning Health System: The Foundation for Continuous Improvement in Health and Health Care: Workshop Series Summary. Washington, DC. The National Academies Press; 2011.
- Torous J, Nebeker C. Navigating ethics in the digital age: introducing connected and open research ethics (CORE), a tool for researchers and institutional review boards. J Med Internet Res. Feb 08, 2017;19(2):e38. [FREE Full text] [CrossRef] [Medline]
- Anderson KM, Olson S. The Promises and Perils of Digital Strategies in Achieving Health Equity: Workshop Summary. Washington, DC. National Academies Press; 2016.
- Partnership at the digital health frontier: accelerating access to healthcare through public-private collaboration. U.S. Chamber of Commerce. Jun 21, 2023. URL: https://tinyurl.com/addc9f8h [accessed 2024-07-04]
- Ford KL, Portz JD, Zhou S, Gornail S, Moore SL, Zhang X, et al. Benefits, facilitators, and recommendations for digital health academic-industry collaboration: a mini review. Front Digit Health. Apr 15, 2021;3:616278. [FREE Full text] [CrossRef] [Medline]
- MacLeod J, Abdelrahim M, Painter S, Maddula R, Steward A, Hamid A, et al. Ten step academic-industry digital health collaboration methodology: a case-based guide for digital health research teams with the example of cardio-oncology. Front Cardiovasc Med. Sep 30, 2022;9:982059. [FREE Full text] [CrossRef] [Medline]
- Diversity Program Consortium. URL: https://diversityprogramconsortium.org/pages/ [accessed 2024-07-04]
- Gustavson AM, Lewinski AA, Fitzsimmons-Craft EE, Coronado GD, Linke SE, O'Malley DM, et al. Strategies to bridge equitable implementation of telehealth. Interact J Med Res. May 15, 2023;12:e40358. [FREE Full text] [CrossRef] [Medline]
- Moullin JC, Dickson KS, Stadnick NA, Rabin B, Aarons GA. Systematic review of the exploration, preparation, implementation, sustainment (EPIS) framework. Implement Sci. Jan 05, 2019;14(1):1. [FREE Full text] [CrossRef] [Medline]
Abbreviations
CORE: Connected and Open Research Ethics |
EHR: electronic health record |
NIH: National Institutes for Health |
Edited by T de Azevedo Cardoso; submitted 28.07.23; peer-reviewed by E Vashishtha, H Veldandi, E Blazek; comments to author 26.02.24; revised version received 02.05.24; accepted 27.05.24; published 01.08.24.
Copyright©Maura M Kepper, Lauren A Fowler, Isabelle S Kusters, Jean W Davis, Manal Baqer, Sara Sagui-Henson, Yunyu Xiao, Adati Tarfa, Jean C Yi, Bryan Gibson, Kristin E Heron, Nicole M Alberts, Marissa Burgermaster, Veronica PS Njie-Carr, Lisa M Klesges. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 01.08.2024.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research (ISSN 1438-8871), is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.