Published on in Vol 26 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/59939, first published .
Equity in Digital Mental Health Interventions in the United States: Where to Next?

Equity in Digital Mental Health Interventions in the United States: Where to Next?

Equity in Digital Mental Health Interventions in the United States: Where to Next?

Viewpoint

1Woebot Health, San Francisco, CA, United States

2Joan & Irwin Jacobs Center for Health Innovation, University of California, San Diego, San Diego, CA, United States

3Center for Behavioral Intervention Technologies, Northwestern University Feinberg School of Medicine, Chicago, IL, United States

4Sano Genetics, London, United Kingdom

5United States Department of Veterans Affairs, Mann-Grandstaff Veterans Affairs Medical Center, Spokane, WA, United States

Corresponding Author:

Athena Robinson, PhD

Woebot Health

535 Mission St Fl 14

San Francisco, CA, 94105

United States

Phone: 1 707 563 1759

Email: scicomms@woebothealth.com


Health care technologies have the ability to bridge or hinder equitable care. Advocates of digital mental health interventions (DMHIs) report that such technologies are poised to reduce the documented gross health care inequities that have plagued generations of people seeking care in the United States. This is due to a multitude of factors such as their potential to revolutionize access; mitigate logistical barriers to in-person mental health care; and leverage patient inputs to formulate tailored, responsive, and personalized experiences. Although we agree with the potential of DMHIs to advance health equity, we articulate several steps essential to mobilize and sustain meaningful forward progression in this endeavor, reflecting on decades of research and learnings drawn from multiple fields of expertise and real-world experience. First, DMHI manufacturers must build diversity, equity, inclusion, and belonging (DEIB) processes into the full spectrum of product evolution itself (eg, product design, evidence generation) as well as into the fabric of internal company practices (eg, talent recruitment, communication principles, and advisory boards). Second, awareness of the DEIB efforts—or lack thereof—in DMHI research trials is needed to refine and optimize future study design for inclusivity as well as proactively address potential barriers to doing so. Trials should incorporate thoughtful, inclusive, and creative approaches to recruitment, enrollment, and measurement of social determinants of health and self-identity, as well as a prioritization of planned and exploratory analyses examining outcomes across various groups of people. Third, mental health care advocacy, research funding policies, and local and federal legislation can advance these pursuits, with directives from the US Preventive Services Taskforce, National Institutes of Health, and Food and Drug Administration applied as poignant examples. For products with artificial intelligence/machine learning, maintaining a “human in the loop” as well as prespecified and adaptive analytic frameworks to monitor and remediate potential algorithmic bias can reduce the risk of increasing inequity. Last, but certainly not least, is a call for partnership and transparency within and across ecosystems (academic, industry, payer, provider, regulatory agencies, and value-based care organizations) to reliably build health equity into real-world DMHI product deployments and evidence-generation strategies. All these considerations should also extend into the context of an equity-informed commercial strategy for DMHI manufacturers and health care organizations alike. The potential to advance health equity in innovation with DMHI is apparent. We advocate the field’s thoughtful and evergreen advancement in inclusivity, thereby redefining the mental health care experience for this generation and those to come.

J Med Internet Res 2024;26:e59939

doi:10.2196/59939

Keywords



The past few decades have marked significant momentum in the digital mental health field. More than 350,000 health-related mobile apps are available and a significant portion of these are specifically related to mental health support [1]. Enthusiasts postulate that digital mental health interventions (DMHIs) may eliminate commonplace access barriers [2,3] while also providing evidence-based mental health care that yields meaningful outcomes [4,5]. Moreover, there is a tenable undercurrent of hope, combined with appropriate and poignant questioning, on whether or not DMHI can genuinely and reliably reduce health care disparities. “Techquity” is a recently coined colloquial term that refers to this potential to either bridge or hinder equitable health care [6,7].

Problems with access to mental health care, both historical and present, are well documented across the United States and are especially pronounced within minoritized and underserved populations [8-13]. A key and increasingly common approach to understanding these inequities is through the study of social determinants of health (SDOH), which focuses on how the various circumstances in which people live affect their health and well-being [14,15]. Groups of individuals affected by systemic inequities in mental health care, in terms of both prevalence and care access, have been identified via various SDOH factors including, but not limited to, people who experience stigma or discrimination because of race, ethnicity, class, gender, sexual orientation (eg, LGBTQIA+ [Lesbian, Gay, Bisexual, Transgender, Queer, Intersex, Asexual+]); language or another aspect of identity; those with low household income or educational attainment; those who are underemployed or unemployed; older adults; those living in rural communities; members of Medicare or Medicaid; uninsured or underinsured people; veterans; and people living with disabilities [16-20]. When considering DMHIs, we must also acknowledge the “digital divide,” as many individuals may lack access, consistent connectivity, skills, or trust to engage with digital mental health technologies, further contributing to and even widening existing inequities, as was the case during the COVID-19 pandemic [21-23].

The arc of how to progress toward bridging equitable health care is multifaceted, complex, dynamic, and of course, evergreen. Scholars have contributed important theoretical and applied work toward addressing inequities in digital health and DMHI, focusing on a range of topics from development to dissemination [24-28]. This viewpoint, in the spirit of the overarching special issue theme “Reflecting on Transformative Technologies, Interventions, Methods, and Policy Issues,” aims to contribute to the conversation on health equity in US-based DMHIs in 2 ways. First, by referencing extant frameworks and best practices, and second, by articulating perspectives across key stages of product and organizational maturation, from initial product development to commercialization and health care ecosystem adoption (Figure 1; see also [14,25,28-41]). The present authorship collaboration will do this by drawing upon its collective expertise in several relevant domains, including scientific research in academia and industry, DMHI commercialization and deployment strategies from both industry and health care system perspectives, DMHI product development, and organizational leadership. We also include salient illustrative examples from real-world development at Woebot Health, a US-based company that manufactures DMHIs, with which a number of the authors are affiliated.

Figure 1. Integral elements toward building, sustaining, and advancing equitable mental health care and corresponding recommended reading. DMHI: digital mental health intervention; LLM: large language model; PIDAR: Partner, Identify, Demonstrate, Access, Report; USPSTF: US Preventive Services Taskforce.

To begin to articulate the arc, we first focus on key elements in product and intervention development. Available development frameworks call for requisite community involvement, partnership, and trust throughout as well as embedded technological support for varied digital literacy levels [25,28]. Beyond development, multiple DMHI app evaluation frameworks have been published [42-44], some with specific callouts for the import of diversity equity and inclusion therein [45]. Moreover, industry manufacturers and academicians alike are encouraged to consider their company’s or lab’s integration of diversity, equity, inclusion, and belonging (DEIB) principles into talent recruitment, workstreams, and advisory boards. Next, we discuss considerations in evidence generation. Several recent systematic reviews and meta-analyses suggest that DMHI is effective for addressing symptoms of depression and anxiety [46-48], including across the age range from adolescents [49] to older adults [50]. However, simultaneous calls to action for enhanced diversity in clinical trials underscored the ongoing need for inclusive research [29,51], calling into question whether these conclusions may be biased due to unrepresentative samples [52]. Methodological strategies to facilitate inclusive clinical trial designs will be considered. The adoption of evidence-based DMHIs has been encouraged by the American Medical Association [53] and American Psychiatric Association [54], perhaps augmenting existing options for mental health care [55]. We also highlight the need for various ecosystems (academic, industry, payer, provider, and value-based care organizations) to articulate their requirements for health equity to be a part of a manufacturer’s DMHI product and evidence-generation portfolio before adoption or deployment within a system. Specification of considerations of an equity-informed commercialization strategy for evidence-based DHMI will be discussed.

Given the promising yet relatively nascent status of the DMHI field, we encourage transparent and open conversation and a collective articulation to help specify and manifest an evergreen process of monitoring for and reducing mental health care inequities.


As noted in the World Health Organization’s Global Strategy on Digital Health 2020-2025, “When planning and prioritizing digital health interventions...the specific potential of digital technologies to promote health equity should be leveraged. Designed properly, digital solutions can propel inclusiveness as digital connectivity can transcend physical barriers” [56]. As any creation usually bears some imprint of the creator, a key starting principle for building an inclusive service is ensuring that the team that builds it represents a diverse set of perspectives and backgrounds, which include those of the intended users. Equity must also be baked into the product development life cycle. Similar to the European Union’s General Data Protection Regulation (GDPR) principle of “Privacy by Design,” we may think about this as “Equity by Design.” This entails explicit exploration of whether equity is likely to be achieved early on in design sessions, identifying any potentially problematic pitfalls and addressing them systematically. Human-centered design roots itself in the philosophy that thorough discovery and understanding of human needs optimize product design to meet those needs, as well as making the experience meaningful and satisfying [57]. Some human-centered design frameworks have been tailored to address DMHIs broadly [58], while others specifically target improving the health equity of DMHI [30,59]. For example, human-centered design approaches, which organically focus on inviting and hearing needs at hand, should be purposefully extended to include voices from marginalized communities [30,60], including communities with diverse digital literacy levels [61]. The PIDAR (Partner, Identify, Demonstrate, Access, Report) framework, developed by the Society of Behavioral Medicine’s Health Equity Special Interest Group, highlights partnerships as both integral to avoiding increased health inequities in DMHI and a fundamental first step in an equity-centric intervention development approach [25]. Methodologies for community-based participatory research have been articulated and incorporate strategies such as rapid prototyping and iteration for efficient colearning, as well as key human-centric and empathy-first principles of commitment, collaboration, and listening [62-64].

As more DMHIs begin to integrate aspects of artificial intelligence (AI), machine learning (ML), and large language models (LLMs), issues surrounding health equity in the rapidly evolving world of AI/ML are particularly salient to this conversation. These technologies hold great potential to, for example, enhance a conversational agent’s ability to understand natural language inputs as well as generate nuanced and tailored responses. However, there are a number of risks associated with the use of LLMs in mental health, both general and specific to health equity concerns. General concerns are LLM’s potential to “hallucinate” or generate false or misleading information as well as the limitations imposed by training data, which can be biased, inaccurate, or even actively harmful [65]. Equity-related LLM risks include their potential to exacerbate or amplify disparities if algorithms are constructed using data that reflect historical or societal biases and inequities; additionally, they increase skepticism and alienation of minoritized individuals due to lack of transparency and perception of bias [66,67]. Furthermore, many LLMs are trained primarily on a corpus of English sources, and may only be available in certain languages (eg, English), creating potential biases and risks for nonprimary language learners in understanding and interpreting these interventions, or directly excluding large swaths of people who do not speak certain languages [31,68,69]. Health equity–centered AI development frameworks are emerging to proactively address such risks [70-72]. For example, frameworks focused on the integration of LLMs into health care products recommend that LLMs are (1) thoroughly evaluated for equity-related risks, (2) rigorously monitored during deployment, (3) integrated into systems with humans-in-the-loop (eg, providers or users) to guard against biased algorithmic drift, and (4) trained in collaboration with impacted communities or populations they are intended for, all of which can help mitigate the exacerbation of potential biases [32,61,72]. Certainly, more research as well as the development and refinement of regulatory frameworks for responsible AI utilization in DMHI is called for overall [73]. President Biden’s Executive Order highlights the need to protect the “rights and safety of the public” through (1) strengthening AI governance, (2) advancing responsible AI innovation, and (3) managing risk from the use of AI [74].


Embedding DEIB practices into the fabric of organizations, from corporate objectives to hiring practices and more, has been advocated for openly, and is another key element of the larger techquity conversation with implications for DMHIs [33,75]. There is strong support for the benefits that a diverse workforce can bring to an organization in terms of key business outcomes (eg, innovation and revenue generation), as well as aligning with what talent may seek within a company’s culture [76,77]. For mental health–focused organizations, the inclusion of people with lived experience of mental health challenges is especially critical, as their involvement in all aspects of DMHI research, development, policy, and practice is fundamental to promoting equity [34,78]. Diversity at both the inception of digital health innovation (eg, within design teams at DMHI manufacturing organizations) and in health care systems deploying such innovations (eg, accountable care organizations or integrated delivery networks) is part of the holistic picture [33]. Organizational commitment to various endeavors and working groups (eg, podcasts, blogs, hiring practices, educational seminars, advisory boards, health benefits, and employee well-being programs, task forces) that host and elevate conversations on equity promote recognition of its fundamental importance as well as set a regular cadence of expected updates or outputs [79-82]. Examples are the DMHI industry commitment to supporting their own employees’ mental health via a variety of DEIB efforts (ie, Headspace [83]), the establishment of a clinical diversity advisory board (ie, Woebot Health [80]), and podcast interviews with industry leaders to discuss key DEIB topics (ie, Meeting of the Minds Podcast; Health Nonprofit Digital Marketing [82,84]). Powerful work led by the University of California San Francisco’s Taskforce on Equity and Anti-Racism in Research underscored several core learnings from their endeavors, among them a clear call for a diverse workforce across the full membership of the research team, as well as ongoing education and support for DEIB in research [35]. The National Institutes of Health (NIH) offers awards dedicated to engaging undergraduate students from diverse backgrounds in biomedical research [85,86] and Rush Education and Career Center Hub (REACH) offers support in STEM (Science, Technology, Engineering, Mathematics) research to students from preschool age onward [87]. Both of these highlight direct efforts to diversify researchers of the future.


Enhancing Health Equity in Evidence Generation for DMHIs: Frameworks and Methodological Considerations

The generation of evidence of the feasibility, acceptability, efficacy, effectiveness, and safety of DMHIs provides another critical opportunity for the consideration of health equity. Existing frameworks that have been used to explore the centering of health equity in research are PIDAR, RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance), and others, many of which highlight partnerships with diverse stakeholders and potential users, consideration of how access to technology and digital literacy affect eligibility, and how data are collected and disseminated [25,26,31]. In addition to these frameworks, we offer further methodological considerations to center evidence generation in health equity, drawing on our experience in implementing these practices.

Meta-analytic research has generally supported DMHI’s efficacy, feasibility, and acceptability [46-48]. However, despite the anticipated promise of DMHIs in addressing the health equity gap, little is known about outcomes across various sociodemographic subgroups and whether the trials recruited diverse samples; additionally, only a few studies have specifically focused on interventions intended for minoritized populations [31,88]. For example, a recent systematic literature review spearheaded by Woebot Health highlighted the underreporting of sociodemographic characteristics in clinical trials evaluating DMHIs and pointed to even fewer reporting any results by sociodemographic characteristics [36]. To examine the real impact of DMHIs on health equity, evidence-generation methodology needs to be thoughtfully designed and implemented.

Recruitment and Trial Design

First, the recruitment of diverse samples is the foundation upon which evidence generation rests. A variety of tactics can be used to recruit diverse samples, including the use of culturally sensitive recruitment materials; community outreach; thoughtful partnerships with socially, economically, geographically, or racially diverse health care systems; resources to support those with limited access to the internet; and diverse research and recruitment teams [25,28]. For example, in a recent research collaboration between Scripps Translational Science Institute and Woebot Health, utilization of such methods facilitated successful recruitment and enrollment of the a priori target of approximately 50% of a sample self-identifying as individuals from categories noted as historically underrepresented in biomedical research, including racial/ethnic minorities and rural/nonmetropolitan area residents, among others [89]. Real-world partnerships are particularly important for inviting collaboration with marginalized groups and exploring the potential of the DMHI to address health equity, with the necessity of real-world evidence outlined as an important component in several frameworks on health equity within DMHIs [26,28,31]. In these cases, clinician-referred recruitment should be managed with care and not utilized as a stand-alone recruitment strategy. Medical research has shown that clinicians and researchers may selectively exclude certain minority participants due to biases or assumptions about their interest in research, ability to follow study protocols, and likelihood of dropping out, among others [90]. Indeed, a large review [91] of minority participation in health research demonstrated that while minorities are willing to participate, they are less likely to be recruited. Where possible, health systems, patient registries, or other common recruitment sources should consider an “opt-out” method for study recruitment invitations. Specifically, upon entry to the system/registry, patients consent by default to be contacted for research opportunities unless they choose to “opt out” of such communications. This might allow for a greater diversity of individuals to be invited to participate in studies in the first place, without compromising their agency to decide which particular studies to apply for. To guide recruitment, specific targets for race, ethnicity, sexual orientation, and gender, among others, should be determined a priori based on the desired end users and relevant prevalence rates. While attempting to create targets based on census data or population prevalence is one viable option, we suggest aligning targets more closely with the prevalence rates of mental health problems in specific sociodemographic groups to more accurately capture real-world needs [92]. Additionally, to have a sufficient sample size to examine group differences, recruiting large enough samples or overrecruiting for a particular group(s) of interest may be necessary.

Sociodemographic Surveys and Data Collection

Second, sociodemographic surveys need to be thoughtfully designed and consistently implemented. Sociodemographic reporting should include culturally sensitive and inclusive response options to questions on race, ethnicity, sexual orientation, and gender identity, as well as questions related to SDOH such as food and housing insecurity [93]. To promote honest disclosure, participants should be given the opportunity to respond electronically and be assured of the privacy and protection of their sensitive data. Of note, it is often more challenging to collect comprehensive sociodemographic and SDOH data in the context of deployment outside of research settings. Thoughtful approaches to the collection and use of these data should be agreed upon by stakeholders and tested with end users to ensure that factors such as assessment burden, privacy concerns, and potential cultural differences in the appropriateness of questionnaire content are appropriately considered.

Analysis and Outcomes

Third, analyzing and reporting on sociodemographic characteristics and outcomes across subgroups are integral to examining the impact of DMHIs on health equity. At a minimum, DMHI research should provide the sociodemographic characteristics of their sample. Additionally, consumer-based DMHI data (outside the research context) should be presented in dashboards and reports that include a breakdown of sociodemographic characteristics, where possible and sample size permitting. Ideally, outcomes are also reported by sociodemographic groups of interest, or included as covariates in models to better understand their potential impact on or association with outcomes (see, eg, [94]). However, given the small sample sizes in many sociodemographic subgroups of interest, traditional hypothesis-confirming statistical methods of significance testing and modeling may not be possible. For such cases, we suggest focusing on exploratory, descriptive, and hypothesis-generating approaches such as within-group effect sizes (eg, the effect size of a symptom change score in non–Hispanic Black participants) and between-group effect sizes (eg, the effect size of the difference between symptom change scores in non–Hispanic Black and non–Hispanic White participants) where possible. Consolidating certain subgroups into another broader group may also be necessary in certain cases (eg, collapsing “genderqueer,” “nonbinary,” “agender,” and “different identity” into “other” for gender identity; see [95]), ideally to reach a sample size of at least 20-25 per subgroup [96], although greater care must be taken in the interpretation of these less precise groupings. For this exploratory approach, replication is key to identifying consistent and reliable patterns, and these analyses should be prespecified and conducted for every study even if only for internal purposes. Data from these exploratory analyses can be used to identify potential questions and hypotheses for future research, provide preliminary data for power analyses and study planning, and inform intervention improvements and possible precision targets. Researchers should also go beyond the assessment of differences in outcomes by sociodemographic characteristics, and consider how they can identify, capture, and analyze the structural factors (eg, discrimination, exclusionary policies, digital redlining) that may be responsible for creating or exacerbating inequities [97,98].

The outcomes assessed should be comprehensive and include efficacy (eg, symptom change), engagement (eg, app use metrics, therapeutic alliance), satisfaction and feasibility (including trust and perception of bias), and safety. Moreover, the assessed outcomes must reflect not only the priorities and values of the researchers, but also those of the participants. Doing so allows for a more nuanced understanding of the impact of DMHIs on various groups of people, and is necessary for a precision-based research and development approach that can be leveraged to address health equity and create better products. Qualitative data (eg, free-text questions about app experience, participant interviews) should be solicited, as they illuminate the nuance of experience across different groups of people and can reveal previously unknown issues or concerns among users.

Safety, in particular, is an important outcome to examine in the context of health equity [99]. Despite this, not all DMHI trials provide safety data and there is little standardization in how adverse events are captured and reported [100]. This may be, to a certain extent, because different types of DMHIs require varying degrees of safety capturing and oversight. Trials also vary considerably in the level of clinical support to mitigate and manage potential adverse events. Safety measurement must align with each intervention’s risk and capabilities to address safety concerns, while being as consistent as possible across DMHIs. Lastly, when generating internal safety reports for each trial, safety events and any other related data should be provided alongside sociodemographic data to allow exploration of prevalence rates within different groups of people.

All of these equity-centering research practices, from recruitment and data collection to analysis and safety considerations, should also be integrated into iterative internal product development processes and user experience (UX) research as well as external evidence-generation efforts.


Shifting our view “up” to another level, we turn to considerations of advocacy, policy, regulation, and funding, which may unlock paths to address inequities unavailable at the individual or even company level [27]. For example, the translation of mental health evidence–generation findings into new policies intended to improve health equity in mental health care has been bolstered by the implementation of advocacy efforts and new policy, regulation, and funding efforts at both the federal and local levels [52,101,102]. Advocacy efforts such as lobbying and grassroots campaigns focused on improving the equitable distribution of mental health services and awareness of mental health disparities have been critical in advancing policy change and allocation of resources as well [103,104].

In part due to these advocacy efforts, the past several decades have brought about various legislative initiatives focused on parity, community mental health initiatives, workforce diversity, and trauma-informed care that have served to improve mental health equity. Perhaps the most groundbreaking example of federal parity legislation in the past 25 years was the implementation of the Mental Health Parity and Addiction Equity Act of 2008 [105] which required insurance companies to offer mental health and substance use disorder care coverage similar to that of medical care, paving the way for equitable access to the support and services for those in need. Broader efforts to expand internet access have also evolved in recent years. These initiatives include broadband expansion that uses public or private funding to build the infrastructure needed to deliver internet to areas without current capabilities [106], net neutrality regulations established in 2003 [107], public Wi-Fi funded by governments or municipalities, and digital literacy programs that teach the fundamentals of using the internet [108]. The ability of users to connect online to DMHIs has been greatly enhanced by these collective efforts.

The regulatory oversight of medical devices by the Food and Drug Administration (FDA) can also impact digital mental health equity. Clinical trial diversity initiatives, regulatory science research and policies, public health education initiatives, postmarket surveillance activities, and drug/device presubmission interactions and approval processes have the ability to support or leave vulnerable populations in need of additional digital mental health care [109-111]. For example, following the onset of the COVID-19 pandemic and the nationwide public health emergency, the FDA announced in April 2020 that it would temporarily waive certain requirements for digital therapeutics targeting psychiatric disorders. This measure aimed to provide urgently needed mental health support tools to a struggling population, although it expired in November 2023 [112].

In addition, various organizations such as the American Psychological Association (APA) [101], the National Institute of Mental Health (NIMH) [52], the US Preventive Services Taskforce (USPSTF) [37], the Substance Abuse and Mental Health Services Administration (SAMHSA) [102], and others have provided support for recommendations and funding that have advanced mental health equity. For example, the USPSTF recently developed a framework to incorporate health equity into each step of their recommendation-making process. The NIMH’s ongoing Laboratories to Optimize Digital Health program seeks to fund innovative research projects that study ways to increase access, efficacy and effectiveness, and quality of DMHIs, particularly among those who experience health disparities [113]. Beyond the critical research focused on interventions to help more vulnerable populations, researchers should also focus on understanding individual-level differences in the prevalence, root causes, and mechanisms of expression of different mental health challenges [114-116]. Additional funding opportunities should be made available to train underrepresented minorities, develop culturally competent interventions, and determine the impact of the implementation of interventions or policies within underserved communities and health care settings. Trends in research that require the involvement of patients with lived experiences, interventions integrating peer support, and community-based participatory research [63] highlight the importance of including multiple stakeholders to identify priorities, develop and test interventions, and inform policy. These efforts reflect a commitment to advocating for and enacting policies that guide, regulate, and fund work that ensures a wide variety of users can access and benefit from DMHIs. Progress in these areas will be crucial in advancing equity across the field of DMHI in the future.


For-profit companies and commercial endeavors represent an opportunity to accelerate the traction of equity-related efforts in mental health. Company success in terms of market penetration and financial growth are well aligned and in many cases dependent on the factors described earlier (DEIB maturity in the workforce, more inclusive practices in product design and evidence generation, more representative and true to real-world evidence gathering, and reinforcement of equity-related policy). Today’s market rewards and reinforces equity-centered practices as customers are seeking products that meet sophisticated requirements in this regard. Deloitte estimated that their life sciences clients could garner a 10× return on their investment by bolstering equitable care access in underserved markets [38] and entrepreneurs focused on mental health equity are attracting early support and funding [117]. That said, challenges exist for for-profit ventures as well. For example, the cost of providing DMHI access to “hard to reach” populations (eg, those without a smartphone or internet access, or who are members of groups too small to amass commercial attention) may be greater, impacting profitability and sustainability of outreach efforts (see Galea [118] for an analogous case related to the greater cost of vaccinating certain vulnerable populations). Moreover, in cases where end users, and not an intermediary organization (eg, an employer, health plan, or health care provider), directly bear some or all of the cost for access to a DMHI, existing financial inequities may perpetuate or exacerbate inequities in mental health access and outcomes [119]. In both these cases, commercial stakeholders may consider steps such as advocating for ring-fenced funding, or allocation of protected funds that are specifically and exclusively intended for the purpose of reaching historically minoritized and underserved populations. Importantly, the purpose of these protected funds would not be to optimize customer acquisition costs, but rather to optimize representation.

Commercial and medical affairs functions in health care organizations such as DMHI and pharmaceutical manufacturers play a vital role in translating and reinforcing progress from science/policy out to the market and market demands back to internal groups [120]. Customer listening allows firms to collect very clear requirements on how products need to function and be deployed to address real-world equity-related challenges, helping product and evidence teams prioritize their road maps [39]. In the other direction, commercial and medical affairs teams showcase emerging work by science and product, building confidence and momentum in the market to go after equity-related unmet needs with more urgency.

Strong and creative commercial and medical affairs functions can also help build differentiated paths to market by developing tailored marketing, enrollment, and payment models to meet the specific needs of underserved populations. Customers who struggle to meet quality standards or equity requirements may be more inclined to pursue digital solutions aggressively. Manufacturers can foster more effective deployments by offering configurable solutions and flexibility in implementation and marketing. Additionally, not all DMHI manufacturers operate as for-profit ventures; exploring other models for addressing health inequities, such as the US State Department’s “Public Health 3.0” initiative [121] and nonprofit business models [122], is crucial for scaling new products.


Although it appears as the final section of this paper, the importance of thoughtful consideration of health equity within and across DMHI ecosystem deployments cannot be underscored enough. This view is critical because it spans the individual, familial, and community levels, as well as the larger encompassing “ecosystem” organizations, such as health care systems or provider networks, which may be in unique positions to operate across multiple levels of SDOH to address inequities [27]. Deployment is also where “the rubber meets the road,” and the actual impact of DMHIs is realized.

Implementation science frameworks offer considerations into how evidence-supported interventions are “implemented” in routine practice in naturalistic, real-world contexts; and may, for example, recommend evaluation of factors such as immediate and sustained adoption of the intervention, cost, and barriers therein [123]. Such real-world data are of paramount importance in determining not only the real-world effectiveness of DMHIs, but also integral for informing and refining approaches to deployment processes (ie, provider training and patient-facing information). Moreover, such data create an opportunity for monitoring if the DHMI or its deployment characteristics are closing or exacerbating equity gaps, paving the way for deployment adjustments accordingly.

Ecosystems purchasing or deploying DMHIs (eg, payer, provider, value-based care organizations) are encouraged to transparently and reliably emphasize the need for health equity to be included in a manufacturer’s DMHI product and evidence-generation portfolio before adoption or deployment within their system. To begin, existing implementation science frameworks have been adapted to focus on health equity and can provide thoughtful questions for ecosystems and deployment partners to consider. These may include an early focus on “reach” (ie, who is included and excluded in different deployment strategies), proactive design and selection of interventions for vulnerable populations, and measuring and monitoring outcomes through the lens of addressing inequities [40]. Ecosystems may also consider adopting a health equity–informed implementation science framework [33], such as the Evidence- and Consensus-Based Digital Healthcare Equity Framework [41], or may choose to create and implement their own, as demonstrated by health care organizations such as Elevance [124], Kaiser Permanente [125], Reliant Medical Group [126], and the Centers for Medicare and Medicaid Services [127].

One example of how health equity might be considered in the deployment of a DMHI within a health care ecosystem is through the collection, monitoring, and evaluation of SDOH data. DMHIs (or their underlying platform infrastructure) could be designed to thoughtfully gather information about specific SDOH factors from patients. Such data could inform further risk assessment or clinical follow-ups, and facilitate the offering of available resources provided by the system to the patient. Processes like this may enable earlier intervention, more precise tailoring of interventions, and greater utilization of available support and resources for those in greatest need. This approach has the potential to benefit underserved individuals, DMHI manufacturers, and health care systems as the shift toward whole-person care evolves.

New models of care that support DMHI implementation are also emerging in postpandemic health care delivery: one such role is the digital navigator. This role facilitated the rapid transition to telehealth in the early days of the pandemic as a means to support patients accessing platforms to access care. The digital navigator can access which phone and data plan a patient has to optimally match them with a DMHI that takes the whole-person’s life context into account. This role is one method for addressing the friction from referral to activation that is often experienced in real-world deployments [128]. Other promising examples of alternative care models are stepped care [129,130] and collaborative care [131,132], both of which have accrued growing bodies of support in the literature, and which offer opportunities for DMHI integration and implementation. As these new models of care mature, data exchange to support the optimal levels of human and digital touchpoints can support the broader use of DMHIs in populations that may not traditionally seek care for mental health.


The potential to advance health equity through innovation in DMHIs is apparent, but by no means guaranteed. Here, utilizing decades of learning across multiple domains of expertise, we explored the progress and opportunities within the DMHI field to address mental health care inequities and articulated several steps essential to mobilize and sustain meaningful forward progression in this endeavor. While notable progress has been made over the past 25 years, we advocate for the field’s thoughtful and evergreen advancement in inclusivity and equity, thereby continuing to redefine the mental health care experience for this generation and those to come.

Acknowledgments

We thank Adam Platt, MSc, for coordinating scientific communications and facilitating the organization of the manuscript preparation and submission, as well as Katherine McGuckin, MS, for conceptual and drafting contributions to the “Commercial and Market Engagement Strategy” section. We also thank Julie Ross and Robbert Zusterzeel for their review and comments, and Stephanie Rapoport for helping to design the summary figure. This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors. Funding to publish this article as open access was provided by Woebot Health.

Authors' Contributions

AR, in collaboration with RMM, MF, and AD, conceptualized the piece and outlined it. The introduction was drafted by AR and RMM. The “Product Development” section was drafted by AR with support from RMM and AD. The “Organizationwide Practices” section was drafted by AR. The “Evidence Generation” section was drafted by MF, with support from RMM and VLFH. The “Advocacy, Policy, Regulation, and Funding” section was drafted by VLFH with support from RMM. The “Commercial and Market Engagement Strategy” section was drafted by ML, AR, and RMM. The “Equity-Informed Implementation Science in Real-World Deployments” section was drafted by AR, RMM, and TH. TA, DCM, PW, and CG reviewed and provided contributions and feedback throughout. All authors contributed to multiple draft revisions, with ownership for incorporation of all author edits and flow of the overall manuscript championed by RMM and AR. All authors read and approved the submitted version.

Conflicts of Interest

AR, MF, VLFH, AD, TH, ML, and RMM are all employees of Woebot Health. DCM has accepted honoraria and consulting fees from Boehringer-Ingelheim, Optum Behavioral Health, Centerstone Research Institute, and the One Mind Foundation; royalties from Oxford Press; and has an ownership interest in Adaptive Health, Inc. TA has nothing to declare. PW is an associate editor at the Journal of Medical Internet Research and is on the editorial advisory boards of BMC Medicine, The Patient, and Digital Biomarkers; was a former consultant to Woebot Health; and is currently employed by Sano Genetics and holds stock/options in Sano Genetics. CG is a consultant to Woebot Health. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

  1. IQVIA Institute for Human Data Science. Digital health trends 2021: innovation, evidence, regulation, and adoption. IQVIA. 2021. URL: https:/​/www.​iqvia.com/​insights/​the-iqvia-institute/​reports-and-publications/​reports/​digital-health-trends-2021 [accessed 2024-04-23]
  2. Radez J, Reardon T, Creswell C, Lawrence PJ, Evdoka-Burton G, Waite P. Why do children and adolescents (not) seek and access professional help for their mental health problems? A systematic review of quantitative and qualitative studies. Eur Child Adolesc Psychiatry. Feb 2021;30(2):183-211. [FREE Full text] [CrossRef] [Medline]
  3. National Institutes of Mental Health (NIMH). Technology and the future of mental health treatment. NIMH. 2023. URL: https://www.nimh.nih.gov/health/topics/technology-and-the-future-of-mental-health-treatment [accessed 2024-04-23]
  4. Philippe TJ, Sikder N, Jackson A, Koblanski ME, Liow E, Pilarinos A, et al. Digital health interventions for delivery of mental health care: systematic and comprehensive meta-review. JMIR Ment Health. May 12, 2022;9(5):e35159. [FREE Full text] [CrossRef] [Medline]
  5. Faria M, Zin STP, Chestnov R, Novak AM, Lev-Ari S, Snyder M. Mental health for all: the case for investing in digital mental health to improve global outcomes, access, and innovation in low-resource settings. J Clin Med. Oct 25, 2023;12(21):6735. [FREE Full text] [CrossRef] [Medline]
  6. Clark CR, Akdas Y, Wilkins CH, Rhee K, Johnson KB, Bates DW, et al. TechQuity is an imperative for health and technology business: let's work together to achieve it. J Am Med Inform Assoc. Aug 13, 2021;28(9):2013-2016. [FREE Full text] [CrossRef] [Medline]
  7. Ipsos, The HLTH Foundation. Ipsos. 2022. URL: https:/​/www.​ipsos.com/​sites/​default/​files/​ct/​publication/​documents/​2022-03/​Ipsos-HLTH-Path-to-techquity_0.​pdf [accessed 2024-04-23]
  8. Cook BL, Trinh N, Li Z, Hou SS, Progovac AM. Trends in racial-ethnic disparities in access to mental health care, 2004-2012. Psychiatr Serv. Jan 01, 2017;68(1):9-16. [FREE Full text] [CrossRef] [Medline]
  9. Cook BL, Hou SS, Lee-Tauler SY, Progovac AM, Samson F, Sanchez MJ. A review of mental health and mental health care disparities research: 2011-2014. Med Care Res Rev. Dec 2019;76(6):683-710. [CrossRef] [Medline]
  10. Erikson CE, Dent RB, Park YH, Luo Q. Historic redlining and contemporary behavioral health workforce disparities. JAMA Netw Open. Apr 01, 2022;5(4):e229494. [CrossRef] [Medline]
  11. Institute of Medicine (US). Introduction. In: How Far Have We Come in Reducing Health Disparities? Progress Since 2000: Workshop Summary. Washington, DC. National Academies Press; 2012:1.
  12. Salmond S, Dorsen C. Time to reflect and take action on health disparities and health inequities. Orthop Nurs. 2022;41(2):64-85. [FREE Full text] [CrossRef] [Medline]
  13. Schueller SM, Hunter JF, Figueroa C, Aguilera A. Use of digital mental health for marginalized and underserved populations. Curr Treat Options Psych. Jul 5, 2019;6(3):243-255. [CrossRef]
  14. Allen J, Balfour R, Bell R, Marmot M. Social determinants of mental health. Int Rev Psychiatry. Aug 2014;26(4):392-407. [CrossRef] [Medline]
  15. Marmot M. Social determinants of health inequalities. Lancet. 2005;365(9464):1099-1104. [FREE Full text] [CrossRef] [Medline]
  16. National Institute of Mental Health (NIMH). Medicaid data show wide differences in mental health care in the United States. National Institute of Mental Health (NIMH). 2023. URL: https:/​/www.​nimh.nih.gov/​news/​science-news/​2023/​medicaid-data-show-wide-differences-in-mental-health-care-in-the-united-states [accessed 2024-04-23]
  17. Williams ND, Turpin RE, Akré E-RL, Boekeloo BO, Fish JN. Disparities in mental health care access among persons differing in sexual identity: nationally representative findings. Psychiatr Serv. Apr 01, 2022;73(4):456-459. [FREE Full text] [CrossRef] [Medline]
  18. Kirkbride JB, Anglin DM, Colman I, Dykxhoorn J, Jones PB, Patalay P, et al. The social determinants of mental health and disorder: evidence, prevention and recommendations. World Psychiatry. Feb 2024;23(1):58-90. [FREE Full text] [CrossRef] [Medline]
  19. Compton MT, Shim RS. The social determinants of mental health. FOC. Oct 2015;13(4):419-425. [CrossRef]
  20. Alegría M, NeMoyer A, Falgàs Bagué I, Wang Y, Alvarez K. Social determinants of mental health: where we are and where we need to go. Curr Psychiatry Rep. Sep 17, 2018;20(11):95. [FREE Full text] [CrossRef] [Medline]
  21. Digital access: a super determinant of health. Substance Abuse and Mental Health Services (SAMHSA). 2023. URL: https://www.samhsa.gov/blog/digital-access-super-determinant-health [accessed 2024-04-23]
  22. Beaunoyer E, Dupéré S, Guitton MJ. COVID-19 and digital inequalities: reciprocal impacts and mitigation strategies. Comput Human Behav. Oct 2020;111:106424. [FREE Full text] [CrossRef] [Medline]
  23. Spanakis P, Peckham E, Mathers A, Shiers D, Gilbody S. The digital divide: amplifying health inequalities for people with severe mental illness in the time of COVID-19. Br J Psychiatry. Oct 2021;219(4):529-531. [FREE Full text] [CrossRef] [Medline]
  24. Simmons D, Kaganoff S, Drasser K. Building toward equity: a working model for digital health. Rock Health. Aug 2021. URL: https://rockhealth.com/insights/building-toward-equity-a-working-model-for-digital-health/ [accessed 2024-04-23]
  25. Miller SJ, Sly JR, Alcaraz KI, Ashing K, Christy SM, Gonzalez B, et al. Equity and behavioral digital health interventions: strategies to improve benefit and reach. Transl Behav Med. Jun 09, 2023;13(6):400-405. [FREE Full text] [CrossRef] [Medline]
  26. Jaworski BK, Webb Hooper M, Aklin WM, Jean-Francois B, Elwood WN, Belis D, et al. Advancing digital health equity: directions for behavioral and social science research. Transl Behav Med. Apr 03, 2023;13(3):132-139. [FREE Full text] [CrossRef] [Medline]
  27. Richardson S, Lawrence K, Schoenthaler AM, Mann D. A framework for digital health equity. NPJ Digit Med. Aug 18, 2022;5(1):119. [FREE Full text] [CrossRef] [Medline]
  28. Friis-Healy EA, Nagy GA, Kollins SH. It is time to REACT: opportunities for digital mental health apps to reduce mental health disparities in racially and ethnically minoritized groups. JMIR Ment Health. Jan 26, 2021;8(1):e25456. [FREE Full text] [CrossRef] [Medline]
  29. Advancing equity and racial justice through the federal government. The White House. Washington, DC. The White House URL: https://www.whitehouse.gov/equity/ [accessed 2024-04-23]
  30. Stiles-Shields C, Cummings C, Montague E, Plevinsky JM, Psihogios AM, Williams KDA. A call to action: using and extending human-centered design methodologies to improve mental and behavioral health equity. Front Digit Health. 2022;4:848052. [CrossRef] [Medline]
  31. Ramos G, Hernandez-Ramos R, Taylor M, Schueller SM. State of the science: using digital mental health interventions to extend the impact of psychological services. Behavior Therapy. Apr 2024:e1. (forthcoming). [CrossRef]
  32. Singh N, Lawrence K, Richardson S, Mann DM. Centering health equity in large language model deployment. PLOS Digit Health. Oct 2023;2(10):e0000367. [FREE Full text] [CrossRef] [Medline]
  33. Lawrence K. Digital health equity. In: Lawrence K, Linwood SL, editors. Digital Health. Brisbane, Queensland, Australia. Exon Publications; 2022.
  34. Muchamore I, Karanikolas P, Gooding P. How lived experience expertise shapes research and development in digital mental health: a review of literature and insights. Wellcome Open Research. 2024. URL: https://wellcomeopenresearch.org/documents/9-373 [accessed 2024-07-19]
  35. Folk JB, Carter SP, Jagsi R, Mangurian C. Title IX offices at top United States universities with medical centers: staffing, investigations and transparency. Office of Diversity and Outreach UCSF. San Francisco, CA. Office of Diversity and Outreach UCSF; 2023. URL: https:/​/research.​ucsf.edu/​sites/​g/​files/​tkssra2931/​f/​UCSF_Task_Force_Report_Final_Anti-Racism_in_Research_IDEA.​pdf [accessed 2024-04-24]
  36. Kirvin-Quamme A, Kissinger J, Quinlan L, Montgomery R, Chernenok M, Pirner MC, et al. Common practices for sociodemographic data reporting in digital mental health intervention research: a scoping review. BMJ Open. Feb 12, 2024;14(2):e078029. [FREE Full text] [CrossRef] [Medline]
  37. Lin JS, Webber EM, Bean SI, Evans CV. Development of a health equity framework for the US Preventive Services Task Force. JAMA Netw Open. Mar 04, 2024;7(3):e241875. [FREE Full text] [CrossRef] [Medline]
  38. Wilkins D. The business case for health equity in life sciences. Deloitte. 2022. URL: https:/​/www2.​deloitte.com/​us/​en/​blog/​health-care-blog/​2022/​the-business-case-for-health-equity-in-life-sciences.​html [accessed 2024-04-24]
  39. Equitable healthcare starts with medical affairs. H1. 2022. URL: https:/​/h1.​co/​blog/​a-different-approach-and-a-wider-scope-equitable-healthcare-starts-with-medical-affairs/​ [accessed 2024-04-24]
  40. Baumann AA, Cabassa LJ. Reframing implementation science to address inequities in healthcare delivery. BMC Health Serv Res. Mar 12, 2020;20(1):190. [FREE Full text] [CrossRef] [Medline]
  41. Hatef E, Austin M, Scholle S, Buckley B. Evidence- and consensus-based digital healthcare equity framework: a practical guide for implementation. Agency for Healthcare Research and Quality. Rockville, MD. Agency for Healthcare Research and Quality (US); Feb 2024. URL: https:/​/digital.​ahrq.gov/​ahrq-funded-projects/​creating-digital-healthcare-equity-framework-accompanying-guide-its-use#nav-publications [accessed 2024-04-24]
  42. Lagan S, Sandler L, Torous J. Evaluating evaluation frameworks: a scoping review of frameworks for assessing health apps. BMJ Open. Mar 19, 2021;11(3):e047001. [FREE Full text] [CrossRef] [Medline]
  43. Neary M, Schueller SM. State of the field of mental health apps. Cogn Behav Pract. Nov 2018;25(4):531-537. [FREE Full text] [CrossRef] [Medline]
  44. Silberman J, Wicks P, Patel S, Sarlati S, Park S, Korolev IO, Evidence DEFINED Workgroup, et al. Rigorous and rapid evidence assessment in digital health with the evidence DEFINED framework. NPJ Digit Med. May 31, 2023;6(1):101. [FREE Full text] [CrossRef] [Medline]
  45. Ramos G, Ponting C, Labao JP, Sobowale K. Considerations of diversity, equity, and inclusion in mental health apps: a scoping review of evaluation frameworks. Behav Res Ther. Dec 2021;147:103990. [FREE Full text] [CrossRef] [Medline]
  46. Linardon J, Cuijpers P, Carlbring P, Messer M, Fuller-Tyszkiewicz M. The efficacy of app-supported smartphone interventions for mental health problems: a meta-analysis of randomized controlled trials. World Psychiatry. Oct 2019;18(3):325-336. [FREE Full text] [CrossRef] [Medline]
  47. Karyotaki E, Riper H, Twisk J, Hoogendoorn A, Kleiboer A, Mira A, et al. Efficacy of self-guided internet-based cognitive behavioral therapy in the treatment of depressive symptoms: a meta-analysis of individual participant data. JAMA Psychiatry. Apr 01, 2017;74(4):351-359. [FREE Full text] [CrossRef] [Medline]
  48. Pauley D, Cuijpers P, Papola D, Miguel C, Karyotaki E. Two decades of digital interventions for anxiety disorders: a systematic review and meta-analysis of treatment effectiveness. Psychol Med. Jan 2023;53(2):567-579. [CrossRef] [Medline]
  49. Lehtimaki S, Martic J, Wahl B, Foster KT, Schwalbe N. Evidence on digital mental health interventions for adolescents and young people: systematic overview. JMIR Ment Health. Apr 29, 2021;8(4):e25847. [FREE Full text] [CrossRef] [Medline]
  50. Riadi I, Kervin L, Dhillon S, Teo K, Churchill R, Card KG, et al. Digital interventions for depression and anxiety in older adults: a systematic review of randomised controlled trials. Lancet Healthy Longev. Aug 2022;3(8):e558-e571. [FREE Full text] [CrossRef] [Medline]
  51. Food and Drug Administration (FDA). Diversity action plans to improve enrollment of participants from underrepresented populations in clinical studies guidance for industry. FDA. Silver Spring, MD. Food and Drug Administration URL: https://www.fda.gov/media/157635/download [accessed 2024-04-23]
  52. National Institute of Mental Health (NIMH). NIMH’s approach to mental health disparities research. NIMH. Bethesda, MD. NIMH URL: https:/​/www.​nimh.nih.gov/​about/​organization/​od/​odwd/​nimhs-approach-to-mental-health-disparities-research [accessed 2024-04-23]
  53. Berg S. AMA unveils playbook to speed digital health adoption. American Medical Association. 2018. URL: https:/​/www.​ama-assn.org/​practice-management/​digital/​ama-unveils-playbook-speed-digital-health-adoption [accessed 2024-04-23]
  54. The app evaluation model. American Psychiatric Association. URL: https://www.psychiatry.org:443/psychiatrists/practice/mental-health-apps/the-app-evaluation-model [accessed 2024-04-23]
  55. Bond RR, Mulvenna MD, Potts C, O'Neill S, Ennis E, Torous J. Digital transformation of mental health services. Npj Ment Health Res. Aug 22, 2023;2(1):13. [FREE Full text] [CrossRef] [Medline]
  56. World Health Organization (WHO). Global strategy on digital health 2020-2025. WHO. Geneva, Switzerland. WHO; 2021. URL: https://iris.who.int/bitstream/handle/10665/344249/9789240020924-eng.pdf [accessed 2024-04-23]
  57. What is human-centered design (HCD)? The Interaction Design Foundation. URL: https://www.interaction-design.org/literature/topics/human-centered-design [accessed 2024-04-23]
  58. Vial S, Boudhraâ S, Dumont M. Human-centered design approaches in digital mental health interventions: exploratory mapping review. JMIR Ment Health. Jun 07, 2022;9(6):e35591. [FREE Full text] [CrossRef] [Medline]
  59. Brewer LC, Fortuna KL, Jones C, Walker R, Hayes SN, Patten CA, et al. Back to the future: achieving health equity through health informatics and digital health. JMIR Mhealth Uhealth. Jan 14, 2020;8(1):e14512. [FREE Full text] [CrossRef] [Medline]
  60. Porche MV, Folk JB, Tolou-Shams M, Fortuna LR. Researchers' perspectives on digital mental health intervention co-design with marginalized community stakeholder youth and families. Front Psychiatry. 2022;13:867460. [FREE Full text] [CrossRef] [Medline]
  61. Figueroa CA, Murayama H, Amorim PC, White A, Quiterio A, Luo T, et al. Applying the digital health social justice guide. Front Digit Health. 2022;4:807886. [CrossRef] [Medline]
  62. Unertl KM, Schaefbauer CL, Campbell TR, Senteio C, Siek KA, Bakken S, et al. Integrating community-based participatory research and informatics approaches to improve the engagement and health of underserved populations. J Am Med Inform Assoc. Jan 2016;23(1):60-73. [FREE Full text] [CrossRef] [Medline]
  63. Israel BA, Coombe CM, Cheezum RR, Schulz AJ, McGranaghan RJ, Lichtenstein R, et al. Community-based participatory research: a capacity-building approach for policy advocacy aimed at eliminating health disparities. Am J Public Health. Nov 2010;100(11):2094-2102. [CrossRef] [Medline]
  64. Chen E, Leos C, Kowitt SD, Moracco KE. Enhancing community-based participatory research through human-centered design strategies. Health Promot Pract. Jan 2020;21(1):37-48. [CrossRef] [Medline]
  65. Blease C, Torous J. ChatGPT and mental healthcare: balancing benefits with risks of harms. BMJ Ment Health. Nov 2023;26(1):e300884. [FREE Full text] [CrossRef] [Medline]
  66. Omiye JA, Lester JC, Spichak S, Rotemberg V, Daneshjou R. Large language models propagate race-based medicine. NPJ Digit Med. Oct 20, 2023;6(1):195. [FREE Full text] [CrossRef] [Medline]
  67. Timmons AC, Duong JB, Simo Fiallo N, Lee T, Vo HPQ, Ahle MW, et al. A call to action on assessing and mitigating bias in artificial intelligence applications for mental health. Perspect Psychol Sci. Sep 2023;18(5):1062-1096. [FREE Full text] [CrossRef] [Medline]
  68. Chua L, Ghazi B, Huang Y, Kamath P, Kumar R, Manurangsi P, et al. Crosslingual capabilities and knowledge barriers in multilingual large language models. arXiv. :1. Preprint posted online on June 23, 2024. [CrossRef]
  69. Shen L, Tan W, Chen S, Chen Y, Zhang J, Xu H, et al. The language barrier: dissecting safety challenges of LLMs in multilingual contexts. arXiv. :1. Preprint posted online on January 23, 2024. [CrossRef]
  70. Chen I, Szolovits P, Ghassemi M. Can AI help reduce disparities in general medical and mental health care? AMA J Ethics. Feb 01, 2019;21(2):E167-E179. [FREE Full text] [CrossRef] [Medline]
  71. Green BL, Murphy A, Robinson E. Accelerating health disparities research with artificial intelligence. Front Digit Health. 2024;6:1330160. [FREE Full text] [CrossRef] [Medline]
  72. Abràmoff MD, Tarver ME, Loyo-Berrios N, Trujillo S, Char D, Obermeyer Z, Foundational Principles of Ophthalmic Imaging/Algorithmic Interpretation Working Group of the Collaborative Community for Ophthalmic Imaging Foundation‚ Washington‚ D.C., et al. Considerations for addressing bias in artificial intelligence for health equity. NPJ Digit Med. Sep 12, 2023;6(1):170. [FREE Full text] [CrossRef] [Medline]
  73. Meskó B, Topol EJ. The imperative for regulatory oversight of large language models (or generative AI) in healthcare. NPJ Digit Med. Jul 06, 2023;6(1):120. [FREE Full text] [CrossRef] [Medline]
  74. Young S. Advancing governance, innovation, and risk management for agency use of artificial intelligence. Executive Office of the President Office of Management and Budget. 2024. URL: https:/​/www.​whitehouse.gov/​wp-content/​uploads/​2024/​03/​M-24-10-Advancing-Governance-Innovation-and-Risk-Management-for-Agency-Use-of-Artificial-Intelligence.​pdf [accessed 2024-04-23]
  75. Nundy S, Cooper LA, Kelsay E. Employers can do more to advance health equity. Harvard Business Review. 2023. URL: https://hbr.org/2023/01/employers-can-do-more-to-advance-health-equity [accessed 2024-04-23]
  76. The Deloitte Millennial Survey 2018. Deloitte. 2018. URL: https://www2.deloitte.com/tr/en/pages/about-deloitte/articles/millennialsurvey-2018.html [accessed 2024-04-23]
  77. Eswaran V. The business case for diversity in the workplace is now overwhelming. World Economic Forum. 2019. URL: https://www.weforum.org/agenda/2019/04/business-case-for-diversity-in-the-workplace/ [accessed 2024-04-23]
  78. Hawke LD, Sheikhan NY, Jones N, Slade M, Soklaridis S, Wells S, et al. Embedding lived experience into mental health academic research organizations: critical reflections. Health Expect. Oct 2022;25(5):2299-2305. [FREE Full text] [CrossRef] [Medline]
  79. Michalak C, Jackson M. Supporting the well-being of your underrepresented employees. Harvard Business Review. 2022. URL: https://hbr.org/2022/03/supporting-the-well-being-of-your-underrepresented-employees [accessed 2024-04-23]
  80. Woebot Health Forms Clinical Diversity Advisory Board. Woebot Health. 2021. URL: https://woebothealth.com/woebot-health-forms-clinical-diversity-advisory-board/ [accessed 2024-04-23]
  81. Delogne MC. Woebot Health to present abstracts on diversity in digital mental health interventions at ABCT 2022. Woebot Health. 2024. URL: https:/​/woebothealth.​com/​woebot-health-to-present-abstracts-on-diversity-in-digital-mental-health-interventions-at-abct-2022/​ [accessed 2024-04-23]
  82. Hemphill C. 8 building blocks of health equity strategy. Woebot Health. URL: https://woebothealth.com/8-building-blocks-of-health-equity-strategy/ [accessed 2024-04-23]
  83. Making mental health a part of your DEIB strategy. Headspace. 2024. URL: https://get.headspace.com/guide-making-mental-health-a-part-of-your-deib-strategy [accessed 2024-04-23]
  84. Hemphill C. What does racism cost our healthcare system? Woebot Health. URL: https://woebothealth.com/what-does-racism-cost-our-healthcare-system/ [accessed 2024-04-24]
  85. NIMHD Research Diversity Supplement Application Guidelines. National Institute on Minority Health and Health Disparities. URL: https:/​/www.​nimhd.nih.gov/​programs/​extramural/​training-career-dev/​research-supplements/​diversity-supplements.​html [accessed 2024-04-24]
  86. Welcome to NIGMS. National Institute of General Medical Sciences. URL: https://nigms.nih.gov/ [accessed 2024-04-24]
  87. Empower minds. Create opportunities. REACH. URL: https://reachatrush.org/ [accessed 2024-04-24]
  88. Ramos G, Chavira DA. Use of technology to provide mental health care for racial and ethnic minorities: evidence, promise, and challenges. Cognitive and Behavioral Practice. Feb 2022;29(1):15-40. [CrossRef]
  89. Bullard L, Rapoport S, Ariniello L, Delgado F, Waalen J, Williams A, et al. Utilization of community-based participatory research strategies in a postpartum digital health trial. 2024. Presented at: Annual Postpartum Support International Conference; July 26-28, 2024; Washington, DC.
  90. Joseph G, Dohan D. Diversity of participants in clinical trials in an academic medical center: the role of the 'Good Study Patient?'. Cancer. Feb 01, 2009;115(3):608-615. [FREE Full text] [CrossRef] [Medline]
  91. Wendler D, Kington R, Madans J, Van Wye G, Christ-Schmidt H, Pratt LA, et al. Are racial and ethnic minorities less willing to participate in health research? PLoS Med. Feb 2006;3(2):e19. [FREE Full text] [CrossRef] [Medline]
  92. Cullen MR, Lemeshow AR, Amaro S, Bandera EV, Cooper LA, Kawachi I, et al. A framework for setting enrollment goals to ensure participant diversity in sponsored clinical trials in the United States. Contemp Clin Trials. Jun 2023;129:107184. [FREE Full text] [CrossRef] [Medline]
  93. Call CC, Eckstrand KL, Kasparek SW, Boness CL, Blatt L, Jamal-Orozco N, et al. Scholars for Elevating EquityDiversity (SEED). An ethics and social-justice approach to collecting and using demographic data for psychological researchers. Perspect Psychol Sci. Sep 2023;18(5):979-995. [FREE Full text] [CrossRef] [Medline]
  94. Boucher E, Honomichl R, Ward H, Powell T, Stoeckl SE, Parks A. The effects of a digital well-being intervention on older adults: retrospective analysis of real-world user data. JMIR Aging. Sep 02, 2022;5(3):e39851. [FREE Full text] [CrossRef] [Medline]
  95. Pratap A, Neto EC, Snyder P, Stepnowsky C, Elhadad N, Grant D, et al. Indicators of retention in remote digital health studies: a cross-study evaluation of 100,000 participants. NPJ Digit Med. 2020;3:21. [FREE Full text] [CrossRef] [Medline]
  96. Placzek M, Friede T. Clinical trials with nested subgroups: analysis, sample size determination and internal pilot studies. Stat Methods Med Res. Nov 2018;27(11):3286-3303. [CrossRef] [Medline]
  97. McCall T, Asuzu K, Oladele CR, Leung TI, Wang KH. A socio-ecological approach to addressing digital redlining in the United States: a call to action for health equity. Front Digit Health. 2022;4:897250. [FREE Full text] [CrossRef] [Medline]
  98. Egede LE, Ruiz R, Mosley-Johnson E, Aguilar-Gaxiola SA, Corbie GM, Wilkins CH, et al. Laying the groundwork to make diversity, equity, and inclusion front and center in clinical and translational research. J Clin Transl Sci. 2023;7(1):e95. [FREE Full text] [CrossRef] [Medline]
  99. Martinez-Martin N. Envisioning a path toward equitable and effective digital mental health. AJOB Neurosci. 2022;13(3):196-198. [FREE Full text] [CrossRef] [Medline]
  100. Taher R, Hsu C, Hampshire C, Fialho C, Heaysman C, Stahl D, et al. The safety of digital mental health interventions: systematic review and recommendations. JMIR Ment Health. Oct 09, 2023;10:e47433. [FREE Full text] [CrossRef] [Medline]
  101. Health equity. American Psychological Association. URL: https://www.apaservices.org/advocacy/issues/health-equity [accessed 2024-04-24]
  102. Behavioral health equity. SAMHSA - Substance Abuse and Mental Health Services. URL: https://www.samhsa.gov/behavioral-health-equity [accessed 2024-04-24]
  103. Advocate for change. NAMI. URL: https://www.nami.org/advocacy/advocate-for-change/ [accessed 2024-04-24]
  104. Advocacy network. Mental Health America. URL: https://mhanational.org/issues/advocacy-network [accessed 2024-04-24]
  105. The mental health parity and addiction equity act (MHPAEA). Centers for Medicare & Medicaid Services. 2013. URL: https://www.cms.gov/marketplace/private-health-insurance/mental-health-parity-addiction-equity [accessed 2024-04-24]
  106. Cohen ES, editor. Broadband internet: access, regulation, and policy. New York, NY. Nova Science Publishers; 2008.
  107. Wu T. Network neutrality, broadband discrimination. SSRN Journal. 2003;2:141. [CrossRef]
  108. Rolan G, Denison T, Mackenzie C. "Broadband, digital literacy and public libraries: the Mill Park story". Library Hi Tech News. 2015;6:15-18. [CrossRef]
  109. Clinical trial diversity. FDA. URL: https://www.fda.gov/consumers/minority-health-and-health-equity/clinical-trial-diversity [accessed 2024-04-24]
  110. Spinner J, Araojo RR. FDA's strategies to close the health equity gap among diverse populations. J Prim Care Community Health. 2021;12:21501327211000232. [FREE Full text] [CrossRef] [Medline]
  111. Grabman G, Tenenbaum C. FDA regulation must uphold women's health. Food & Drug Law Institute (FDLI). 2022. URL: https://www.fdli.org/wp-content/uploads/2022/12/Grabman-Tenenbaum-FDLJ-77-3.pdf [accessed 2024-08-30]
  112. Food and Drug Administration (FDA). Enforcement policy for digital health devices for treating psychiatric disorders during the Coronavirus Disease 2019 (COVID-19): public health emergency guidance for industry and Food and Drug Administration staff. FDA. 2020. URL: https://www.regulations.gov/document/FDA-2020-D-1138-0068 [accessed 2024-04-24]
  113. PAR-22-154: Laboratories to optimize digital health. National Institutes of Mental Health. 2023. URL: https://grants.nih.gov/grants/guide/pa-files/PAR-22-154.html [accessed 2024-04-24]
  114. Kessler RC, Wang PS. The descriptive epidemiology of commonly occurring mental disorders in the United States. Annu Rev Public Health. 2008;29:115-129. [CrossRef] [Medline]
  115. Hossain MM, Tasnim S, Sultana A, Faizah F, Mazumder H, Zou L, et al. Epidemiology of mental health problems in COVID-19: a review. F1000Res. 2020;9:636. [FREE Full text] [CrossRef] [Medline]
  116. Ohlsson H, Kendler KS. Applying causal inference methods in psychiatric epidemiology: a review. JAMA Psychiatry. Jun 01, 2020;77(6):637-644. [FREE Full text] [CrossRef] [Medline]
  117. Meet New Profit’s 2023 mental health equity catalyze cohort. New Profit. May 22, 2023. URL: https://www.newprofit.org/go/meet-new-profits-2023-mental-health-equity-catalyze-cohort/ [accessed 2024-04-24]
  118. Galea S. The price of health equity. JAMA Health Forum. Apr 01, 2021;2(4):e210720. [FREE Full text] [CrossRef] [Medline]
  119. Knifton L, Inglis G. Poverty and mental health: policy, practice and research implications. BJPsych Bull. Oct 2020;44(5):193-196. [FREE Full text] [CrossRef] [Medline]
  120. Soliman W. ACMA. 2021. URL: https://medicalaffairsspecialist.org/blog/diversity-inclusion-clinical-trials-medical-affairs [accessed 2024-04-24]
  121. DeSalvo KB, Wang YC, Harris A, Auerbach J, Koo D, O'Carroll P. Public Health 3.0: a call to action for public health to meet the challenges of the 21st century. Prev Chronic Dis. Sep 07, 2017;14:E78. [FREE Full text] [CrossRef] [Medline]
  122. Dwyer M. Nonprofit leaders see potential to improve health equity through cross-sector partnerships. Pew. 2022. URL: https://pew.org/3zMdVT3 [accessed 2024-04-24]
  123. Bauer MS, Damschroder L, Hagedorn H, Smith J, Kilbourne AM. An introduction to implementation science for the non-specialist. BMC Psychol. Sep 16, 2015;3(1):32. [FREE Full text] [CrossRef] [Medline]
  124. Efforts to close the digital health equity divide may improve access to healthcare. ElevanceHealth. 2023. URL: https:/​/www.​elevancehealth.com/​our-approach-to-health/​health-equity/​efforts-to-close-the-digital-health-equity-divide [accessed 2024-04-24]
  125. Mordecai D, Histon T, Neuwirth E, Heisler WS, Kraft A, Bang Y, et al. How Kaiser Permanente Created a Mental Health and Wellness Digital Ecosystem. NEJM Catalyst. Jan 2021;2(1). [FREE Full text] [CrossRef]
  126. Youn SJ, Jaso B, Eyllon M, Sah P, Hoyler G, Barnes JB, et al. Leveraging implementation science to integrate digital mental health interventions as part of routine care in a practice research network. Adm Policy Ment Health. May 2024;51(3):348-357. [CrossRef] [Medline]
  127. CMS framework for health equity. Centers for Medicare & Medicaid Services. URL: https://www.cms.gov/priorities/health-equity/minority-health/equity-programs/framework [accessed 2024-04-24]
  128. Chen K, Lane E, Burns J, Macrynikola N, Chang S, Torous J. The digital navigator: standardizing human technology support in app-integrated clinical care. Telemed J E Health. Jun 2024;30(7):e1963-e1970. [CrossRef] [Medline]
  129. Nicholas J, Ringland KE, Graham AK, Knapp AA, Lattie EG, Kwasny MJ, et al. Stepping up: predictors of 'stepping' within an iCBT stepped-care intervention for depression. Int J Environ Res Public Health. Nov 25, 2019;16(23):4689. [FREE Full text] [CrossRef] [Medline]
  130. Nordgreen T, Haug T, Öst L-G, Andersson G, Carlbring P, Kvale G, et al. Stepped care versus direct face-to-face cognitive behavior therapy for social anxiety disorder and panic disorder: a randomized effectiveness trial. Behav Ther. Mar 2016;47(2):166-183. [CrossRef] [Medline]
  131. Adewuya AO, Momodu O, Olibamoyo O, Adegbaju A, Adesoji O, Adegbokun A. The effectiveness and acceptability of mobile telephone adherence support for management of depression in the Mental Health in Primary Care (MeHPriC) project, Lagos, Nigeria: A pilot cluster randomised controlled trial. J Affect Disord. Jun 15, 2019;253:118-125. [CrossRef] [Medline]
  132. Jonassaint CR, Belnap BH, Huang Y, Karp JF, Abebe KZ, Rollman BL. Racial differences in the effectiveness of internet-delivered mental health care. J Gen Intern Med. Feb 2020;35(2):490-497. [FREE Full text] [CrossRef] [Medline]


AI: artificial intelligence
APA: American Psychological Association
DEIB: diversity, equity, inclusion, and belonging
DMHI: digital mental health intervention
FDA: Food and Drug Administration
GDPR: General Data Protection Regulation
LGBTQIA+: Lesbian, Gay, Bisexual, Transgender, Queer, Intersex, Asexual+
LLM: large language model
ML: machine learning
NIH: National Institutes of Health
NIMH: National Institute of Mental Health
PIDAR: Partner, Identify, Demonstrate, Access, Report
REACH: Rush Education and Career Center Hub
RE-AIM: Reach, Effectiveness, Adoption, Implementation, Maintenance
SAMHSA: Substance Abuse and Mental Health Services Administration
SDOH: social determinants of health
STEM: Science, Technology, Engineering, Mathematics
USPSTF: US Preventive Services Taskforce


Edited by G Eysenbach; submitted 30.04.24; peer-reviewed by S Miller, R Bhattacharya, D Ellis, J Murphy; comments to author 21.06.24; revised version received 07.08.24; accepted 10.08.24; published 24.09.24.

Copyright

©Athena Robinson, Megan Flom, Valerie L Forman-Hoffman, Trina Histon, Monique Levy, Alison Darcy, Toluwalase Ajayi, David C Mohr, Paul Wicks, Carolyn Greene, Robert M Montgomery. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 24.09.2024.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research (ISSN 1438-8871), is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.