This paper is in the following e-collection/theme issue:

E-Health Policy and Health Systems Innovation (207) JMIR Theme Issue: COVID-19 Special Issue (2388) JMH Theme Issue: COVID-19 and Mental Health: Impact and Interventions (371) Innovations in Mental Health Systems (370)

Published on in Vol 23, No 6 (2021): June

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/25331, first published .
The Impact of Technology-Enabled Care Coordination in a Complex Mental Health System: A Local System Dynamics Model

The Impact of Technology-Enabled Care Coordination in a Complex Mental Health System: A Local System Dynamics Model

The Impact of Technology-Enabled Care Coordination in a Complex Mental Health System: A Local System Dynamics Model

Authors of this article:

Frank Iorfino1 Author Orcid Image ;   Jo-An Occhipinti1 Author Orcid Image ;   Adam Skinner1 Author Orcid Image ;   Tracey Davenport1 Author Orcid Image ;   Shelley Rowe1 Author Orcid Image ;   Ante Prodan2 Author Orcid Image ;   Julie Sturgess3 Author Orcid Image ;   Ian B Hickie1 Author Orcid Image
Article Authors Cited by (21) Tweetations (24) Metrics

    Original Paper

    1Brain and Mind Centre, University of Sydney, Sydney, Australia

    2Translational Health Research Institute, Western Sydney University, Sydney, Australia

    3North Coast Primary Health Network, Coffs Harbour, Australia

    Corresponding Author:

    Frank Iorfino, PhD

    Brain and Mind Centre

    University of Sydney

    94 Mallet Street, Camperdown

    Sydney, 2050

    Australia

    Phone: 61 2 9351 0584

    Email: frank.iorfino@sydney.edu.au


    Background: Prior to the COVID-19 pandemic, major shortcomings in the way mental health care systems were organized were impairing the delivery of effective care. The mental health impacts of the pandemic, the recession, and the resulting social dislocation will depend on the extent to which care systems will become overwhelmed and on the strategic investments made across the system to effectively respond.

    Objective: This study aimed to explore the impact of strengthening the mental health system through technology-enabled care coordination on mental health and suicide outcomes.

    Methods: A system dynamics model for the regional population catchment of North Coast New South Wales, Australia, was developed that incorporated defined pathways from social determinants of mental health to psychological distress, mental health care, and suicidal behavior. The model reproduced historic time series data across a range of outcomes and was used to evaluate the relative impact of a set of scenarios on attempted suicide (ie, self-harm hospitalizations), suicide deaths, mental health–related emergency department (ED) presentations, and psychological distress over the period from 2021 to 2030. These scenarios include (1) business as usual, (2) increase in service capacity growth rate by 20%, (3) standard telehealth, and (4) technology-enabled care coordination. Each scenario was tested using both pre– and post–COVID-19 social and economic conditions.

    Results: Technology-enabled care coordination was forecast to deliver a reduction in self-harm hospitalizations and suicide deaths by 6.71% (95% interval 5.63%-7.87%), mental health–related ED presentations by 10.33% (95% interval 8.58%-12.19%), and the prevalence of high psychological distress by 1.76 percentage points (95% interval 1.35-2.32 percentage points). Scenario testing demonstrated that increasing service capacity growth rate by 20% or standard telehealth had substantially lower impacts. This pattern of results was replicated under post–COVID-19 conditions with technology-enabled care coordination being the only tested scenario, which was forecast to reduce the negative impact of the pandemic on mental health and suicide.

    Conclusions: The use of technology-enabled care coordination is likely to improve mental health and suicide outcomes. The substantially lower effectiveness of targeting individual components of the mental health system (ie, increasing service capacity growth rate by 20% or standard telehealth) reiterates that strengthening the whole system has the greatest impact on patient outcomes. Investments into more of the same types of programs and services alone will not be enough to improve outcomes; instead, new models of care and the digital infrastructure to support them and their integration are needed.

    J Med Internet Res 2021;23(6):e25331

    doi:10.2196/25331

    Keywords

    medical informatics; internet; care coordination; complex systems; simulation; health systems; policy; mental health 


    Mental illness is a major cause of disability and early mortality globally [1-3]. The early onset, chronicity, and complexity of mental illness means that the human, social, and economic costs are enormous [4]. Yet, mental health systems often struggle to provide adequate care that effectively intervenes to mitigate the short- and long-term negative outcomes [5].

    For some, access to mental health care has improved [6-9]; however, most health systems lack effective coordination between service silos, which impacts on the delivery of holistic, timely, and quality mental health care [10,11]. Service fragmentation, delayed care, mental health treatment isolated from other physical and social needs, complicated service pathways, and inefficient resource allocation are persistent features of an underperforming service system [5,12]. This is particularly problematic for people with more complex needs who tend to report higher rates of disengagement from education or employment [7-9], suicidality [13,14], and comorbidity [15]. These cases are the norm among those who frequently engage with health systems and typically require multidisciplinary team-based care approaches [16]. These approaches embrace collaborative care models, which recognize that effective care coordination between service providers, including intensive assessment, personalized treatment plans, targeted referrals, clinical information systems use, and outcome monitoring can improve treatment engagement, satisfaction with care, and mental health outcomes [17-19].

    The integrated use of digital technologies offers significant potential to enable effective coordination of mental health care [20-23]. The accessibility, scalability, and standardization mean that technology is well-placed to play a major role in the digitization of health care and can be leveraged to deliver quality mental health care across settings, especially those that are remote or rural and may be underresourced when compared to urban centers [24]. Their use in mental health systems has already demonstrated utility to improve access to care and communication between service providers and consumers [25]. This may be particularly important for people with more complex needs, such as housing and employment support, whereby mental health treatment may be an additional burden in terms of time, effort, and finance. Technology offers an opportunity to alleviate some of this burden through greater flexibility in terms of access to effective care, greater efficiencies through the sharing of information between providers, and improving engagement with care [26].

    Never has this capability been more vital than amid a pandemic and recession whose effects are disrupting nearly every aspect of life: familial, educational, vocational, health, and social structures. This disruption is threatening population mental health and well-being and is likely to generate service demand of unprecedented magnitude for many years [27,28]. Some governments are responding by instituting measures to reduce economic and social hardship, investing in mental health programs and services, and improving access via virtual mental health services (ie, basic telehealth). These investments represent a move in the right direction; however, without addressing the fundamental models of care, the rapid adoption of telehealth poses the risk that it may digitize the problems that already exist in existing models of care across the mental health system [29,30].

    Systems modeling and simulation is a low-risk method of exploring likely impacts of counterfactual scenarios. This study uses an existing local system dynamics model developed for regional mental health services planning to identify the impact of using digital technologies to facilitate care coordination on mental health outcomes and health system burden (ie, technology-enabled care coordination). Here, we aimed to compare technology-enabled care coordination to three other likely intervention scenarios: (1) business as usual, (2) an increase in the growth rate of existing service capacity (ie, increasing throughput of people into existing systems), and (3) digital technologies used to extend existing services online (eg, via videoconferencing) without changing the underlying model of care (ie, standard telehealth). We aimed to model the impacts of each scenario within both a typical context and a public mental health crisis resulting from the pandemic and economic recession.


    Context

    The North Coast NSW (New South Wales) Primary Health Network supports a population of 502,524, as of 2016 [31], distributed over a geographic area of approximately 35,570 square kilometers and takes in both coastal and inland rural communities. The region is more socioeconomically disadvantaged compared to the state and national averages, with higher rates of unemployment, domestic and family violence, and homelessness [32,33].

    Model Overview

    The system dynamics model was developed using a participatory modeling approach that involved over 50 local stakeholders, including representatives from health and social policy agencies, local government, nongovernmental organizations, primary care providers, emergency services, research institutions, community groups, and, importantly, people with lived experience. The process employed a broad systems perspective drawing on the deep tacit knowledge of the diverse perspectives of these system actors. Input from stakeholders was provided through a series of workshops, meetings, surveys, and local system mapping activities between July and December 2019. This process involved iteratively working on the model structure and assumptions; regular face validity checks by a diverse group of academic, clinical, policy, program planning, emergency services, and lived-experience stakeholders were undertaken to ensure accurate model representation, conceptualization, and outputs. A more detailed description of the model development process, structure, outputs, and calibration can be found in the primary paper [34].

    In summary, the core model structure included the following dynamically interacting components:

    1. A population component, capturing changes over time in the size and structure of the population resulting from births, net migration, and mortality across the following age groups: 0-14 years, 15-24 years, 25-64 years, and 65+ years old.
    2. A psychological distress component that captures changes in the rates and severity of psychological distress in the population (ie, states of low psychological distress, with a Kessler 10 [K10] score of 10-15; moderate psychological distress, with a K10 score of 16-21; and high to very high psychological distress, with a K10 score of 22-50).
    3. A series of components capturing pathways within and between key social determinants of mental health and suicidal behavior, namely, early life exposures, substance abuse, domestic violence, homelessness, and unemployment.
    4. A mental health service system component that models the movement of psychologically distressed people through one of several possible service pathways, potentially involving general practitioners; psychiatrists; allied mental health professionals, including psychologists and mental health nurses; emergency department (ED) and psychiatric inpatient care; community- and hospital-based outpatient care; and online services, and one that captures changes over time in service demand and capacity.
    5. A suicidal behavior component that captures self-harm hospitalizations and suicide deaths. Figure S1 in Multimedia Appendix 1 details the key social determinants identified by the participatory process and their hypothesized impact on mental health and the other model outcomes.

    Model construction and analysis were performed using Stella Architect, version 1.9.4 (isee systems inc). The model was validated by (1) testing whether the model could replicate historic data across a range of key indicators, namely, time series of psychological distress, psychiatric hospitalizations, mental health–related ED presentations, self-harm hospitalizations, and suicide deaths, and (2) ensuring face validity among diverse system actors in the model structure and performance. The AdViSHE (Assessment of the Validation Status of Health-Economic decision models) checklist was also used to assess the validation status of this model and its outputs [35].

    Model Outputs

    For this study, model outputs included both mental health outcomes and service usage for the total population. Mental health outcomes and health system burden include total cumulative numbers of self-harm hospitalizations, which are a proxy for suicide attempts; suicide deaths; prevalence of high to very high psychological distress; and mental health–related ED hospitalizations. All outputs were calculated every 0.4375 days (ie, one-sixteenth of a week) starting from January 1, 2011; these permitted comparisons of model outputs with historic data from 2011 to 2017 for validation. Forecasts of the impacts of intervention scenarios described below are simulated from the time of implementation in 2021 to the end of 2029 [34].

    Intervention Scenarios

    Four distinct intervention scenarios were tested. The first scenario is business as usual, whereby there is no change to the existing services system and the rate of growth in existing services is maintained. The second scenario is an increase in service capacity growth by 20%, whereby the yearly growth of existing service capacity is increased. These services include those provided by general practitioners; psychiatrists; allied mental health professionals, including psychologists and mental health nurses; and community-based mental health services. The third scenario is standard telehealth, whereby digital technologies are used to extend existing services online (eg, via videoconferencing) without changing the underlying model of care. The fundamental assumption here is that technologies are being used to remotely provide existing models of care delivered by individual providers rather than being used to improve the coordination of care between service providers: a coordinated, multidisciplinary, team-based approach to care. This means that there is no change to referrals between services nor to the per-service recovery rate, since the only element that has changed is the mode of delivery. The fourth scenario is technology-enabled care coordination, which involves the use of online technology to facilitate delivery of multidisciplinary team-based care, in which medical and allied health professionals consider all relevant treatment options and collaboratively develop an individual treatment and care plan for each patient. Online technology enables enhanced coordination of care and facilitates communication between medical and allied health professionals, since each health professional involved in the care of a patient has access to the same information about that patient’s treatment history (see parameter details in Textbox 1 [17,25,34,36,37]).

    Each scenario was operationalized by varying key parameter estimates in the model, as outlined in Table 1. Each of these intervention scenarios was tested under pre–COVID-19 conditions, which are based on original trends in socioeconomic circumstances (ie, all policies and programs currently in place remain unchanged and service capacity continues to increase at current rates). Each intervention scenario was also tested under post–COVID-19 conditions, which reflect a new baseline for socioeconomic circumstances to compare and contrast the qualitative and quantitative performance of this intervention when faced with new realities (eg, socioeconomic shocks). The interventions considered here are not intended to be a complete evaluation of strategies to mitigate the effects of the COVID-19 pandemic, but rather we aimed to determine the robustness of each scenario under these changed conditions. Table 2 details how the pre– and post–COVID-19 initial conditions were implemented in the model.

    Parameters determining the direct effects of technology-enabled care coordination [34].

    Maximum rate per service:

    This refers to the maximum proportion of mental health services provided that involve technology-enabled care coordination. This proportion will depend on the number of medical and allied mental health professionals adopting technology-enabled care coordination, as well as the number of patients consenting to the use of these technologies in the management of their care (ie, uptake among service providers and patients). The default value (0.7) assumes that when fully implemented, technology-enabled care coordination will be provided in 70% of mental health services completed.

    Effect on recovery rate:

    This refers to the multiplicative effect of technology-enabled care coordination on the per-service recovery rate (ie, the probability that a patient’s level of psychological distress will decrease after receiving treatment). The default estimate (1.177) implies that technology-enabled care coordination increases the per-service probability of a reduction in psychological distress by 17.7% [17,25].

    Effect on referrals to specialized care:

    This refers to the multiplicative effect of technology-enabled care coordination on general practitioners’ rates of referral to specialized psychiatric care (ie, psychiatrists and allied mental health services). The default value (1.266) implies that technology-enabled care coordination increases the per-consultation probability that a general practitioner will refer a patient with high or very high psychological distress to specialized psychiatric care by 26.6% [36]. Note that technology-enabled care coordination is assumed to have no effect on the referral rate for patients with moderate psychological distress.

    Effect on disengagement:

    This refers to the multiplicative effect of technology-enabled care coordination on rates of disengagement from mental health services, including waiting for services and dissatisfaction with services received. The default estimate (0.520) implies that technology-enabled care coordination reduces rates of disengagement by 48.0% [25,36].

    Effect on referrals to alcohol and other drugs services:

    This refers to the multiplicative effect of technology-enabled care coordination on the rate of referral of patients with a substance abuse disorder to alcohol and drug treatment services. The default value (1.1) assumes an increase in the rate of referral of 10% (ie, patients with a substance abuse disorder receiving technology-enabled care coordination are 10% more likely to be referred to alcohol and drug treatment services than patients with a substance abuse disorder receiving usual care).

    Effect on substance use relapse rate:

    This refers to the multiplicative effect of coordinated treatment of co-occurring substance abuse and mental disorders on the substance use relapse rate (ie, the probability that a patient treated for a substance use disorder will relapse when treatment is completed). The default value (0.869) implies that coordinated substance abuse and psychiatric treatment reduces the rate of substance use relapse by 13.1% (ie, compared to substance abuse treatment alone) [37].

    Effect on employment initiation:

    This refers to the multiplicative effect of technology-enabled care coordination on the rate at which unemployed patients gain employment, through referral to employment services. The default value (1.1) assumes an increase in the employment initiation rate of 10% (ie, unemployed patients receiving technology-enabled care coordination are 10% more likely to gain employment than unemployed patients receiving usual care).

    Effect on exiting homelessness rate:

    This refers to the multiplicative effect of technology-enabled care coordination on the rate at which homeless patients secure housing, through referral to homelessness services. The default value (1.1) assumes a 10% increase in the rate that patients exit homelessness, equal to the inverse of the duration of homelessness (ie, homeless patients receiving technology-enabled care coordination are 10% more likely to secure housing than homeless patients receiving usual care).

    Effect on psychiatric service capacity:

    This refers to the multiplicative effect of technology-enabled care coordination on the total capacity of specialized psychiatric services (ie, the maximum number of services that can be provided by psychiatrists and allied mental health providers per year). The default value (1.1) assumes an increase in service capacity of 10%.

    Effect on referrals to online services:

    This refers to the multiplicative effect of technology-enabled care coordination on the rate of referral of patients with moderate psychological distress to online services. The default value (1.1) assumes an increase in the rate of referral of 10% (ie, patients with moderate psychological distress receiving technology-enabled care coordination are 10% more likely to be referred to online services than patients with moderate psychological distress receiving usual care).

    Textbox 1. Parameters determining the direct effects of technology-enabled care coordination [34].
    Table 1. Parameter values for each intervention scenario.
    ParameteraParameter values for each scenario

    		Scenario 1bScenario 2cScenario 3dScenario 4e
    Direct effects on technology interventions

    		Maximum rate per service000.700.70

    		Effect on recovery rate1.001.001.091.18

    		Effect on referrals to specialized care1.001.0010.001.27

    		Effect on disengagement1.001.000.760.52

    		Effect on alcohol and other drugs services referral rate1.001.001.001.10

    		Effect on substance abuse relapse1.001.000.930.87

    		Effect on employment1.001.001.001.10

    		Effect on exiting homelessness rate1.001.001.001.10

    		Effect on service capacity1.001.001.101.10

    		Effect on referrals to online services1.001.001.001.10
    Direct effects on service capacity

    		General practice service capacity increase per year125.85151.02125.85125.85

    		Psychiatrist and allied service capacity increase per year216.31259.57216.31216.31

    		CMHCf service capacity increase per year075.1400

    aSee Textbox 1 for more details about each parameter.

    bScenario 1: business as usual.

    cScenario 2: increase in service capacity growth rate by 20%.

    dScenario 3: standard telehealth.

    eScenario 4: technology-enabled care coordination.

    fCMHC: community mental health capacity.

    Table 2. Comparison of parameters used to model pre– and post–COVID-19 initial conditions.
    ParameterParameter values for each condition

    		Pre–COVID-19Post–COVID-19
    Youth job loss rate ratio1.005.00
    Unemployment total1.0015.00
    Unemployment effect decay rate00.05
    Sense of community index (ie, social connectedness)9.618.24
    Years to reach sense of community index01.00
    Duration (years) of social disconnection02.00

    Statistical Analysis

    Sensitivity analyses were performed to assess the impact of uncertainty in parameter estimates of the direct effects of each intervention scenario on the simulation results. Latin hypercube sampling was used to draw 100 sets of values for selected model parameters determining the direct effects of the interventions on suicidal behavior in young people, from a uniform joint distribution spanning ±20% of the default values. Differences in each of the model outputs (eg, cumulative numbers of self-harm hospitalizations, suicide deaths, and mental health–related ED presentations) between the baseline and intervention scenarios were calculated for each set of parameter values and were summarized using simple descriptive statistics. All intervals reported in this paper are derived from the distributions of model outputs calculated in the sensitivity analyses; they provide a measure of the impact of uncertainty in the intervention effect estimates but should not be interpreted as confidence intervals.


    Overview

    Under the baseline scenario (ie, business as usual pre–COVID-19), approximately 12,274 self-harm hospitalizations, 953 suicide deaths, and 81,263 mental health–related ED presentations were forecast for the period from 2021 to 2030. By 2030, the prevalence of high psychological distress was expected to be on a trajectory of decline and was set to reduce by 2 percentage points (ie, from 17.60% in 2021 to 15.60% in 2030). Figure 1 shows the relative impact of each scenario on mental health and suicide outcomes. The implementation of technology-enabled care coordination (scenario 4) had the largest impact on outcomes for the total population. For the total population, self-harm hospitalizations and suicide deaths were reduced by 6.71% (95% interval 5.63%-7.87%), mental health–related ED presentations were reduced by 10.33% (95% interval 8.58%-12.19%), and the prevalence of high psychological distress in 2030 was reduced by 1.76 percentage points (95% interval 1.35-2.32 percentage points). This would result in the prevention of 844 self-harm hospitalizations, 66 suicides, and 8448 mental health–related hospitalizations over the forecast period and a decline in the prevalence of high psychological distress to 14% in 2030. The rate of uptake of technology-enabled care coordination has a major impact on the effects of this intervention (Figure 2). The impact on all outcomes is greater as the rate of uptake across the mental health system increases from 20% to 50% and then to 80%.

    ‎
    Figure 1. Mental health outcomes for each intervention scenario. ED: emergency department.
    View this figure
    ‎
    Figure 2. The impact of the rate of uptake on mental health outcomes. ED: emergency department.
    View this figure

    Increasing the service capacity growth rate by 20% (scenario 2) only had a minor impact on both populations; for the total population, it was forecast to reduce self-harm hospitalizations and suicide deaths by 1.64% (95% interval –0.20% to 3.51%), mental health–related ED presentations by 2.76% (95% interval –0.41% to 5.95%), and the prevalence of high psychological distress in 2030 by 0.57 percentage points (95% interval –0.08 to 1.29 percentage points). This would result in the prevention of 274 self-harm hospitalizations, 21 suicides, and 3023 mental health–related hospitalizations. The prevalence of high psychological distress was projected to decline to 15% in 2030.

    When digital technologies were used for standard telehealth (scenario 3), the impact on outcomes was better than scenario 2 but lower than scenario 4, reducing self-harm hospitalizations and suicide deaths by 3.50% (95% interval 1.58%-5.03%), mental health–related ED presentations by 5.48% (95% interval 2.24%-5.43%), and the prevalence of high psychological distress in 2030 by 0.99 percentage points (95% interval 0.42-1.67 percentage points). Over the forecast period, this would result in the prevention of 418 self-harm hospitalizations, 32 suicides, 4244 mental health–related hospitalizations, and a decline in the prevalence of high psychological distress to 14.8% in 2030.

    Post–COVID-19 Scenario Modeling

    The impact of the public mental health crisis was estimated to have detrimental effects on all outcomes, with 14,973 self-harm hospitalizations (22% increase from baseline figures), 1176 suicide deaths (23% increase), and 98,591 mental health–related ED presentations (21% increase). By 2030, the prevalence of high psychological distress was forecast to be 18.3%, a 2.7–percentage point increase from the baseline figures forecast for 2030. During this public mental health crisis, technology-enabled care coordination (scenario 4) was forecast to have a similar impact on outcomes, with a 6.43% (95% interval 5.29%-7.46%) reduction in self-harm hospitalizations, a 6.40% (95% interval 5.26%-7.42%) reduction in suicide deaths, a 10.01% (95% interval 8.06%-11.71%) reduction in mental health–related ED presentations, and a reduction of 2.52 percentage points (95% interval 1.82-3.08 percentage points) in high psychological distress in 2030. The pattern of results for each scenario was consistent under these changed conditions; technology-enabled care coordination represents an important and effective part of the strategy to mitigate the social and economic impacts of the COVID-19 pandemic, with outcomes reduced back down to the initial business as usual estimates from pre–COVID-19.


    Principal Findings

    These findings suggest that the use of technology-enabled care coordination is likely to result in better mental health outcomes and reduce health system burden at a population level. When compared to increasing the service capacity growth rate across a variety of settings by 20% and standard telehealth, technology-enabled care coordination led to greater reductions in suicide deaths, the total number of self-harm hospitalizations or mental health–related ED hospitalizations, and the prevalence of high psychological distress in the population. This emphasizes that strengthening how the whole mental health system functions together will have a greater impact on outcomes than simply improving the capacity across individual components of the mental health system. Investments into more of the same types of programs and services alone will not be enough to improve the outcomes for the whole system; instead, new models of care and the infrastructure to support them and their integration need to accompany these investments.

    Increasing the service capacity growth rate does have a minor impact; however, since it primarily acts to increase throughput into the current mental health system, it does not address existing challenges of service fragmentation. Many structural barriers and misaligned incentives remain across the system, which contribute to the health system burden and inefficient allocation of resources that often result in poor outcomes for individuals [38-40]. Addressing these systemic issues will most likely involve ensuring that the mental health system has the appropriate infrastructure in place to not only meet the demand for services, but provide timely care that appropriately targets the diverse needs of people presenting for care.

    This work supports calls for increased use of digital technologies in mental health care [41]; however, it also suggests the importance of the way these technologies are employed. The modeling shows that when digital technologies are used for standard telehealth practices by extending existing services online (eg, via videoconferencing), without changing the underlying model of care, then the impact is lower. This type of scenario reflects what we might expect to see when telehealth is more widely implemented to deliver existing services, yet little effort is made to utilize these technologies in ways that promote multidimensional team-based care and maximize the benefits that technologies provide. As such, while telehealth stands to improve access, reach, and throughput to the mental health system and is a critical improvement in health service delivery, it does not necessarily ensure that people receive the appropriate type of mental health and social care that improves their chances of recovery. For this, a transformation in the models of care provided by services within the mental health system are required to achieve the full potential benefits of digital technologies.

    Research regarding the effectiveness of digital technologies for mental health is growing, yet many of these innovations focus on the use of technologies within closed systems of care, often in isolation from other parts of the mental health system [30,42]. This neglects the way people typically need to access multiple parts of the system to receive effective care. This study illustrates that the benefits of technology-enabled care coordination for the whole system continues to increase as the proportion of services using this intervention increases. Unfortunately, realizing this type of widespread usage will require overcoming specific implementation barriers that have plagued most attempts to implement new technologies into existing health systems [22,43]. Common barriers include technology design, variation in the level of integration into existing service pathways and clinical protocols, process dynamics, contextual factors (eg, local leadership and organizational support), and other factors (eg, resourcing and training) [44-46]. Addressing these barriers requires a whole system approach that challenges the traditional and often rigid health systems to ensure that these tools are developed and integrated with services in a way that truly transforms clinical practice for the whole system.

    This work should be considered in light of some limitations. The use of multiple secondary data sets introduces potential measurement bias for the estimates used to parameterize the model. Strategies were used to reduce the impact of such biases, including the triangulation of multiple data sources, parameter estimation via constrained optimization, and local verification to identify plausible estimates. The impacts of simulated scenarios are not necessarily generalizable to other regions, due to the specificity of the population, demographic, behavioral, social, economic, and mental health service dynamics that drive outcomes in a particular modeled region. Yet, for regions contextually similar to the modeled region, many of the model insights are likely to be relevant and provide a compelling case for exploring the likely impacts of similar technologies elsewhere. Further, the distinctions between the assumptions of scenarios 3 and 4 are likely to provide more generalizable insights about what components of digital transformation are projected to have large impacts in health systems. Future work should also focus on validating these model outputs over time by embedding them in local monitoring and evaluation of the implemented technology. In addition, comparisons of the modeled impacts of the technology applied to regions with similar or different social, economic, and mental health system contexts will provide additional broader insights. Finally, this study focuses on population effects of scenarios whereby the effects of interventions are generalized at the population level and cannot account for individual differences in the way that digital technologies may be rolled out or implemented at a local level. To address these specific issues, individual-level approaches, such as agent-based modeling, may be more appropriate to determine the effect of digital technologies on different agents within a mental health system (eg, people, clinicians, and services) and the impact this has on mental health and suicide outcomes.

    Conclusions

    Systems modeling and simulation of the likely impact of technology-enabled care coordination in ordinary and extraordinary times has highlighted its significant potential in improving population mental health and suicide outcomes. This work also provides important evidence to support a push for major investment to scale up the implementation of digital technologies that support new models of care facilitating care coordination.

    Acknowledgments

    The model was developed in partnership with the North Coast Primary Health Network and was intended as a contribution to the North Coast Collective, which is a regional collaboration initially between three organizations—North Coast Primary Health Network, Northern NSW Local Health District, and Mid-North Coast Local Health District—and is growing to include partners and a range of community stakeholders, including those outside of the health sector and people with lived experience of mental ill-health and suicidal behavior. Critically, this regional focus seeks to deliver on regionally agreed outcomes, optimizing the intervention and investment portfolio to achieve the greatest gain—value is defined by the quadruple aim of health care—in the most efficient way. This work was made possible by generous contributions of time, local knowledge, data, and content area expertise by the North Coast Collective modeling group, which includes the following members: Fay Adamson, Dr Graeme Browne, Dr Ashlea Broomfield, Luke Buckley, Warren Burgess, Dale Cara, Vigeeta Chauban, Christopher Clark, Dr Trish Collie, Janet Cormick, Katrina Dart, Swati Devmurari, Samara Finlayson, Guy Flaherty, Robyn George, Dr Adrian Gilliland, Dr Nicola Holmes, Rebecca Hope, David Horseman, Danica Hudson, Glen James, Darren Kershaw, Nicholas Kosseris, Deborah Kuhn, Dr Toney Lower, Dr Corrine Maynard, Tracey Mills, Lyn Moran, Niall Mulligan, David Noble, Stanley Nebo, Stuart Nunan, Judy O’Mara, Margarete Anna Ogonowski, Anne-Maree Parry, Alan Pretty, Leavina Reid, Rachel Richardson, Deidre Robinson, Vicki Rose, Shelly Rowe, Sara Shaughnessy, Dr Peter Silberberg, Janny Sinclair, Liz Stirling, Julie Sturgess, Trent Taylor, Claudine Tule, Dr Richard Tranter, Darryl Walker, Tracey Wild, Leigh Williamson, Diana Wilson, and Jami-Lee Winnacott.

    Conflicts of Interest

    IBH was an inaugural commissioner on Australia’s National Mental Health Commission (2012-2018). He is the Co-Director, Health and Policy at the Brain and Mind Centre (BMC), University of Sydney. The BMC operates an early-intervention youth services program at Camperdown under contract to Headspace. He is the Chief Scientific Advisor to, and a 5% equity shareholder in, InnoWell Pty Ltd. InnoWell was formed by the University of Sydney (45% equity) and PwC (Australia; 45% equity) to deliver the Aus $30 million (~US $23,212,500) Australian Government–funded Project Synergy (2017-2020; a 3-year program for the transformation of mental health services) and to lead the transformation of mental health services internationally through the use of innovative technologies. JAO is Head of Systems Modelling, Simulation & Data Science and Co-Director of the Mental Wealth Initiative at the University of Sydney’s BMC, and is Managing Director of Computer Simulation & Advanced Research Technologies (CSART). TD is the Director of Research & Insights at the Australian Digital Health Agency.

    ‎
    Multimedia Appendix 1

    Supplementary materials.

    DOCX File , 8212 KB

    References

    1. Copeland WE, Wolke D, Shanahan L, Costello EJ. Adult functional outcomes of common childhood psychiatric problems: A prospective, longitudinal study. JAMA Psychiatry 2015 Sep;72(9):892-899 [FREE Full text] [CrossRef] [Medline]
    2. Merikangas KR, Nakamura EF, Kessler RC. Epidemiology of mental disorders in children and adolescents. Dialogues Clin Neurosci 2009;11(1):7-20 [FREE Full text] [Medline]
    3. Gore FM, Bloem PJ, Patton GC, Ferguson J, Joseph V, Coffey C, et al. Global burden of disease in young people aged 10-24 years: A systematic analysis. Lancet 2011 Jun 18;377(9783):2093-2102. [CrossRef] [Medline]
    4. Vigo D, Thornicroft G, Atun R. Estimating the true global burden of mental illness. Lancet Psychiatry 2016 Feb;3(2):171-178. [CrossRef] [Medline]
    5. Contributing Lives, Thriving Communities – Report of the National Review of Mental Health Programmes and Services. Sydney, Australia: National Mental Health Commission, Australian Government; 2014.   URL: https:/​/www.​mentalhealthcommission.gov.au/​monitoring-and-reporting/​national-reports/​2014-contributing-lives-review [accessed 2021-06-14]
    6. Rickwood DJ, Telford NR, Parker AG, Tanti CJ, McGorry PD. headspace - Australia's innovation in youth mental health: Who are the clients and why are they presenting? Med J Aust 2014 Feb 03;200(2):108-111. [CrossRef] [Medline]
    7. Hamilton BA, Naismith SL, Scott EM, Purcell S, Hickie IB. Disability is already pronounced in young people with early stages of affective disorders: Data from an early intervention service. J Affect Disord 2011 Jun;131(1-3):84-91. [CrossRef] [Medline]
    8. O'Dea B, Glozier N, Purcell R, McGorry PD, Scott J, Feilds K, et al. A cross-sectional exploration of the clinical characteristics of disengaged (NEET) young people in primary mental healthcare. BMJ Open 2014 Dec 23;4(12):e006378 [FREE Full text] [CrossRef] [Medline]
    9. Scott J, Scott EM, Hermens DF, Naismith SL, Guastella AJ, White D, et al. Functional impairment in adolescents and young adults with emerging mood disorders. Br J Psychiatry 2014 Nov;205(5):362-368. [CrossRef] [Medline]
    10. Eiring O, Landmark BF, Aas E, Salkeld G, Nylenna M, Nytrøen K. What matters to patients? A systematic review of preferences for medication-associated outcomes in mental disorders. BMJ Open 2015 Apr 08;5(4):e007848 [FREE Full text] [CrossRef] [Medline]
    11. Kilbourne AM, Fullerton C, Dausey D, Pincus HA, Hermann RC. A framework for measuring quality and promoting accountability across silos: The case of mental disorders and co-occurring conditions. Qual Saf Health Care 2010 Apr;19(2):113-116. [CrossRef] [Medline]
    12. Hickie IB. Youth mental health: We know where we are and we can now say where we need to go next. Early Interv Psychiatry 2011 Feb;5 Suppl 1:63-69. [CrossRef] [Medline]
    13. Iorfino F, Davenport TA, Ospina-Pinillos L, Hermens DF, Cross S, Burns J, et al. Using new and emerging technologies to identify and respond to suicidality among help-seeking young people: A cross-sectional study. J Med Internet Res 2017 Jul 12;19(7):e247 [FREE Full text] [CrossRef] [Medline]
    14. Scott EM, Hermens DF, Naismith SL, White D, Whitwell B, Guastella AJ, et al. Thoughts of death or suicidal ideation are common in young people aged 12 to 30 years presenting for mental health care. BMC Psychiatry 2012 Dec 26;12:234 [FREE Full text] [CrossRef] [Medline]
    15. Iorfino F, Scott EM, Carpenter JS, Cross SP, Hermens DF, Killedar M, et al. Clinical stage transitions in persons aged 12 to 25 years presenting to early intervention mental health services with anxiety, mood, and psychotic disorders. JAMA Psychiatry 2019 Nov 01;76(11):1167-1175 [FREE Full text] [CrossRef] [Medline]
    16. Hickie IB, Scott EM, Cross SP, Iorfino F, Davenport TA, Guastella AJ, et al. Right care, first time: A highly personalised and measurement-based care model to manage youth mental health. Med J Aust 2019 Nov;211 Suppl 9:S3-S46. [CrossRef] [Medline]
    17. Woltmann E, Grogan-Kaylor A, Perron B, Georges H, Kilbourne AM, Bauer MS. Comparative effectiveness of collaborative chronic care models for mental health conditions across primary, specialty, and behavioral health care settings: Systematic review and meta-analysis. Am J Psychiatry 2012 Aug;169(8):790-804. [CrossRef] [Medline]
    18. Bodenheimer T, Wagner EH, Grumbach K. Improving primary care for patients with chronic illness. JAMA 2002 Oct 09;288(14):1775-1779. [CrossRef] [Medline]
    19. Raney L, Kathol R, Summergrad P. Collaborative care models for comorbid medical and behavioral health conditions. Focus (Am Psychiatr Publ) 2013 Jan;11(4):501-508. [CrossRef]
    20. Lora A, Lesage A, Pathare S, Levav I. Information for mental health systems: An instrument for policy-making and system service quality. Epidemiol Psychiatr Sci 2017 Aug;26(4):383-394 [FREE Full text] [CrossRef] [Medline]
    21. Kilbourne AM, Beck K, Spaeth-Rublee B, Ramanuj P, O'Brien RW, Tomoyasu N, et al. Measuring and improving the quality of mental health care: A global perspective. World Psychiatry 2018 Feb;17(1):30-38 [FREE Full text] [CrossRef] [Medline]
    22. Hickie IB, Davenport TA, Burns JM, Milton AC, Ospina-Pinillos L, Whittle L, et al. Project Synergy: Co-designing technology-enabled solutions for Australian mental health services reform. Med J Aust 2019 Oct;211 Suppl 7:S3-S39. [CrossRef] [Medline]
    23. Young HM, Nesbitt TS. Increasing the capacity of primary care through enabling technology. J Gen Intern Med 2017 Apr;32(4):398-403 [FREE Full text] [CrossRef] [Medline]
    24. Hoeft TJ, Fortney JC, Patel V, Unützer J. Task-sharing approaches to improve mental health care in rural and other low-resource settings: A systematic review. J Rural Health 2018 Dec;34(1):48-62 [FREE Full text] [CrossRef] [Medline]
    25. Falconer E, Kho D, Docherty JP. Use of technology for care coordination initiatives for patients with mental health issues: A systematic literature review. Neuropsychiatr Dis Treat 2018;14:2337-2349 [FREE Full text] [CrossRef] [Medline]
    26. Kalton A, Falconer E, Docherty J, Alevras D, Brann D, Johnson K. Multi-agent-based simulation of a complex ecosystem of mental health care. J Med Syst 2016 Feb;40(2):39 [FREE Full text] [CrossRef] [Medline]
    27. Reger MA, Stanley IH, Joiner TE. Suicide mortality and coronavirus disease 2019-A perfect storm? JAMA Psychiatry 2020 Nov 01;77(11):1093-1094. [CrossRef] [Medline]
    28. Pfefferbaum B, North CS. Mental health and the Covid-19 pandemic. N Engl J Med 2020 Aug 06;383(6):510-512. [CrossRef]
    29. Rathbone AL, Prescott J. The use of mobile apps and SMS messaging as physical and mental health interventions: Systematic review. J Med Internet Res 2017 Aug 24;19(8):e295 [FREE Full text] [CrossRef] [Medline]
    30. Selby P, Vojtila L, Ashfaq I, Dragonetti R, Melamed OC, Carriere R, et al. Technology-enabled collaborative care for youth with early psychosis: A protocol for a feasibility study to improve physical health behaviours. Early Interv Psychiatry 2020 Aug 03:1. [CrossRef] [Medline]
    31. Census of Population and Housing: Socio-Economic Indexes for Areas (SEIFA), Australia, 2016. Canberra, Australia: Australian Bureau of Statistics; 2018.   URL: http://www.abs.gov.au/AUSSTATS/abs@.nsf/DetailsPage/2033.0.55.0012016?OpenDocument [accessed 2020-03-06]
    32. General Population Health Needs Assessment. Coffs Harbour, Australia: North Coast Primary Health Network; 2018.   URL: https://hnc.org.au/wp-content/uploads/2019/03/E.-General_Population_NeedsReport_Nov18.pdf [accessed 2021-06-14]
    33. Census of Population and Housing: Estimating Homelessness 2016. Canberra, Australia: Australian Bureau of Statistics; 2018.   URL: http://www.abs.gov.au/ausstats/abs@.nsf/mf/2049.0 [accessed 2020-03-06]
    34. Occhipinti JA, Skinner A, Iorfino F, Lawson K, Sturgess J, Burgess W, et al. Reducing youth suicide: Systems modelling and simulation to guide targeted investments across the determinants. BMC Med 2021 Mar 12;19(1):61 [FREE Full text] [CrossRef] [Medline]
    35. Vemer P, Corro Ramos I, van Voorn GAK, Al MJ, Feenstra TL. AdViSHE: A validation-assessment tool of health-economic models for decision makers and model users. Pharmacoeconomics 2016 Apr;34(4):349-361 [FREE Full text] [CrossRef] [Medline]
    36. Badamgarav E, Weingarten SR, Henning JM, Knight K, Hasselblad V, Gano A, et al. Effectiveness of disease management programs in depression: A systematic review. Am J Psychiatry 2003 Dec;160(12):2080-2090. [CrossRef] [Medline]
    37. Kikkert M, Goudriaan A, de Waal M, Peen J, Dekker J. Effectiveness of Integrated Dual Diagnosis Treatment (IDDT) in severe mental illness outpatients with a co-occurring substance use disorder. J Subst Abuse Treat 2018 Dec;95:35-42. [CrossRef] [Medline]
    38. van Os J, Guloksuz S, Vijn TW, Hafkenscheid A, Delespaul P. The evidence-based group-level symptom-reduction model as the organizing principle for mental health care: Time for change? World Psychiatry 2019 Feb;18(1):88-96 [FREE Full text] [CrossRef] [Medline]
    39. Crowe J. Reform, revolution and disruption in mental health care: A consumer's perspective. Public Health Res Pract 2017 Apr 27;27(2):e2721711 [FREE Full text] [CrossRef] [Medline]
    40. Patrício L, Sangiorgi D, Mahr D, Čaić M, Kalantari S, Sundar S. Leveraging service design for healthcare transformation: Toward people-centered, integrated, and technology-enabled healthcare systems. J Serv Manage 2020 Jun 08;31(5):889-909. [CrossRef]
    41. Hickie IB. The role of new technologies in monitoring the evolution of psychopathology and providing measurement-based care in young people. World Psychiatry 2020 Feb;19(1):38-39 [FREE Full text] [CrossRef] [Medline]
    42. Subramanian S, Naimoli J, Matsubayashi T, Peters DH. Do we have the right models for scaling up health services to achieve the Millennium Development Goals? BMC Health Serv Res 2011 Dec 14;11:336 [FREE Full text] [CrossRef] [Medline]
    43. Rowe SC, Davenport TA, Easton MA, Jackson TA, Melsness J, Ottavio A, et al. Co-designing the InnoWell Platform to deliver the right mental health care first time to regional youth. Aust J Rural Health 2020 Apr;28(2):190-194. [CrossRef] [Medline]
    44. Boswell JF, Kraus DR, Miller SD, Lambert MJ. Implementing routine outcome monitoring in clinical practice: Benefits, challenges, and solutions. Psychother Res 2015;25(1):6-19. [CrossRef] [Medline]
    45. Bradford S, Rickwood D. Electronic psychosocial assessment tool: Concept development and identification of barriers to successful implementation. J Technol Hum Serv 2014 Nov 26;32(4):275-296. [CrossRef]
    46. Kotte A, Hill KA, Mah AC, Korathu-Larson PA, Au JR, Izmirian S, et al. Facilitators and barriers of implementing a measurement feedback system in public youth mental health. Adm Policy Ment Health 2016 Nov;43(6):861-878. [CrossRef] [Medline]

    ‎
    AdViSHE: Assessment of the Validation Status of Health-Economic decision models
    BMC: Brain and Mind Centre
    ED: emergency department
    K10: Kessler 10
    NSW: New South Wales

    Edited by C Basch; submitted 28.10.20; peer-reviewed by M Hamilton, A Hidki, X He; comments to author 01.12.20; revised version received 20.12.20; accepted 15.04.21; published 30.06.21

    Copyright

    ©Frank Iorfino, Jo-An Occhipinti, Adam Skinner, Tracey Davenport, Shelley Rowe, Ante Prodan, Julie Sturgess, Ian B Hickie. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 30.06.2021.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.