This paper is in the following e-collection/theme issue:

Innovations and Technology for Healthy Eating Education (414) Adoption and Change Management of eHealth Systems (712) Parent and Child Education on Healthy Eating and Nutrition (169)

Published on in Vol 22, No 11 (2020): November

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/22036, first published .
Barriers and Enablers to Adoption of Digital Health Interventions to Support the Implementation of Dietary Guidelines in Early Childhood Education and Care: Cross-Sectional Study

Barriers and Enablers to Adoption of Digital Health Interventions to Support the Implementation of Dietary Guidelines in Early Childhood Education and Care: Cross-Sectional Study

Barriers and Enablers to Adoption of Digital Health Interventions to Support the Implementation of Dietary Guidelines in Early Childhood Education and Care: Cross-Sectional Study

Authors of this article:

Alice Grady1, 2, 3, 4 Author Orcid Image ;   Courtney Barnes1, 2, 3, 4 Author Orcid Image ;   Luke Wolfenden1, 2, 3, 4 Author Orcid Image ;   Christophe Lecathelinais2 Author Orcid Image ;   Sze Lin Yoong1, 2, 3, 4 Author Orcid Image
Article Authors Cited by (6) Tweetations (10) Metrics

    Original Paper

    1School of Medicine and Public Health, University of Newcastle, Callaghan, Australia

    2Population Health, Hunter New England Local Health District, Wallsend, Australia

    3Hunter Medical Research Institute, New Lambton, Australia

    4Priority Research Centre for Health Behaviour, University of Newcastle, Callaghan, Australia

    Corresponding Author:

    Alice Grady, PhD

    School of Medicine and Public Health

    University of Newcastle

    University Drive

    Callaghan, 2308

    Australia

    Phone: 61 0249246310

    Email: alice.grady@health.nsw.gov.au


    Background: Few Australian childcare centers provide foods consistent with sector dietary guidelines. Digital health technologies are a promising medium to improve the implementation of evidence-based guidelines in the setting. Despite being widely accessible, the population-level impact of such technologies has been limited due to the lack of adoption by end users.

    Objective: This study aimed to assess in a national sample of Australian childcare centers (1) intentions to adopt digital health interventions to support the implementation of dietary guidelines, (2) reported barriers and enablers to the adoption of digital health interventions in the setting, and (3) barriers and enablers associated with high intentions to adopt digital health interventions.

    Methods: A cross-sectional telephone or online survey was undertaken with 407 childcare centers randomly sampled from a publicly available national register in 2018. Center intentions to adopt new digital health interventions to support dietary guideline implementation in the sector were assessed, in addition to perceived individual, organizational, and contextual factors that may influence adoption based on seven subdomains within the nonadoption, abandonment, scale-up, spread, and sustainability (NASSS) of health and care technologies framework. A multiple-variable linear model was used to identify factors associated with high intentions to adopt digital health interventions.

    Results: Findings indicate that 58.9% (229/389) of childcare centers have high intentions to adopt a digital health intervention to support guideline implementation. The changes needed in team interactions subdomain scored lowest, which is indicative of a potential barrier (mean 3.52, SD 1.30), with organization’s capacity to innovate scoring highest, which is indicative of a potential enabler (mean 5.25, SD 1.00). The two NASSS subdomains of ease of the adoption decision (P<.001) and identifying work and individuals involved in implementation (P=.001) were significantly associated with high intentions to adopt digital health interventions.

    Conclusions: A substantial proportion of Australian childcare centers have high intentions to adopt new digital health interventions to support dietary guideline implementation. Given evidence of the effectiveness of digital health interventions, these findings suggest that such an intervention may make an important contribution to improving public health nutrition in early childhood.

    J Med Internet Res 2020;22(11):e22036

    doi:10.2196/22036

    Keywords

    early childhood education and care; digital health technologies; adoption; dissemination; guidelines 


    Poor diet is a modifiable risk factor and leading cause of burden of disease globally [1], with 11 million deaths and 255 million disability-adjusted life years in 2017 attributable to dietary risk factors [2]. Early childhood is a critical period to instill healthy eating habits to reduce diet-related burden of disease, as dietary behaviors developed in childhood track into adulthood [3]. Within Australia, population surveys indicate preschool-aged children are not consuming the recommended servings of fruits and vegetables, and consume more than recommended amounts of discretionary foods (ie, foods high in sodium, saturated fat, and added sugar) [4-6]. As a strategy to reduce the burden from poor diet, the implementation of dietary guidelines in the early childhood education and care (ECEC) setting is recommended [7,8]. Despite such recommendations, Australian childcare centers do not provide foods consistent with sector dietary guidelines [9-11]. For example, a 2017 audit of menus in 70 childcare centers across New South Wales (NSW) determined none of the menus were fully compliant with sector-specific dietary guidelines, particularly for vegetables [9].

    Digital health interventions (eg, web-based programs, apps, etc) are advocated by the World Health Organization [12] and offer the opportunity to deliver support at scale and at low cost to improve the nutrition-related practices of food service organizations, such as childcare centers [13]. Evidence from randomized controlled trials [11,14-16] suggests that digital health interventions in education settings can improve the purchasing, provision, and consumption of healthier foods. Despite the clear potential of technology-based approaches, such interventions to improve health outcomes are often not adopted by end users, that is, the individual or organization for which the digital health intervention was developed (eg, ECEC centers, schools, and parents within educational settings). For example, it has been estimated that 80% of health technologies fail [17] due to uncertainty (ie, doubt about the technology’s value or dependability), abandonment (ie, ceasing use of the technology), and lack of organizational willingness to adopt the technology [18] when disseminated in real-world contexts.

    Broadly, systematic reviews, guidelines, and previous literature suggest that factors across a number of levels are important for the adoption and implementation of digital health interventions. These include factors related to the individual user (eg, knowledge, skills, beliefs, and attitudes) [19-21], the organization (eg, compatibility or fit with the organization, access to appropriate infrastructure and equipment, and leadership engagement) [12,19-21], the wider setting (eg, external policies and incentives) [12,19,21], the process of implementation (eg, lack of considered planning, engagement, and evaluation) [21], and the technology-based intervention itself (eg, complexity, costs, adaptability, and ability of the intervention to meet user needs) [12,19-21].

    Within ECEC settings, a 2015 systematic review examining the barriers to integration of information technology more broadly, including computers, tablets, and touchscreen whiteboards, identified a scarcity of empirical studies examining barriers and enablers within the setting, none of which focused on improving guideline implementation or child health outcomes [19]. The lack of research examining the factors that may enable or impede the adoption of digital health interventions to improve dietary guideline implementation is problematic, as such evidence is necessary to inform future strategies to maximize the adoption and, therefore, impact of evidence-based technologies in the setting.

    As such, by employing the nonadoption, abandonment, scale-up, spread, and sustainability (NASSS) of health and care technologies framework [17], this study aimed to describe the following in a randomly selected national sample of Australian childcare centers: (1) intentions to adopt digital health interventions to support childcare center implementation of dietary guidelines, (2) reported individual, organizational, and contextual barriers and enablers to the adoption of digital health interventions in the setting, and (3) barriers and enablers associated with high intentions to adopt digital health interventions.


    Study Design, Ethics Approval, and Consent to Participate

    This study employed a cross-sectional design. Ethical approval was obtained by the Human Research Ethics Committees of Hunter New England (16/02/17/4.05) and the University of Newcastle (H-2016-0111). All subjects in this research study provided consent to participate.

    Sample

    The Australian Children’s Education and Care Quality Authority’s (ACECQA) national register [22] was used to obtain a sampling frame of potentially eligible center-based childcare centers, including long day cares (ie, centers that provide care for children aged 0-6 years for >8 hours per day) and preschools (ie, centers that provide care for children aged 3-6 years for 6-8 hours per day) [5], from each state within Australia (N=10,631). A sample of 1500 childcare centers (14.11%) were randomly selected from the sampling frame of potentially eligible centers, stratified by state and center area socioeconomic classification by an independent statistician.

    Childcare center eligibility was assessed via online or telephone survey items. Centers were deemed ineligible if they did not provide meals to children or make menu planning decisions onsite, as this survey was assessing technology to support nutrition guideline implementation on menus; had staff with insufficient English to complete the survey; were a Department of Education and Communities center, as ethical approval was not obtained from the relevant government department; were located in the Hunter New England region of NSW or were select centers across NSW, due to concurrent nutrition and physical activity research trials being undertaken by the research team; were identified as out-of-school hours, vacation care, or family day care; or catered solely to children with special needs.

    Recruitment and Procedures

    An email with an information statement and link to an online survey was sent to the nominated supervisor (ie, the center manager) of all sampled childcare centers (N=1500) inviting them to assess eligibility and participate in the study. Nominated supervisors were able to select an alternate staff member (eg, center director) to complete the survey on their behalf. Centers that did not complete the survey within 4 weeks were sent a reminder email to participate (1466/1500, 97.73%), followed by a phone call from a member of the research team (1455/1500, 97.00%) to assess eligibility and gain verbal consent to complete the telephone version of the survey. A final reminder email was sent to centers that indicated a preference to complete the online version of the survey (846/1500, 56.40%) and those who were noncontactable via phone. Centers that were yet to complete the survey following the final reminder email received a final telephone call to gain consent and complete a telephone version of the survey (744/1500, 49.60%). Centers were not offered any incentives to complete the survey. Data to assess study outcomes were collected between January and August 2018.

    Data Collection and Measures

    Center and Responder Characteristics

    Childcare centers were asked to report on the type of center (ie, preschool or long day care), number of full-time equivalent staff members, center opening and closing hours, number of children enrolled, and the number of children enrolled identifying as of Aboriginal and/or Torres Strait Islander background. Childcare center staff completing the survey were asked to report their main role at the center and the total number of years working in the childcare setting. Survey items assessing center characteristics were sourced from previous Australian childcare center surveys conducted by the research team [11,23,24].

    Center geographical information, including state and postcode, were obtained via the ACECQA national register to determine location and the center area socioeconomic classification.

    Intentions to Adopt Digital Health Interventions

    To aid comprehension and standardization of digital health interventions and their capabilities, participants were first given a brief example of the potential modality (eg, web-based or online) and key features (eg, feedback and tips) that could be provided within a digital health intervention to support guideline implementation in the setting. Three survey items derived from the Technology Acceptance Model [25] were then used to assess childcare centers’ intentions to adopt digital health interventions in the setting. The Technology Acceptance Model is an information systems theory that models how end users come to accept and use a new technology [25]. The Technology Acceptance Model has been shown to have high internal consistency (Cronbach α>.80) [26]. Respondents were asked to rate on a 7-point Likert scale, ranging from 1 (strongly disagree) to 7 (strongly agree), how much they agreed with the following statements, assuming they had access to a digital health intervention to support the implementation of dietary guidelines in their center: “I intend to use it,” “I predict that I would use it,” and “I would plan to use it.” These items have been used in previous research by the team in the ECEC setting [27].

    Barriers and Enablers to Adoption of Digital Health Interventions

    A purpose-built measure based on the NASSS framework by Greenhalgh [18] was used to assess individual, organizational, and contextual factors that may influence adoption of digital health technologies to improve the implementation of dietary guidelines in the childcare setting. The NASSS framework is an evidence-based, theory-informed, and pragmatic framework designed to help predict and evaluate the success of a technology-supported health care program [18]. The NASSS consists of seven domains: the illness or condition, the technology, the value proposition, the individuals intended to adopt the technology, the organizations, the wider system, and how all these domains interact over time [28]. The NASSS framework can be used to generate insight into the multiple influences on the success or failure of a complex technology-based intervention; to identify simple, complicated, and complex components of the intervention; and to consider how individuals and organizations may be supported to handle complex components of the intervention [18].

    An expert advisory group, including health promotion practitioners, implementation scientists, and dietitians, was involved in the development of the measure. Based on expert advisory group consensus, only three of the seven NASSS domains were deemed relevant to the end users for the scale of dissemination of digital health interventions under examination and were, therefore, assessed. At the time of survey development, no validated measure for the NASSS framework existed. As such, a search was conducted for validated measures that had corresponding domains to the NASSS framework. Where possible, such validated measures were employed and adapted to fit the ECEC context, including the e-Health Readiness Measure [29], which was utilized for two of the subdomains: the organization’s capacity to innovate and readiness of the organization for technology-supported change. The e-Health Readiness Measure [30] has been shown to have high internal consistency (Cronbach α>.80). Items for the remaining five subdomains were developed by the advisory group and pilot-tested among a group of health promotion practitioners and trained telephone interviewers for comprehension and face validity. The final measure consisted of 24 items, 10 of which were adapted items from the e-Health Readiness Measure, across three domains and seven subdomains of the NASSS framework, rated on a 7-point Likert scale, ranging from 1 (strongly disagree) to 7 (strongly agree). Table 1 lists the domains, subdomains, number of survey items, and an example survey item relevant to the setting.

    Table 1. Nonadoption, abandonment, scale-up, spread, and sustainability framework application to the early childhood education and care setting.
    Domain and subdomain (No. of items)Example survey item
    The adopter system

    		Changes in staff roles, practices, and identities (3 items)Using an online program is consistent with the usual practices of my cook and menu planner.
    The organization

    		Organization’s capacity to innovate (6 items)Overall, I think our service has a champion or leader for using new technology.

    		Readiness of the organization for technology-supported change (4 items)Overall, I think our service has access to experts in use of new technology.

    		Ease of the adoption and funding decision (1 item)It would be easy to adopt new technology to support menu planning in my service.

    		Changes needed in team interactions and routines (2 items)My service would need to change the way it currently plans menus if we decided to adopt new technology.

    		Identifying work and individuals involved in implementation (2 items)We already have the existing personnel available to support the adoption of new technology.
    The wider context

    		Political, economic, regulatory, professional (eg, medicolegal), and sociocultural context for program rollout (6 items)I would be more likely to adopt new technology in my service if it was promoted by relevant government agencies (ie, Department of Education or Department of Health).

    Analysis

    Overview

    All analyses were performed in SAS, version 9.3 (SAS Institute) [31]. Descriptive statistics including means, frequencies, and proportions were used to describe center demographic characteristics and survey responses. Childcare center postcodes ranked in the top 50% of NSW, according to the Socio-Economic Indexes for Areas, were classified as higher socioeconomic status [32]. A chi-square analysis (ie, test of independence) was used to compare center area socioeconomic classification among consenters and nonconsenters.

    Intentions to Adopt Digital Health Interventions

    An intention-to-adopt score for each responder was calculated by averaging scores for the three intention items. This score was also used to dichotomize responders into having low intentions to adopt (score <6) or high intentions to adopt (score ≥6). This cut point corresponds to those who agree or strongly agree with each item. Such an approach has been used previously within ECEC centers [27].

    Barriers and Enablers to Adoption of Digital Health Interventions

    Similar to previous studies assessing barriers and enablers using theoretical frameworks [9,33-35], average scores for each NASSS construct were calculated by summing all scores for all items within the subdomain, ranging from 1 (strongly disagree) to 7 (strongly agree), and dividing by the total number of responses within the domain. Six survey items were negatively worded and were, therefore, reverse scored. Mean values were used to describe the domains as potential barriers and enablers [33]. A lower mean (≤4) suggested that the particular domain may be a barrier, and a higher mean (>4) suggested a perceived enabler to adoption of digital health interventions. In consultation with the expert advisory group (ie, health promotion practitioners, implementation scientists, and dieticians), this cutoff was employed as a pragmatic approach to categorizing mean scores (ie, ≤4 [responses strongly disagree to neither agree nor disagree] and >4 [responses slightly agree to strongly agree]) and was chosen to limit reporting of any potential social desirability bias in the identification of enablers.

    Barriers and Enablers Associated With Intentions to Adopt Digital Health Interventions

    All seven NASSS subdomains were entered as independent variables into a multiple-variable logistic regression model, to assess which NASSS constructs were significantly associated with high intentions to adopt digital health interventions (ie, dependent variable) after adjusting for each other. The significance value was set at .05.


    Characteristics of Participants

    Of the 1500 centers invited to participate in the study, 72 (4.80%) were noncontactable, 53 (3.53%) were contacted but did not respond, and 378 (25.20%) declined to participate prior to eligibility being assessed. A total of 997 out of 1500 (66.47%) centers consented to the study and were assessed for eligibility, with 590 of these 997 (59.2%) centers deemed ineligible, most commonly due to the center not providing meals and/or snacks to children and being a Department of Education and Community center. This resulted in a total of 407 centers taking part in the survey. There were no statistically significant differences in center socioeconomic area between consenters and nonconsenters.

    The large majority of participating centers were long day care centers (391/407, 96.1%) (see Table 2). The majority of responders held the position of nominated supervisor (183/399, 45.9%) or director (179/399, 44.9%), with more than 10 years’ experience working in the childcare setting (278/397, 70.0%).

    Table 2. Childcare center and responder characteristics.
    CharacteristicsValue, n (%) or mean (SD)
    Center characteristics (N=407)

    		Type of center, n (%)


    		Preschool16 (3.9)


    		Long day care center391 (96.1)

    		Number of children enrolled (n=406), mean (SD)96.33 (56.79)

    		Number of full-time equivalent primary contact teaching staff (n=404), mean (SD)12.78 (7.93)

    		Number of children of Aboriginal and/or Torres Strait Islander background enrolled at center (n=406), n (%)214 (52.7)

    		Center area socioeconomic status, n (%)


    		High231 (56.8)


    		Low176 (43.2)

    		Center geographic location, n (%)


    		Urban (major cities)307 (75.4)


    		Rural (inner regional, outer regional, or remote)100 (24.6)

    		Center state, n (%)


    		New South Wales165 (40.5)


    		Victoria94 (23.1)


    		Queensland62 (15.2)


    		Australian Capital Territory7 (1.7)


    		Tasmania7 (1.7)


    		Western Australia40 (9.8)


    		South Australia25 (6.1)


    		Northern Territory7 (1.7)
    Responder characteristics(n=399), n (%)

    		Role at the center


    		Nominated supervisor183 (45.9)


    		Director179 (44.9)


    		Cook12 (3.0)


    		Other28 (7.0)

    		Number of years working in the childcare setting (n=397), n (%)


    		≤536 (9.1)


    		6-1083 (20.9)


    		>10278 (70.0)

    Intentions to Adopt Digital Health Interventions

    The mean intention score was 5.52 (SD 1.07), with a median of 6.00 (IQR 5.00-6.00). Of 389 responders, 229 (58.9%) centers had high intentions to adopt digital health interventions to support the implementation of dietary guidelines.

    Reported Barriers and Enablers to Adoption of Digital Health Interventions

    A mean score of 4 or lower (ie, barriers) was found for four of the seven NASSS domains (see Table 3). For three of the seven NASSS constructs—organization’s capacity to innovate, ease of the adoption and funding decision, and political context—responders had mean scores of more than 4 (ie, enablers).

    Table 3. Mean and median scores for the nonadoption, abandonment, scale-up, spread, and sustainability subdomain barriers and enablers, as reported by responders.
    Barrier or enablerScorea

    		Mean (SD)bMedian (IQR)
    The adopter system (n=390)


    		Changes in staff roles, practices, and identities4.32 (1.25)4.33 (3.33-5.00)
    The organization


    		Organization’s capacity to innovate (n=382)5.25 (1.00)5.50 (4.67-6.00)

    		Readiness of the organization for technology-supported change (n=386)4.88 (1.03)5.00 (4.25-5.75)

    		Ease of the adoption and funding decision (n=387)5.22 (1.31)6.00 (4.00-6.00)

    		Changes needed in team interactions and routines (n=389)3.52 (1.30)3.50 (2.50-4.00)

    		Identifying work and individuals involved in implementation (n=389)4.35 (1.19)4.00 (4.00-5.00)
    The wider context(n=389)


    		Political, economic, regulatory, professional (eg, medicolegal), and sociocultural context for program rollout5.07 (1.08)5.33 (4.50-6.00)

    aConstructs are reported on a 7-point Likert scale, ranging from 1 (strongly disagree) to 7 (strongly agree).

    bA mean of ≤4 suggests that the particular domain may be a barrier; a mean of >4 suggests the domain may be an enabler.

    Barriers and Enablers Associated With Adoption of Digital Health Interventions

    Multiple-variable logistic regression analyses revealed a significant association between two of the NASSS subdomains and high intentions to adopt digital health interventions (see Table 4). For every 1-point increase in the ease of the adoption and funding decision subdomain, centers were 1.75 times more likely to have high intentions of adopting digital health interventions (95% CI 1.40-2.18; P<.001). For every 1-point increase in the identifying work and individuals involved in implementation subdomain, centers had 1.46 times the odds of having high intentions to adopt digital health interventions (95% CI 1.61-1.84; P=.001).

    Table 4. Nonadoption, abandonment, scale-up, spread, and sustainability subdomains associated with high intentions to adopt digital health interventions in early childhood education and care centers.
    Barrier or enablerOdds ratio95% CIP value
    The adopter system



    		Changes in staff roles, practices, and identities0.880.71-1.10.27
    The organization



    		Organization’s capacity to innovate1.260.91-1.75.17

    		Readiness of the organization for technology-supported change1.150.83-1.59.41

    		Ease of the adoption and funding decision1.751.40-2.18<.001

    		Changes needed in team interactions and routines0.920.75-1.13.42

    		Identifying work and individuals involved in implementation1.461.16-1.84.001
    The wider context



    		Political, economic, regulatory, professional (eg, medicolegal), and sociocultural context for program rollout1.030.82-1.29.81

    Principal Findings

    This novel study applied a technology-specific framework to conduct a theoretical assessment of childcare center barriers and enablers to the adoption of digital health interventions to improve dietary guideline implementation, nationally. Application of the NASSS framework resulted in the identification of a number of reported barriers and enablers. The main barrier identified was changes needed in team interactions and routines, with the main enablers identified as being ease of the adoption decision, identifying work and individuals involved in implementation, and organization’s capacity to innovate. Centers that reported higher scores in the ease of the adoption decision and the identifying work and individuals involved in implementation subdomains were significantly more likely to have high intentions of adopting digital health interventions.

    The study found that over half (229/389, 58.9%) of responders had high intentions to adopt digital health interventions in the setting. Few studies of technology-based health interventions within the ECEC setting report adoption rates, with variable findings. A 2015 cross-sectional study assessing intentions to adopt a web-based program to support healthy eating and physical activity policies and practices in the ECEC setting reported that 72% of respondents had high intentions to adopt such a program [27]. In our earlier study assessing the impact of implementation support on actual adoption of a web-based menu planning program, 58% of the control group, who did not receive support, had adopted the program [36]. Combined, these findings are indicative of the relatively high intentions to adopt digital health technologies in the ECEC setting.

    When examining the potential barriers and enablers to adoption of digital health interventions, scores of 4 or higher were found for only three of the subdomains assessed (ie, enablers), two of which fall within the organizational construct of the NASSS framework. The highest levels of agreement were found for the organization’s capacity to innovate (mean 5.25, SD 1.00), the ease of the adoption decision (mean 5.22, SD 1.31), and political context (mean 5.07, SD 1.08). This suggests these subdomains may be potential enablers of the adoption of digital health interventions for end users. Responders reported the lowest level of agreement for changes needed in team interactions (mean 3.52, SD 1.30) within the organizational construct, which suggests this subdomain may be a potential barrier to adoption. Such findings suggest that in order to facilitate the adoption of new technology, strategies that generate a high level of organizational support (eg, informing opinion leaders, involving executive boards, and mandating change) and those that overcome any operational challenges and changes in practice (eg, educational outreach visits, changing equipment, and local technical assistance) should be considered [37]. This finding is consistent with previous research demonstrating that implementation support strategies, including face-to-face training, ongoing telephone support, and provision of resources and infrastructure, in addition to obtaining managerial support, improved the adoption of a web-based program in the setting [36].

    Study results revealed a discrepancy in the reported barriers and enablers to adoption of digital health interventions and the factors associated with adoption. Multiple-variable logistic regression analyses determined that the ease of the adoption decision and the identifying work and individuals involved in implementation subdomains were the only factors to have a statistically significant association with high intentions to adopt. Responders scoring higher, that is, those with greater agreement, on these two factors were 1.75 and 1.46 times more likely to report high intentions to adopt digital health interventions, respectively. Although previous studies have not specifically assessed such theoretical constructs in this setting, incongruity in the perceived versus the actual experiences of barriers to the adoption of technology-based interventions [19] and evidence-based guidelines [9] within the ECEC setting has been reported previously. There are opportunities to target this identified incongruence. In-depth examination of the factors by way of supplementation with qualitative methods among all intended end users is warranted. This may provide greater insights into the complexities to adoption of technology-based health interventions and the interaction between each domain of the NASSS.

    While recent studies have employed the NASSS framework retrospectively to categorize various constructs [38,39], this study is novel in its prospective application of the NASSS as a measure to conduct a theory-based assessment. Future research could further examine use of the NASSS as a tool to identify barriers and enablers to the adoption of digital health interventions to inform intervention development and evaluation. In addition, embedding measures of the NASSS into the evaluation of dissemination interventions to improve adoption of digital health interventions would allow for an examination of mechanisms and provide a better understanding of how individual, organizational, and contextual factors impact adoption.

    Limitations

    The intention to adopt digital health interventions, rather than actual adoption, was assessed. While there is evidence of a relationship between intentions and actual adoption [40], and while our findings align with prior research in the setting [36], rates of actual adoption may differ to those reported. While drawing on validated measures used in other settings, this study employed a nonvalidated self-reported measure to assess barriers and enablers to the adoption of digital health interventions, which may be subject to social desirability bias [41]. Three of the subdomains—changes needed in team interaction, identifying work and individuals involved in implementation, and ease of funding decision—contained less than three items and, as such, should be interpreted with caution. This study also did not assess additional contextual factors that are theorized to influence adoption according to the NASSS framework, such as the condition, the technology, the value proposition, and embedding and adapting over time [18]. Future studies should consider undertaking an assessment of such factors to assist in providing a more comprehensive understanding of the broader factors that may impact adoption of digital health technologies in the childcare setting. Finally, as Department of Education and Community centers were not eligible to participate, study findings may not be representative of these centers. However, as the geographic distribution of participating centers is similar to that of the sampling frame—all center-based childcare within the ACECQA national register (differences between the responders in each state vs state population ranged from 0.32% to 7.05%)—the sample may be considered nationally representative.

    Conclusions

    This study provides novel insights into the perceived and actual factors that may facilitate or impede the adoption of digital health interventions at scale from the perspective of end users. A substantial proportion of Australian childcare centers reported high intentions to adopt digital health interventions. Given evidence of the effectiveness of such technologies, these interventions have the potential to make an important contribution to improving public health nutrition in early childhood. Nonetheless, future efforts to disseminate digital health prevention programs at scale should consider targeting factors within the ease of the adoption decision and identifying work and individuals involved in implementation subdomains in order for adoption to be ubiquitous in the setting.

    Acknowledgments

    The authors wish to thank participating childcare centers, data collection staff, and the expert advisory group. This project is funded in part by The Australian Prevention Partnership Centre (TAPPC), the National Health and Medical Research Council (NHMRC) (APP1102943), the Cancer Council NSW (CCNSW) (PG16-05), and the Priority Research Centre and School of Medicine and Public Health, University of Newcastle. TAPPC, NHMRC, and CCNSW played no role in the conduct of the research. The content of this publication is the responsibility of the authors and does not reflect the views of TAPPC, NHMRC, or CCNSW. Hunter New England Population Health (HNEPH) and the University of Newcastle provided infrastructure funding. LW is a Hunter New England Clinical Research Fellow and is supported by a Heart Foundation Future Leader Fellowship (award No. 101175) and an NHMRC Career Development Fellowship (APP1128348). SY is a postdoctoral research fellow funded by the National Heart Foundation (award No. 100547) and the Australian Research Council (DE170100382). CB is supported by a cofunded industry scholarship between HNEPH and the University of Newcastle.

    Authors' Contributions

    All authors contributed to conception or design of the work, data acquisition, and analysis or interpretation of data, and took part in revising the manuscript. All authors give their final approval of this version to be published and agree to be accountable for all aspects of the work. AG, SY, and LW conceived the study and secured funding. AG and SY designed the evaluation procedures. AG and CB lead the acquisition of data. CL conducted the data analysis. AG led the drafting of the manuscript.

    Conflicts of Interest

    None declared.

    1. Lim S, Vos T, Flaxman A, Danaei G, Shibuya K, Adair-Rohani H, et al. A comparative risk assessment of burden of disease and injury attributable to 67 risk factors and risk factor clusters in 21 regions, 1990-2010: A systematic analysis for the Global Burden of Disease Study 2010. Lancet 2012;380(9859):2224-2260. [CrossRef]
    2. GBD 2017 Diet Collaborators. Health effects of dietary risks in 195 countries, 1990-2017: A systematic analysis for the Global Burden of Disease Study 2017. Lancet 2019 May 11;393(10184):1958-1972 [FREE Full text] [CrossRef] [Medline]
    3. Craigie A, Lake A, Kelly S, Adamson A, Mathers J. Tracking of obesity-related behaviours from childhood to adulthood: A systematic review. Maturitas 2011 Nov;70(3):266-284. [CrossRef] [Medline]
    4. Australian Bureau of Statistics. Australian Health Survey: Consumption of Food Groups From the Australian Dietary Guidelines. Australia 2011-12. Canberra, Australia: Commonwealth of Australia; 2016.   URL: https:/​/www.​ausstats.abs.gov.au/​ausstats/​subscriber.nsf/​0/​77E3E65E4D967249CA2581F40016ABD6/​$File/​4364.​0.​55.​012%20-%20consumption%20of%20food%20groups%20from%20australian%20dietary%20guidelines.​pdf [accessed 2020-11-13]
    5. Baxter J. Child care and early childhood education in Australia. Australian Institute of Family Studies. 2015 May.   URL: https://aifs.gov.au/publications/child-care-and-early-childhood-education-australia [accessed 2018-12-01]
    6. Centre for Epidemiology and Evidence. Fruit and vegetables: Recommended daily consumption by children. HealthStats NSW. Sydney, Australia: NSW Ministry of Health; 2020 May.   URL: http://www.healthstats.nsw.gov.au/Indicator/beh_vegkid_age/beh_vegkid_age_snap [accessed 2018-12-01]
    7. Institute of Medicine (IOM), Committee on Obesity Prevention Policies for Young Children. In: Birch LL, Parker L, Burns A, editors. Early Childhood Obesity Prevention Policies. Washington, DC: The National Academies Press; 2011.
    8. Global Nutrition Targets 2025: Policy brief series. World Health Organization. Geneva, Switzerland: World Health Organization; 2014.   URL: https://www.who.int/nutrition/publications/globaltargets2025_policybrief_overview/en/ [accessed 2020-11-13]
    9. Grady A, Seward K, Finch M, Fielding A, Stacey F, Jones J, et al. Barriers and enablers to implementation of dietary guidelines in early childhood education centers in Australia: Application of the theoretical domains framework. J Nutr Educ Behav 2018 Mar;50(3):229-237.e1. [CrossRef] [Medline]
    10. Yoong S, Skelton E, Jones J, Wolfenden L. Do childcare services provide foods in line with the 2013 Australian dietary guidelines? A cross-sectional study. Aust N Z J Public Health 2014 Dec;38(6):595-596. [CrossRef] [Medline]
    11. Grady A, Wolfenden L, Wiggers J, Rissel C, Finch M, Flood V, et al. Effectiveness of a web-based menu-planning intervention to improve childcare service compliance with dietary guidelines: Randomized controlled trial. J Med Internet Res 2020 Feb 04;22(2):e13401 [FREE Full text] [CrossRef] [Medline]
    12. WHO Guideline: Recommendations on Digital Interventions for Health System Strengthening. Geneva, Switzerland: World Health Organization; 2019.   URL: https://apps.who.int/iris/bitstream/handle/10665/311941/9789241550505-eng.pdf?ua=1 [accessed 2020-11-13]
    13. Vandelanotte C, Müller AM, Short C, Hingle M, Nathan N, Williams SL, et al. Past, present, and future of eHealth and mHealth research to improve physical activity and dietary behaviors. J Nutr Educ Behav 2016 Mar;48(3):219-228.e1. [CrossRef] [Medline]
    14. Sutherland R, Nathan N, Brown A, Yoong S, Finch M, Lecathelinais C, et al. A randomized controlled trial to assess the potential efficacy, feasibility and acceptability of an m-health intervention targeting parents of school aged children to improve the nutritional quality of foods packed in the lunchbox 'SWAP IT'. Int J Behav Nutr Phys Act 2019 Jul 02;16(1):54 [FREE Full text] [CrossRef] [Medline]
    15. Delaney T, Wyse R, Yoong SL, Sutherland R, Wiggers J, Ball K, et al. Cluster randomized controlled trial of a consumer behavior intervention to improve healthy food purchases from online canteens. Am J Clin Nutr 2017 Nov;106(5):1311-1320. [CrossRef] [Medline]
    16. Yoong S, Grady A, Wiggers J, Stacey FG, Rissel C, Flood V, et al. Child-level evaluation of a web-based intervention to improve dietary guideline implementation in childcare centers: A cluster-randomized controlled trial. Am J Clin Nutr 2020 Apr 01;111(4):854-863 [FREE Full text] [CrossRef] [Medline]
    17. Greenhalgh T. Why do so many technology projects in healthcare fail? A new framework for studying the non-adoption, abandonment and failure of scale-up, spread and sustainability (NASSS) of health and care technologies. Oxford Talks. 2018.   URL: https://new.talks.ox.ac.uk/talks/id/4e41675d-317c-467f-8c70-96918ca171eb [accessed 2018-12-01]
    18. Greenhalgh T, Wherton J, Papoutsi C, Lynch J, Hughes G, A'Court C, et al. Beyond adoption: A new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies. J Med Internet Res 2017 Nov 01;19(11):e367 [FREE Full text] [CrossRef] [Medline]
    19. Plumb M, Kautz K. Barriers to the integration of information technology within early childhood education and care organisations: A review of the literature. In: Proceedings of the Australasian Conference on Information Systems. 2016 Presented at: Australasian Conference on Information Systems; November 30-December 4, 2015; Adelaide, Australia.
    20. Moxey A, Robertson J, Newby D, Hains I, Williamson M, Pearson SA. Computerized clinical decision support for prescribing: Provision does not guarantee uptake. J Am Med Inform Assoc 2010;17(1):25-33 [FREE Full text] [CrossRef] [Medline]
    21. Ross J, Stevenson F, Lau R, Murray E. Factors that influence the implementation of e-health: A systematic review of systematic reviews (an update). Implement Sci 2016 Oct 26;11(1):146 [FREE Full text] [CrossRef] [Medline]
    22. National registers. Australian Children’s Education and Care Quality Authority.   URL: https://www.acecqa.gov.au/resources/national-registers [accessed 2020-11-13]
    23. Finch M, Seward K, Wedesweiler T, Stacey F, Grady A, Jones J, et al. Challenges of increasing childcare center compliance with nutrition guidelines: A randomized controlled trial of an intervention providing training, written menu feedback, and printed resources. Am J Health Promot 2019 Mar;33(3):399-411. [CrossRef] [Medline]
    24. Yoong SL, Finch M, Nathan N, Wiggers J, Lecathelinais C, Jones J, et al. A longitudinal study assessing childcare services' adoption of obesity prevention policies and practices. J Paediatr Child Health 2016 Jul;52(7):765-770. [CrossRef] [Medline]
    25. Venkatesh V, Bala H. Technology Acceptance Model 3 and a research agenda on interventions. Decis Sci 2008 May;39(2):273-315. [CrossRef]
    26. King WR, He J. A meta-analysis of the technology acceptance model. Inf Manage 2006 Sep;43(6):740-755. [CrossRef]
    27. Yoong SL, Williams CM, Finch M, Wyse R, Jones J, Freund M, et al. Childcare service centers' preferences and intentions to use a web-based program to implement healthy eating and physical activity policies and practices: A cross-sectional study. J Med Internet Res 2015 Apr 30;17(5):e108 [FREE Full text] [CrossRef] [Medline]
    28. Greenhalgh T, Abimbola S. The NASSS framework - A synthesis of multiple theories of technology implementation. Stud Health Technol Inform 2019 Jul 30;263:193-204. [CrossRef] [Medline]
    29. Touré M, Poissant L, Swaine BR. Assessment of organizational readiness for e-health in a rehabilitation centre. Disabil Rehabil 2012;34(2):167-173. [CrossRef] [Medline]
    30. Poissant L, Curran J. The development of a questionnaire to assess organizational readiness to adopt e-health technologies. In: Proceedings of the Annual Canadian Association for Health Services and Policy Research (CAHSPR) Conference. Ottawa, ON: Canadian Association for Health Services and Policy Research; 2007 Presented at: Annual Canadian Association for Health Services and Policy Research (CAHSPR) Conference; June 2007; Toronto, ON p. 33.
    31. SAS 9.3 software. SAS Support. Cary, NC: SAS Institute Inc   URL: https://support.sas.com/software/93/#s1=1 [accessed 2020-12-13]
    32. Australian Bureau of Statistics. Socio-Economic Indexes for Areas (SEIFA) 2016. Canberra, Australia: Commonwealth of Australia; 2018.   URL: https:/​/www.​ausstats.abs.gov.au/​ausstats/​subscriber.nsf/​0/​756EE3DBEFA869EFCA258259000BA746/​$File/​SEIFA%202016%20Technical%20Paper.​pdf [accessed 2020-11-13]
    33. Beenstock J, Sniehotta FF, White M, Bell R, Milne EM, Araujo-Soares V. What helps and hinders midwives in engaging with pregnant women about stopping smoking? A cross-sectional survey of perceived implementation difficulties among midwives in the North East of England. Implement Sci 2012 Apr 24;7:36 [FREE Full text] [CrossRef] [Medline]
    34. Taylor N, Lawton R, Conner M. Development and initial validation of the determinants of physical activity questionnaire. Int J Behav Nutr Phys Act 2013 Jun 11;10:74 [FREE Full text] [CrossRef] [Medline]
    35. Taylor N, Parveen S, Robins V, Slater B, Lawton R. Development and initial validation of the Influences on Patient Safety Behaviours Questionnaire. Implement Sci 2013 Jul 29;8:81 [FREE Full text] [CrossRef] [Medline]
    36. Grady A, Wolfenden L, Rissel C, Green S, Reilly K, Yoong SL. Effectiveness of a dissemination strategy on the uptake of an online menu planning program: A controlled trial. Health Promot J Austr 2019 Dec;30 Suppl 1:20-25. [CrossRef] [Medline]
    37. Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: Results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci 2015 Feb 12;10:21 [FREE Full text] [CrossRef] [Medline]
    38. Dijkstra A, Heida A, van Rheenen PF. Exploring the challenges of implementing a web-based telemonitoring strategy for teenagers with inflammatory bowel disease: Empirical case study. J Med Internet Res 2019 Mar 29;21(3):e11761 [FREE Full text] [CrossRef] [Medline]
    39. Edridge C, Deighton J, Wolpert M, Edbrooke-Childs J. The implementation of an mHealth intervention (ReZone) for the self-management of overwhelming feelings among young people. JMIR Form Res 2019 May 02;3(2):e11958 [FREE Full text] [CrossRef] [Medline]
    40. Turner M, Kitchenham B, Brereton P, Charters S, Budgen D. Does the technology acceptance model predict actual use? A systematic literature review. Inf Softw Technol 2010 May;52(5):463-479. [CrossRef]
    41. Grimm P. Social desirability bias. In: Kamakura WA, editor. Wiley International Encyclopedia of Marketing. Volume 2: Marketing Research. Chichester, UK: John Wiley & Sons; 2010:258-259.

    ‎
    ACECQA: Australian Children’s Education and Care Quality Authority
    CCNSW: Cancer Council NSW
    ECEC: early childhood education and care
    HNEPH: Hunter New England Population Health
    NASSS: nonadoption, abandonment, scale-up, spread, and sustainability
    NHMRC: National Health and Medical Research Council
    NSW: New South Wales
    TAPPC: The Australian Prevention Partnership Centre

    Edited by G Eysenbach; submitted 06.07.20; peer-reviewed by S Mazzucca, D Fetter; comments to author 22.08.20; revised version received 25.08.20; accepted 29.10.20; published 20.11.20

    Copyright

    ©Alice Grady, Courtney Barnes, Luke Wolfenden, Christophe Lecathelinais, Sze Lin Yoong. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 20.11.2020.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.