This paper is in the following e-collection/theme issue:

e-Mental Health and Cyberpsychology (1386) Knowledge Translation and Implementation Science (372) Adoption and Change Management of eHealth Systems (670) Transdiagnostic Mental Health Interventions (120)

Published on in Vol 21, No 8 (2019): August

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/13432, first published .
Internet-Based Cognitive Behavioral Therapy Among Psychologists in a Medical Setting: A Survey on Implementation

Internet-Based Cognitive Behavioral Therapy Among Psychologists in a Medical Setting: A Survey on Implementation

Internet-Based Cognitive Behavioral Therapy Among Psychologists in a Medical Setting: A Survey on Implementation

Authors of this article:

Renée V H IJzerman1 Author Orcid Image ;   Rosalie van der Vaart1 Author Orcid Image ;   Andrea W M Evers1 Author Orcid Image
Article Authors Cited by (9) Tweetations (7) Metrics

    Original Paper

    Unit of Health, Medical and Neuropsychology, Faculty of Social and Behavioural Sciences, Leiden University, Leiden, Netherlands

    Corresponding Author:

    Renée V H IJzerman, MSc

    Unit of Health, Medical and Neuropsychology

    Faculty of Social and Behavioural Sciences

    Leiden University

    Wassenaarseweg 52

    Leiden,

    Netherlands

    Phone: 31 715275083

    Email: r.v.h.ijzerman@fsw.leidenuniv.nl


    Background: Internet-based cognitive behavioral therapy (iCBT) is an effective treatment for patients with a chronic somatic illness to improve self-management skills and to learn to adjust to their chronic disease and its impact on daily life. However, the implementation of iCBT in clinical practice is challenging.

    Objective: This study aimed to examine the current degree of implementation of iCBT among psychologists in a medical setting and discover determinants influencing the implementation of iCBT among nonusers.

    Methods: A Web-based survey, based on the Unified Theory of Acceptance and Use of Technology (UTAUT), was distributed among psychologists in a medical setting. The survey included questions regarding the current use of iCBT, intention to use iCBT in the future, and operationalized concepts of the UTAUT constructs, that is, performance expectancy (PE), effort expectancy (EE), social influence (SI), and facilitating conditions (FC).

    Results: In total, 107 (24.8%) psychologists completed the survey. Of them, 16.8% have access to iCBT, 15.9% currently use iCBT, and 21.5% are expected to use iCBT within the next year. The constructs PE, EE, and SI together significantly influenced behavioral intention (BI; mean 3.9 [SD=0.8]) among nonusers (R2=0.490; F4.85=20.405; P<.001).

    Conclusions: In spite of an average to high BI, the current implementation of iCBT is rather low among psychologists in a medical setting. Further research should focus on reducing the gap between intention to use and actual use by focusing on influencing the predictive UTAUT constructs.

    J Med Internet Res 2019;21(8):e13432

    doi:10.2196/13432

    Keywords

    eHealth; chronic care; self-management; implementation; psychologists; UTAUT 


    Background

    Patients with a chronic somatic illness often struggle with a complex interaction of physical, psychological, and social demands related to their disease. These demands significantly influence their disease perception and quality of life [1-3]. Supporting patients in increasing their disease self-management can effectively increase illness adjustment and adherence to treatment, and decrease problems related to illness behaviors and comorbid mental illnesses such as depression and anxiety [4-6]. Psychologists can offer this support as part of outpatient treatment in a hospital clinic. In the Netherlands, these psychologists are called medical psychologists, and patients are referred to them by their medical specialist. Regarding the content of this support, cognitive behavioral therapy (CBT)–based techniques are regularly used. However, CBT is generally only available to a small number of patients in this setting because it is expensive, time consuming [7,8], and sometimes inaccessible because of attendance barriers [9,10].

    Internet-Based Cognitive Behavioral Therapy

    With the development of internet-based treatment [11], CBT has become much more accessible to a wide range of patients [4]. In the Netherlands, internet-based CBT (iCBT) is usually offered as a guided program, containing modules regarding goal setting, psychoeducation, (behavioral) assignments, relaxation exercises, and diary registrations, which are supported by asynchronous contact with a therapist through messages in a secured email box [12]. The iCBT service can be used in several ways, depending on the severity of the problems of the patient and the patient preferences. It can be provided as a stand-alone service, in which it is a replacement of a regular therapy, or it can be used as an addition to regular treatment, in which iCBT is used blended, combined with face-to-face sessions. In all scenarios, patients use the Web portal from their home environment. Use of iCBT potentially produces similar overall effects compared with face-to-face CBT [13-15] and is significantly efficacious in improving disease-specific symptoms, disease control [9,16-18], and disease-related physical outcomes [13]. Moreover, treatment by traditional forms of psychological therapy can be associated with stigmatizing beliefs about mental illness and negative prejudices about therapists [19], whereas iCBT is usually experienced as easy to access and the most private way to seek help [20]. Moreover, iCBT provides patients the ability to administer treatment and access treatment-related material at any time and any place [16]. Finally, regarding economical perspectives, offering iCBT enables a potential reduction in health care costs [21], the number of needed contact hours, waiting lists, and traveling time for patients [22].

    Current Implementation of Internet-Based Cognitive Behavioral Therapy

    However, implementation of iCBT in clinical practice remains a challenge [23,24], and different health care settings show different usages of iCBT. Results of a naturalistic study among therapists of a Dutch mental health center showed that after training, over a period of 3 years, only 3.6% of the patients were offered the possibility to participate in iCBT, initiated by 18% of the therapists qualified to provide iCBT [25]. On the contrary, a study among Dutch primary care psychologists (PCPs) and mental health counselors (MHCs) in general practitioner practices showed more optimistic numbers, with 29% of the PCPs and 60% of the MHCs having used Web-based psychological self-management interventions (based on CBT) in their treatments [26]. Regarding iCBT in the hospital setting, research is lacking. Therefore, the aim of this study was to gain insight into use, barriers, and facilitators regarding implementation of iCBT among psychologists in medical settings.

    Research into possible factors influencing the degree of implementation of iCBT and iCBT-related interventions among psychologists is relatively young. Dissemination and implementation of digital health interventions often face many barriers on differing levels, for example, related to perceived effectiveness, expected usability, usefulness in the patient population, facilitating conditions (FC) at work, and personal productivity [26,27]. A suitable model to measure acceptance of technology and its associated influences on those multiple levels is the Unified Theory of Acceptance and Use of Technology (UTAUT) [28]. On the basis of this model, determinants influencing behavioral intention (BI) of iCBT are mapped, related to future users’ performance expectancy (PE), effort expectancy (EE), social influence (SI), and available FC. [28].

    Use of the Unified Theory of Acceptance and Use of Technology

    According to the UTAUT model, 4 constructs are crucial in explaining the use of technology, namely PE, EE, SI, and FC. PE indicates “the degree to which an individual believes that using the system will help him or her to attain gains in job performance” [28]. For psychologists in medical settings, this would mean that the use of iCBT may or may not contribute to their quality of work in a positive manner, for instance, the use of iCBT reduces time that is required to fulfill major responsibilities (eg, providing help to patients). EE can be defined as “the degree of ease associated with the use of the system” [28]. In practice, this would mean that the use of iCBT may or may not be clear, understandable, and easy to learn for psychologists. SI indicates “the degree to which an individual perceives that important others believe he or she should use the new system” [28]. In practice, this would mean that psychologists may or may not believe that colleagues and management at the workplace think they should use iCBT and support their use of iCBT. FC indicates “the degree to which an individual believes that an organizational and technical infrastructure exists to support the use of the system” [28]. For psychologists in medical settings, this would indicate that the use of iCBT may or may not be stimulated by the organization or manager. Moreover, the construct BI is a crucial determinant for use behavior and can be defined as “a person's subjective probability to perform a specified behavior” [29]. In practice, this would mean the likelihood of use of iCBT among psychologists in medical settings.

    The purpose of this study was to examine the fit and current degree of implementation of iCBT among psychologists in a medical setting and explore the extent to which the determinants of the UTAUT model influence the degree of implementation among nonusers. This was done using a nationally spread survey in the Netherlands to gain broad and generalizable insights into barriers and facilitators regarding implementation of iCBT in hospitals.


    Recruitment

    Respondents were recruited by (personal) email in March 2017. Dissemination of the survey was done by the Dutch Association of Medical Psychologists, and email addresses were collected by systematically searching hospitals per province (using Zorgkaart Nederland and Google), after which these hospitals were approached. In case no information on names or email address of psychologists was found on the website, the secretariat of the hospital was contacted by phone to ask whether they would agree to share their psychologists’ contact information. This resulted in a total initial spreading among 432 addresses. However, a snowball effect might have occurred because psychologists were asked to forward our invitation to colleagues to whom it might be relevant as well.

    The email included an information letter and a link to the Web-based survey in Qualtrics (2015 Qualtrics, LLC). The information letter explained the purpose of the study and its voluntary nature, use and anonymization of the data, estimated time needed to participate (10 min), and the reward for participating in the study (5 gift certificates of €50 were raffled among the respondents). All email addresses were stored separately and were only used for the raffle. The Web-based survey started with an informed consent form. Not responding to the survey or opting out in the informed consent form was considered as choosing not to participate in the study. Psychologists who were employed at multiple hospitals were asked to choose 1 hospital and fill in the survey based on their chosen hospital. If the survey was not fully completed, data were not included in further statistical analysis. Furthermore, 1 and 2 weeks after sending the invitation emails, reminder emails were sent to all email addresses. The study was approved by the Psychology Research Ethics Committee of Leiden University.

    Survey

    The survey consisted of 3 parts, namely (1) background information about the psychologist and the hospital, (2) general and work-related use of the internet of the respondent, and (3) an operationalization of the UTAUT constructs. The background information included gender, age, professional background, number of working hours per week, and years of employment. Background information about the hospital included number of colleagues working as a psychologist, number of newly referred patients per month, reasons for referral of patients, consult duration per visit, number of contacts per patient per treatment trajectory, and type of primarily offered help to patients. In part 2, general and work-related use of the internet was measured using questions about quantity of internet use in general, self-perceived skills to use the internet, use of internet for work-related activities, and current available Web-based applications in the hospital.

    To operationalize the UTAUT, subscales were created for each construct in the model (PE, EE, SI, FC, and BI). Regarding BI, respondents first answered whether using iCBT was part of their current work activities, after which they had to answer whether they had the intention to start using iCBT in case they currently did not use it. By measuring actual use of iCBT, a distinction between users and nonusers was possible. Subscales of the UTAUT constructs were measured with 3 to 8 items formulated as statements, for instance, “I expect/experience that guided iCBT is effective for my patient population” (PE), “I expect/experience that guided iCBT is time intensive to use” (EE), “I expect/experience that iCBT is seen as a positive development among my colleagues” (SI), “I expect/experience that iCBT fits within the technological circumstances of my practice” (FC), and “I want to use/continue to use guided iCBT” (BI). Respondents answered statements on a 5-point Likert scale, ranging from completely disagree (1) to completely agree (5). A complete overview of the survey is provided in Multimedia Appendix 1.

    Statistical Analysis

    Statistical analyses were performed using the Statistical Package for the Social Sciences (IBM SPSS Statistics 24). Descriptive statistics were used to describe the study sample, their internet experience, and their scores on the UTAUT constructs. Scale scores and Cronbach alphas were calculated for each UTAUT construct to check internal reliability. In the sample of nonusers, Pearson correlations were calculated to determine the relationship between the UTAUT variables PE, EE, SI, and FC and the dependent variable BI. On the basis of the statistical significance of these relations, multiple regression analysis was carried out to examine the further nature of these relations.


    Respondents

    A total of 127 psychologists in medical settings filled in the survey. Among them, 107 completed the survey, whereas 20 stopped early. These data were not used for analyses and contained 11.8% of the data. Among the respondents, 58 (58/107, 54.2%) stated that they are members of the Dutch Association of Medical Psychologists, whereas 49 (49/107, 45.8%) stated that they are not members. The estimated response rate is 24.8%, as 432 people were contacted for participation via their email addresses. However, because of the method of data collection, it is not possible to calculate an exact response rate. Table 1 provides an overview of the respondents’ characteristics. Most respondents were female (92/107, 86.0%), with a mean age of 40.9 years (SD=11.3). A large part of the respondents had a professional background as a health care psychologist (45/107, 42.1%) or clinical psychologist (27/107, 25.2%; these are both protected titles in the Netherlands, based on postmaster educational tracks). On average, respondents have been active as psychologists in a medical setting for 10.0 (SD=8.1) years and received up to 20 (69/107, 64.5%) new patients each month (data not shown in Table 1). Regarding consultations, most patients were seen for 5 to 10 times (60/107, 56.1%), and therapy sessions lasted an average of 53 min per session. With regard to characteristics of the care provided, respondents most often reported treating problems with dealing with chronic physical complaints and limitations (93/107, 86.9%), anxiety- and/or mood-related problems (68/107, 63.6%), and pain (39/107, 36.4%). Finally, the type of care primarily provided consisted of interventions aimed at improving mental functioning (93/107, 86.9%), problem clarification and diagnostics (90/107, 84.1%), psychoeducation (80/107, 75.7%), and guiding and supporting self-management (65/107, 60.7%).

    Table 1. Background information of the respondents and their hospital (N=107).
    CharacteristicsStatistics
    Gender, n (%)

    		Men15 (14.0)

    		Women92 (86.0)
    Age (years), mean (SD)40.5 (11.5)
    Professional background, n (%)

    		Psychologist, MSc13 (12.1)

    		Health care psychologist45 (42.1)

    		Clinical psychologist27 (25.2)

    		Clinical neuropsychologist2 (1.9)

    		Other (eg, in training to become health care psychologist)20 (18.7)
    Number of consultations during 1 complete treatment, n (%)

    		<539 (36.4)

    		5-1060 (56.1)

    		>108 (7.5)
    Average number of minutes spent per therapy session, mean (SD)53.9 (29.2)

    Internet Experience

    Most respondents used the internet on a daily basis (102/107, 95.3%) and rated their internet skills as (very) good (92/107, 86%). Concerning work functionalities, respondents mainly used the internet to search for medical information (103/107, 96.3%) or have contact with clients through email (71/107, 66.4%). Regarding availability of Web-based health applications in the hospital, respondents primarily reported availability of electronic medical records (104/107, 97.2%), a website with patient information (73/107, 68.2%), and a Web portal with patient records (46/107, 43%). Electronic or Web-based screening (21/107, 19.6%), Web-based self-management modules (18/107, 16.8%), and use of teleconsultation (10/107, 9.3%) were less common.

    Use of Guided Internet-Based Cognitive Behavioral Therapy

    Regarding the type of problems for which the respondents considered iCBT as an appropriate treatment, anxiety- and/or mood-related problems were most often reported (81/107, 75.7%), followed by problems dealing with chronic physical complaints and limitations (78/107, 72.9%), sleep problems (72/107, 67.3%), and fatigue problems (70/107, 65.4%).

    Table 2 shows that 15.9% (17/107) of the respondents used guided iCBT at the time of filling in the survey. More than half of the respondents (68/107, 63.6%) had seen guided iCBT programs before. Among this subgroup, almost three-fourths (49/68, 72.1%) considered iCBT a suitable treatment for problems related to dealing with chronic physical complaints and limitations, and more than three-fourths (54/68, 79.4%) considered iCBT a suitable treatment for anxiety- and/or mood-related problems. In addition, almost one-third of the respondents (31/107, 29%) had received training in the use of guided iCBT and more than a quarter used it as a part of their work activities in the past (31/107, 29%). Within these subgroups, more than half of the respondents (18/31, 58.1% in both subgroups) considered iCBT a suitable treatment for problems related to dealing with chronic physical complaints and limitations, and more than three-fourths (26/31, 83.9% and 25/31, 80.6%, respectively) considered iCBT a suitable treatment for anxiety- and/or mood-related problems. Finally, of the (former) users, a majority (20/31, 64.5%) had used guided iCBT in less than 10 treatments. Regarding future use of iCBT, more than one-fourth of all nonusers (23/90, 25.6%) expected to use guided iCBT within the next year, and more than half (57/90, 63.3%) expected to use guided iCBT within 2 to 5 years.

    Facilitators and Barriers

    Distribution of the scores on the UTAUT constructs was normal. Internal consistency was acceptable to excellent (see Table 3). On average, responses varied between the answer categories neutral and partly agree.

    Influence of Unified Theory of Acceptance and Use of Technology Constructs on Behavioral Intention Among Nonusers

    Pearson correlations showed statistically significant moderate to high positive associations between the UTAUT constructs PE, EE, SI, and FC and the dependent variable of BI, respectively (PE r=0.656; EE r=0.479; SI r=0.251; and FC r=0.443; P<.001 for PE, EE, and FC, and P=.02 for SI). Table 4 shows the results of the multiple regression analysis using the enter method. The multiple regression model with the dependent variable BI explained 49% of variance in BI (R2=0.490; F4.85=20.405; P<.001). The constructs PE, EE, and FC had a significant positive effect on BI regarding use of iCBT, whereas SI did not.

    Table 2. Use of guided internet-based cognitive behavioral therapy (N=107).
    QuestionStatistics, n (%)
    Current use of guided iCBTa17 (15.9)
    Previous experience with guided iCBT

    		Has seen a program of guided iCBT68 (63.6)

    		Has received a training in the use of guided iCBT31 (29.0)

    		Has applied guided iCBT in previous treatments31 (29.0)
    Completed guided iCBT treatment programs by (former) users (n=31)

    		<10 treatments20 (64.5)

    		10-20 treatments4 (12.9)

    		>20 treatments7 (22.6)
    Expected time frame of iCBT usage in the future among nonusers (n=90)

    		Within the next year23 (25.6)

    		Within 2-5 years57 (63.3)

    		Not within the next 5 years9 (10.0)

    		Never1 (1.1)

    aiCBT: internet-based cognitive behavioral therapy.

    Table 3. Scores on the Unified Theory of Acceptance and Use of Technology constructs (total N=107; users N=17; nonusers N=90).
    ConstructCronbach alphaStatistics, mean (SD)a
    Behavioral intention.903.9 (.8)

    		Users—b4.5 (.7)

    		Nonusers—3.8 (.8)
    Performance expectancy.803.7 (.4)

    		Users—3.7 (.3)

    		Nonusers—3.7 (.4)
    Effort expectancy.713.5 (.4)

    		Users—3.5 (.3)

    		Nonusers—3.5 (.4)
    Social influence.783.0 (.7)

    		Users—3.2 (.7)

    		Nonusers—2.9 (.6)
    Facilitating conditions.683.4 (.6)

    		Users—3.5 (.6)

    		Nonusers—3.3 (.6)

    aResponses answered all statements of all constructs by a 5-point Likert scale, namely 1: completely disagree, 2: partly disagree, 3: neutral, 4: partly agree, and 5: completely agree.

    bNot applicable.

    Table 4. Results multiple regression analysis of Unified Theory of Acceptance and Use of Technology constructs on behavioral intention (N=90).
    ModelBaBetabSEP value
    Constant−1.823—c0.669.01
    Performance expectancy0.8030.4380.176<.001
    Effort expectancy0.6250.2880.187.001
    Social influence−0.222−0.1740.139.11
    Facilitating conditions0.3550.2700.154.02

    aB: partial regression coefficient.

    bBeta: standardized regression coefficient.

    cNot applicable.


    Principal Findings

    Guided iCBT is a suitable and effective treatment for patients with a chronic somatic illness. However, its implementation in clinical practice remains challenging. The main purpose of this study was to examine the fit and the current degree of implementation of iCBT among psychologists in medical settings and determine its facilitators and barriers among nonusers. Most respondents in our sample were female (92/107, 86.0%) and had an official registration as psychologist, which is representative for the Dutch situation [30].

    The results of the study showed that the use of technology is highly integrated among psychologists, both on a personal level and work-related level. Moreover, respondents generally considered iCBT as an appropriate treatment for the type of problems they treat their patients for, regardless of their (previous) experience with iCBT. The actual current use of iCBT, however, was limited. Our results show that only 16% (17/107) of the respondents is currently using iCBT. In addition, 29% (31/107) had received training in the use of guided iCBT, and 29% (31/107) had used it as a part of their work activities in the past. This raises the question why only such a small portion of psychologists actually use these Web-based treatment tools nowadays and what happened when they stopped using them. Presumable reasons for ending the use of iCBT could be that people have changed organizations and were not satisfied with the Web-based programs they used or, for instance, a change of policy from their management.

    Our results concerning outcomes on the UTAUT model provide some insight into these questions and into what is further needed to increase implementation success. BI regarding the use of iCBT was found to be high among nonusers, with 98.9% (89/90) planning to use it within the upcoming 5 years; therefore, there is a high willingness to use Web-based tools in treatment. We also found that PE, EE, and FC appear to be significant predictors for this BI. These results indicate that aspects such as effectiveness for the client population, easiness of use, and managerial focus impact psychologists’ choice in the use of iCBT. These outcomes are in line with recent research on iCBT use in primary and routine care [26,27]. Still, the answers on most constructs had a small dispersion (spreading of the answers; responses were located around the answer categories partly agree or neutral), indicating that the respondents did not have very outspoken expectations on these determinants. This might indicate an implementation barrier in itself because the needs and beliefs about iCBT might not be strong enough to actually create behavioral change. To create actual change, it seems of major importance that the availability of Web-based self-management tools increases in hospital settings because, currently, only 17% (18/107) have access to iCBT. As a result, a larger part of psychologists in these settings will actually be able to use iCBT when willing to.

    In the Netherlands, there is quite a large number of commercially provided iCBT portals, in which hosting and updating is outsourced. Psychologists are able to make use of these programs using a paid license. Although we now know that practicing psychologists would be intended to use these iCBT services, the actual access is probably often depending on the willingness of their management to invest in iCBT services. Future implementation efforts should therefore initially focus on these types of stakeholders, using implementation models that take a broad range of stakeholders into account. An example of such a model is the Consolidated Framework for Implementation Research [31], addressing 5 domains to include in implementation research. These are intervention characteristics (eg, adaptability and relative advantage), the setting within the organization (eg, culture, leadership engagement, and communication), the environment outside the organization (eg, external policies and incentives, peer pressure, needs, and resources), characteristics of the individuals involved (eg, self-efficacy, personal attributes, and individual stages of change), and the process of implementation (eg, planning, execution, and internal implementation leaders).

    Future Directions

    Based on our results using the UTAUT model, we can further reflect on what follow-up steps in improving implementation success seem essential, partly on an individual level. Concerning PE and EE, this study showed that fewer than one-third of the respondents have received a training in the use of iCBT. Therefore, expectations about whether iCBT asks a lot of new skills, affects work productivity, and increases the quality of care provision appear to affect the implementation process of iCBT. Moreover, these findings are consistent with previous research stating that lack of knowledge of the program and expectations regarding effectiveness and fully mastering the required protocol influence acceptance of iCBT [8,27,32,33]. Therefore, attention should be paid to providing employees more education in iCBT by offering knowledge with regard to availability of existing iCBT programs, their effectiveness, usefulness, and performance productivity and by offering them proper skills training [27,34]. Regarding FC, stimulation of iCBT use from a management level is a key prerequisite for use in daily practice. Moreover, attention should be paid to the degree of customization of iCBT to the daily workflow of psychologists.

    Limitations

    With this survey, we aimed to reach the most representative sample possible by trying to contact each psychologist in a medical setting in the Netherlands. The possibility exists that people interested in electronic health (eHealth) or actual eHealth users were more inclined to respond to the survey. This could result in fewer psychologists actually using iCBT in the complete population than the results from this survey show. In addition, social desirability may have influenced the provided answers of the respondents because the government encourages the use of eHealth among health professionals, which might have pressured our respondents toward positive answers. Furthermore, it is not possible to exactly estimate how many psychologists actually received our survey because invited psychologists were asked to forward our invitation to colleagues to whom it might be relevant as well. However, our estimated response rate of 24.8% is in line with the average response rate of large surveys [35]. Moreover, by sending out 2 reminders each 7 days after the first invitation email and by making use of personalization, appropriate measures were used to increase the response rate as much as possible [36]. Delay between reminders was based on research stating no significant difference in response rate for follow-up emails sent after 1 or 2 weeks and recommending time lags of 1 week [37].

    Conclusions

    Despite an average to high BI, current implementation of iCBT is low among psychologists in medical settings. Increasing the availability of iCBT and bringing change in other areas that could influence the gap between intention and actual use is needed. The UTAUT constructs PE, EE, and FC significantly affect BI regarding use of iCBT. Therefore, further research and implementation trajectories should focus on offering a wide range of iCBT programs, education on iCBT facilities and required skills, and customization of iCBT to the daily workflow of psychologists.

    Acknowledgments

    The authors thank all the health professionals who participated in the study. They also thank the Dutch Society of Medical Psychologists (Landelijke Vereniging Medische Psychologie) for their participation in spreading the survey among their members and Maaike Alvares, Simone Daamen, Nadine Haasnoot, Giovanna Haneveld, Annemarie van der Kaaij, Lenneke Peijs, Pien van Putte, Nadia van Silfhout, and Demi de Vries for their contribution to the data collection.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    English version of the survey as distributed among medical psychologists in the Netherlands.

    PDF File (Adobe PDF File), 144KB
    1. Wagner EH, Austin BT, Davis C, Hindmarsh M, Schaefer J, Bonomi A. Improving chronic illness care: translating evidence into action. Health Aff (Millwood) 2001;20(6):64-78. [CrossRef] [Medline]
    2. Sensky T. Patients' reactions to illness. Br Med J 1990 Mar 10;300(6725):622-623 [FREE Full text] [CrossRef] [Medline]
    3. Strine TW, Chapman DP, Balluz LS, Moriarty DG, Mokdad AH. The associations between life satisfaction and health-related quality of life, chronic illness, and health behaviors among US community-dwelling adults. J Community Health 2008 Feb;33(1):40-50. [CrossRef] [Medline]
    4. Barlow J, Wright C, Sheasby J, Turner A, Hainsworth J. Self-management approaches for people with chronic conditions: a review. Patient Educ Couns 2002;48(2):177-187. [CrossRef] [Medline]
    5. Halford J, Brown T. Cognitive–behavioural therapy as an adjunctive treatment in chronic physical illness. Adv Psychiatr Treat 2018 Jan 2;15(4):306-317. [CrossRef]
    6. Hofmann SG, Asnaani A, Vonk IJ, Sawyer AT, Fang A. The efficacy of cognitive behavioral therapy: a review of meta-analyses. Cognit Ther Res 2012 Oct 1;36(5):427-440 [FREE Full text] [CrossRef] [Medline]
    7. Hans E, Hiller W. Effectiveness of and dropout from outpatient cognitive behavioral therapy for adult unipolar depression: a meta-analysis of nonrandomized effectiveness studies. J Consult Clin Psychol 2013 Feb;81(1):75-88. [CrossRef] [Medline]
    8. Wilhelmsen M, Høifødt RS, Kolstrup N, Waterloo K, Eisemann M, Chenhall R, et al. Norwegian general practitioners' perspectives on implementation of a guided web-based cognitive behavioral therapy for depression: a qualitative study. J Med Internet Res 2014 Sep 10;16(9):e208 [FREE Full text] [CrossRef] [Medline]
    9. Beatty L, Lambert S. A systematic review of internet-based self-help therapeutic interventions to improve distress and disease-control among adults with chronic health conditions. Clin Psychol Rev 2013 Jun;33(4):609-622. [CrossRef] [Medline]
    10. Mohr DC, Ho J, Duffecy J, Baron KG, Lehman KA, Jin L, et al. Perceived barriers to psychological treatments and their relationship to depression. J Clin Psychol 2010 Apr;66(4):394-409 [FREE Full text] [CrossRef] [Medline]
    11. Kontos E, Blake KD, Chou WS, Prestin A. Predictors of ehealth usage: insights on the digital divide from the Health Information National Trends Survey 2012. J Med Internet Res 2014 Jul 16;16(7):e172 [FREE Full text] [CrossRef] [Medline]
    12. Andersson G, Hedman E. Effectiveness of guided internet-based cognitive behavior therapy in regular clinical settings. Verhaltenstherapie 2013;23(3):140-148. [CrossRef]
    13. van Beugen S, Ferwerda M, Hoeve D, Rovers MM, Spillekom-van Koulil S, van Middendorp H, et al. Internet-based cognitive behavioral therapy for patients with chronic somatic conditions: a meta-analytic review. J Med Internet Res 2014 Mar 27;16(3):e88 [FREE Full text] [CrossRef] [Medline]
    14. Andersson G, Cuijpers P, Carlbring P, Riper H, Hedman E. Guided internet-based vs face-to-face cognitive behavior therapy for psychiatric and somatic disorders: a systematic review and meta-analysis. World Psychiatry 2014 Oct;13(3):288-295 [FREE Full text] [CrossRef] [Medline]
    15. Cuijpers P, Donker T, van Straten A, Li J, Andersson G. Is guided self-help as effective as face-to-face psychotherapy for depression and anxiety disorders? A systematic review and meta-analysis of comparative outcome studies. Psychol Med 2010 Dec;40(12):1943-1957. [CrossRef] [Medline]
    16. Macea DD, Gajos K, Calil YAD, Fregni F. The efficacy of web-based cognitive behavioral interventions for chronic pain: a systematic review and meta-analysis. J Pain 2010 Oct;11(10):917-929. [CrossRef] [Medline]
    17. Newman MG, Szkodny LE, Llera SJ, Przeworski A. A review of technology-assisted self-help and minimal contact therapies for anxiety and depression: is human contact necessary for therapeutic efficacy? Clin Psychol Rev 2011 Feb;31(1):89-103. [CrossRef] [Medline]
    18. Richards D, Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev 2012 Jun;32(4):329-342. [CrossRef] [Medline]
    19. Sibold M, Mittag O, Kulick B, Müller E, Opitz U, Jäckel WH. [Predictors of participation in medical rehabilitation follow-up in working patients with chronic back pain]. Rehabilitation (Stuttg) 2011 Dec;50(6):363-371. [CrossRef] [Medline]
    20. Kauer SD, Mangan C, Sanci L. Do online mental health services improve help-seeking for young people? A systematic review. J Med Internet Res 2014 Mar 4;16(3):e66 [FREE Full text] [CrossRef] [Medline]
    21. Hedman E, Ljótsson B, Lindefors N. Cognitive behavior therapy via the internet: a systematic review of applications, clinical efficacy and cost-effectiveness. Expert Rev Pharmacoecon Outcomes Res 2012 Dec;12(6):745-764. [CrossRef] [Medline]
    22. Cuijpers P, van Straten A, Andersson G. Internet-administered cognitive behavior therapy for health problems: a systematic review. J Behav Med 2008 Apr;31(2):169-177 [FREE Full text] [CrossRef] [Medline]
    23. Fleming TM, de Beurs D, Khazaal Y, Gaggioli A, Riva G, Botella C, et al. Maximizing the impact of e-therapy and serious gaming: time for a paradigm shift. Front Psychiatry 2016;7:65 [FREE Full text] [CrossRef] [Medline]
    24. Mohr DC, Riper H, Schueller SM. A solution-focused research approach to achieve an implementable revolution in digital mental health. JAMA Psychiatry 2018 Feb 1;75(2):113-114. [CrossRef] [Medline]
    25. Kenter RMF, van de Ven PM, Cuijpers P, Koole G, Niamat S, Gerrits RS, et al. Costs and effects of internet cognitive behavioral treatment blended with face-to-face treatment: results from a naturalistic study. Internet Interv 2015 Mar;2(1):77-83. [CrossRef]
    26. van der Vaart R, Atema V, Evers AWM. Guided online self-management interventions in primary care: a survey on use, facilitators, and barriers. BMC Fam Pract 2016 Mar 9;17:27 [FREE Full text] [CrossRef] [Medline]
    27. Folker AP, Mathiasen K, Lauridsen SM, Stenderup E, Dozeman E, Folker MP. Implementing internet-delivered cognitive behavior therapy for common mental health disorders: a comparative case study of implementation challenges perceived by therapists and managers in five European internet services. Internet Interv 2018 Mar;11:60-70 [FREE Full text] [CrossRef] [Medline]
    28. Venkatesh V, Morris MG, Davis GB, Davis FD. User acceptance of information technology: toward a unified view. MIS Q 2003;27(3):435-478 [FREE Full text] [CrossRef]
    29. Yi MY, Jackson JD, Park JS, Probst JC. Understanding information technology acceptance by individual professionals: toward an integrative view. Inform Manage 2006 Apr;43(3):350-363. [CrossRef]
    30. BIG-Register. 2019. [Basic Occupation and Specialty]   URL: https://www.bigregister.nl/over-het-big-register/cijfers/basisberoep-en-specialisme [accessed 2019-04-15] [WebCite Cache]
    31. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci 2009 Aug 7;4:50 [FREE Full text] [CrossRef] [Medline]
    32. Kivi M, Eriksson MCM, Hange D, Petersson EL, Björkelund C, Johansson B. Experiences and attitudes of primary care therapists in the implementation and use of internet-based treatment in Swedish primary care settings. Internet Interv 2015 Sep;2(3):248-256. [CrossRef]
    33. Yang Z, Wang X, Su C. A review of research methodologies in international business. Int Bus Rev 2006 Dec;15(6):601-617. [CrossRef]
    34. Gagnon MP, Desmartis M, Labrecque M, Car J, Pagliari C, Pluye P, et al. Systematic review of factors influencing the adoption of information and communication technologies by healthcare professionals. J Med Syst 2012 Feb;36(1):241-277 [FREE Full text] [CrossRef] [Medline]
    35. Sánchez-Fernández J, Muñoz-Leiva F, Montoro-Ríos FJ. Improving retention rate and response quality in web-based surveys. Comput Hum Behav 2012 Mar;28(2):507-514. [CrossRef]
    36. Yarbrough AK, Smith TB. Technology acceptance among physicians: a new take on TAM. Med Care Res Rev 2007 Dec;64(6):650-672. [CrossRef] [Medline]
    37. Sauermann H, Roach M. Increasing web survey response rates in innovation research: an experimental study of static and dynamic contact design features. Res Policy 2013 Feb;42(1):273-286. [CrossRef]

    ‎
    BI: behavioral intention
    CBT: cognitive behavioral therapy
    eHealth: electronic health
    EE: effort expectancy
    FC: facilitating conditions
    iCBT: internet-based cognitive behavioral therapy
    MHCs: mental health counselors
    PCPs: primary care psychologists
    PE: performance expectancy
    SI: social influence
    UTAUT: Unified Theory of Acceptance and Use of Technology

    Edited by G Eysenbach; submitted 17.01.19; peer-reviewed by M Kivi, K Mathiasen, K Stasiak; comments to author 28.02.19; revised version received 24.04.19; accepted 20.05.19; published 09.08.19

    Copyright

    ©Renée V H IJzerman, Rosalie van der Vaart, Andrea W M Evers. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 09.08.2019.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.