This paper is in the following e-collection/theme issue:

Digital Mental Health Interventions, e-Mental Health and Cyberpsychology (1514) Web-based and Mobile Health Interventions (3297) Depression and Mood Disorders; Suicide Prevention (1363)

Published on in Vol 20, No 9 (2018): September

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/10743, first published .
Web-Based Cognitive Behavioral Therapy Blended With Face-to-Face Sessions for Major Depression: Randomized Controlled Trial

Web-Based Cognitive Behavioral Therapy Blended With Face-to-Face Sessions for Major Depression: Randomized Controlled Trial

Web-Based Cognitive Behavioral Therapy Blended With Face-to-Face Sessions for Major Depression: Randomized Controlled Trial

Authors of this article:

Shigetsugu Nakao1 Author Orcid Image ;   Atsuo Nakagawa1, 2, 3, 4, 5 Author Orcid Image ;   Yoshiyo Oguchi6 Author Orcid Image ;   Dai Mitsuda1 Author Orcid Image ;   Noriko Kato1, 3 Author Orcid Image ;   Yuko Nakagawa1 Author Orcid Image ;   Noriko Tamura1 Author Orcid Image ;   Yuka Kudo1 Author Orcid Image ;   Takayuki Abe2, 7 Author Orcid Image ;   Mitsunori Hiyama4 Author Orcid Image ;   Satoru Iwashita5 Author Orcid Image ;   Yutaka Ono8 Author Orcid Image ;   Masaru Mimura1 Author Orcid Image
Article Authors Cited by (30) Tweetations (63) Metrics

    Original Paper

    1Department of Neuropsychiatry, Keio University School of Medicine, Tokyo, Japan

    2Clinical and Translational Research Center, Keio University Hospital, Tokyo, Japan

    3National Center for Cognitive Behavior Therapy and Research, National Center of Neurology and Psychiatry, Kodaira, Japan

    4Department of Psychiatry, National Hospital Organization Tokyo Medical Center, Tokyo, Japan

    5Department of Psychiatry, Sakuragaoka Memorial Hospital, Tama, Japan

    6Department of Psychiatry, St. Marianna University School of Medicine, Kawasaki, Japan

    7Department of Preventive Medicine and Public Health, Keio University School of Medicine, Tokyo, Japan

    8Center for the Development of Cognitive Behavior Therapy Training, Tokyo, Japan

    Corresponding Author:

    Atsuo Nakagawa, MD, PhD

    Clinical and Translational Research Center

    Keio University Hospital

    35, Shinanomachi, Shinjuku-Ku

    Tokyo, 160-8582

    Japan

    Phone: 81 3 3353 1211

    Fax:81 3 5363 3480

    Email: anakagawa@keio.jp


    Background: Meta-analyses of several randomized controlled trials have shown that cognitive behavioral therapy (CBT) has comparable efficacy to antidepressant medication, but therapist availability and cost-effectiveness is a problem.

    Objective: This study aimed to evaluate the effectiveness of Web-based CBT blended with face-to-face sessions that reduce therapist time in patients with major depression who were unresponsive to antidepressant medications.

    Methods: A 12-week, assessor-masked, parallel-group, waiting- list controlled, randomized trial was conducted at 3 medical institutions in Tokyo. Outpatients aged 20-65 years with a primary diagnosis of major depression who were taking ≥1 antidepressant medications at an adequate dose for ≥6 weeks and had a 17-item GRID-Hamilton Depression Rating Scale (HAMD) score of ≥14 were randomly assigned (1:1) to blended CBT or waiting-list groups using a computer allocation system, stratified by the study site with the minimization method, to balance age and baseline GRID-HAMD score. The CBT intervention was given in a combined format, comprising a Web-based program and 12 45-minute face-to-face sessions. Thus, across 12 weeks, a participant could receive up to 540 minutes of contact with a therapist, which is approximately two-thirds of the therapist contact time provided in the conventional CBT protocol, which typically provides 16 50-minute sessions. The primary outcome was the alleviation of depressive symptoms, as measured by a change in the total GRID-HAMD score from baseline (at randomization) to posttreatment (at 12 weeks). Moreover, in an exploratory analysis, we investigated whether the expected positive effects of the intervention were sustained during follow-up, 3 months after the posttreatment assessment. Analyses were performed on an intention-to-treat basis, and the primary outcome was analyzed using a mixed-effects model for repeated measures.

    Results: We randomized 40 participants to either blended CBT (n=20) or waiting-list (n=20) groups. All patients completed the 12-week treatment protocol and were included in the intention-to-treat analyses. Participants in the blended CBT group had significantly alleviated depressive symptoms at week 12, as shown by greater least squares mean changes in the GRID-HAMD score, than those in the waiting list group (−8.9 points vs −3.0 points; mean between-group difference=−5.95; 95% CI −9.53 to −2.37; P<.001). The follow-up effects within the blended CBT group, as measured by the GRID-HAMD score, were sustained at the 3-month follow-up (week 24) and posttreatment (week 12): posttreatment, 9.4 (SD 5.2), versus follow-up, 7.2 (SD 5.7); P=.009.

    Conclusions: Although our findings warrant confirmation in larger and longer term studies with active controls, these suggest that a combined form of CBT is effective in reducing depressive symptoms in patients with major depression who are unresponsive to antidepressant medications.

    Trial Registration: University Hospital Medical Information Network Clinical Trials Registry: UMIN000009242; https://upload.umin.ac.jp/cgi-open-bin/ctr_e/ctr_view.cgi?recptno=R000010852 (Archived by WebCite at http://www.webcitation. org/729VkpyYL)

    J Med Internet Res 2018;20(9):e10743

    doi:10.2196/10743

    Keywords

    blended cognitive behavioral therapy; cognitive behavioral therapy; major depressive disorder; major depression; randomized controlled trial 


    Major depression is a common mental disorder with a serious public health impact. Over 300 million people globally are estimated to suffer from major depression, equivalent to 4.4% of the world’s population [1]. In addition, major depression is associated with increased morbidity and impaired function; it poses a significant societal and economic burden that accounts for 2.5% of the global disease burden [2]. Thus, it is predicted to be the leading cause of disability in high-income countries by 2030 and the third-leading cause in low-income and middle-income countries [3].

    Meta-analyses of a large number of randomized controlled trials (RCTs) have shown that cognitive behavioral therapy (CBT) has efficacy comparable to antidepressant medication [4,5] and is more successful than antidepressant medication in reducing the risk of relapse after treatment ends [6,7]. In addition, the literature shows that many patients would like to access psychotherapy as an alternative or adjunct to pharmacotherapy [8,9]. Despite these compelling justifications for the widespread dissemination and implementation of CBT, significant barriers exist to providing CBT in the routine practice. One barrier to broadly disseminating CBT is an insufficient number of trained therapists [10]. The United Kingdom initiated a national project called “Improving Access to Psychological Therapies” to improve access to psychotherapy for patients with depression and anxiety. In this project, >3600 new therapists were trained and deployed in the initial 3 years; however, the program required a total cost of 309 million pounds (equivalent to US $405 million) [11]. Thus, large-scale CBT dissemination requires addressing inevitable resource allocation problems.

    Computerized CBT (see Multimedia Appendix 1) is an alternative strategy for the broad dissemination of CBT and is considered to be more cost-effective. Although ample research has demonstrated the efficacy of computerized CBT in controlled research settings [12,13], the evidence to date indicates that computerized CBT without human support typically has much smaller effects and is associated with a higher rate of attrition than those with a modest amount of human support [12]. Furthermore, a pragmatic trial that tested the efficacy of 2 widely known computerized CBT programs delivered through a website, that is, Web-based CBT (the Mood Gym and Beating the Blues) with a small amount of telephone support in a primary care setting, found no clinical benefit and an extremely low treatment adherence [14].

    To overcome low adherence while improving the beneficial effect of Web-based CBT, a newer treatment format, called blended CBT, where CBT sessions delivered by a therapist and computer are integrated into 1 treatment protocol, has been developed [15,16]; this blended format can be beneficial by tailoring sessions to meet patient-specific needs during therapist-delivered sessions, over and above the computerized program [17,18]. In addition, blended CBT aids in improving the efficiency by allowing therapists to focus more on process-related treatment components (eg, treatment introduction, evaluation, discussing thoughts and feelings, and asking questions about homework) in their therapist-delivered sessions, while more practical therapy components, such as psychoeducation, mood and activity diaries, and homework, can be done through the computerized program [18].

    Despite the aforementioned advantages, so far only a few researchers have tested the efficacy of blended CBT in comparison with a control condition in the treatment of clinically diagnosed major depression. An 8-week blended CBT protocol developed by Wright et al [19] demonstrated beneficial effects compared with waiting list controls. Furthermore, a modified version of Wright’s earlier protocol, involving the therapy extension by another 8 weeks by adding 4 25-minute booster face-to-face sessions, showed similar effects as the conventional 16-week CBT protocol [20]. However, these trial participants were not currently taking antidepressant medications.

    The blended CBT protocol used in this study was designed to integrate the Web-based CBT program using Kokoro-no-skill-up-training [21] with face-to-face sessions. Kokoro-no-skill-up-training (Kokoro-no means “for the mind” in Japanese) is a Web-based CBT program developed by one of our authors (YO), which provides computerized CBT modules. The stand-alone version of Kokoro-no-skill-up-training has demonstrated a beneficial effect on high-stress workers [22] and school students [23].

    The objective of this study was to demonstrate that Web-based CBT blended with face-to-face sessions is effective in treating patients with major depression who are unresponsive to antidepressant medications, while reducing the therapist time. This study focuses on subjects with refractory depression because one-third of patients with major depression have considerable residual symptomatology after initial treatment [24,25]. Studies have shown that the addition of CBT is a promising strategy for refractory depression [26,27]. We, therefore, conducted an assessor-masked, 12-week, RCT to test the effectiveness of blended CBT for patients with major depression who did not respond to ≥1 antidepressant medication. Furthermore, in an uncontrolled explorative analysis, we investigated whether the expected positive effects of the intervention were sustained at follow-up, 3 months after the posttreatment assessment.


    Design and Approval

    This study was a 12-week, single-blind, waiting list controlled, randomized trial. The study was approved by the Ethics Committees of the study sites and registered in the University Hospital Medical Information Network Clinical Trials Registry (UMIN000009242). The study was conducted and reported in accordance with the Consolidated Standards of Reporting Trials of Electronic and Mobile HEalth Applications and onLine TeleHealth checklist [28].

    Participants

    Participants were individuals who sought treatment for major depression at 3 study sites located in Tokyo: a university teaching hospital, a psychiatric hospital, and a general hospital. Those who agreed to participate were asked to provide written consent and undergo a baseline assessment.

    Participants were eligible for inclusion in this study if they were aged 20-65 years and had Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (DSM-IV) major depressive disorder [29], as confirmed by the Structured Clinical Interview for DSM-IV-TR Axis I Disorders-Patient Edition (SCID-I/P) [30]. In addition, all participants met the operationalized criteria of having a 17-item GRID-Hamilton Depression Rating Scale (GRID-HAMD) [31,32] score of ≥14 despite having received adequate therapy with ≥1 antidepressant medications for at least 6 weeks as part of their routine care, and had access to the internet at home.

    The exclusion criteria were a primary DSM-IV axis I diagnosis other than major depressive disorder, as assessed by the Mini-International Neuropsychiatric Interview [33,34], manic or psychotic episodes, alcohol or substance use disorder or antisocial personality disorder, serious and imminent suicidal ideation, organic brain lesions or major cognitive deficits, and serious or unstable medical illnesses. Moreover, those who had received CBT in the past (ie, defined as attending ≥8 CBT sessions) or who were unlikely to attend >8 sessions of study treatment (for reasons such as planned relocation) were excluded. The diagnostic interviews were conducted by treating psychiatrists, all of whom had received extensive training in the administration of semistructured interviews.

    Randomization and Masking

    All eligible participants were randomly allocated (in a ratio of 1:1) to either the blended CBT group or the waiting list group. The allocation was concealed with the use of a Web-based random allocation system. Randomization was stratified by the study site using the minimization method to balance participants in terms of their age at study entry (<40 years, ≥40 years) and baseline GRID-HAMD score (14-18, ≥19).

    Owing to the nature of interventions, although neither participants nor treating psychiatrists or therapists could be masked to the randomization status, the primary outcome measure (GRID-HAMD) was assessed by central assessors using the telephone. Central assessors were not involved with the treatment or study coordination and were prohibited from accessing any information that would reveal participant allocation. In addition, participants were instructed not to disclose their allocated treatment during telephonic interviews. All assessors were licensed clinical psychologists based at the National Center of Neurology and Psychiatry who had received extensive GRID-HAMD training and achieved excellent interrater reliability (intraclass correlation=.98). The percentage of agreement and kappa coefficients between the actual allocation and the allocation guessed by central assessors were 62.5% and .20 (95% CI –0.10 to 0.46) for the 6-week midpoint assessment and 60.0% and.25 (95% CI –0.06 to 0.52) for the 12-week posttreatment assessment, respectively, indicating that masking was successful.

    Treatment Procedures

    Web-Based Cognitive Behavioral Therapy Blended With Face-to-Face Sessions

    Participants allocated to the blended CBT arm were offered 12 weeks of Web-based CBT blended with 12 45-minute face-to-face sessions, with no booster session. Multimedia Appendix 2 provides an overview of the blended CBT program, which integrates the Web-based program using the Kokoro-no-skill-up-training with 12 weekly therapist sessions. The Web-based program consists of the following 5 core components: (1) psychoeducation, assessment, and problem clarification; (2) behavioral activation; (3) cognitive restructuring; (4) problem solving; and (5) relapse prevention (outline shown in Multimedia Appendix 3). By accessing the Web-based program, participants watched psychoeducational video clips and read short columns, rated and monitored their daily mood graphs, and mastered CBT skills, including behavioral activation, recognizing and addressing dysfunctional thoughts, and problem solving, by entering text as interactively guided on the Web screen. Although participants were encouraged to work with their Web-based program during the intervention period at their own pace, each module typically took about 30 minutes to complete. In the face-to-face session, therapists reviewed the material covered in the Web-based program, evaluated and discussed the participant-specific problem, and practiced CBT skills and set homework for the next session using the Web-based program. A guidebook was provided to facilitate mastery of the program. The guidebook offers a detailed session-by-session treatment procedure that includes information on how and when to use the specific Web-based content to meet the individualized needs of diverse participants.

    We selected a 12-week format to improve the efficiency of treatment by reducing the number of therapist sessions compared with the standard Japanese CBT protocol, which offers 16 50-minutes sessions [35]. Thus, across 12 weeks, a participant could receive up to 540 minutes of contact with a therapist, approximately two-thirds of that provided in the conventional CBT protocol (ie, a total of 800 minutes). After 12 sessions of blended CBT, participants resumed usual care. Notably, 1 psychiatrist, 2 clinical psychologists with a doctoral degree, and 1 psychiatric nurse provided the blended CBT. Together, the therapists had practiced CBT for a mean of 6.0 (SD 2.4) years before the study. All therapists received CBT training, which included a 2-day intensive CBT workshop and 1-hour onsite group supervision every week from a skilled CBT supervisor (AN), with thorough reviews of cases and detailed feedback to maintain the adherence to CBT protocols and competence during the study. Participants allocated to the waiting list group also received the intervention after a 12-week waiting period and were informed about this before study entry.

    Treatment as Usual

    Participants allocated to both the blended CBT and waiting list groups continued treatment as usual with their treating psychiatrist. It consisted of medication management along with education regarding medication and dosage schedules, review of adverse effects, and supportive guidance from treating psychiatrists. Monitoring of depressive symptoms with the 16-item Quick Inventory of Depressive Symptomatology Self-Report (QIDS) [36,37] was conducted at each visit. Although there were no particular restrictions on the pharmacotherapy provided, treatments were in line with practice guidelines for depression care [38]. Three treating psychiatrists who had specialist experience in psychiatric care for a mean of 6.6 (SD 5.7) years provided the medication visits, which were offered roughly every 2 weeks, each visit lasting approximately 10 minutes. Notably, treating psychiatrists were not involved in the delivery or supervision of CBT.

    Outcomes

    The primary outcome was the alleviation of depressive symptoms, as measured by the change in the total 17-item GRID-HAMD score from the baseline (at randomization: baseline assessment) to 12 weeks postrandomization (at the end of the intervention or waiting period: posttreatment assessment). The GRID-HAMD is an amended version of the original Hamilton Depression Rating Scale, which provides standardized explicit scoring conventions with a structured interview guide for administration and scoring [31,32]. In addition, changes were assessed after 6 weeks (midpoint assessment). Furthermore, outcome measures were assessed 3 months after the intervention was completed (follow-up assessment) in the blended CBT group only. For ethical reasons, we decided to offer CBT to participants from the control group after their participation in the waiting list study group. Therefore, the planned follow-up analysis to determine whether the effect of CBT was sustained was uncontrolled.

    All secondary outcomes were also evaluated at the same time-points; these included treatment response (≥50% reduction in the baseline GRID-HAMD score); remission (GRID-HAMD score≤7); participant-rated measures of depressive symptoms, that is Beck Depression Inventory-Second Edition (BDI) score [39,40] and QIDS score; participant-rated inventory for depressogenic schemata, that is 24-item dysfunctional attitude scale (DAS-24) score [41,42]; and the quality-of-life status as measured by the mental and physical component summary score of the 36-Item Short-Form Health Survey [43,44]. Furthermore, participants were asked to complete the European Quality of Life Questionnaire-5 Dimensions to measure the health-related quality of life [45,46].

    Information on the total daily dose of each antidepressant medication was expressed as a fraction of the World Health Organization’s defined daily dose [47], which is defined as the assumed average maintenance dose per day for adults calculated from the dosage recommendations for each drug. In addition, adverse events were monitored. Serious adverse events were defined as death, life-threatening events, events leading to severe impairment or dysfunction, and hospitalization.

    Statistical Analysis

    Based on Wright et al [19], we assumed that a mean difference of 6 points on the 17-item GRID-HAMD score with an SD of 5.5 between the 2 groups would be clinically meaningful. With a two-sided 5% significance level and 90% power, a sample size of 18 was required for each group. Therefore, a total sample of 40 would provide sufficient power while also accounting for possible attrition. As we were not aware of any published blended CBT studies on refractory depression, we calculated the sample size of our study based on this prior study that included patients with a similar depression severity as our patients.

    The primary analysis was performed on an intention-to-treat basis, and all randomized participants were included. For continuous outcomes, the least squares means (LS means) and their 95% CIs were estimated using a mixed-effects model for repeated measures (MMRM) for changes from the baseline, which contained the treatment group, week, and group-by-week interaction as fixed-effects with an unstructured covariance matrix among time-points; Kenward-Roger degrees of freedom adjustment were used. Mean changes for each group at each time-point and mean between-group differences were estimated using appropriate contrasts in the MMRM. Notably, missing values were not inputted. For categorical outcomes, relative risks (RRs) and their 95% CIs were calculated. The number needed to treat (NNT) was calculated when a 95% CI of RR did not include 1.0. In addition, we calculated the effect size (Cohen d) for all significant outcome measures (ie, as the difference in mean changes at posttreatment assessment between the blended CBT group and the waiting list group divided by the pooled SD of both groups). The effect size was classified as small (Cohen d=0.2-0.49), medium (Cohen d=0.5-0.79), or large (Cohen d>0.8) [48]. Furthermore, we investigated the follow-up effects in the blended CBT group with paired t tests, comparing the scores at follow-up assessment with the scores at posttreatment assessment. The significance level was set at.05 (two-tailed) for all analyses. No multiple-testing correction was applied because this study was an RCT with a single primary null-hypothesis. Statistical analyses were performed with SAS version 9.4 (SAS Institute, Cary, NC, USA).


    Figure 1 shows participants’ flow from screening to 3-months follow-up during the study. We screened 57 patients between November 29, 2011 and November 18, 2015, and the final 3-month follow-up was done on May 4, 2016. Of these 57 patients, 12% (7/57) did not meet the inclusion criteria and 18% (10/57) declined to participate. Therefore, 70% (40/57) eligible patients who agreed to participate and completed baseline assessments were randomized either to the blended CBT (n=20) or waiting list (n=20) group. There were no dropouts from the study, and all participants allocated to the blended CBT group completed the follow-up assessment.

    Table 1 summarizes the sociodemographic and clinical characteristics of participants at the baseline. The mean age of participants was 40.2 (SD 9.8) years, and the percentage of males was 50% (20/40). Furthermore, 68% (27/40) participants had received one course of antidepressant medication and 33% (13/40) had received 2 courses before study entry. None of the participants had received >3 courses of antidepressant medication before study entry.

    Tables 2 and 3 show treatment engagement by the study groups.

    ‎
    Figure 1. The Consolidated Standards of Reporting Trials diagram of participants’ flow through the study. CBT: cognitive behavioral therapy.
    View this figure
    Table 1. Characteristics of participants at the baseline.
    CharacteristicBlended CBTa (n=20)Waiting list (n=20)Total (n=40)
    Age (years), mean (SD)39.7 (9.4)40.6 (10.2)40.2 (9.7)
    Male, n (%)10 (50)10 (50)20 (50)
    Education (years), mean (SD)15.4 (1.9)15.6 (2.6)15.4 (2.2)
    Unemployed, n (%)3 (15)4 (20)7 (18)
    Marital status, n (%)

    		Married8 (40)10 (50)18 (45)

    		Separated, divorced, or widowed2 (10)0 (0)2 (5)

    		Single (never married)10 (50)10 (50)20 (50)
    Cohabiting, n (%)14 (70)16 (80)30 (75)
    Number of lifetime depression episodes, mean (SD)1.5 (0.6)1.7 (1.4)1.6 (1.1)
    History of psychiatric hospitalization, n (%)1 (5)3 (15)4 (10)
    Prior suicide attempt, n (%)1 (5)1 (5)2 (5)
    Self-reported childhood abuse, n (%)2 (10)5 (25)7 (18)
    Self-reported victims of childhood bullying, n (%)5 (25)3 (15)8 (20)
    Family history of psychiatric disorders, n (%)7 (35)5 (25)12 (30)
    Duration of index depression episode (months), mean (SD)27.3 (29.8)20.3 (32.3)23.8 (30.9)
    Particulars of index episode (DSM-IVb), n (%)

    		Chronic (≥2 years of index episode)8 (40)4 (20)12 (30)

    		Melancholic features12 (60)11 (55)23 (58)

    		Atypical features0 (0)0 (0)0 (0)
    Comorbid DSM-IV Axis I diagnoses, n (%)

    		Any anxiety disorder1 (5)5 (25)6 (15)

    		Panic disorder (with or without agoraphobia)0 (0)2 (10)2 (5)

    		Social anxiety disorder1 (5)1 (5)2 (5)

    		Obsessive compulsive disorder0 (0)0 (0)0 (0)

    		Generalized anxiety disorder0 (0)0 (0)0 (0)

    		Dysthymic disorder0 (0)0 (0)0 (0)
    Number of prior courses of antidepressant treatment, n (%)

    		1-2 courses15 (75)15 (75)30 (75)

    		3-4 courses2 (10)3 (15)5 (13)

    		5-6 courses2 (10)1 (5)3 (8)

    		7-10 courses1 (5)0 (0)1 (3)

    		>10 courses0 (0)1 (5)1 (3)
    Number of antidepressant medications prescribed at baseline, n (%)

    		1 medication14 (70)13 (65)27 (67.5)

    		≥2 medications6 (30)7 (35)13 (32.5)
    Health-related quality of life, mean (SD)

    		European Quality of Life Questionnaire 5-dimension, mean (SD)0.7 (0.1)0.8 (0.1)0.7 (0.1)
    Depression severity

    		17-item GRID-Hamilton Depression Rating Scale score, mean (SD)18.3 (3.7)18.5 (3.6)18.4 (3.6)

    		Beck Depression Inventory-Second Edition score, mean (SD)28 (8.8)24.4 (7.8)26.2 (8.4)

    		Quick Inventory of Depressive Symptomatology Self-Report score, mean (SD)14.8 (4.2)13.5 (4)14.1 (4.1)

    aCBT: cognitive behavioral therapy.

    bDSM-IV: Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition.

    Table 2. Treatment engagement of the study group (n=20).
    Treatment engagementValue
    Mean number of blended CBTa sessions attended, mean (SD)11.65 (2.32)
    Completion rate of the full course of blended CBT sessions (n of blended CBT completers/n of blended CBT participants), n (%)20 (100)
    Mean duration of face-to-face-CBT sessions (minutes), mean (SD)44.3 (6.85)
    Mean duration of medication visits (minutes, over 12-weeks), mean (SD)11.6 (2.3)

    aCBT: cognitive behavioral therapy.

    Table 3. Treatment engagement of the groups.
    Treatment engagementBlended CBTa (n=20)Waiting list (n=20)P valueb
    Mean medication compliance over 12-weeks, treatment and medication compliance data scale self-report, n (%)19 (97)19 (96).67
    Number of medication visits over 12-weeks, mean (SD)8 (1)7 (1).37
    Mean antidepressant medication dose at baseline and 12 weeks, mean (SD)

    		0 week (baseline)1.39 (0.58)1.31 (0.75).74

    		12 weeks1.21 (0.68)1.31 (0.75).67
    Changes in antidepressant prescription by the end of the 12-week intervention period, n (%)

    		No change14 (70)10 (50).20

    		Switched to another antidepressant2 (10)1 (5)>.99

    		Increased antidepressant dose1 (5)1 (5)>.99

    		Combined another antidepressant1 (5)3 (15).61

    		Decreased0 (0)3 (15).23

    		Stopped antidepressant2 (10)2 (10)>.99

    aCBT: cognitive behavioral therapy.

    bP values are for t test for continuous outcomes and chi-square test for categorical outcomes.

    All participants allocated to the blended CBT group completed the full program course (defined as attending at least 8 sessions). The therapist adherence (yes or no) to the CBT treatment protocol was at high level—100% (n/allocators=20/20) for behavioral activation component, 90% (18/20) for cognitive reconstruction component, and 85% (17/20) for problem-solving component. In terms of the medication management, the mean daily dose of antidepressant medications was comparable at each assessment point between the groups, and no significant dose changes were observed during the 12-week interventional period. Selective serotonin reuptake inhibitors were the most common antidepressant medication prescribed at the baseline, 35% (14/40) participants (Multimedia Appendix 4). There were no differences in the number of medical visits between the groups.

    Participants in the blended CBT group had significantly alleviated depressive symptoms after 12 weeks, as shown by greater LS mean changes in the GRID-HAMD score compared with that in the waiting list group (−8.9 points vs −3.0 points; mean between-group difference=−5.95; 95% CI −9.53 to −2.37; P=.0002; Cohen d=1.0; Figure 2). Figure 2 shows LS mean changes and their 95% CIs in the GRID-HAMD total scores over time estimated with a MMRM analysis; error bars indicate 95% CIs. In addition, the follow-up effects showed that the GRID-HAMD score at 3-month follow-up had improved significantly compared with the GRID-HAMD score after 12 weeks: 9.4 (SD 5.2) vs 7.2 (SD 5.7); P=.009. Of note, no significant treatment effect was observed after 6 weeks (P=.25).

    ‎
    Figure 2. Least squares mean change in the 17-item GRID-Hamilton Depression Rating Scale (GRID-HAMD) score over time in participants allocated to the blended cognitive behavioral therapy (CBT) group or waiting list group.
    View this figure

    Tables 4 and 5 summarize the secondary outcome measures. Participants allocated to the blended CBT group were 2.8 times more likely to have a treatment response at the posttreatment (12 weeks) assessment than those in the waiting list group (RR, 2.75; 95% CI 1.05-7.20), resulting in an NNT of 3 (95% CI 1.6-14.2). In addition, the blended CBT group demonstrated achievement of significant remission at the posttreatment assessment (12 weeks; RR, 8.00, 95% CI 1.10-58.19; NNT: 3, 95% CI 1.7-8.7). Although the blended CBT group participants had milder depressive symptoms, as measured by the BDI, than the participants of the waiting-list group over the intervention period, differences were not statistically significant at each assessment point. There were no statistically significant differences between the groups in the intensity of depressogenic schemata, as assessed by the DAS-24, and in the quality-of-life status, as assessed by the 36-Item Short-Form Health Survey, mental and physical subscales, and the European Quality of Life Questionnaire-5 Dimensions, over the study period. Of note, none of the participants experienced serious adverse events during the intervention period.

    Table 4. Summary of repeated measures analyses of outcomes: treatment response and remission (intention-to-treat population).
    Timepoint of achieving response or remissionBlended CBTa (n=20), n (%)Waiting list (n=20), n (%)Comparison



    		Relative risks (95% CI)P value
    Response (≥50% reduction in 17-item GRID-HAMDb)

    		6 weeks2 (10)2 (10)1.00 (0.16 to 6.42)>.99

    		12 weeks11 (55)4 (20)2.75 (1.05 to 7.20).04

    		24 weeks (3-month follow-up) only CBT15 (75)N/AcN/AN/A
    Remission (GRID-HAMD≤7)

    		6 weeks2 (10)1 (5)2.00 (0.20 to 20.33).56

    		12 weeks8 (40)1 (5)8.00 (1.10 to 58.19).04

    		24 weeks (3-month follow-up) only CBT13 (65)N/AN/AN/A
    Response (≥50% reduction in QIDSd)

    		6 weeks12 (60)6 (30)2.00 (0.94 to −4.27).07

    		12 weeks9 (45)3 (15)3.00 (0.95 to −9.48).06

    		24 weeks (3-month follow-up) only CBT14 (70)N/AN/AN/A
    Remission (QIDS≤5)

    		6 weeks6 (30)4 (20)1.50
    (0.20 to −20.33)    		.56

    		12 weeks6 (30)3 (15)2.00 (0.58 to −6.91).27

    		24 weeks (3-month follow-up) only CBT11 (55)N/AN/AN/A
    Response (≥50% reduction in BDIe)

    		6 weeks3 (15)2 (10)1.50 (0.28 to −8.04).64

    		12 weeks7 (35)3 (15)2.33 (0.70 to −7.76).17

    		24 weeks (3-month follow-up) only CBT10 (50)N/AN/AN/A
    Remission (BDI≤13)

    		6 weeks4 (20)5 (25)0.80 (0.25 to −2.55).71

    		12 weeks8 (40)5 (25)1.60 (0.63 to −4.05).32

    		24 weeks (3-month follow-up) only CBT10 (50)N/AN/AN/A

    aCBT: cognitive behavioral therapy.

    bGRID-HAM: GRID-Hamilton Depression Rating Scale.

    cN/A: not applicable.

    dQIDS: Quick Inventory of Depressive Symptomatology.

    eBDI: Beck Depression Inventory-Second Edition.

    Table 5. Summary of repeated measures analyses of outcomes: participant-rated measures (intention-to-treat population).
    Participant-rated measuresBlended CBTa, mean (SD)Waiting list, mean (SD)Difference in mean change scoresb,c (95% CI)P value
    17-item GRID-Hamilton Depression Rating Scale score

    		0 week (baseline)18.3 (3.6)18.5 (3.6)N/AdN/A

    		6 weeks14.0 (5.7)16.1 (4.7)1.90 (−1.46 to 5.26).26

    		12 weeks9.4 (5.1)15.5 (6.3)5.95 (2.37 to 9.53).002

    		24 weeks (3-month follow-up) only CBT7.2 (5.7)N/AN/AN/A
    Beck Depression Inventory-Second Edition score

    		0 week (baseline)28.0 (8.6)24.4 (7.6)N/AN/A

    		6 weeks23.4 (11.2)20.1 (8.2)0.35 (−4.63 to 5.33).89

    		12 weeks18.5 (12.3)20.8 (9.1)5.85 (−0.27 to 11.97).06

    		24 weeks (3-month follow-up) only CBT14.7 (12.5)N/AN/AN/A
    Quick Inventory of Depressive Symptomatology Self-Report score

    		0 week (baseline)14.8 (4.0)13.5 (3.9)N/AN/A

    		6 weeks7.9 (3.7)8.7 (3.8)2.20 (−0.66 to 5.06).13

    		12 weeks8.0 (4.7)10.2 (4.2)3.55 (0.53 to 6.57).02

    		24 weeks (3-month follow-up) only CBT6.8 (5.5)N/AN/AN/A
    Dysfunctional attitude scale score

    		0 week (baseline)97.1 (19.0)87.6 (17.1)N/AN/A

    		6 weeks97.4 (19.2)86.1 (17.8)−1.80 (−9.23 to 5.63).63

    		12 weeks92.4 (23.6)84.9 (18.5)2.05 (−6.82 to 10.92).64

    		24 weeks (3-month follow-up) only CBT83.4 (21.8)N/AN/AN/A
    European Quality of Life Questionnaire-5 Dimensions score

    		0 week (baseline)0.7 (0.1)0.7 (0.1)N/AN/A

    		6 weeks0.8 (0.1)0.8 (0.1)−0.04 (−0.12 to 0.04).29

    		12 weeks0.8 (0.1)0.8 (0.1)−0.07 (−0.16 to 0.01).08

    		24 weeks (3-month follow-up) only CBT0.8 (0.1)N/AN/AN/A
    36-item Short-Form Health Survey (SF-36) mental component summary score

    		0 week (baseline)37.7 (10.6)37.8 (7.7)N/AN/A

    		6 weeks39.5 (9.7)41.6 (8.3)1.96 (−3.45 to 7.37).47

    		12 weeks43.9 (10.2)41.3 (7.9)−2.70 (−8.91 to 3.50).38

    		24 weeks (3-month follow-up) only CBT44.6 (11.1)N/AN/AN/A
    SF-36 physical component summary score

    		0 week (baseline)52.8 (11.2)51.7 (10.8)N/AN/A

    		6 weeks50.8 (11.0)53.5 (7.4)3.87 (−1.90 to 9.64).18

    		12 weeks49.4 (13.5)53.4 (10.6)5.04 (−2.81 to 12.89).20

    		24 weeks (3-month follow-up) only CBT52.8 (9.6)N/AN/AN/A

    aCBT: cognitive behavioral therapy.

    bThe difference in the mean change in scores is the intergroup difference in the least squares mean treatment change score from the baseline to the data point, from the mixed-effects model for repeated measures analysis.

    cThe intergroup difference is the CBT group value minus the waiting list group value.

    dN/A: not applicable.


    This study tested the effectiveness of the blended CBT program in patients with major depression who did not respond to antidepressant treatment after taking ≥1 antidepressant medications at adequate doses for ≥6 weeks, compared with waiting list control conditions. The between-group effect size after blended CBT was large (Cohen d=1.0), and these results were similar to Wright et al’s blended CBT trial using waiting list controls (Cohen d=1.14) [19]. In addition, we were able to reduce the therapist contact time by about two-thirds compared with the standard CBT protocol. Furthermore, we focused on patients who were unresponsive to antidepressant medications.

    There are several possible reasons for the high level of treatment protocol adherence with no dropouts with the blended CBT program in this study. First, the program had a blended format rather than a stand-alone Web-based CBT program. Patients might have developed a stronger treatment engagement through the therapist-delivered session because of tailoring the program according to patient-specific needs and may have gained mastery of CBT skills by accessing the interactive Web-based program. Second, owing to the shortage of trained therapists [49] and insufficient health insurance coverage of CBT sessions in Japan (health insurance does not cover CBT sessions delivered by psychologists), participants may have had strong expectations from CBT. Dunlop et al reported that patients matched to their preferred treatment could achieve a higher rate of treatment completion than those who were mismatched [50].

    Significant alleviation of depressive symptoms was found in the assessment of primary (GRID-HAMD) and secondary outcome measures of depressive symptoms (QIDS). Furthermore, the remission rate (8/20, 40%) as measured by the GRID-HAMD was similar to that reported by Thase et al [20]. In contrast to their findings, our study did not show significant differences in self-reported depressive symptomatology, as measured by the BDI and DAS-24, between the groups. As this study was powered to detect the effectiveness based on the primary outcome measure, it is possible that these secondary outcome measures were underpowered. In addition, the BDI and DAS-24 baseline scores of our sample were lower than those reported by Thase et al [20], which could have been because of a floor effect.

    Our blended CBT program has a unique format, integrating Web-based and offline components back to back. Patients engage themselves in a self-directed Web-based learning module, such as by reading psychoeducational columns and watching video clips, before coming to the face-to-face session. Moreover, in the subsequent face-to-face session, patients assimilate and apply what they have learned in the Web-based component to reinforce mastery of CBT skills. Thus, this blended format appears to correspond with the newer educational system, known as “blend learning” or “inverted classroom,” which is reported to be more effective than purely face-to-face or purely Web-based classes [51]. In addition, this blended format is perhaps promising for trainee therapists. With the Web-based assistance, therapists can deliver CBT techniques with more confidence, despite little experience. In fact, studies have shown that computer-assisted training is effective in training clinicians in empirically supported manual-guided therapies [52,53].

    This study has several limitations. First, this study used waiting list controls rather than active controls. The use of the waiting list group could have provoked nocebo effects [54,55]. However, all our participants allocated to the waiting list group continued their usual treatment with their psychiatrists, and the course of depression symptoms was similar to the course of patients receiving psychiatric care [25]. Second, the benefits of blended CBT observed in this study cannot be solely attributed to the intervention because there was no treatment control. In other words, nonspecific treatment effects, such as patient expectations, may also account for the observed efficacy of the intervention. Nevertheless, this study aimed to examine the effectiveness of blended CBT rather than evaluating the effects of blended CBT itself. The third possible limitation is that this study was of relatively small size, although the number of participants exceeded that required for power analysis. Fourth, participants were recruited from 3 sites with a zero dropout rate, suggesting a cohort of highly motivated treatment-seeking patients, which may limit generalizability. Finally, there was no control group during the follow-up phase. Hence, a sustained effect during this phase cannot be attributed with certainty to the effects of acute therapy with our blended CBT program.

    In conclusion, this study suggests that our blended CBT program was effective in reducing depressive symptoms in patients with major depression compared with waiting list controls. Additional research is now needed to replicate our results with larger sample size, longer observation period, and using active controls before definite conclusions can be drawn.

    Acknowledgments

    This study was funded by the Intramural Research Grant (24-4, 27-3) for Neurological and Psychiatric Disorders, National Center of Neurology and Psychiatry. The funders had no role in the design and conduct of the study, collection, management, analysis, and interpretation of the data, preparation, review, or approval of the manuscript, and decision to submit the manuscript for publication.

    Authors' Contributions

    YO and AN conceived and designed the study and drafted the initial study protocol. SN refined the study protocol. AN drafted the grant proposal, organized study implementation, and conducted the study. DM managed study monitoring, including data collection, and liaised with the recruitment sites. YO provided cognitive behavioral therapy expertise, and AN supervised the therapists. MH, SI, and MM are the directors of the 3 study sites and provided onsite study management. SN, AN, and TA conducted the statistical analyses. SN drafted the manuscript.

    Conflicts of Interest

    AN has received royalties from Igaku-Shoin and Kongo-Shuppan publishers. YO is the developer or sponsor of the Kokoro-no-Skill-up-training program and has received royalties from Seiwa-Shoten, Igaku-Shoin, and Kongo-Shuppan publishers. MM has received grants and speaker’s honoraria from Daiichi Sankyo, Dainippon-Sumitomo Pharma, Eisai, Eli Lilly, Fuji Film RI Pharma, Janssen Pharmaceutical, Mochida Pharmaceutical, MSD, Nippon Chemipher, Novartis Pharma, Ono Yakuhin, Otsuka Pharmaceutical, Pfizer, Takeda Yakuhin, Tsumura, and Yoshitomi Yakuhin. All the other authors declare that they have no conflicts of interest.

    ‎

    Multimedia Appendix 1

    Modes of delivery of computerized cognitive behavioral therapy.

    PDF File (Adobe PDF File), 50KB
    ‎

    Multimedia Appendix 2

    Overview of the blended cognitive behavioral therapy (CBT) program.

    PPTX File, 3MB
    ‎

    Multimedia Appendix 3

    The framework of the 12-week web-based cognitive behavioral therapy blended with face-to-face sessions for major depression.

    PDF File (Adobe PDF File), 27KB
    ‎

    Multimedia Appendix 4

    Type and dose of antidepressant medication prescribed at baseline.

    PDF File (Adobe PDF File), 23KB
    ‎

    Multimedia Appendix 5

    CONSORT‐EHEALTH checklist (V 1.6.1).

    PDF File (Adobe PDF File), 3MB
    1. World Health Organization. Depression   URL: http://www.who.int/mediacentre/factsheets/fs369/en/ [WebCite Cache]
    2. Murray CJL, Vos T, Lozano R, Naghavi M, Flaxman AD, Michaud C, et al. Disability-adjusted life years (DALYs) for 291 diseases and injuries in 21 regions, 1990-2010: a systematic analysis for the Global Burden of Disease Study 2010. Lancet 2012 Dec 15;380(9859):2197-2223. [CrossRef] [Medline]
    3. Mathers CD, Loncar D. Projections of global mortality and burden of disease from 2002 to 2030. PLoS Med 2006 Nov;3(11):e442 [FREE Full text] [CrossRef] [Medline]
    4. Cuijpers P, van SA, van OP, Andersson G. Are psychological and pharmacologic interventions equally effective in the treatment of adult depressive disorders? A meta-analysis of comparative studies. J Clin Psychiatry 2008 Nov;69(11):1675-85; quiz 1839. [Medline]
    5. Weitz ES, Hollon SD, Twisk J, van SA, Huibers MJH, David D, et al. Baseline Depression Severity as Moderator of Depression Outcomes Between Cognitive Behavioral Therapy vs Pharmacotherapy: An Individual Patient Data Meta-analysis. JAMA Psychiatry 2015 Nov;72(11):1102-1109. [CrossRef] [Medline]
    6. Vittengl JR, Clark LA, Dunn TW, Jarrett RB. Reducing relapse and recurrence in unipolar depression: a comparative meta-analysis of cognitive-behavioral therapy's effects. J Consult Clin Psychol 2007 Jun;75(3):475-488 [FREE Full text] [CrossRef] [Medline]
    7. Biesheuvel-Leliefeld KEM, Kok GD, Bockting CLH, Cuijpers P, Hollon SD, van MHWJ, et al. Effectiveness of psychological interventions in preventing recurrence of depressive disorder: meta-analysis and meta-regression. J Affect Disord 2015 Mar 15;174:400-410. [CrossRef] [Medline]
    8. Raue PJ, Schulberg HC, Heo M, Klimstra S, Bruce ML. Patients' depression treatment preferences and initiation, adherence, and outcome: a randomized primary care study. Psychiatr Serv 2009 Mar;60(3):337-343 [FREE Full text] [CrossRef] [Medline]
    9. McHugh RK, Whitton SW, Peckham AD, Welge JA, Otto MW. Patient preference for psychological vs pharmacologic treatment of psychiatric disorders: a meta-analytic review. J Clin Psychiatry 2013 Jun;74(6):595-602 [FREE Full text] [CrossRef] [Medline]
    10. Kaltenthaler E, Sutcliffe P, Parry G, Beverley C, Rees A, Ferriter M. The acceptability to patients of computerized cognitive behaviour therapy for depression: a systematic review. Psychol Med 2008 Nov;38(11):1521-1530. [CrossRef] [Medline]
    11. Clark DM. Implementing NICE guidelines for the psychological treatment of depression and anxiety disorders: the IAPT experience. Int Rev Psychiatry 2011 Aug;23(4):318-327 [FREE Full text] [CrossRef] [Medline]
    12. So M, Yamaguchi S, Hashimoto S, Sado M, Furukawa TA, McCrone P. Is computerised CBT really helpful for adult depression?-A meta-analytic re-evaluation of CCBT for adult depression in terms of clinical implementation and methodological validity. BMC Psychiatry 2013;13:113 [FREE Full text] [CrossRef] [Medline]
    13. Rozental A, Magnusson K, Boettcher J, Andersson G, Carlbring P. For better or worse: An individual patient data meta-analysis of deterioration among participants receiving Internet-based cognitive behavior therapy. J Consult Clin Psychol 2017 Feb;85(2):160-177. [CrossRef] [Medline]
    14. Gilbody S, Littlewood E, Hewitt C, Brierley G, Tharmanathan P, Araya R, et al. Computerised cognitive behaviour therapy (cCBT) as treatment for depression in primary care (REEACT trial): large scale pragmatic randomised controlled trial. BMJ 2015;351:h5627 [FREE Full text] [Medline]
    15. Wentzel J, van DVR, Bohlmeijer ET, van GJEWC. Mixing Online and Face-to-Face Therapy: How to Benefit From Blended Care in Mental Health Care. JMIR Ment Health 2016;3(1):e9 [FREE Full text] [CrossRef] [Medline]
    16. Kooistra LC, Wiersma JE, Ruwaard J, van OP, Smit F, Lokkerbol J, et al. Blended vs. face-to-face cognitive behavioural treatment for major depression in specialized mental health care: study protocol of a randomized controlled cost-effectiveness trial. BMC Psychiatry 2014 Oct 18;14:290 [FREE Full text] [CrossRef] [Medline]
    17. Beattie A, Shaw A, Kaur S, Kessler D. Primary-care patients' expectations and experiences of online cognitive behavioural therapy for depression: a qualitative study. Health Expect 2009 Mar;12(1):45-59. [CrossRef] [Medline]
    18. van der Vaart R, Witting M, Riper H, Kooistra L, Bohlmeijer ET, van Gemert-Pijnen L. Blending online therapy into regular face-to-face therapy for depression: content, ratio and preconditions according to patients and therapists using a Delphi study. BMC Psychiatry 2014;14(1):355 [FREE Full text] [CrossRef] [Medline]
    19. Wright JH, Wright AS, Albano AM, Basco MR, Goldsmith LJ, Raffield T, et al. Computer-assisted cognitive therapy for depression: maintaining efficacy while reducing therapist time. Am J Psychiatry 2005 Jun;162(6):1158-1164. [CrossRef] [Medline]
    20. Thase ME, Wright JH, Eells TD, Barrett MS, Wisniewski SR, Balasubramani GK, et al. Improving the Efficiency of Psychotherapy for Depression: Computer-Assisted Versus Standard CBT. Am J Psychiatry 2018 Mar 01;175(3):242-250. [CrossRef] [Medline]
    21. Oguchi Y. Cognitive Behavior Therapy by internet or telephone. Japanese Journal of Psychiatric Treatment 2015;30(5):674-677.
    22. Kimura R, Mori M, Tajima M, Somemura H, Sasaki N, Yamamoto M, et al. Effect of a brief training program based on cognitive behavioral therapy in improving work performance: A randomized controlled trial. J Occup Health 2015;57(2):169-178 [FREE Full text] [CrossRef] [Medline]
    23. Sekizaki R, Nemoto T, Tsujino N, Takano C, Yoshida C, Yamaguchi T, et al. School mental healthcare services using internet-based cognitive behaviour therapy for young male athletes in Japan. Early Interv Psychiatry 2017 Jun 14:1-7. [CrossRef] [Medline]
    24. Paykel ES, Ramana R, Cooper Z, Hayhurst H, Kerr J, Barocka A. Residual symptoms after partial remission: an important outcome in depression. Psychol Med 1995 Nov;25(6):1171-1180. [Medline]
    25. Trivedi MH, Rush AJ, Wisniewski SR, Nierenberg AA, Warden D, Ritz L, et al. Evaluation of outcomes with citalopram for depression using measurement-based care in STAR*D: implications for clinical practice. Am J Psychiatry 2006 Jan;163(1):28-40. [CrossRef] [Medline]
    26. Cuijpers P, Dekker J, Hollon SD, Andersson G. Adding psychotherapy to pharmacotherapy in the treatment of depressive disorders in adults: a meta-analysis. J Clin Psychiatry 2009 Sep;70(9):1219-1229. [CrossRef] [Medline]
    27. Cuijpers P, Sijbrandij M, Koole SL, Andersson G, Beekman AT, Reynolds CF. Adding psychotherapy to antidepressant medication in depression and anxiety disorders: a meta-analysis. World Psychiatry 2014 Feb;13(1):56-67 [FREE Full text] [CrossRef] [Medline]
    28. Eysenbach G, CONSORT-EHEALTH Group. CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. J Med Internet Res 2011;13(4):e126 [FREE Full text] [CrossRef] [Medline]
    29. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, 4th edition. Washington, DC: American Psychiatric Association; 1994:A.
    30. First M, Spitzer R, Gibbon M. Structured Clinical Interview for DSM-IV-TR Axis I Disorders. New York, NY: Biometrics Research Department; 1997.
    31. Williams JBW, Kobak KA, Bech P, Engelhardt N, Evans K, Lipsitz J, et al. The GRID-HAMD: standardization of the Hamilton Depression Rating Scale. Int Clin Psychopharmacol 2008 May;23(3):120-129. [CrossRef] [Medline]
    32. Tabuse H, Kalali A, Azuma H, Ozaki N, Iwata N, Naitoh H, et al. The new GRID Hamilton Rating Scale for Depression demonstrates excellent inter-rater reliability for inexperienced and experienced raters before and after training. Psychiatry Res 2007 Sep 30;153(1):61-67. [CrossRef] [Medline]
    33. Weed LL. Medical records that guide and teach. N Engl J Med 1968 Mar 21;278(12):652-7 concl. [CrossRef] [Medline]
    34. Otsubo T, Tanaka K, Koda R, Shinoda J, Sano N, Tanaka S, et al. Reliability and validity of Japanese version of the Mini-International Neuropsychiatric Interview. Psychiatry Clin Neurosci 2005 Oct;59(5):517-526 [FREE Full text] [CrossRef] [Medline]
    35. Ministry OH, LabourWelfare. Cognitive therapy? Cognitive behavioral therapy for depression Treatment manual for therapist. Japan: Ministry of Health, Labour and Welfare; 2009.   URL: http://www.mhlw.go.jp/bunya/shougaihoken/kokoro/dl/01.pdf [WebCite Cache]
    36. Rush AJ, Trivedi MH, Ibrahim HM, Carmody TJ, Arnow B, Klein DN, et al. The 16-Item Quick Inventory of Depressive Symptomatology (QIDS), clinician rating (QIDS-C), and self-report (QIDS-SR): a psychometric evaluation in patients with chronic major depression. Biol Psychiatry 2003 Sep 01;54(5):573-583. [Medline]
    37. Fujisawa D, Nakagawa A, Tajima M, Sado M, Kikuchi T, Ono Y. Development of the Japanese version of Quick Inventory of Depressive Symptomatology Self-Reported (QIDS-SR16-J) (in Japanese). Stress science 2010;25:43-52.
    38. American Psychiatric Association. Practice guideline for the treatment of patients with major depressive disorder. 3rd ed. Washington, DC: American Psychiatric Association; 2010.   URL: https://psychiatryonline.org/pb/assets/raw/sitewide/practice_guidelines/guidelines/mdd.pdf [WebCite Cache]
    39. Beck A, Steer R, Brown G. Manual for the Beck Depression Inventory-II (BDI-II). San Antonio: Psychological Corporation; 1996.
    40. Kojima M, Furukawa TA, Takahashi H, Kawai M, Nagaya T, Tokudome S. Cross-cultural validation of the Beck Depression Inventory-II in Japan. Psychiatry Res 2002 Jul 31;110(3):291-299. [Medline]
    41. Power MJ, Duggan CF, Lee AS, Murray RM. Dysfunctional attitudes in depressed and recovered depressed patients and their first-degree relatives. Psychol Med 1995 Jan;25(1):87-93. [Medline]
    42. Tajima M, Akiyama T, Numa H, Kawamura Y, Okada Y, Sakai Y, et al. Reliability and validity of the Japanese version of the 24-item Dysfunctional Attitude Scale. Acta Neuropsychiatr 2007 Dec;19(6):362-367. [CrossRef] [Medline]
    43. Brazier JE, Harper R, Jones NM, O'Cathain A, Thomas KJ, Usherwood T, et al. Validating the SF-36 health survey questionnaire: new outcome measure for primary care. BMJ 1992 Jul 18;305(6846):160-164 [FREE Full text] [Medline]
    44. Fukuhara S, Ware JE, Kosinski M, Wada S, Gandek B. Psychometric and clinical tests of validity of the Japanese SF-36 Health Survey. J Clin Epidemiol 1998 Nov;51(11):1045-1053. [Medline]
    45. EuroQol G. EuroQol--a new facility for the measurement of health-related quality of life. Health Policy 1990 Dec;16(3):199-208. [Medline]
    46. Fukuhara S, Ikegami N, Torrance GW, Nishimura S, Drummond M, Schubert F. The development and use of quality-of-life measures to evaluate health outcomes in Japan. Pharmacoeconomics 2002;20 Suppl 2:17-23. [Medline]
    47. World Health Organization. Guidelines for ATC Classification and DDD Assignment. WHO Collaborationg Center for Drug Statistics Methodology. Geneva: World Health Organization; 2018.   URL: https://www.whocc.no/filearchive/publications/guidelines.pdf [accessed 2018-04-09] [WebCite Cache]
    48. Cohen J. Statistical power analysis for the behavioural sciences. Hillside, NJ: Lawrence Earlbaum Associates. ISBN080580 1988:2835.
    49. Ono Y, Furukawa TA, Shimizu E, Okamoto Y, Nakagawa A, Fujisawa D, et al. Current status of research on cognitive therapy/cognitive behavior therapy in Japan. Psychiatry Clin Neurosci 2011 Mar;65(2):121-129 [FREE Full text] [CrossRef] [Medline]
    50. Dunlop BW, Kelley ME, Aponte-Rivera V, Mletzko-Crowe T, Kinkead B, Ritchie JC, PReDICT Team. Effects of Patient Preferences on Outcomes in the Predictors of Remission in Depression to Individual and Combined Treatments (PReDICT) Study. Am J Psychiatry 2017 Dec 01;174(6):546-556. [CrossRef] [Medline]
    51. Bhugra D, Tasman A, Pathare S, Priebe S, Smith S, Torous J, et al. The WPA-Lancet Psychiatry Commission on the Future of Psychiatry. Lancet Psychiatry 2017 Oct;4(10):775-818. [CrossRef] [Medline]
    52. Sholomskas DE, Syracuse-Siewert G, Rounsaville BJ, Ball SA, Nuro KF, Carroll KM. We don't train in vain: a dissemination trial of three strategies of training clinicians in cognitive-behavioral therapy. J Consult Clin Psychol 2005 Feb;73(1):106-115 [FREE Full text] [CrossRef] [Medline]
    53. Sholomskas DE, Carroll KM. One small step for manuals: Computer-assisted training in twelve-step facilitation. J Stud Alcohol 2006 Nov;67(6):939-945 [FREE Full text] [Medline]
    54. Mohr DC, Spring B, Freedland KE, Beckner V, Arean P, Hollon SD, et al. The selection and design of control conditions for randomized controlled trials of psychological interventions. Psychother Psychosom 2009;78(5):275-284. [CrossRef] [Medline]
    55. Furukawa TA, Noma H, Caldwell DM, Honyashiki M, Shinohara K, Imai H, et al. Waiting list may be a nocebo condition in psychotherapy trials: a contribution from network meta-analysis. Acta Psychiatr Scand 2014 Sep;130(3):181-192. [CrossRef] [Medline]

    ‎
    BDI: Beck Depression Inventory-Second Edition
    CBT: cognitive behavioral therapy
    DAS: dysfunctional attitude scale
    DSM-IV: Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition
    GRID-HAMD: GRID-Hamilton Depression Rating Scale
    LS: least squares
    MMRM: mixed-effects model for repeated measures
    NNT: number needed to treat
    QIDS: Quick Inventory of Depressive Symptomatology Self-Report
    RR: relative risk

    Edited by G Eysenbach; submitted 11.04.18; peer-reviewed by M Ito; comments to author 19.06.18; revised version received 02.08.18; accepted 14.08.18; published 21.09.18

    Copyright

    ©Shigetsugu Nakao, Atsuo Nakagawa, Yoshiyo Oguchi, Dai Mitsuda, Noriko Kato, Yuko Nakagawa, Noriko Tamura, Yuka Kudo, Takayuki Abe, Mitsunori Hiyama, Satoru Iwashita, Yutaka Ono, Masaru Mimura. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 21.09.2018.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.