Published on in Vol 21, No 1 (2019): January

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/12530, first published .
Internet-Delivered Acceptance and Commitment Therapy for Anxiety Treatment: Systematic Review

Internet-Delivered Acceptance and Commitment Therapy for Anxiety Treatment: Systematic Review

Internet-Delivered Acceptance and Commitment Therapy for Anxiety Treatment: Systematic Review

Review

Cyberpsychology Research Group, Faculty of Health Sciences, The University of Sydney, Sydney, Australia

Corresponding Author:

Joshua Kelson, PhD

Cyberpsychology Research Group

Faculty of Health Sciences

The University of Sydney

City Road

Sydney, 2006

Australia

Phone: 61 2 9351 7089

Email: joshnkelson@gmail.com


Background: Anxiety conditions are debilitating and prevalent throughout the world. Acceptance and Commitment Therapy (ACT) is an effective, acceptance-based behavioral therapy for anxiety. However, there are treatment barriers (eg, financial, geographical, and attitudinal), which prevent people from accessing it. To overcome these barriers, internet-delivered ACT (iACT) interventions have been developed in recent years. These interventions use websites to deliver ACT information and skill training exercises on the Web, either as pure self-help or with therapist guidance.

Objective: This systematic review aimed to examine the therapeutic impact of iACT on all anxiety conditions.

Methods: The EMBASE, MEDLINE, ProQuest Central, PsycINFO, Scopus, and Web of Science databases were searched up to September 2018. The titles and abstracts of remaining records after deduplication were screened by 2 authors with a total of 36 full-text articles being retained for closer inspection next to eligibility criteria. Empirical studies of all designs, population types, and comparator groups were included if they appraised the impact of iACT treatment on any standardized measure of anxiety. Included studies were appraised on methodological quality and had their data extracted into a standardized coding sheet. Findings were then tabulated, and a narrative synthesis was performed because of the heterogeneity found between studies.

Results: A total of 20 studies met inclusion criteria. There were 11 randomized controlled trials (RCTs) and 9 uncontrolled pilot studies. Participants across all studies were adults. The anxiety conditions treated were as follows: generalized anxiety disorder (GAD), social anxiety disorder (SAD), illness anxiety disorder (IAD), and general anxiety symptoms, with or without comorbid physical and mental health problems. A total of 18 studies reported significant anxiety reduction after iACT treatment. This was observed in studies that delivered iACT with (n=13) or without (n=5) therapist guidance. The average attrition rate across all included studies during the active iACT treatment phase was 19.19%. In the 13 studies that assessed treatment satisfaction, participants on average rated their iACT experience with above average to high treatment satisfaction.

Conclusions: These findings indicate that iACT can be an efficacious and acceptable treatment for adults with GAD and general anxiety symptoms. More RCT studies are needed to corroborate these early iACT findings using empirical treatments in active control groups (eg, internet-delivered cognitive behavioral therapy). This would potentially validate the promising results found for SAD and IAD as well as address the full spectrum of anxiety disorders.

J Med Internet Res 2019;21(1):e12530

doi:10.2196/12530

Keywords



Background

Anxiety and its related conditions are highly prevalent on a global scale [1]. The Diagnostic and Statistical Manual of Mental Disorders-Fifth Edition (DSM-5) describes multiple anxiety disorders such as specific phobia, generalized anxiety disorder (GAD), social anxiety disorder (SAD), illness anxiety disorder (IAD), panic disorder, agoraphobia, separation anxiety disorder, substance or medication-induced anxiety disorder, and selective mutism [2]. These disorders can start early in life [3], persist long after onset [4], and be highly debilitating from even subclinical symptomatology [5,6]. They are often comorbid with other mental health issues [7], and risk factors for suicide [8].

A potential solution for people with anxiety is Acceptance and Commitment Therapy (ACT)—a psychological treatment that teaches mindfulness skills to help people accept their anxiety and commit to living in accordance with personal values [9]. The primary aim of ACT is not to eliminate anxiety symptoms but rather to improve psychological flexibility which refers to a person’s ability to contact the present moment more fully as a conscious human being, and engage in values-based action [9,10]. This is accomplished in therapy by targeting 6 core processes of change: acceptance, contact with the present moment, cognitive defusion, self-as-context, values, and committed action [9]. ACT delivery is not constrained to one specific method or technology, but can make use of a host of methods and modalities to facilitate these processes [10]. Even though anxiety symptom reduction is not the primary focus of ACT, substantial evidence has accrued showing that it can significantly reduce anxiety symptoms and put anxiety disorders into remission [11-15]. In contrast to other established treatments for anxiety, such as cognitive behavioral therapy (CBT) [16,17] and pharmacotherapy [18], the ACT model provides a unique transdiagnostic approach [19] that emphasizes acceptance, mindfulness, and values-guided behavioral exercises, rather than control, logical analysis, and cognitive disputation exercises [10].

To make psychological treatment accessible to the broader population, researchers have developed Web-based therapy interventions [20]. This therapy involves using websites to provide mental health information and skill training online [21]. These interventions can overcome many of the structural and attitudinal barriers of face-to-face treatment such as therapist worker shortages, geographical distance, wait-lists, social stigma, financial cost, and work commitments [22], which are especially pronounced in rural areas [23]. Evidence indicates that Web-based interventions can be an effective, an acceptable, and a practical health care option for anxiety sufferers when used as pure self-help or as an adjunct to treatment-as-usual [24,25]. However, efforts to treat anxiety through the Web have largely been concentrated on CBT [26-29]. This is because the CBT tradition has a larger evidence base from a longer research history than the more recent ACT model [15,30]. Nevertheless, attrition and treatment adherence remain key issues for internet-delivered CBT (iCBT) [31,32]. It is therefore important to assess the potential benefits of other therapy models delivered through the Web, such as ACT. A previous review of randomized controlled trial (RCT) evidence indicated that internet-delivered ACT (iACT) can reduce anxiety and depression symptoms [33]. However, none of the RCTs published in this earlier review specifically targeted anxiety disorders nor examined the use of iACT for anxiety in other research designs.

Objective

The aim of this systematic review was to provide a comprehensive and up-to-date account on the empirical status of iACT for anxiety. To this end, all studies that investigated the impact of iACT on any standardized measure of anxiety were appraised. This included pilot studies as they can cost-effectively determine the feasibility of new interventions and research pursuits before expending greater resources on developing complex interventions, or testing advanced research designs [34]. As iACT for anxiety is a nascent research field [33], including the following information can help: (1) inform researchers on what has already been done, and where treatment gaps for anxiety are present; (2) clarify what interventions hold the potential for acceptable, efficacious, and practical anxiety treatment; and (3) potentially guide the design, development, and empirical validation of new iACT interventions as either self-help or as an adjunct to treatment-as-usual.


Eligibility Criteria

This systematic review was performed using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. A PRISMA checklist is available in Multimedia Appendix 1. To be included in the review, articles needed to report on empirical data obtained from iACT treatment on any standardized measure of anxiety. This criterion was set to ensure the validity and reliability of the anxiety symptom scores obtained at pre- and post-iACT treatment. Furthermore, to ensure that the review was comprehensive, all empirical research designs were included, as well as all population and comparator types. The iACT intervention under investigation needed to be delivered through a website and be based on at least 2 of the 6 core ACT processes: acceptance, contact with the present moment, cognitive defusion, self-as-context, values, and committed action. This criterion was set in accordance with Swain et al’s [14] reasoning that setting a minimum of 2 ACT processes will include interventions that address multiple aspects of the ACT model (rather than just a stand-alone technique), while simultaneously avoiding the reiteration of earlier review research on single processes (eg, pure mindfulness). Furthermore, studies emphasizing stress reduction (rather than anxiety reduction) or cognitive restructuring techniques were excluded in the present review [14]. Only articles written in the English language and published in peer-reviewed journals were included.

Search Strategy

The following electronic databases of scientific research were searched: EMBASE, MEDLINE, ProQuest Central, PsycINFO, Scopus, and Web of Science. Keywords used to search each database were ((Anxiety) AND ((ACT) OR (acceptance and commitment therapy) OR (iACT)) AND ((Internet) OR (online) OR (web-based) OR (etherapy))). The search was limited to peer-reviewed papers published in English up to the month of September 2018. The reference lists of included papers were manually searched. The Association for Contextual Behavioral Science (ACBS) website [35] was also surveyed for iACT research. The ACBS organization is a worldwide online learning and research community for ACT.

Article Selection

Upon removal of duplicate citations, article titles and abstracts were then independently screened and appraised next to the eligibility criteria by 2 researchers (JK and AR). Full text review was again conducted by both reviewers, and divergent views were resolved through discussion and mutual agreement.

Data Extraction

Data from included studies were extracted by one reviewer (JK) into a standardized coding sheet and then checked by a second reviewer (AC). Data items extracted for synthesis included the following:

  1. Reference source: first author surname and year of publication.
  2. Anxiety-related problem/disorder under investigation.
  3. Study design: methodology, comparator trial arms, and measurement points.
  4. Population: country, participants, sample size, age, and gender breakdown.
  5. iACT intervention details: intervention name, manual protocol, number of modules, treatment length, therapist guidance, and educational content.
  6. Efficacy: study quality rating, anxiety measures, outcomes, and effect sizes.
  7. Adherence: attrition rate, treatment satisfaction, and intention-to-treat analysis.

Attrition in this review was defined and measured as the relative number of participants who commenced but did not complete the active iACT treatment phase.

Quality Assessment

Öst’s [36] psychotherapy outcome study methodology rating form (POMRF) was used to appraise the quality of the reviewed iACT articles. It is a 22-item questionnaire that addresses key methodological issues pertinent to psychotherapy intervention studies such as research design, participant details, psychotherapy implementation, therapist characteristics, user adherence, statistical analyses, and clinical significance [36]. It can be used to assess study quality across multiple research designs, including RCTs, and has been used in an earlier systematic review by Swain et al [14] on ACT for anxiety. Each item in the POMRF is rated on a 3-point scale ranging from 0 (poor) to 2 (good), with the total POMRF score calculated as the sum of all points. The total score for any given study can range from 0 to 44 points, with higher scores indicating greater overall methodological quality. Öst [36] found the POMRF questionnaire to demonstrate high internal consistency (Cronbach alpha of 0.86) and interrater reliability (kappa coefficient mean of 0.75). In this systematic review, the included iACT studies were independently assessed next to the POMRF items by 2 reviewers (JK and AC) who individually calculated the overall POMRF scores. On completion, these scores were compared between reviewers, and the discrepancies were resolved by discussion and mutual agreement.

Narrative Synthesis

A narrative synthesis approach was chosen for this systematic review due to a paucity of iACT papers and the heterogeneity found between studies (eg, populations, designs, comparators, and anxiety outcomes). Results are presented as descriptive data with no further analyses performed.


Study Selection

The literature search yielded 566 papers. A total of 186 records remained after duplicate removal. Of these records, 20 met the eligibility criteria (see Figure 1).

Participant Characteristics

Table 1 shows that the majority of studies and their participants were from Sweden (35%, 7/20) and the United States (35%, 7/20), with the remaining studies from Australia (10%, 2/20), the Netherlands (10%, 2/20), Finland (5%, 1/20), and Denmark (5%, 1/20). All participants were adults with mean ages ranging from 18.37 to 59 years. Sample sizes ranged from 13 to 238 participants, with a median of 76 participants. Participants were mainly female with an average sample proportion of 72.62% (range 43.4%-100%). Both clinical (65%, 13/20) and nonclinical (35%, 7/20) studies were conducted. Anxiety symptom reduction was typically measured as a secondary outcome with 15 out of 20 studies (75%) targeting people with a general health issue and/or comorbid anxiety problem. Several studies (25%, 5/20) targeted a specific anxiety disorder. Diagnoses of GAD and SAD were obtained by clinical interviews delivered in person or by phone, whereas IAD diagnoses were obtained by videoconferencing.

Research Designs

Table 2 shows that just over half of the studies were RCTs (55%, 11/20). Control groups consisted of wait-lists (n=8), online discussion forums (n=2), expressive writing (n=2), iCBT program (n=1), and a mental health education website (n=1). The remaining studies in the review were uncontrolled pilot studies (45%, 9/20). There were 12 studies that reported between-group analyses, and 14 that reported within-group analyses, on their respective anxiety measures. Pretest, posttest, and follow-up assessments were used in 14 out of 20 studies (70%). The follow-up assessments ranged from 2 weeks to 1 year, with a median of 3 months.

Figure 1. Flowchart of systematic review search results. ACT: Acceptance and Commitment Therapy.
View this figure

Internet-Delivered Acceptance and Commitment Therapy Interventions

Educational content was typically presented in multimedia formats (ie, audio, video, text, images, and animations) with interactive exercises, worksheets, quizzes, and homework assignments provided (see Table 3). Several studies (40%, 8/20) based their content directly upon a detailed treatment manual that is publicly available. Every study appraised the iACT treatment of individuals, as no group-based approaches were adopted. Treatment lengths ranged from 2 to 12 weeks, with a mode of 8. The number of treatment modules ranged from 2 to 9, with a mode of 7. Most studies (70%, 14/20) tested iACT with therapist guidance, except for several (30%, 6/20) which delivered iACT as pure self-help.

Attrition and Treatment Satisfaction

Attrition in the active iACT treatment phase varied between the studies, with a mean of 19.19% and a range of 0 to 60.77% (see Table 4). To handle missing data, 18 out of 20 studies reported the use of an intention-to-treat analysis (90%). Several studies (55%, 9/20) used a standardized measure to collect treatment satisfaction ratings from participants after iACT completion. These measures included the Client Satisfaction Questionnaire-8 items (CSQ-8) and System Usability Scale (SUS). Several studies (35%, 7/20) incorporated nonstandardized questions (NSQ) on treatment satisfaction. Participants’ mean rating of their iACT experience ranged from above average to high satisfaction.

Anxiety Measures

Details of the standardized anxiety measures used are summarized in Table 5. The anxiety subscales of the Depression Anxiety Stress Scales-21 items and Hospital Anxiety and Depression Scale were the most frequently used measures (7 and 5 studies, respectively). Most studies (70%, 14/20) used a single anxiety measure, whereas the remaining 6 studies (30%) used multiple measures.

Anxiety Outcomes

Nearly all studies (90%, 18/20) reported small-to-large improvement on anxiety symptoms after treatment (see Table 5). Two studies on GAD found large anxiety reductions immediately after iACT, and at the 3- [40] and 6-month [39] follow-up points. Two studies on SAD found large reductions in anxiety symptoms after 8 weeks of iACT and at 3-month follow-up [42,43]. Hoffmann et al [45] found large effect sizes on both anxiety measures at posttest and 3-month follow-up for IAD. Anxiety symptoms also reduced for people with fibromyalgia [51], tinnitus [44], chronic pain [37,55], major depression [38], a history of interpersonal trauma [41], and mild to moderate symptoms of depression, anxiety, and stress [46-48,50,53,54,56].

However, the study by Levin et al [49] found no significant subclinical anxiety reduction after 3 weeks of self-help iACT treatment. Similarly, Räsänen et al [54] detected no significant difference between an iACT and a wait-list control group on anxiety symptoms among university students. Furthermore, Molander et al [52] found no significant difference in anxiety between their iACT and wait-list control group at post-treatment among adults with hearing problems. When comparing iACT to iCBT on anxiety reduction in tinnitus sufferers, Hesser et al [44] found no significant differences. No significant differences were found between iACT with or without therapist support for people with SAD [43]. Finally, the study by Trompetter et al [55] found no significant difference between iACT and expressive writing for reducing anxiety symptoms in chronic pain sufferers.

Quality Assessment

Total POMRF scores for each study are presented in Table 5. Out of a possible total of 44 points, the mean score for the reviewed iACT studies was 19 (SD 5.7), with a range of 10 to 29. The included studies gave either fair (65%, 13/20) or good (35%, 7/20) descriptions on their research participants in terms of inclusion/exclusion criteria, demographics, and comorbidity.

Table 1. Description of participants in reviewed internet-delivered Acceptance and Commitment Therapy (iACT) studies.
SourceCountryProblem/diagnosisClinicalNaAge (years), mean (SD)Females in total sample, n (%)
Buhrman [37]SwedenChronic painYes7649.1 (10.34)45 (59)
Carlbring [38]SwedenMajor depressionYes8044.4 (13.5)66 (82)
Dahlin [39]SwedenGADbYes10339.48 (10.73)86 (83.5)
Dahlin [40]SwedenGADYes1432 (10)11 (78)
Fiorillo [41]United StatesInterpersonal traumaYes2539.12 (16)25 (100)
Gershkovich [42]United StatesSADcYes1333.2 (10.04)9 (69)
Gershkovich [43]United StatesSADYes4231.5 (9.95)27 (64)
Hesser [44]SwedenTinnitusYes9948.5 (14.7)43 (43)
Hoffmann [45]DenmarkIADdYes1538.8 (NRe)12 (67)
Kelson [46]AustraliaDASf symptomsNo4021.62 (2.4)21 (52)
Levin [47]United StatesDAS symptomsNo7618.37 (.54)41 (54)
Levin [48]United StatesDAS symptomsNo8221.88 (3.50)62 (75)
Levin [49]United StatesDAS symptomsNo23421.61 (5.48)180 (77)
Levin [50]United StatesDAS symptomsNo7920.51 (2.73)52 (66)
Ljótsson [51]SwedenFibromyalgiaYes4152 (9)41 (100)
Molander [52]SwedenHearing problemsYes6159 (11)41 (67.2)
Pots [53]The NetherlandsDepressive symptomsYes23646.85 (12.06)179 (75.8)
Räsänen [54]FinlandDAS symptomsNo6824.29 (3.28)58 (85.3)
Trompetter [55]The NetherlandsChronic painYes23852.8 (12.37)181 (76)
Viskovich [56]AustraliaDAS symptomsNo13026.3 (7.96)98 (75)

aRefers to total number of participants.

bGAD: generalized anxiety disorder.

cSAD: social anxiety disorder.

dIAD: Illness anxiety disorder.

eNR: not reported.

fDAS: depression, anxiety, and stress.

Table 2. Description of research designs in reviewed internet-delivered Acceptance and Commitment Therapy (iACT) studies.
SourceRCTaTrial arms (n)bDesignMeasurements
Buhrman [37]YesiACT (38); forum (38)BGcPred, Poste, 6-month FUf
Carlbring [38]YesiACT (40); WLCg (40)BGPre, Post, 3-month FU
Dahlin [39]YesiACT (52); WLC (51)WGh; BGPre, Post, 6-month FU
Dahlin [40]NoiACT (14)WGPre, Post, 2 to 3-month FU
Fiorillo [41]NoiACT (25)WGPre, Post
Gershkovich [42]NoiACT (13)WGPre, Midi, Post, 3-month FU
Gershkovich [43]NoiACT (22); iACT + TSj (20)WG, BGPre, Mid, Post
Hesser [44]YesiACT (35); iCBTk (32); forum (32)BGPre, Post, 1-year FU
Hoffmann [45]NoiACT (15)WGPre, Post, 3-month FU
Kelson [46]NoiACT (40)WGPre, Post, 2-week FU
Levin [47]YesiACT (37); WLC (39)WG; BGPre, Post, 3-week FU
Levin [48]NoiACT (82)WGPre, Post
Levin [49]YesiACT (114); website (120)WG; BGPre, Post, 3-month FU
Levin [50]YesiACT (40); WLC (39)WG; BGPre, Post
Ljótsson [51]NoiACT (41)WGPre, Post, 6-month FU
Molander [52]YesiACT (31); WLC (30)BGPre, Post
Pots [53]YesiACT (82); EWl (67); WLC (87)BGPre, Post, 3 and 6-month FU
Räsänen [54]YesiACT (33); WLC (35)WG; BGPre, Post, 1-year FU
Trompetter [55]YesiACT (82); EW (79); WLC (77)BGPre, Post, 3-month FU
Viskovich [56]NoiACT (130)WGPre, Post

aRCT: randomized controlled trial.

bRefers to number of participants.

cBG: between-groups.

dPre: pretest.

ePost: posttest.

fFU: follow-up.

gWLC: wait-list control.

hWG: within-groups.

iMid: midtest.

jTS: therapist support.

kiCBT: internet-delivered cognitive behavioral therapy.

lEW: expressive writing.

All studies’ participants were either somewhat or very representative of people seeking treatment for their respective anxiety-related issue. Diagnostic reliability was obtained in all 13 clinical studies with a structured interview from a trained assessor. Several studies (40%, 8/20) recruited participants with anxiety conditions inclusive of both acute chronicity (ie, less than one year duration) and low severity. Of the remaining studies, 5 consisted of chronic anxiety sufferers with at least moderate severity [37,41,45,51,55], and the other 7 included people with subthreshold symptoms [46-48,50,54,56].

Most studies (70%, 14/20) were rated poorly on research design because of being uncontrolled or only making use of a wait-list control group (see Table 2). The control for concomitant treatments outside of iACT was also generally poor (65%, 13/20). Several studies (45%, 9/20) reported a power analysis. Just over half of the studies (60%, 12/20) randomly assigned participants to treatment conditions, with 6 of these also randomly assigning therapists [38,39,44,53-55]. Assessment points were typically conducted at pretest, posttest, and follow-up of less than a year (60%, 12/20). Two studies had follow-up of a year or more [44,54]. All iACT studies employed adequate statistical analyses and presented results fully with means and SDs.

All studies incorporated moderate or very specific anxiety outcome measures with good psychometric properties for their targeted conditions. Details on the clinical significance of therapy outcomes were provided in several studies (45%, 9/20), 5 of which used Jacobson and Truax’s [57] criteria for clinically significant change [39,41,43,44,53]. There was no blinding of assessors across any included iACT studies. Outcome measures were collected via the internet in the form of self-report questionnaires.

About 8 of the iACT interventions under investigation were based on manual treatment programs (see Table 3). All therapist-guided iACT studies (70%, 14/20) deployed at least 2 therapists. Graduate psychology students were often used to guide participants through the iACT interventions (55%, 11/20). Therapist competence was checked either somewhat or frequently in all guided iACT studies. The equality of therapy hours between conditions was good in the 3 studies that had an active treatment control [44,53,55]. Treatment adherence checks were made in all studies and proportions of attrition rates were provided. Intent-to-treat analyses were performed in all but 2 studies (see Table 4).

Table 3. Details of the internet-delivered Acceptance and Commitment Therapy (iACT) interventions studied.
SourceNameManualModulesLength (weeks)GuidedSystem features
Buhrman [37]Not specifiedNo77YesAudio, text, interactive exercises
Carlbring [38]The Depression HelpNo78YesMultimediaa, animations, interactive exercises, homework, CD
Dahlin [39]The Worry HelpNo79YesMultimedia, animations, interactive exercises, homework, CD
Dahlin [40]The Worry HelpNo78-10YesMultimedia, animations, interactive exercises, homework, CD
Fiorillo [41]Not specifiedYes66NoMultimedia, interactive exercises, worksheets
Gershkovich [42]Not specifiedYes88YesMultimedia, interactive exercises, homework, quizzes
Gershkovich [43]Not specifiedYes88YesMultimedia, interactive exercises, homework, quizzes
Hesser [44]Not specifiedYes88YesMultimedia, interactive exercises, homework
Hoffmann [45]Not specifiedYes712YesMultimedia, interactive exercises, homework
Kelson [46]FearLessNo92NoText, images, interactive exercises, quizzes
Levin [47]ACT on College LifeNo23NoMultimedia, animations, interactive exercises, worksheets, quizzes
Levin [48]ACT on College LifeNo34YesMultimedia, animations, interactive exercises, worksheets, quizzes
Levin [49]ACT on College LifeNo23NoMultimedia, animations, interactive exercises, worksheets, quizzes
Levin [50]Not specifiedNo64NoMultimedia, interactive exercises, homework, worksheets,
Ljótsson [51]Not specifiedYes510YesText, interactive exercises, worksheets
Molander [52]Not specifiedNo88YesText, images, audio, interactive exercises, homework
Pots [53]Not specifiedYes912YesMultimedia, interactive exercises, diary
Räsänen [54]The Student CompassNo97YesMultimedia, interactive exercises, journal
Trompetter [55]Living with PainYes912YesText, interactive exercises, diary
Viskovich [56]You Only Live OnceNo44NoMultimedia, interactive exercises, animations

aMultimedia: combined use of audio, video, text, and images.

Table 4. Details of attrition rates and treatment satisfaction.
SourceAttrition (%)ITTaSatisfaction measuresSatisfaction outcomes
Buhrman [37]17.14Yesb
Carlbring [38]0Yes
Dahlin [39]19.2YesNSQcHigh satisfaction
Dahlin [40]0YesCSQ-8dHigh satisfaction
Fiorillo [41]16YesCSQ-8High satisfaction
Fiorillo [41]16YesSUSeHigh satisfaction
Gershkovich [42]0YesNSQHigh satisfaction
Gershkovich [43]31YesNSQHigh satisfaction
Hesser [44]8.57Yes
Hoffmann [45]20No
Kelson [46]26NoSUSAbove average satisfaction
Levin [47]8YesSUSHigh satisfaction
Levin [48]56YesSUSHigh satisfaction
Levin [48]56YesNSQHigh satisfaction
Levin [49]30YesSUSAbove average satisfaction
Levin [50]20YesSUSAbove average
Levin [50]20YesNSQAdequate satisfaction
Ljtósson [51]2Yes
Molander [52]16.13Yes
Pots [53]15Yes
Räsänen [54]12YesNSQHigh satisfaction
Trompetter [55]28.05YesCSQ-8High satisfaction
Trompetter [55]28.05YesNSQMore than adequate satisfaction
Viskovich [56]60.77YesSUSAbove average satisfaction

aITT: intention-to-treat analysis.

bnot applicable.

cNSQ: nonstandardized questions.

dCSQ-8: Client Satisfaction Questionnaire-8 items.

eSUS: System Usability Scale.

Table 5. Details on study quality, anxiety measures, outcomes, and effect sizes (Cohen d) for internet-delivered Acceptance and Commitment Therapy (iACT).
SourcePOMRFaMeasuresWGb effect sizeBGc effect size
Buhrman [37]23HADS-Ade0.18 (iACT vs WLCf)
Carlbring [38]22BAIg0.45 (iACT vs WLC)
Dahlin [39]23PSWQh1.35 (prei to postj)0.87 (iACT vs WLC)
Dahlin [39]23GAD-7k1.89 (pre to post)0.98 (iACT vs WLC)
Dahlin [39]23GAD-Q-IVl1.5 (pre to post)0.70 (iACT vs WLC)
Dahlin [39]23BAI0.92 (pre to post)0.55 (iACT vs WLC)
Dahlin [39]20PSWQ2.14 (pre to post)
Fiorillo [41]20DASS-Am0.89 (pre to post)
Gershkovich [42]18SPAI-SPn1.47 (pre to post)
Gershkovich [42]18LSASo0.92 (pre to post)
Gershkovich [43]22SPAI-SP1.07 (pre to post)NSp
Gershkovich [43]22LSAS0.77 (pre to post)NS
Gershkovich [44]22SIASq1.01 (pre to post)NS
Hesser [44]29HADS-A0.59 (iACT vs Forum)
Hoffmann [45]22WI-7r1.63 (pre to post)s
Hoffmann [45]22SCL-92 Anxt0.73 (pre to post)s
Kelson [46]11DASS-A0.42 (pre to FUu)
Kelson [46]11GAD-70.66 (pre to post)
Levin [47]13DASS-A0.95 (pre to FU)0.81 (iACT vs WLC)
Levin [48]14DASS-A0.55 (pre to post)
Levin [49]11DASS-ANSNS
Levin [50]13CCAPS-Anxv0.39 (pre to post)NS
Levin [50]13CCAPS-Social0.69 (pre to post)0.78 (iACT vs WLC)
Ljótsson [51]18HADS-A0.75 (pre to post)
Molander [52]17GAD-7NS
Pots [53]27HADS-A0.49 (iACT vs WLC)
Pots [53]27HADS-A0.41 (iACT vs EWw)
Räsänen [54]19DASS-A0.42 (pre to post)Ns (iACT vs WLC)
Trompetter [55]28HADS-A0.39 (iACT vs WLC)
Trompetter [55]28HADS-ANs (iACT vs EW)
Viskovich [56]10DASS-A0.32 (pre to post)

aPOMRF: psychotherapy outcome study methodology rating form.

bWG: within-group.

cBG: between-group.

dHADS-A: Hospital Anxiety and Depression Scale-Anxiety subscale.

eN/A: not applicable.

fWLC: wait-list control.

gBAI: Beck Anxiety Inventory.

hPSWQ: Penn State Worry Questionnaire.

ipre: pretest.

jpost: posttest.

kGAD-7: Generalized Anxiety Disorder-7 item.

lGAD-Q-IV Generalized Anxiety Disorder Questionnaire IV.

mDASS-A: Depression, Anxiety and Stress Scales-Anxiety subscale.

nSPAI-SP: Social Phobia and Anxiety Inventory-Social Phobia subscale.

oLSAS: Liebowitz Social Anxiety Scale-Total.

pNS: nonsignificant.

qSIAS: Social Interaction Anxiety Scale.

rWI-7: Whiteley Index-7.

sStandardized response mean effect size.

tSCL-92: Symptom Checklist-92.

uFU: follow-up.

vCCAPS: Counseling Center Assessment of Psychological Symptoms.

wEW: expressive writing.


Overview

In total, 18 of the 20 studies found in this systematic review reported small-to-large anxiety reductions among participants after iACT on standardized measures. Studies typically aimed to treat a primary issue other than an anxiety disorder. Just over half were RCTs, with a fewer number of randomized or uncontrolled pilot studies of new iACT interventions. The interventions were typically rich in multimedia information content and interactive exercises that were provided to participants with therapist guidance over a period of several weeks. Attrition rates were commensurate to other website interventions based on other therapy models [32], and treatment satisfaction was rated above average to high among participants who completed their respective iACT program. There is still considerable need to test iACT on all anxiety conditions with studies of greater methodological quality to corroborate extant findings.

Participant Characteristics

The delivery of iACT for anxiety is a new field as all studies identified in this review were published from 2012 onward. Many studies were pioneering new iACT programs for people in their respective countries, with Sweden and the United States featured prominently. There were few to no identified studies from other major Western countries such as the United Kingdom, Australia, New Zealand, and Canada. Participants in the included iACT studies were primarily young to middle-aged adults with a high representation of females, indicating that there is substantial need to improve the generalizability of results by creating or applying existing iACT interventions to the wider population across other demographics (eg, children, adolescents, the elderly, and male participants).

Research Designs

Nine of the iACT studies were uncontrolled pilot studies. Preliminary intervention testing with open and uncontrolled research designs has merit for cost-effectively recruiting participants and demonstrating feasibility of the program on key issues of usability, safety, and limited efficacy [34]. Future creators of iACT programs can also glean insight from these studies on how to design, develop, and test their new interventions for phase I clinical trials. However, uncontrolled pilot studies do not allow for solid conclusions on the efficacy of treating anxiety with iACT because of the lack of control for confounding factors, such as concomitant treatments. For instance, the effect sizes of the uncontrolled studies may be inflated as they are susceptible to threats of internal validity such as maturation, history, and regression to the mean [17]. Therefore, the magnitude of the reported effect sizes in this review cannot be compared across uncontrolled and controlled studies. The remaining studies had stronger research designs that used wait-list control and active treatment groups for comparators. Overall, more RCTs are required to corroborate the promising findings of the uncontrolled pilot studies.

Internet-Delivered Acceptance and Commitment Therapy Interventions

Presently, there is no single or leading iACT intervention for anxiety. Multiple programs have been developed and tested with key differences. For instance, some iACT programs were tailored with information and exercises to people from specific groups such as university students [47], or chronic pain sufferers [55]. Few iACT interventions had more than one study investigating their therapeutic impact. Due to the heterogeneity between programs, it is not clear what modules were well received by participants and facilitated therapeutic change. Future corelational and component analytical studies on which modules/exercises are better suited for certain populations could help identify optimal features and predictors of success between interventions [13].

Despite the differences between iACT interventions, there were still commonalities. This included the multimedia representation of content, proposed mechanisms of change underlying exercises (eg, acceptance and mindfulness), number of intervention modules, and overall treatment length of several weeks. Another key shared factor was therapist guidance, with most studies having used therapists to varying extents. Research has reported that therapist-guided interventions, in general, produce larger effects than unguided interventions [20]. However, Gershkovich et al [43] found equal anxiety reductions delivering iACT with or without therapist support. Furthermore, RCT studies by Levin et al [47,50] found significant reductions in subclinical anxiety symptoms with unguided iACT. These outcomes should be examined in further research. If the findings hold across studies with greater methodological rigor, then unguided iACT could potentially help address therapist worker shortages [22,23].

Attrition and Treatment Satisfaction

Attrition rates in the active treatment phase of iACT varied considerably between studies. Three studies in particular had a high percentage of participants not completing the entire program [38,48,56]. Carlbring et al [38] used no treatment satisfaction measures for their iACT program, so it was not possible to gauge the extent to which this impacted upon adherence. In contrast, Levin et al [48] had high system usability and treatment satisfaction ratings from program completers despite a high attrition rate. Similar positive ratings were also received across all other studies that included treatment satisfaction, measures regardless of attrition rate. This suggests that iACT may not be suitable for everyone but can be particularly well received by some as an online treatment modality. The mean attrition rate across all included studies (19.19%) was lower than the median dropout rate of 24% identified across other Web-based interventions, and lower than the weighted average of 35% [32]. Future research would need to make equivalency comparisons on attrition rates between iACT programs and mainstream iCBT programs to help determine if iACT has superior user retention.

Anxiety Outcomes

Generalized Anxiety Disorder

Two studies indicated that iACT can be efficacious and acceptable for adults with GAD [39,40]. The first study by Dahlin et al [40] found a large reduction on GAD symptomatology across 14 participants. However, this uncontrolled pilot study had a small sample, which limits conclusions on the true efficacy of The Worry Help program because of possible treatment confounds. However, large reductions across multiple measures of GAD were also found in a subsequent RCT study by Dahlin et al [39]. There was no clinically significant deterioration throughout this study, with GAD symptoms improving beyond the acute treatment phase [40]. A key limitation of this study, however, was the use of only a wait-list control rather than an active treatment group. Nevertheless, both of these studies still provide early support for treating adults with GAD using therapist-guided iACT over a period ranging from 8 to 10 weeks. This pattern of results mirrors the large GAD anxiety reductions of face-to-face ACT treatment [12], which implicates the potential of guided iACT to provide adjunctive clinical care.

Social Anxiety Disorder

Two studies indicate that iACT can be efficacious and acceptable for adults with SAD [42,43]. The first study by Gershkovich et al [42] found large effects on multiple measures of SAD symptoms across 13 participants. However, this uncontrolled pilot study had a small sample, which limits conclusions on the true efficacy of this iACT program because of possible treatment confounds. The other study by Gershkovich et al [43] investigated the same iACT program with participants randomized to 1 of 2 conditions: treatment with or without therapist support. Once more there were large reductions in SAD anxiety symptoms found in both groups at posttest with 14 out of 26 (53.8%) participants no longer meeting SAD criteria. Key limitations of this study were the lack of a non-iACT control group, and no participant follow-up assessments. These foundational studies provide tentative support for treating adults with SAD using iACT over an 8-week period. This pattern of results mirrors the large SAD anxiety reductions found with face-to-face ACT treatment [12], which further implicates the potential of iACT to provide adjunctive clinical care.

Illness Anxiety Disorder

It appears that iACT holds promise as an efficacious treatment for IAD, a condition of severe health anxiety that was previously known as hypochondriasis before the DSM-5 [45]. Significantly large reductions on both measures of anxiety were found at post-treatment that were also sustained at 3-month follow-up. This implies that therapist-guided iACT over 12 weeks is a feasible treatment approach for severe health anxiety among adults. However, this study was an uncontrolled pilot study with a small sample size of 15 self-referred patients. Therefore, these preliminary results must be validated in further larger-scale RCT research to control for treatment confounds.

General Anxiety Symptoms

Small-to-large improvements in general anxiety symptoms were reported across most studies that evaluated iACT on various physical and mental health issues. These outcomes were found across several different Western countries, which indicate the capacity for iACT to transcend national and cultural borders. Furthermore, the highest quality RCT evidence in this review revealed that iACT was just as efficacious as iCBT [44], and expressive writing [53,55]. These studies had the highest POMRF scores in the review with a range of 27 to 29. These scores are all well above the average POMRF score of 18.1 reported earlier for face-to-face ACT treatment RCTs [36]. Additionally, iACT outcomes were maintained at follow-up for all studies that found significant reductions. The primary implication is that iACT can provide a transdiagnostic, efficacious, and acceptable treatment option for people with general anxiety symptoms.

However, the results of studies that investigated the benefit of iACT for general anxiety symptoms, specifically among young adult university students, were mixed. Several studies indicated that iACT can be efficacious for reducing anxiety symptoms in this population with moderate-to-large effects [46-48,50]. Results in 2 of these studies [47,48] were procured from online treatment using fewer ACT-based modules (2 to 3) than the other iACT studies (5 to 9). This suggests that it could be possible to streamline iACT content to produce equivalent results to programs with more content. Furthermore, 2 of these studies [46,47] had no therapist guidance, and the pilot study by Kelson et al [46] found significant subclinical anxiety reduction after 2 weeks. These findings hold promise for delivering unguided iACT interventions in the form of self-help, or stepped care, to the “worried well” to procure rapid anxiety relief [6].

However, while the RCT by Räsänen et al [54] found a moderate within-group effect of guided iACT treatment on anxiety reduction in young adults, there was no significant difference between the iACT condition and the wait-list control group at posttest. Furthermore, an RCT by Levin et al [49] did not find a significant anxiety reduction after delivering 2 modules of unguided iACT treatment over a 3-week period. This outcome contradicts the significant results of the earlier RCT study by Levin et al [47] that delivered the same iACT intervention without therapist guidance over 3 weeks. Together, these results imply that iACT may not be efficacious for all young adults, or that possible confounds occurred, such as wait-list participants using concomitant treatments, or natural fluctuations in subclinical symptomatology.

It is important to note that all of the unguided iACT studies that included participants with subclinical anxiety had low POMRF ratings. Therefore, methodological issues limit conclusive interpretations of these early stage outcomes. For instance, the first study by Levin et al [47] was a small feasibility trial that used a less conservative alpha level to determine significance (P<.10). The studies by Kelson et al [46] and Levin et al [48] made use of single-group, uncontrolled open-trial designs. The third study by Levin et al [49] had low power and did not use a dosage equivalent treatment condition to help control for nonspecific confounds. Pilot study recruitment issues of university students may also have affected results. For instance, most participants in the most recent study by Levin et al [50] reportedly sought the incentive of psychology course credits more so than mental health treatment which could have impacted upon observed program engagement, satisfaction, and self-report outcomes. Therefore, subsequent studies would need to appraise the impact of iACT in university settings among a pure treatment seeking a sample that does not receive any inducements such as money or course credits. Despite these limitations, there is still a need for more iACT research on people suffering from subclinical general anxiety symptoms, as they can be quite debilitating [5]. Therefore, more methodologically rigorous RCT studies are needed to clarify the utility of unguided iACT for subclinical anxiety.

Future Research

Presently, there is substantial need to test iACT interventions on all anxiety-related problems. There were no iACT studies on separation anxiety disorder, selective mutism, specific phobia, panic disorder, agoraphobia, substance/medication-induced anxiety disorder, or anxiety disorders due to medical conditions [2]. Questions also remain regarding the capacity of iACT interventions to enact therapeutic change in vein of established treatments, such as iCBT, on multiple factors (eg, cost-effectiveness, credibility, brevity, outcome longevity, and integration with clinical services). Therefore, further investigation into the impact of individual ACT-based modules, with or without therapist guidance, using RCT designs that incorporate an active positive control is warranted. This could help pinpoint optimal treatment time lengths, clarify the quality of content, and elucidate the utility of unguided treatment protocols. Future research should also consider quality appraisal guidelines such as Öst’s [36] POMRF criteria when designing iACT studies. This would help address gaps in the current literature, such as concomitant treatment confounds, lack of clinical significance reporting, and anxiety outcome sustainability beyond a year. As most of the iACT programs were researched by the people who developed them, independent investigation would clarify the validity of extant findings.

Review Limitations

This systematic review has several limitations. Owing to the inclusion of only peer-reviewed English-language journal articles, there may potentially be more anxiety iACT studies in the public domain available in other languages or formats (eg, conference proceedings). Even among the English language–based literature reviewed, there were studies found which met inclusion criteria, yet were not self-described as iACT. For example, several studies used terms such as “acceptance-based” or “acceptance and values-based behavior therapy” in their article titles [38-40,51]. It is possible that a study may have been overlooked because of obscure nomenclature. Also, this systematic review only focused on Web-based interventions and did not include in its scope other online modalities, such as mobile phone apps, social media, and virtual reality systems. Furthermore, there were no subgroup analyses performed on the impact of iACT on anxiety. Thus, insight was lacking into the applicability of iACT to people with specific demographic characteristics (eg, gender, age, or education level).

With regard to quality appraisal limitations, all types of studies were included in this review to reduce publication bias. Although non-RCT studies can provide insight into iACT on anxiety, there is a greater risk of bias that needs to be accounted for when interpreting the validity of the reported effects. This risk of bias was addressed with Öst’s [36] POMRF questionnaire in this review, yet there is still room for subjectively interpreting POMRF criteria. For example, a study may have actually met certain criteria in its execution, yet scored lower on an item in our quality appraisal because of the authors omitting that information in the publication text. Although the subjective interpretation of risk of bias is an issue with any quality appraisal method, it is still a limitation to consider that may impact on the capacity to replicate the findings of this systematic review.

Conclusions

Nearly all studies reported the beneficial impact of iACT on anxiety. Small to large reductions in anxiety symptoms among populations suffering from GAD, SAD, IAD, and anxiety-related health problems were found in all but 2 studies. More research is required to establish outcomes on iACT for other anxiety relevant conditions such as panic disorder, agoraphobia, separation anxiety, selective mutism, and specific phobias [2]. An important aspect of this is making direct comparisons of iACT treatments with established active interventions (eg, iCBT) on key standardized measures of anxiety, adherence, usability, and treatment satisfaction. Further research on iACT for anxiety on untested demographics (eg, children, adolescents, and the elderly), as well as in countries and cultural settings outside of Sweden and the United States, is also warranted. Overall, the current findings indicate that iACT can be an effective and acceptable treatment for some anxiety conditions among young to middle aged adults in Western societies.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Preferred Reporting Items for Systematic Reviews and Meta-Analyses checklist.

PDF File (Adobe PDF File), 67KB

  1. Baxter AJ, Scott KM, Vos T, Whiteford HA. Global prevalence of anxiety disorders: a systematic review and meta-regression. Psychol Med 2013 May;43(5):897-910. [CrossRef] [Medline]
  2. Diagnostic and statistical manual of mental disorders (DSM-5). Washington DC: American Psychiatric Association; 2013.
  3. Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, Walters EE. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry 2005 Jun;62(6):593-602. [CrossRef] [Medline]
  4. Kessler RC, Petukhova M, Sampson NA, Zaslavsky AM, Wittchen H. Twelve-month and lifetime prevalence and lifetime morbid risk of anxiety and mood disorders in the United States. Int J Methods Psychiatr Res 2012 Sep;21(3):169-184 [FREE Full text] [CrossRef] [Medline]
  5. Haller H, Cramer H, Lauche R, Gass F, Dobos GJ. The prevalence and burden of subthreshold generalized anxiety disorder: a systematic review. BMC Psychiatry 2014 May 01;14:128 [FREE Full text] [CrossRef] [Medline]
  6. Wick JY, Zanni GR. Hypochondria: the worried well. Consult Pharm 2008 Mar;23(3):192-208. [CrossRef] [Medline]
  7. Kessler RC, Chiu WT, Demler O, Walters EE. Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry 2005 Jun;62(6):617-627 [FREE Full text] [CrossRef] [Medline]
  8. Bomyea J, Lang AJ, Craske MG, Chavira D, Sherbourne CD, Rose RD, et al. Suicidal ideation and risk factors in primary care patients with anxiety disorders. Psychiatry Res 2013 Aug 30;209(1):60-65 [FREE Full text] [CrossRef] [Medline]
  9. Eifert GH, Forsyth JP. Acceptance and Commitment Therapy for Anxiety Disorders: a Practitioner's Treatment Guide to Using Mindfulness, Acceptance, and Values-Based Behavior Change. Oakland, CA: New Harbinger Publications; 2005.
  10. Hayes SC, Levin ME, Plumb-Vilardaga J, Villatte JL, Pistorello J. Acceptance and commitment therapy and contextual behavioral science: examining the progress of a distinctive model of behavioral and cognitive therapy. Behav Ther 2013 Jun;44(2):180-198 [FREE Full text] [CrossRef] [Medline]
  11. Bluett EJ, Homan KJ, Morrison KL, Levin ME, Twohig MP. Acceptance and commitment therapy for anxiety and OCD spectrum disorders: an empirical review. J Anxiety Disord 2014 Aug;28(6):612-624. [CrossRef] [Medline]
  12. Dalrymple KL, Herbert JD. Acceptance and commitment therapy for generalized social anxiety disorder: a pilot study. Behav Modif 2007 Sep;31(5):543-568. [CrossRef] [Medline]
  13. Roemer L, Orsillo SM, Salters-Pedneault K. Efficacy of an acceptance-based behavior therapy for generalized anxiety disorder: evaluation in a randomized controlled trial. J Consult Clin Psychol 2008 Dec;76(6):1083-1089 [FREE Full text] [CrossRef] [Medline]
  14. Ruiz F. A review of Acceptance and Commitment Therapy (ACT) empirical evidence: Correlational, experimental psychopathology, component and outcome studies. Rev Int Psicol Ter Psicol 2010;10(1):125-162 [FREE Full text]
  15. Swain J, Hancock K, Hainsworth C, Bowman J. Acceptance and commitment therapy in the treatment of anxiety: a systematic review. Clin Psychol Rev 2013 Dec;33(8):965-978. [CrossRef] [Medline]
  16. Beck AT, Dozois DJ. Cognitive therapy: current status and future directions. Annu Rev Med 2011 Feb;62:397-409. [CrossRef] [Medline]
  17. Butler AC, Chapman JE, Forman EM, Beck AT. The empirical status of cognitive-behavioral therapy: a review of meta-analyses. Clin Psychol Rev 2006 Jan;26(1):17-31. [CrossRef] [Medline]
  18. Koen N, Stein DJ. Pharmacotherapy of anxiety disorders: a critical review. Dialogues Clin Neurosci 2011;13(4):423-437 [FREE Full text] [Medline]
  19. Hayes SC. Acceptance and commitment therapy, relational frame theory, and the third wave of behavioral and cognitive therapies. Behav Ther 2004;35(4):639-665. [CrossRef]
  20. Andersson G, Titov N. Advantages and limitations of Internet-based interventions for common mental disorders. World Psychiatry 2014 Feb;13(1):4-11 [FREE Full text] [CrossRef] [Medline]
  21. Barak A, Klein B, Proudfoot JG. Defining internet-supported therapeutic interventions. Ann Behav Med 2009 Aug;38(1):4-17. [CrossRef] [Medline]
  22. Andrade LH, Alonso J, Mneimneh Z, Wells JE, Al-Hamzawi A, Borges G, et al. Barriers to mental health treatment: results from the WHO World Mental Health surveys. Psychol Med 2014 Apr;44(6):1303-1317 [FREE Full text] [CrossRef] [Medline]
  23. Gamm L, Stone S, Pittman S. Rural Health Research. College Station, TX: The Texas A&M University System Health Science Center, School of Rural Public Health, Southwest Rural Health Research Center; 2010. Rural healthy people 2010: a companion document to healthy people 2010   URL: https://www.ruralhealthresearch.org/projects/286 [accessed 2019-01-15] [WebCite Cache]
  24. Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N. Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: a meta-analysis. PLoS One 2010;5(10):e13196 [FREE Full text] [CrossRef] [Medline]
  25. Barak A, Hen L, Boniel-Nissim M, Shapira N. A comprehensive review and a meta-analysis of the effectiveness of internet-based psychotherapeutic interventions. J Technol Hum Serv 2008 Jul 03;26(2-4):109-160. [CrossRef]
  26. Andersson G, Carlbring P, Ljótsson B, Hedman E. Guided internet-based CBT for common mental disorders. J Contemp Psychother 2013 Dec;43(4):223-233. [CrossRef]
  27. Arnberg FK, Linton SJ, Hultcrantz M, Heintz E, Jonsson U. Internet-delivered psychological treatments for mood and anxiety disorders: a systematic review of their efficacy, safety, and cost-effectiveness. PLoS One 2014;9(5):e98118 [FREE Full text] [CrossRef] [Medline]
  28. Grist R, Cavanagh K. Computerised cognitive behavioural therapy for common mental health disorders, what works, for whom under what circumstances? A systematic review and meta-analysis. J Contemp Psychother 2013 Dec;43(4):243-251. [CrossRef]
  29. Newby JM, Twomey C, Yuan LS, Andrews G. Transdiagnostic computerised cognitive behavioural therapy for depression and anxiety: a systematic review and meta-analysis. J Affect Disord 2016 Jul 15;199:30-41. [CrossRef] [Medline]
  30. Zettle RD. The evolution of a contextual approach to therapy: from comprehensive distancing to ACT. Int J Behav Consult Ther 2005;1(2):77-89. [CrossRef]
  31. Christensen H, Griffiths KM, Farrer L. Adherence in internet interventions for anxiety and depression: systematic review. J Med Internet Res 2009 Apr;11(2):e13 [FREE Full text] [CrossRef] [Medline]
  32. Melville KM, Casey LM, Kavanagh DJ. Dropout from internet-based treatment for psychological disorders. Br J Clin Psychol 2010 Nov;49(4):455-471. [CrossRef] [Medline]
  33. Brown M, Glendenning A, Hoon AE, John A. Effectiveness of web-delivered acceptance and commitment therapy in relation to mental health and well-being: a systematic review and meta-analysis. J Med Internet Res 2016 Aug 24;18(8):e221 [FREE Full text] [CrossRef] [Medline]
  34. Bowen DJ, Kreuter M, Spring B, Cofta-Woerpel L, Linnan L, Weiner D, et al. How we design feasibility studies. Am J Prev Med 2009 May;36(5):452-457 [FREE Full text] [CrossRef] [Medline]
  35. Association for Contextual Behavioral Science.   URL: https://contextualscience.org/ [accessed 2019-01-16] [WebCite Cache]
  36. Öst LG. Efficacy of the third wave of behavioral therapies: a systematic review and meta-analysis. Behav Res Ther 2008 Mar;46(3):296-321. [CrossRef] [Medline]
  37. Buhrman M, Skoglund A, Husell J, Bergström K, Gordh T, Hursti T, et al. Guided internet-delivered acceptance and commitment therapy for chronic pain patients: a randomized controlled trial. Behav Res Ther 2013 Jun;51(6):307-315. [CrossRef] [Medline]
  38. Carlbring P, Hägglund M, Luthström A, Dahlin M, Kadowaki Å, Vernmark K, et al. Internet-based behavioral activation and acceptance-based treatment for depression: a randomized controlled trial. J Affect Disord 2013 Jun;148(2-3):331-337. [CrossRef] [Medline]
  39. Dahlin M, Andersson G, Magnusson K, Johansson T, Sjögren J, Håkansson A, et al. Internet-delivered acceptance-based behaviour therapy for generalized anxiety disorder: a randomized controlled trial. Behav Res Ther 2016 Feb;77:86-95. [CrossRef] [Medline]
  40. Dahlin M, Ryberg M, Vernmark K, Annas N, Carlbring P, Andersson G. Internet-delivered acceptance-based behavior therapy for generalized anxiety disorder: a pilot study. Internet Interv 2016 Nov;6:16-21 [FREE Full text] [CrossRef] [Medline]
  41. Fiorillo D, McLean C, Pistorello J, Hayes SC, Follette VM. Evaluation of a web-based acceptance and commitment therapy program for women with trauma-related problems: a pilot study. J Contextual Behav Sci 2017 Jan;6(1):104-113. [CrossRef]
  42. Gershkovich M, Herbert JD, Forman EM, Glassman L. Guided internet-based self-help intervention for social anxiety disorder with videoconferenced therapist support. Cogn Behav Pract 2016 May;23(2):239-255 [FREE Full text] [CrossRef]
  43. Gershkovich M, Herbert JD, Forman EM, Schumacher LM, Fischer LE. Internet-delivered acceptance-based cognitive-behavioral intervention for social anxiety disorder with and without therapist support: a randomized trial. Behav Modif 2017 Sep;41(5):583-608. [CrossRef] [Medline]
  44. Hesser H, Gustafsson T, Lundén C, Henrikson O, Fattahi K, Johnsson E, et al. A randomized controlled trial of internet-delivered cognitive behavior therapy and acceptance and commitment therapy in the treatment of tinnitus. J Consult Clin Psychol 2012 Aug;80(4):649-661. [CrossRef] [Medline]
  45. Hoffmann D, Rask CU, Hedman-Lagerlöf E, Ljótsson B, Frostholm L. Development and feasibility testing of internet-delivered acceptance and commitment therapy for severe health anxiety: pilot study. JMIR Ment Health 2018 Apr 6;5(2):e28 [FREE Full text] [CrossRef] [Medline]
  46. Kelson JN, Lam MK, Keep M, Campbell AJ. Development and evaluation of an online acceptance and commitment therapy program for anxiety: phase I iterative design. J Technol Hum Serv 2017 Apr;35(2):135-151. [CrossRef]
  47. Levin ME, Pistorello J, Seeley JR, Hayes SC. Feasibility of a prototype web-based acceptance and commitment therapy prevention program for college students. J Am Coll Health 2014 Jan;62(1):20-30 [FREE Full text] [CrossRef] [Medline]
  48. Levin ME, Pistorello J, Hayes SC, Seeley JR, Levin C. Feasibility of an acceptance and commitment therapy adjunctive web-based program for counseling centers. J Couns Psychol 2015 Jul;62(3):529-536. [CrossRef] [Medline]
  49. Levin ME, Hayes SC, Pistorello J, Seeley JR. Web-based self-help for preventing mental health problems in universities: comparing acceptance and commitment training to mental health education. J Clin Psychol 2016 Mar;72(3):207-225. [CrossRef] [Medline]
  50. Levin ME, Haeger JA, Pierce BG, Twohig MP. Web-based acceptance and commitment therapy for mental health problems in college students: a randomized controlled trial. Behav Modif 2017 Jan 1;41(1):141-162. [CrossRef] [Medline]
  51. Ljótsson B, Atterlöf E, Lagerlöf M, Andersson E, Jernelöv S, Hedman E, et al. Internet-delivered acceptance and values-based exposure treatment for fibromyalgia: a pilot study. Cogn Behav Ther 2014;43(2):93-104. [CrossRef] [Medline]
  52. Molander P, Hesser H, Weineland S, Bergwall K, Buck S, Jäder Malmlöf J, et al. Internet-based acceptance and commitment therapy for psychological distress experienced by people with hearing problems: a pilot randomized controlled trial. Cogn Behav Ther 2018 Mar;47(2):169-184. [CrossRef] [Medline]
  53. Pots WT, Fledderus M, Meulenbeek PA, ten Klooster PM, Schreurs KM, Bohlmeijer ET. Acceptance and commitment therapy as a web-based intervention for depressive symptoms: randomised controlled trial. Br J Psychiatry 2016 Jan;208(1):69-77. [CrossRef] [Medline]
  54. Räsänen P, Lappalainen P, Muotka J, Tolvanen A, Lappalainen R. An online guided ACT intervention for enhancing the psychological wellbeing of university students: a randomized controlled clinical trial. Behav Res Ther 2016 Mar;78:30-42. [CrossRef] [Medline]
  55. Trompetter HR, Bohlmeijer ET, Veehof MM, Schreurs KM. Internet-based guided self-help intervention for chronic pain based on acceptance and commitment therapy: a randomized controlled trial. J Behav Med 2015 Feb;38(1):66-80. [CrossRef] [Medline]
  56. Viskovich S, Pakenham KI. Pilot evaluation of a web-based acceptance and commitment therapy program to promote mental health skills in university students. J Clin Psychol 2018 Jul;74(12):2047-2069. [CrossRef] [Medline]
  57. Jacobson NS, Truax P. Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. J Consult Clin Psychol 1991 Feb;59(1):12-19. [CrossRef] [Medline]


ACBS: Association for Contextual Behavioral Science
ACT: Acceptance and Commitment Therapy
CBT: cognitive behavioral therapy
CSQ-8: Client Satisfaction Questionnaire-8 Items
DSM-5: Diagnostic and Statistical Manual of Mental Disorders-Fifth Edition
GAD: generalized anxiety disorder
iACT: internet-delivered Acceptance and Commitment Therapy
IAD: illness anxiety disorder
iCBT: internet-delivered Cognitive-Behavioral Therapy
NSQ: nonstandardized questions
POMRF: psychotherapy outcome study methodology rating form
PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses
RCT: randomized controlled trial
SAD: social anxiety disorder
SUS: System Usability Scale


Edited by G Eysenbach; submitted 18.10.18; peer-reviewed by SC Hayes, D Hoffmann; comments to author 01.11.18; revised version received 10.11.18; accepted 24.11.18; published 29.01.19

Copyright

©Joshua Kelson, Audrey Rollin, Brad Ridout, Andrew Campbell. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 29.01.2019.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.