This paper is in the following e-collection/theme issue:

Digital Mental Health Interventions, e-Mental Health and Cyberpsychology (1514) Web-based and Mobile Health Interventions (3297)

Published on in Vol 10, No 2 (2008): Apr-Jun

Therapist-Assisted, Internet-Based Treatment for Panic Disorder: Can General Practitioners Achieve Comparable Patient Outcomes to Psychologists?

Therapist-Assisted, Internet-Based Treatment for Panic Disorder: Can General Practitioners Achieve Comparable Patient Outcomes to Psychologists?

Therapist-Assisted, Internet-Based Treatment for Panic Disorder: Can General Practitioners Achieve Comparable Patient Outcomes to Psychologists?

Authors of this article:

Kerrie Shandley ;   David Austin ;   Britt Klein ;   Ciaran Pier ;   Peter Schattner ;   David Pierce ;   Victoria Wade
Article Authors Cited by (55) Tweetations Metrics

    Original Paper

    1Faculty of Life and Social Sciences, Swinburne University of Technology, Hawthorn, Victoria, Australia

    2School of Psychology, Deakin University, Burwood, Victoria, Australia

    3Department of General Practice, Monash University, Notting Hill, Victoria, Australia

    4School of Rural Health, Melbourne University, Parkville, Victoria, Australia

    5Adelaide Western General Practice Network, Woodville, South Australia, Australia

    Corresponding Author:

    Kerrie Shandley, MPsych (Health)

    Swinburne University of Technology

    Faculty of Life and Social Sciences

    Mail H31, PO Box 218

    Hawthorn, Victoria 3122

    Australia

    Phone: +61 9214 4681

    Email: kshandley@swin.edu.au


    Background: Mental illness is an escalating concern worldwide. The management of disorders such as anxiety and depression largely falls to family doctors or general practitioners (GPs). However, GPs are often too time constrained and may lack the necessary training to adequately manage the needs of such patients. Evidence-based Internet interventions represent a potentially valuable resource to reduce the burden of care and the cost of managing mental health disorders within primary care settings and, at the same time, improve patient outcomes.

    Objective: The present study sought to extend the efficacy of a therapist-assisted Internet treatment program for panic disorder, Panic Online, by determining whether comparable outcomes could be achieved and maintained when Panic Online was supported by either GPs or psychologists.

    Methods: Via a natural groups design, 96 people with a primary diagnosis of panic disorder (with or without agoraphobia) completed the Panic Online program over 12 weeks with the therapeutic assistance of their GP (n = 53), who had received specialist training in cognitive behavioral therapy, or a clinical psychologist (n = 43). Participants completed a clinical diagnostic telephone interview, conducted by a psychologist, and a set of online questionnaires to assess panic-related symptoms at three time periods (pretreatment, posttreatment, and 6 month follow-up).

    Results: Both treatments led to clinically significant improvements on measures of panic and panic-related symptomatology from pretreatment to posttreatment. Both groups were shown to significantly improve over time. Improvements for both groups were maintained at follow-up; however, the groups did differ significantly on two quality of life domains: physical (F1,82 = 9.13, P = .00) and environmental (F1,82 = 4.41, P = .04). The attrition rate was significantly higher among those being treated by their GP (χ21 = 4.40, P = .02, N = 96).

    Conclusions: This study provides evidence that Internet-based interventions are an effective adjunct to existing mental health care systems. Consequently, this may facilitate and enhance the delivery of evidence-based mental health treatments to increasingly large segments of the population via primary care systems and through suitably trained health professionals.

    J Med Internet Res 2008;10(2):e14

    doi:10.2196/jmir.1033

    Keywords

    Panic disorder; anxiety; Internet; mental health; general practice; cognitive behavioral therapy; email 


    Projections indicate that by the year 2020 mental health and neurological disorders will account for 15% of the global burden of disease [1]. Such worldwide estimates are comparable in Australia, with mental illness accounting for 13% of total disease burden [2] and 1 in 10 Australian adults reporting that they suffer from a long-term mental or behavioral problem [3].

    Despite the high prevalence, up to 40% of people experiencing a mental health problem do not receive any mental health care within a given 12-month period [4]. Typically, when treatment is sought, general practitioners (GPs) are the first, and often only, point of contact [5,6], with a recent Australian national survey finding that psychological problems account for 7.8% of GP visits [7]. Seeking help from a GP confers a number of advantages over other mental health professionals, such as psychologists and psychiatrists, in that GP visits are more accessible, affordable, and less stigmatizing [8].

    In an attempt to address gaps in mental health care service provision in Australia, and in recognition of the critical role GPs play in service delivery, the government has expanded the number of Medicare (Australia’s universal health care system) rebate items for mental health consultations, and, in 2001, introduced the Better Outcomes in Mental Health Care (BOiMHC) initiative. The BOiMHC initiative includes educational activities and financial incentives to improve the capacity of GPs to deliver evidence-based psychological interventions such as cognitive behavioral therapy (CBT) [9]. Although the initiative has been welcomed by the health industry and consumers, difficulties in service provision remain. For example, GPs often lack the time and necessary resources and support mechanisms to deliver appropriate psychological interventions to their patients, such as clinical supervision [10]. Consequently, not all GPs and/or regional divisions of general practice choose to participate, thereby creating inequitable patient access. As such, it is important to consider alternative models of delivering effective, evidence-based therapy, particularly for use in primary care. One promising and emerging service delivery modality is the Internet.

    Internet-Based Therapy

    Internet-based therapy (eTherapy) typically involves the interaction between a consumer and therapist (eTherapist) via the Internet [11] and incorporates the use of a structured Web-based treatment program for consumers to access in conjunction with eTherapist assistance (usually by email) [12]. Approximately 84% of Australians have access to the Internet [13]; consequently, eTherapy programs offer a unique opportunity to deliver evidence-based mental health treatment, without the need for intensive therapist involvement, to large underserved segments of the population.

    Over the past decade, Internet-based treatments have been found effective for a variety of physical health conditions and mental health disorders, such as headache [14], encopresis [15], tinnitus [16], depression [17], and posttraumatic stress symptoms [18]. Based on existing research, the psychological disorder most effectively treated via the Internet is one of the most common anxiety disorders—panic disorder.

    Panic Disorder

    Panic disorder affects approximately 1.3% (with agoraphobia, 2.4%) of the Australian population annually [5]. It is characterized by recurrent unexpected panic attacks and is commonly associated with other anxiety disorders [6], depression [19,20], increased risk of suicide [19], and substance and alcohol abuse [20]. Its incidence among people attending general practices has been estimated to be as high as 1 in 12 [21].

    CBT is a well established and highly effective treatment for panic disorder (with or without agoraphobia) [22]. The efficacy of CBT for panic disorder appears uncompromised when patients have comorbid depression [23] and when it is transferred from controlled research settings to real-world clinical settings [24]. Although CBT is effective for people with panic disorder, it typically averages 12 hours of face-to-face treatment with a mental health specialist [25]. Furthermore, there are major barriers to accessing expert assistance, including a scarcity of skilled therapists, long waiting lists, high cost, illness symptoms, comorbid conditions, sociodemographic factors, psychological distress, and consumer fears regarding the stigma of a mental health referral [26,27]. These barriers particularly disadvantage people in regional and rural areas where travelling time and distance are an added burden [28].

    Internet-based treatments largely address all of these barriers, and, indeed, panic disorder has been effectively treated via the Internet in a number of countries including Sweden [29-31] and the United Kingdom [32]. In Australia, one Internet program for panic disorder, Panic Online (PO), has been developed and extensively evaluated over the past decade.

    Panic Online

    Clinical trials have shown that PO, when paired with human support via email (provided by psychologist), is clinically superior to information-only control conditions or other forms of manual and telephone-based therapy [33,34]. PO has also been found to be credible and satisfying to participants [34], and outcomes are unaffected by level of education [35]. Furthermore, a recent exploratory study indicated that PO has the potential to be highly cost-effective [36]. Additionally, PO was recognized by the National Institute of Clinical Studies [37], and notably in a recent meta-analysis, it attained the largest effect size for an Internet-based treatment for a clinical mental health disorder [38].

    To our knowledge, PO has not previously been trialled with professional support beyond that of a psychologist, except our own study [39]. This paper reports on the full dataset from a study for which preliminary findings from a limited dataset have been published previously [39]. Given the central role that GPs have in the health system, the aim of the present study was to extend our current understanding of PO’s efficacy by examining participant outcomes when the program is supported by a GP in a traditional face-to-face consultation in comparison to eTherapist assistance.


    Participants

    A total of 193 people registered for the study, and after 97 were excluded on the basis of inclusion/exclusion criteria, a total of 96 individuals ultimately commenced treatment as part of this study: 43 were recruited into the PO plus psychologist support via email (PO+P) group and 53 into the PO plus face-to-face GP (PO+GP) group.

    In total, 132 BOiMHC-trained (CBT-trained) GPs registered to participate in the study, of which 37 actively referred the 53 PO+GP patients and treated participants as per the standardized protocol. Seven psychologists (6 females; 1 male) were employed as eTherapists for the PO+P group and as assessors for both groups.

    Measures

    This study utilized three assessment phases (pretreatment, posttreatment, and 6-month follow-up after treatment). Each assessment included a clinical interview conducted over the telephone by a psychologist and the completion of a set of self-administered questionnaires accessed via the Internet. Recent studies have shown that the majority of validated paper-and-pencil questionnaires generally retain their psychometric qualities and produce equivalent results when administered in an online format [40,41].

    Anxiety Disorders Interview Schedule-IV

    The Anxiety Disorders Interview Schedule-IV (ADIS-IV) is a semistructured clinical interview designed to permit differential diagnosis among anxiety and mood disorders and to screen for other major disorders (eg, substance abuse, psychosis, somatoform disorders). It includes the “number of panic attacks in the last month” (PAMTH). The ADIS-IV has good-to-excellent reliability and validity [42]. In the present study, the ADIS-IV was used to determine eligibility and participant diagnosis at each assessment phase.

    Anxiety Sensitivity Profile

    The Anxiety Sensitivity Profile (ASP) [43] is a 60-item questionnaire measuring the extent to which respondents are fearful that anxiety-related sensations will have harmful consequences. Respondents rate, on a 7-point Likert scale, the extent to which they agree that the sensations described would lead to a bad outcome. The ASP has high test-retest reliability [43].

    Depression Anxiety Stress Scale

    The Depression Anxiety Stress Scale (DASS) [44] is composed of three 14-item subscales measuring depression, anxiety, and stress. The extent to which a variety of symptoms were experienced within the prior week is rated on a 4-point Likert scale. Alpha coefficients have been reported at .91, .84, and .90 for the depression, anxiety, and stress subscales, respectively [44].

    Mobility Inventory

    The Mobility Inventory (MI) [45] is a measure of agoraphobic avoidance behavior, comprising 27 items. Participants indicate, on a 5-point Likert scale (1 = never avoid to 5 = always avoid), the degree to which they avoid a variety of places or situations when they are alone (MIA) and accompanied (MIB). Acceptable psychometrics have been reported for the MI [45-48].

    Panic Disorder Severity Scale

    The Panic Disorder Severity Scale (PDSS) [49] consists of seven items rated on a 5-point Likert scale (0 = not at all to 4 = most severe). The PDSS is designed to assess the severity of seven dimensions of panic disorder (panic attack frequency, panic attack distress, anticipatory anxiety, agoraphobia fear and avoidance, interoceptive fear and avoidance, occupational impairment/interference, and social impairment/interference) and associated symptoms. The seven items are summed to derive a total score ranging from 0-28, with higher scores reflecting greater symptom severity. The PDSS has excellent interrater reliability and good validity [49].

    Treatment Credibility Scale-Modified

    The Treatment Credibility Scale-Modified (TCS-M) [50] measures respondents’ attitudes to the credibility of a nominated treatment (in this study, either PO+P or PO+GP). Respondents rate five items on a 10-point scale (0 = not at all to 10 = very much) with respect to how credible they consider their allocated treatment to be after having read a brief rationale and description of the treatment. Higher scores reflect greater levels of perceived credibility.

    World Health Organization Quality of Life-BREF

    The World Health Organization Quality of Life-BREF (WHOQOL-BREF) [51] is a 26-item questionnaire developed from the original WHOQOL 100-item questionnaire. The WHOQOL-BREF covers four domains: physical health (eg, sleep, pain), psychological health (eg, self-esteem, concentration), social relationships (eg, social support, personal relationships), and environment (eg, physical safety, financial resources, recreation).

    Procedure

    Study Design

    The present study employed a natural groups design open to all Australian residents who met the inclusion criteria (detailed below). Participants who were referred to the program by their GP were allocated back to their GP for treatment and were therefore in the PO+GP group. Participants who self-referred to the program (eg, found it via Web surfing, word-of-mouth) were allocated to receive PO supported by an eTherapist and were therefore in the PO+P group.

    Recruitment

    The study was advertised to the general public via participating GPs, Australian mental health websites, and local and national media. Study volunteers could register their interest on the PO website.

    GPs were recruited in Victoria, South Australia, and New South Wales via BOiMHC-accredited training programs. Participating GPs were sent a project information package and subsequently were contacted by a research officer (either in person or via telephone) to discuss research protocols, PO program components, the manner in which PO was to be used, and the expected role of the GP and patient in the study. Additionally, regular consultative support was provided by the research officer throughout the duration of the study.

    Inclusion/Exclusion Criteria

    To be included in the study, participants were required to be Australian residents, have computer access, be 18 years or over, be fluent in English, have a primary diagnosis of panic disorder (with or without agoraphobia; as determined via the clinical telephone interview), and to agree not to undertake any other type of therapy for their panic disorder during the study. The request to refrain from other treatments did not cover the follow-up period. At post-assessment, all participants but one (whose data were removed from the analysis) had refrained from other treatments, as measured by self-report.

    People were excluded if they reported a seizure disorder, stroke, schizophrenia, hyperthyroidism, organic brain syndrome, heart condition, or chronic hypertension as these are confounding variables with independent associations with panic attacks [52]. People were likewise excluded if they had commenced taking medication in the previous 12 weeks or were not stabilized on their medication dose since this has the potential to confound any treatment effects found for PO.

    Assessment

    Study registrants were contacted by a psychologist who conducted a screening interview to determine whether they met the exclusionary criteria. When exclusionary criteria were met, volunteers were advised of the reason they could not participate and were referred to alternative services as appropriate. When exclusionary criteria were not met, an explanatory statement and consent form were emailed. Upon return of consent, a full clinical diagnostic assessment was conducted via telephone using the ADIS-IV, which took, on average, 90 minutes. Our interrater reliability for this procedure was .93. Following this, participants completed a set of online questionnaires. Upon assessment completion, participants were emailed a username and password with instructions on accessing the PO program. Posttreatment and follow-up assessments (clinical telephone interview and online questionnaires) were conducted at the end of week 12 and 6 months later. Psychologists did not provide therapy for any participant they assessed.

    The Panic Online Program

    PO is a 12-week eTherapy program consisting of an introductory module, four learning modules, and a relapse prevention module. The program includes treatment methods commonly used in standard CBT for panic disorder, including instructions for controlled breathing, progressive muscle relaxation, cognitive restructuring, and interoceptive and situational exposure. Downloadable audio of isometric and progressive muscle relaxation and sequential photographic slide shows for two graduated exposure in vivo exercises (going to the supermarket and driving a car) were provided. An adjunct stress management program was also available to all participants (see Richards et al [34]). Information and guidance throughout the program were standardized across participants.

    Panic Online With Psychologists (PO+P)

    Communication between participants and psychologists occurred via email. No limitations were placed on email frequency; however, the assigned eTherapist was instructed to initiate contact if he or she had not received communication from a participant for approximately 1-2 weeks. On average, per participant, eTherapists sent 15.29 emails (SD 9.26; n = 31) and spent 378.62 minutes (SD 264.43; n = 29) emailing participants throughout the 12-week treatment. On average, each eTherapist provided support to 7.17 (range 2-19) participants.

    Panic Online With General Practitioners (PO+GP)

    Following assessment by a psychologist, participants allocated to the PO+GP condition were asked to make an appointment with their GP for their first PO consultation. The GP was then informed by the assessor that the patient could commence treatment. GPs and participants were encouraged to consult regularly (approximately once per week) throughout the treatment duration, while participants were using PO between consultations. On average, participants saw their GP (in a face-to-face consultation) 7.14 times (n = 31) throughout the 12-week treatment.

    Statistical Methods

    An independent groups t test was conducted to assess treatment credibility. Three repeated measures multivariate analysis of variance (MANOVA), an analysis of covariance (ANCOVA), and an independent groups t test were performed to analyze data from this study. MANOVA was conducted to reduce the possibility of type II errors. The first repeated measures MANOVA examined panic symptoms and included the following: clinician-rated panic disorder and agoraphobia severity (as indicated by the ADIS-IV), PAMTH, ASP, and PDSS scores. The second MANOVA examined negative affect and included the three DASS subscales of depression, anxiety, and stress. The final MANOVA examined quality of life and included three of the four WHOQOL-BREF domains (physical, social, and environmental). Lastly, an ANCOVA was conducted to analyze the WHOQOL-BREF psychological domain using the pretreatment assessment score as the covariate. This was analyzed separately as there was a significant difference in the pre-assessment treatment scores between the two groups.


    Participant Characteristics

    In addition to their primary diagnosis of panic disorder, 75 participants were also assessed with clinical levels of agoraphobia (30 in the PO+P group and 45 in the PO+GP group). See Table 1 for a summary of participant characteristics. At pretreatment assessment, 52% of participants were taking medication (19 in the PO+P group and 31 in the PO+GP group). Table 2 provides a breakdown of medication frequencies at pretreatment assessment. Over half of the sample (n = 56) received a secondary clinical diagnosis at pretreatment assessment. Table 3 provides a breakdown of the frequencies of clinically significant comorbid conditions at pretreatment.

    Table 1. Characteristics of participants at pretreatment assessment, by group
    PO+PPO+GPTotal
    CharacteristicNo.MeanSDNo.MeanSDNo.MeanSD
    Age (years)43.512.438.710.940.911.8
    Education (years)12.72.812.92.812.82.8
    Gender
       Male101020
       Female334376
    Medication
       Yes193150
       No242246
    Primary diagnosis
       Panic disorder13821
       Panic disorder with agoraphobia304575
    Clinically comorbid condition at pretreatment assessment
       Yes223456
       No211940
    Previous mental health treatment (inpatient/outpatient)
       Yes202949
       No232447
    Table 2. Medication frequencies at pretreatment assessment, by group
    Drug Class*PO+PPO+GPTotal
    SSRI11415
    Benzodiazepine9413
    SNRI527
    SSRI + Benzodiazepine246
    Tricyclic antidepressant123
    Tricyclic antidepressant + SSRI1–1
    SSRI + SNRI–11
    Benzodiazepine + SSRI + Antipsychotic–11
    SSRI + Antipsychotic–11
    RIMA + Benzodiazepine–11
    Anticonvulsant + Benzodiazepine + Antipsychotic–11
    Total193150

    *SSRI, selective serotonin reuptake inhibitor; SNRI, selective noradrenaline reuptake inhibitor; RIMA, reversible inhibitor of monoamine oxidase type A

    Table 3. Clinical comorbid condition frequencies at pretreatment assessment, by group*
    DisorderPO+PPO+GPTotal
    Generalized anxiety disorder51722
    Depression91322
    Social anxiety disorder51520
    Specific disorder9918
    Dysthymia4913
       Posttraumatic stress disorder167
    Hypochondriasis246
    Obsessive compulsive disorder–44
    Alcohol dependence123
    Substance abuse–11

    *Some participants were assessed as having multiple clinical comorbid conditions.

    Attrition

    Attrition was defined as participants who withdrew, for reasons either known or unknown, from the research trial. The overall attrition rate for this study was 42.7% (41/96): 37.2% (16/43) and 47.2% (25/53) for the PO+P and PO+GP groups, respectively. This difference was not significant (χ21 = .60, P = .41, N = 96). Attrition from the treatment and follow-up phase was also examined separately. Overall attrition from pretreatment to posttreatment was 28.1% (27/96), with 16.3% (7/43) dropping out of the PO+P group and 37.7% (20/53) from the PO+GP group. Fisher exact test revealed that significantly more participants in the PO+GP group dropped out of the treatment (χ21 = 4.40, P = .02, N = 96). A further 14 participants (14.6%) were lost from the study between posttreatment and follow-up assessment. The overall attrition rate from posttreatment to follow-up by condition was 20.9% (9/43) for the PO+P group and 9.4% (5/53) for the PO+GP group; this difference was not significant (χ21 = 1.68, P = .15, N = 96). Table 4 provides reasons for attrition.

    Table 4. Reasons for attrition, by group
    ReasonPO+PPO+GPTotal
    Unknown9918
    Lost contact145
    Commencing face-to-face counselling123
    Computer problems123
    Personal issues (nonspecific)213
    GP difficulties22
    Cured11
    Health problem11
    Housing crisis11
    Language difficulties11
    Moved state11
    Personal issues (mental health)11
    Pregnancy11
    Total162541

    Data Properties and Treatment

    This study utilized intention-to-treat analyses. That is, pretreatment assessment scores for participants discontinuing their involvement during treatment were carried forward and used in both the posttreatment and follow-up assessments (11 for the PO+P group; 21 for the PO+GP group). Fisher exact test revealed no difference between the groups (χ21 = 1.52, P = .19, N = 96). A further 16 PO+P and 13 PO+GP posttreatment assessment scores were carried forward and used in the follow-up assessment. The difference was not significant (χ21 = 1.26, P = .19, N = 96).

    Nonnormally distributed dependent variables were transformed to satisfy normality assumptions. The DASS depression subscale and the MIA required a square root transformation, and PAMTH required a logarithmic transformation.

    One-way analysis of variance (ANOVA) tests were conducted on all measures to test for pretreatment differences between groups. A significant pretreatment difference was found in the WHOQOL-BREF psychological domain, with the PO+P group reporting greater quality of life for this domain in comparison to the PO+GP group (Table 5 and Table 6). However, no differences were found between the treatment groups for any other measure (see Table 5). Furthermore, no significant pretreatment assessment differences were detected for age (F1,94 = 4.09, P = .05), gender (χ21 = .08, P = .62, N = 96), agoraphobia (χ21 = 2.36, P = .09, N = 96), medication use (χ21 = 1.42, P = .22, N = 96), presence of clinically significant comorbid condition (χ21 = 1.16, P = .22, N = 96), years of education (F1,81 = .10, P = .75), or previous inpatient or outpatient treatment for a mental health condition (χ21 = .35, P = .54, N = 96).

    Results of evaluation of normality assumptions, homogeneity of variance-covariance matrices, and linearity were satisfactory. Additionally, Bartlett’s test of sphericity was conducted to confirm that the dependent variables in the MANOVA groupings were correlated at the P < .05 level. A multivariate outlier was detected in the panic symptoms MANOVA grouping and was subsequently removed due to its impact on the mean.

    Table 5. F ratios and P values from pretreatment assessment ANOVA
    Variable*FP
    DASS depression2.521,89.12
    DASS anxiety0.721,89.40
    DASS stress1.601,89.21
    WHOQOL-BREF physical3.611,87.06
    WHOQOL-BREF psychological6.091,87.02
    WHOQOL-BREF social1.941,87.17
    WHOQOL-BREF environmental2.731,87.10
    MIA0.411,84.53
    MIB0.311,83.58
    PAMTH0.381,94.54
    ASP0.031,88.86
    PDSS1.751,86.19

    *DASS, Depression Anxiety Stress Scale; WHOQOL-BREF, World Health Organization Quality of Life-BREF; MIA, Mobility Inventory alone; MIB, Mobility Inventory accompanied; PAMTH, panic attacks in the last month; ASP, Anxiety Sensitivity Profile; PDSS, Panic Disorder Severity Scale.

    Treatment Outcomes

    Treatment Credibility

    An independent samples t test revealed no significant differences between the groups for perceived treatment credibility prior to treatment (t82 = 1.96, P = .05).

    Panic Symptoms

    For the panic symptoms grouping, repeated measures MANOVA revealed no significant interaction between time (pre, post, follow-up) and group (PO+P, PO+GP) or group main effect. However, a significant main effect for time was found from pretreatment to posttreatment assessment. Examination of the univariate tests for time and associated means revealed a significant decrease on all seven measures. Means and standard deviations are presented in Table 6, multivariate results in Table 7, and univariate results in Table 8.

    Table 6. Means and standard deviations for treatment outcome measures at pretreatment, posttreatment, and follow-up treatment assessments, by group
    PO+PPO+GP
    Variable*No.MeanSDNo.MeanSD
    Clinician panic disorder rating
       Pre436.171.25536.291.29
       Post433.432.03534.292.30
       Follow-up433.022.42533.842.65
    Clinician agoraphobia rating
       Pre434.072.80535.132.35
       Post432.162.22533.652.52
       Follow-up432.402.34533.402.69
    PAMTH
       Pre436.337.99539.8514.83
       Post422.675.48534.278.12
       Follow-up421.862.98534.357.93
    PDSS
       Pre3814.624.405016.055.45
       Post389.715.655212.006.24
       Follow-up389.595.965011.736.36
    ASP
       Pre393.451.31513.401.42
       Post411.881.64512.581.62
       Follow-up411.831.61522.501.59
    MIA
       Pre412.15.93452.26.88
       Post391.78.87402.11.91
       Follow-up371.76.88442.03.87
    MIB
       Pre412.551.09442.67.95
       Post392.141.08422.36.95
       Follow-up372.161.12452.34.93
    DASS depression
       Pre4112.249.835016.4512.86
       Post 407.159.765113.5212.90
       Follow-up417.249.485012.3312.54
    DASS anxiety
       Pre4117.4610.105019.249.80
       Post 4010.2810.735114.5610.60
       Follow-up4110.2310.335013.6410.43
    DASS stress
       Pre4119.2610.355021.9810.06
       Post4012.2310.845117.2411.79
       Follow-up4112.5910.975016.2411.51
    WHOQOL-BREF physical
       Pre4059.0516.814951.5919.60
       Post3769.5313.855058.5421.13
       Follow-up3870.4314.084857.9220.94
    WHOQOL-BREF psychological
       Pre4050.4818.054941.0717.76
       Post3760.4717.945049.8318.48
       Follow-up3860.9617.454848.8319.75
    WHOQOL-BREF social
       Pre4055.0025.094947.1927.21
       Post3761.4922.855052.1727.12
       Follow-up3861.1822.874850.6127.64
    WHOQOL-BREF environment
       Pre4063.3816.924957.6515.76
       Post3767.0015.015060.5815.76
       Follow-up3867.6215.764860.4415.27
    Treatment credibility
       Pre3940.597.574537.477.02

    *PAMTH, panic attacks in the last month; PDSS, Panic Disorder Severity Scale; ASP = Anxiety Sensitivity Profile; MIA, Mobility Inventory alone; MIB, Mobility Inventory accompanied; DASS, Depression Anxiety Stress Scale; WHOQOL-BREF, World Health Organization Quality of Life-BREF.

    Table 7. Effects from the repeated measures MANOVA and ANCOVA analysis between groups*
    Time EffectGroup EffectTreatment × Time
    VariableFPPartial η2β − 1FPPartial η2β − 1FPPartial η2β − 1
    Panic symptoms
       Post10.287,52.00.581.001.657,52.14.18.621.167,52.35.14.45
       Follow-up2.167,58.05.21.77.907,58.52.10.35.877,58.53.10.34
    Negative affect
       Post18.043,86.00.391.01.693,86.48.06.42.803,86.50.03.22
       Follow-up.533,86.66.02.16.533,86.10.07.521.153,86.33.04.30
    Quality of life
       Post15.403,82.00.361.001.953,82.13.07.49.983,82.41.04.26
       Follow-up.583,80.63.02.172.973,80.04.10.68.013,801.00.00.05
    WHOQOL-BREF psychological
       Post2.161,83.15.03.31
       Follow-up.001,80.95.00.052.891,80.09.04.39.231,80.63.23.08

    *Panic symptoms MANOVA includes clinician-rated panic disorder and agoraphobia severity, PDSS, and PAMTH; negative affect MANOVA includes DASS subscales of depression, anxiety, and stress; quality of life MANOVA includes WHOQOL-BREF physical, social, and environmental domains.

    Table 8. Effects from univariate tests
    Time EffectGroup Effect
    VariableFPPartial
    η2    		β − 1FPPartial
    η2    		β − 1
    Pretreatment to Posttreatment
    Panic disorder69.491,58.00.551.00
    PAMTH29.911,58.00.341.00
    ASP35.371,58.00.461.00
    PDSS50.141,58.00.461.00
    Agoraphobia37.231,58.00.391.00
    MIA15.161,58.00.21.97
    MIB21.791,58.00.271.00
    DASS depression41.181,88.00.321.00
    DASS anxiety47.981,88.00.351.00
    DASS stress44.661,88.00.341.00
    WHOQOL-BREF physical45.911,84.00.351.00
    WHOQOL-BREF social9.981,84.00.11.88
    WHOQOL-BREF environmental12.071,84.00.13.93
    Posttreatment to Follow-Up
    WHOQOL-BREF physical9.131,82.001.00.85
    WHOQOL-BREF environmental4.411,82.04.05.55

    *PAMTH, panic attacks in the last month; ASP, Anxiety Sensitivity Profile; PDSS, Panic Disorder Severity Scale; MIA, Mobility Inventory alone; MIB, Mobility Inventory accompanied; DASS, Depression Anxiety Stress Scale; WHOQOL-BREF, World Health Organization Quality of Life-BREF.

    Negative Affect

    For the negative affect grouping, repeated measures MANOVA revealed no significant interaction between time and group or group main effect. However, a significant main effect for time was found from pretreatment to post treatment assessment (see Table 7). Examination of the univariate tests for time (see Table 8) and associated means (see Table 6) revealed a significant decrease on all three DASS subscales.

    Quality of Life

    For the quality of life grouping, repeated measures MANOVA revealed no significant interaction between time and group. However, a significant main effect for time from pretreatment to posttreatment assessment and a significant main effect for group from posttreatment to follow-up assessment were found (see Table 7). Examination of the univariate tests for time (see Table 8) and associated means (see Table 6) revealed a significant positive change on all three domains from pretreatment to posttreatment. Examination of the univariate between-subject effects from posttreatment to follow-up revealed a significant difference between the groups for the WHOQOL-BREF physical and environmental domains. The mean scores for both domains (see Table 6) showed that the PO+P group experienced a slight improvement, whereas the PO+GP group showed a slight decrease from posttreatment to follow-up.

    WHOQOL-BREF (Psychological)

    An ANCOVA was conducted on the psychological domain of the WHOQOL-BREF from pretreatment to posttreatment and posttreatment to follow-up. No significant differences were detected (see Table 7).

    Panic-Free Status and High-End State Functioning

    Panic-free status and high-end state functioning were examined at posttreatment and follow-up assessment. Panic-free status was defined as zero panic attacks reported during the month immediately prior to the assessment. At posttreatment assessment, panic-free status was achieved by 52.4% (22/42) of the PO+P group and 50.9% (27/53) of the PO+GP group; this difference was not significant (χ21 = .00, P = 1.00, N = 95). At follow-up, 52.4% (22/42) of the PO+P group and 47.2% (25/53) of the PO+GP group were panic free, but this difference was also not significant (χ21 = .09, P = .68, N = 95).

    High-end state functioning was defined as being panic free and having a clinician-rated panic disorder score ≤ 2. At posttreatment assessment, 28.6% (12/42) of the PO+P group and 26.4% (14/53) of the PO+GP group achieved high-end state functioning, but this difference was not statistically significant (χ21 = .00, P = .82, N = 95). At follow-up, 47.6% (20/42) of the PO+P group and 32.1% (17/53) of the PO+GP group achieved high-end state functioning, but again, the difference was not significant (χ21 = 1.77, P = .14, N = 95). However, for the PO+P group, the increase in high-end state functioning from posttreatment to follow-up was significant (t41 = −2.44, P = .02).


    The purpose of the current study was to investigate whether the established efficacy of PO was affected by changing the form of therapist assistance from email support provided by psychologists (eTherapists) to face-to-face support provided by GPs, and, further, whether treatment improvements were maintained. The results of this study support findings from several previous studies examining Internet programs in primary care [53,54] and demonstrate that evidence-based eTherapy programs could be a valuable tool for GPs managing patients with mental health conditions.

    The recommended treatment for panic disorder includes CBT, medication (antidepressants and/or benzodiazepines), or a combination of both [55]. However, there are difficulties associated with each form of treatment. Barriers such as accessibility, waiting lists, cost, and stigma inhibit access to CBT experts [26,27], and use of pharmacotherapy is often complicated by side effects, compliance, and other health considerations [56]. Furthermore, medication use in comparison to CBT treatment does not appear to result in sustained recovery beyond discontinuation [56,57]. Consequently, investigating other methods of delivering cost-effective and clinically effective treatment is important to address the growth of mental health disorders both in general practice and the wider community.

    In this study, PO (whether supported by eTherapists or face-to-face GPs) led to significant improvements in panic attack frequency, depression, anxiety, stress, anxiety sensitivity, agoraphobia avoidance, and quality of life. Improvements were maintained at follow-up, with the only significant differences occurring on the WHOQOL-BREF physical and environmental domains. It is beyond the capacity of this study to ascertain definitively why the groups differed on these particular measures. It is possible to speculate, however, that the different dissemination processes (email vs face-to-face) created disparate learning experiences between the groups, resulting in the PO treatment information being used and retained in different manners. Further, while the groups did not significantly differ on any pretreatment assessment sociodemographic measure, the PO+GP group did have a higher degree of comorbidity and proportion of participants on medication. Consequently, it is possible that this study inherently measured two different cohorts.

    Surprisingly, attrition from treatment was significantly higher for the PO+GP group. A number of possible reasons can be hypothesized. First, there was variation in the level of support throughout the duration of the trial. While participants in the PO+GP group were encouraged to regularly access their GP throughout treatment, this was not a requirement, and GP visitations could not be reasonably regulated within this study. By contrast, participants in the PO+P group were able to email their therapist as often as they wished, and their therapist was required to respond within 24 hours. Second, greater effort and planning are required to attend a medical practice in comparison to writing an email. Consequently, participants in the PO+P group may have experienced a greater level of continuous support and encouragement to adhere to the treatment. It is also worth noting that while treatment credibility was not significantly different between the groups, it did near significance, with the PO+P treatment appearing to be viewed more favorably than the PO+GP treatment. Finally, it is not known whether the content of GP visits focused specifically on panic disorder or incorporated consultation on other unrelated ailments. However, in comparison to other Internet-based studies [14,16], attrition overall in this study was relatively low.

    It is noteworthy that the proportion of participants achieving high-end state functioning in both groups continued to increase from posttreatment to follow-up and that for the PO+P group, the increase was significant. These results not only support the durability of PO to maintain treatment outcomes but also indicate that it has the capacity to continue to have benefits beyond treatment completion.

    Limitations

    There are several methodological issues and limitations to note. The primary limitation of this study was that it used a nonrandomized, natural groups design. Consequently, we can not speak to the direct comparability of these two treatments, and it is possible that the groups differed in ways not considered within this study. It should also be mentioned that all participating GPs were trained in delivering CBT. It is unknown whether non-CBT-trained GPs would achieve similar outcomes. This issue would benefit from further investigation as the accessibility to the program would be increased substantially if the evidence base indicated that all GPs were able to effectively support patients using the program. As discussed earlier, the treatments differed in terms of the supportive communication modality employed. This factor may have affected attrition and was not investigated. A final issue relates to PO access. Unfortunately, participant usage statistics (eg, number of times accessed PO, duration of time spent on PO) were not available. Consequently, it is possible that one group may have spent a proportionally greater period of time accessing and/or reading the PO material and therefore achieved and sustained greater benefits.

    Implications

    A number of implications for policy and practice can be derived from this study. While it is anticipated that there might be reluctance to adopt eTherapy into general practice [58], this study has demonstrated the capacity of evidence-based programs, such as PO, to aid GPs in the management of mental health disorders, such as panic disorder, and achieve sustained outcomes, making them an invaluable tool. However, at present, there is no specific Medicare and/or private health insurance rebates on such services. Furthermore, there is need for appropriate educational and financial support within primary care to integrate these programs within existing public health systems.

    Conclusions

    This study demonstrates that when panic disorder sufferers are provided with accessible online treatment protocols, CBT-skilled GPs can achieve sustained patient outcomes comparable to best-practice treatments delivered by psychologists. Further research will be required to evaluate Internet-based programs for other mental health conditions and with non-CBT-trained GPs. Nevertheless, this study provides strong evidence that the use of Internet-based programs is an effective adjunct to existing mental health care services and may enable the delivery of evidence-based treatments to increasingly large numbers of patients via primary care with the support of suitably trained health professionals.

    Acknowledgments

    The authors wish to acknowledge the contribution of the late Professor Jeffrey Richards, instigator and former chief investigator of this research.

    Funding for this research project was provided by the beyondblue Victoria Centre of Excellence in Depression and Related Disorders. Funding for the original development of the PO eTherapy program used in this study was granted to the original chief investigator, the late Professor Jeffrey Richards, by the Australian Rotary Health Research Fund.

    Conflicts of Interest

    None declared.

    1. Murray CJ, Lopez AD. Alternative projections of mortality and disability by cause 1990-2020: Global Burden of Disease Study. Lancet 1997 May 24;349(9064):1498-1504. [Medline] [CrossRef]
    2. ; Australian Institute of Health and Welfare. Australia’s Health 2006. AIHW cat. no. AUS 73. Canberra, Australia: Australian Institute of Health and Welfare; 2006.   URL: http://www.aihw.gov.au/publications/aus/ah06/ah06.pdf [accessed 2008 Apr 16] [WebCite Cache]
    3. ; Australian Bureau of Statistics (ABS). National Health Survey: Summary of Results, 2004-05. ABS cat. no. 4364.0. Canberra, Australia: Australian Bureau of Statistics; 2006.   URL: http:/​/www.​ausstats.abs.gov.au/​ausstats/​subscriber.nsf/​0/​3B1917236618A042CA25711F00185526/​$File/​43640_2004-05.​pdf [accessed 2008 Apr 16] [WebCite Cache]
    4. Hickie IB, Groom GL, McGorry PD, Davenport TA, Luscombe GM. Australian mental health reform: time for real outcomes. Med J Aust 2005 Apr 18;182(8):401-406 [FREE Full text] [Medline]
    5. Andrews G, Hall W, Teeson M, Henderson S. The Mental Health of Australians. Canberra, Australia: Mental Health Branch, Australian Commonwealth Department of Health and Aged Care; 1999.   URL: http:/​/www.​health.gov.au/​Internet/​wcms/​publishing.nsf/​Content/​78CA239BC007B0ADCA2572880002E508/​$File/​mhatitle.​pdf [accessed 2008 Apr 16] [WebCite Cache]
    6. Andrews G, Henderson S, Hall W. Prevalence, comorbidity, disability and service utilisation. Overview of the Australian National Mental Health Survey. Br J Psychiatry 2001 Feb;178(2):145-153 [FREE Full text] [Medline] [CrossRef]
    7. Britt H, Miller GC, Charles J, Pan Y, Valenti L, Henderson J, et al. General Practice Activity in Australia 2005-08. General Practice Series no. 19. AIHW cat. no. GEP 19. Canberra, Australia: Australian Institute of Health and Welfare; 2007.   URL: http://www.aihw.gov.au/publications/gep/gpaa05-06/gpaa05-06-c00.pdf [accessed 2008 Apr 16] [WebCite Cache]
    8. Keks NA, Altson BM, Sacks TL, Hustig HH, Tanaghow A. Collaboration between general practice and community psychiatric services for people with chronic mental illness. Med J Aust 1997 Sep 1;167(5):266-271 [FREE Full text] [Medline]
    9. Pirkis J, Stokes D, Morley B, Kohn F, Mathews R, Naccarella L, et al. Impacts of Australia’s Better Outcomes in Mental Health Care program for psychologists. Aust Psychol 2006;41(3):152-159. [CrossRef]
    10. Blashki G, Hickie IB, Davenport TA. Providing psychological treatments in general practice: how will it work? Med J Aust 2003 Jul 7;179(1):23-25 [FREE Full text] [Medline]
    11. Castelnuovo G, Gaggioli A, Mantovani F, Riva G. From psychotherapy to e-therapy: the integration of traditional techniques and new communication tools in clinical settings. Cyberpsychol Behav 2003 Aug;6(4):375-382. [Medline] [CrossRef]
    12. Abbott J, Klein B, Ciechomski L. Best practices in online therapy. J Technol Hum Serv forthcoming.
    13. ; Australian Bureau of Statistics (ABS). Household Use of Information Technology, 2005-06. Canberra, Australia: Australian Bureau of Statistics; 2006.   URL: http:/​/www.​ausstats.abs.gov.au/​Ausstats/​subscriber.nsf/​0/​CA78A4186873588CCA2570D8001B8C56/​$File/​81460_2004-05.​pdf [accessed 2008 Apr 16] [WebCite Cache]
    14. Ström L, Pettersson R, Andersson G. A controlled trial of self-help treatment of recurrent headache conducted via the Internet. J Consult Clin Psychol 2000 Aug;68(4):722-727. [Medline] [CrossRef]
    15. Ritterband LM, Cox DJ, Walker LS, Kovatchev B, McKnight L, Patel K, et al. An Internet intervention as adjunctive therapy for pediatric encopresis. J Consult Clin Psychol 2003 Oct;71(5):910-917. [Medline] [CrossRef]
    16. Andersson G, Strömgren T, Ström L, Lyttkens L. Randomized controlled trial of internet-based cognitive behavior therapy for distress associated with tinnitus. Psychosom Med 2002 Sep;64(5):810-816 [FREE Full text] [Medline] [CrossRef]
    17. Christensen H, Griffiths KM, Jorm AF. Delivering interventions for depression by using the internet: randomised controlled trial. BMJ 2004 Jan 31;328(7434):265 [FREE Full text] [Medline] [CrossRef]
    18. Litz BT, Williams L, Wang J, Bryant R, Engel CCJ. A therapist-assisted Internet self-help program for traumatic stress. Prof Psychol Res Pr 2004 Dec;35(6):628-634. [CrossRef]
    19. Gorman JM, Coplan JD. Comorbidity of depression and panic disorder. J Clin Psychiatry 1996;57 Suppl 10:34-41; discussion 42-3. [Medline]
    20. Hirschfeld RM. Panic disorder: diagnosis, epidemiology, and clinical course. J Clin Psychiatry 1996;57 Suppl 10:3-8; discussion 9-10. [Medline]
    21. Roy-Byrne P, Katon W, Broadhead WE, Lepine JP, Richards J, Brantley PJ, et al. Subsyndromal ("mixed") anxiety--depression in primary care. J Gen Intern Med 1994 Sep;9(9):507-512. [Medline] [CrossRef]
    22. Gould RA, Ott MW, Pollack MH. A meta-analysis of treatment outcome for panic disorder. Clin Psychol Rev 1995;15(8):819-844. [CrossRef]
    23. McLean PD, Woody S, Taylor S, Koch WJ. Comorbid panic disorder and major depression: implications for cognitive-behavioral therapy. J Consult Clin Psychol 1998 Apr;66(2):240-247. [Medline] [CrossRef]
    24. Wade WA, Treat TA, Stuart GL. Transporting an empirically supported treatment for panic disorder to a service clinic setting: a benchmarking strategy. J Consult Clin Psychol 1998 Apr;66(2):231-239. [Medline] [CrossRef]
    25. Lovell K, Richards D. Multiple access points and levels of entry (MAPLE): ensuring choice, accessibility and equity for CBT services. Behav Cognit Psychother 2000;28:379-391.
    26. Jackson H, Judd F, Komitt A, Fraser C, Murray G, Robins G, et al. Mental health problems in rural contexts: what are the barriers to seeking help from professional providers? Aust Psychol 2007;42(2):147-160. [CrossRef]
    27. Thompson A, Hunt C, Issakidis C. Why wait? Reasons for delay and prompts to seek help for mental health problems in an Australian clinical sample. Soc Psychiatry Psychiatr Epidemiol 2004 Oct;39(10):810-817. [Medline]
    28. Parslow RA, Jorm AF. Who uses mental health services in Australia? An analysis of data from the National Survey of Mental Health and Wellbeing. Aust N Z J Psychiatry 2000 Dec;34(6):997-1008. [Medline]
    29. Carlbring P, Ekselius L, Andersson G. Treatment of panic disorder via the Internet: a randomized trial of CBT vs. applied relaxation. J Behav Ther Exp Psychiatry 2003 Jun;34(2):129-140. [Medline] [CrossRef]
    30. Carlbring P, Nilsson-Ihrfelt E, Waara J, Kollenstam C, Buhrman M, Kaldo V, et al. Treatment of panic disorder: live therapy vs. self-help via the Internet. Behav Res Ther 2005 Oct;43(10):1321-1333. [Medline] [CrossRef]
    31. Carlbring P, Bohman S, Brunt S, Buhrman M, Westling BE, Ekselius L, et al. Remote treatment of panic disorder: a randomized trial of internet-based cognitive behavior therapy supplemented with telephone calls. Am J Psychiatry 2006 Dec;163(12):2119-2125 [FREE Full text] [Medline] [CrossRef]
    32. Kenwright M, Marks IM. Computer-aided self-help for phobia/panic via internet at home: a pilot study. Br J Psychiatry 2004 May;184(5):448-449 [FREE Full text] [Medline] [CrossRef]
    33. Klein B, Richards JC, Austin DW. Efficacy of internet therapy for panic disorder. J Behav Ther Exp Psychiatry 2006 Sep;37(3):213-238. [Medline] [CrossRef]
    34. Richards J, Klein B, Austin D. Internet CBT for panic disorder: Does the inclusion of stress management information improve end-state functioning? Clin Psychol 2006;10(1):2-15. [CrossRef]
    35. Richards J, Klein B, Carlbring P. Internet-based treatment for panic disorder. Cogn Behav Ther 2003;32(3):125-135. [Medline] [CrossRef]
    36. Mihalopoulos C, Kiropoulos L, Shih S, Gunn J, Blashki G, Meadows G. Exploratory economic analyses of three primary care mental health projects: Implications for sustainability. Med J Aust 2005;183:73-76.
    37. ; National Institute of Clinical Studies (NICS). The Impact of the Internet on Consumers Health Behaviour. Centre for General Practice and the Centre for Evidence Based Practice. Melbourne, Australia: NICS; 2003.   URL: url:http:/​/www.​nhmrc.gov.au/​nics/​data/​mediacache/​15746001153874589315/​The%20Impact%20of%20the%20Internet%20on%20Consumers%20Health%20Behaviour.​pdf [accessed 2008 Jan 23] [WebCite Cache]
    38. Spek V, Cuijpers P, Nyklícek I, Riper H, Keyzer J, Pop V. Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: a meta-analysis. Psychol Med 2007 Mar;37(3):319-328. [Medline] [CrossRef]
    39. Pier C, Austin DW, Klein B, Mitchell J, Schattner P, Ciechomski L, et al. A controlled trial of Internet-based cognitive behavioural therapy for panic disorder with face-to-face support from a general practitioner or email support from a psychologist. Ment Health Fam Med fortcoming.
    40. Austin DW, Carlbring P, Richards JC, Andersson G. Internet administration of three commonly used questionnaires in panic research: equivalence to paper administration in Australian and Swedish samples of people with panic disorder. Int J Testing 2006;6(1):25. [CrossRef]
    41. Carlbring P, Brunt S, Bohman S, Austin D, Richards J, Andersson G; Ost L-G. Internet vs. paper and pencil administration of questionnaires commonly used in panic/agoraphobia research. Comput Human Behav 2007;23(3):1421-1434. [CrossRef]
    42. Brown TA, Di Nardo PA, Lehman CL, Campbell LA. Reliability of DSM-IV anxiety and mood disorders: implications for the classification of emotional disorders. J Abnorm Psychol 2001 Feb;110(1):49-58. [Medline] [CrossRef]
    43. Taylor S, Cox BJ. Anxiety sensitivity: multiple dimensions and hierarchic structure. Behav Res Ther 1998 Jan;36(1):37-51. [Medline] [CrossRef]
    44. Lovibond PF, Lovibond SH. The structure of negative emotional states: comparison of the Depression Anxiety Stress Scales (DASS) with the Beck Depression and Anxiety Inventories. Behav Res Ther 1995 Mar;33(3):335-343. [Medline] [CrossRef]
    45. Chambless DL, Caputo GC, Jasin SE, Gracely EJ, Williams C. The Mobility Inventory for Agoraphobia. Behav Res Ther 1985;23(1):35-44. [Medline] [CrossRef]
    46. Cox BJ, Swinson RP, Kuch K, Reichman JT. Dimensions of agoraphobia assessed by the Mobility Inventory. Behav Res Ther 1993 May;31(4):427-431. [Medline] [CrossRef]
    47. Craske MG, Rachman SJ, Tallman K. Mobility, cognitions, and panic. J Psychopathol Behav Assess 1986;8(3):199-210. [CrossRef]
    48. Kwan SM, Evans L. Factor structure of the Mobility Inventory for agoraphobia: a validational study with Australian samples of agoraphobic patients. J Psychopathol Behav Assess 1990;12(4):365-374. [CrossRef]
    49. Shear MK, Brown TA, Barlow DH, Money R, Sholomskas DE, Woods SW, et al. Multicenter collaborative panic disorder severity scale. Am J Psychiatry 1997 Nov;154(11):1571-1575. [Medline]
    50. Borkovec TD, Nau SD. Credibility of analogue therapy rationales. J Behav Ther Exp Psychiatry 1972;3(4):257-260. [CrossRef]
    51. ; The WHOQOL Group. Development of the World Health Organisation WHOQOL-BREF quality of life assessment. Psychol Med 1998;28(3):551-558. [CrossRef]
    52. ; American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders. 4th edition. Washington, DC: American Psychiatric Press, Inc; 2000.
    53. Proudfoot J, Goldberg D, Mann A, Everitt B, Marks I, Gray JA. Computerized, interactive, multimedia cognitive-behavioural program for anxiety and depression in general practice. Psychol Med 2003 Feb;33(2):217-227. [Medline] [CrossRef]
    54. Cavanagh K, Shapiro DA, Van Den Berg S, Swain S, Barkham M, Proudfoot J. The effectiveness of computerized cognitive behavioural therapy in routine care. Br J Clin Psychol 2006 Nov;45(Pt 4):499-514. [Medline] [CrossRef]
    55. Cloos JM. The treatment of panic disorder. Curr Opin Psychiatry 2005 Jan;18(1):45-50. [Medline]
    56. Dannon PN, Iancu I, Cohen A, Lowengrub K, Grunhaus L, Kotler M. Three year naturalistic outcome study of panic disorder patients treated with paroxetine. BMC Psychiatry 2004;4:16. [Medline] [CrossRef]
    57. Choy Y, Peselow ED, Case BG, Pressman MA, Luff JA, Laje G, et al. Three-year medication prophylaxis in panic disorder: to continue or discontinue? A naturalistic study. Compr Psychiatry 2007;48(5):419-425. [Medline] [CrossRef]
    58. Austin D, Pier C, Mitchell J, Schattner P, Wade V, Pierce D, et al. Do GPs use electronic mental health resources? - a qualitative study. Aust Fam Physician 2006 May;35(5):365-366 [FREE Full text] [Medline]

    ‎
    ASP: Anxiety Sensitivity Profile
    BOiMHC: Better Outcomes in Mental Health Care
    CBT: cognitive behavioral therapy
    DASS: Depression Anxiety Stress Scale
    GP: general practitioner
    MIA: Mobility Inventory alone
    MIB: Mobility Inventory accompanied
    PAMTH: panic attacks in the last month
    PDSS: Panic Disorder Severity Scale
    PO: Panic Online
    WHOQOL-BREF: World Health Organization Quality of Life-BREF

    Edited by G Eysenbach; submitted 03.02.08; peer-reviewed by Anonymous, P Carlbring, G Andersson; comments to author 15.02.08; revised version received 27.02.08; accepted 28.03.08; published 19.05.08

    Copyright

    © Kerrie Shandley, David William Austin, Britt Klein, Ciaran Pier, Peter Schattner, David Pierce, Victoria Wade. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 19.05.2008. Except where otherwise noted, articles published in the Journal of Medical Internet Research are distributed under the terms of the Creative Commons Attribution License (http://www.creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided 1) the original work is properly cited, including full bibliographic details and the original article URL on www.jmir.org, and 2) this statement is included.