This paper is in the following e-collection/theme issue:

Telehealth and Telemonitoring (1671) Pulmonology, COPD (143)

Published on in Vol 22, No 7 (2020): July

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/18598, first published .
Technology-Enabled Self-Management of Chronic Obstructive Pulmonary Disease With or Without Asynchronous Remote Monitoring: Randomized Controlled Trial

Technology-Enabled Self-Management of Chronic Obstructive Pulmonary Disease With or Without Asynchronous Remote Monitoring: Randomized Controlled Trial

Technology-Enabled Self-Management of Chronic Obstructive Pulmonary Disease With or Without Asynchronous Remote Monitoring: Randomized Controlled Trial

Authors of this article:

Vess Stamenova1 Author Orcid Image ;   Kyle Liang1 Author Orcid Image ;   Rebecca Yang1 Author Orcid Image ;   Katrina Engel2 Author Orcid Image ;   Florence van Lieshout1 Author Orcid Image ;   Elizabeth Lalingo3 Author Orcid Image ;   Angelica Cheung2 Author Orcid Image ;   Adam Erwood4 Author Orcid Image ;   Maria Radina5 Author Orcid Image ;   Allen Greenwald5 Author Orcid Image ;   Payal Agarwal1, 6 Author Orcid Image ;   Aman Sidhu7, 8 Author Orcid Image ;   R Sacha Bhatia1, 8, 9 Author Orcid Image ;   James Shaw1, 9 Author Orcid Image ;   Roshan Shafai10 Author Orcid Image ;   Onil Bhattacharyya1, 6, 9 Author Orcid Image
Article Authors Cited by (30) Tweetations (12) Metrics

    Original Paper

    1Institute for Health System Solutions and Virtual Care, Women's College Hospital, Toronto, ON, Canada

    2Respiratory Therapy Department, Markham Stouffville Hospital, Markham, ON, Canada

    3Medicine, Care Transitions, Access & Flow, Respiratory Therapy, Markham Stouffville Hospital, Markham, ON, Canada

    4Support Services & Transformation, Markham Stouffville Hospital, Markham, ON, Canada

    5Center for Respiratory Health, Markham Stouffville Hospital, Markham, ON, Canada

    6Department of Family and Community Medicine, University of Toronto, Toronto, ON, Canada

    7University Health Network, Toronto, ON, Canada

    8Department of Medicine, University of Toronto, Toronto, ON, Canada

    9Women’s College Research Institute, Toronto, ON, Canada

    10Hospital to Home and Community Medicine Clinic, Markham Stouffville Hospital, Markham, ON, Canada

    Corresponding Author:

    Vess Stamenova, PhD

    Institute for Health System Solutions and Virtual Care

    Women's College Hospital

    76 Grenville St

    Toronto, ON, M5S 1B2

    Canada

    Phone: 1 4163236000 ext 5112

    Email: vess.stamenova@wchospital.ca


    Background: Chronic obstructive pulmonary disease (COPD) is a leading cause of mortality and leads to frequent hospital admissions and emergency department (ED) visits. COPD exacerbations are an important patient outcome, and reducing their frequency would result in significant cost savings. Remote monitoring and self-monitoring could both help patients manage their symptoms and reduce the frequency of exacerbations, but they have different resource implications and have not been directly compared.

    Objective: This study aims to compare the effectiveness of implementing a technology-enabled self-monitoring program versus a technology-enabled remote monitoring program in patients with COPD compared with a standard care group.

    Methods: We conducted a 3-arm randomized controlled trial evaluating the effectiveness of a remote monitoring and a self-monitoring program relative to standard care. Patients with COPD were recruited from outpatient clinics and a pulmonary rehabilitation program. Patients in both interventions used a Bluetooth-enabled device kit to monitor oxygen saturation, blood pressure, temperature, weight, and symptoms, but only patients in the remote monitoring group were monitored by a respiratory therapist. All patients were assessed at baseline and at 3 and 6 months after program initiation. Outcomes included self-management skills, as measured by the Partners in Health (PIH) Scale; patient symptoms measured with the St George’s Respiratory Questionnaire (SGRQ); and the Bristol COPD Knowledge Questionnaire (BCKQ). Patients were also asked to self-report on health system use, and data on health use were collected from the hospital.

    Results: A total of 122 patients participated in the study: 40 in the standard care, 41 in the self-monitoring, and 41 in the remote monitoring groups. Although all 3 groups improved in PIH scores, BCKQ scores, and SGRQ impact scores, there were no significant differences among any of the groups. No effects were observed on the SGRQ activity or symptom scores or on hospitalizations, ED visits, or clinic visits.

    Conclusions: Despite regular use of the technology, patients with COPD assigned to remote monitoring or self-monitoring did not have any improvement in patient outcomes such as self-management skills, knowledge, or symptoms, or in health care use compared with each other or with a standard care group. This may be owing to low health care use at baseline, the lack of structured educational components in the intervention groups, and the lack of integration of the action plan with the technology.

    Trial Registration: ClinicalTrials.gov NCT03741855; https://clinicaltrials.gov/ct2/show/ NCT03741855

    J Med Internet Res 2020;22(7):e18598

    doi:10.2196/18598

    Keywords

    COPD; eHealth; telemedicine; remote consultation; self-care 


    Background

    Chronic obstructive pulmonary disease (COPD) is the third leading cause of mortality worldwide [1], with 65 million people having moderate to severe COPD worldwide [2]. In Ontario, Canada, COPD accounts for 24% of hospital admissions and 24% of emergency department (ED) visits and is responsible for the highest percentage (18.8%) of 30-day ED readmissions [3]. Reducing the frequency of COPD exacerbations is an important patient outcome and could result in significant cost savings.

    One approach to reducing exacerbations is to provide regular remote monitoring of patients from their homes. Remote monitoring requires patients to take measurements of their vital signs (oxygen, blood pressure, and symptoms) and to record them manually on paper [4] or to transmit them with devices using a phone or an internet line [5-7]. Recent developments such as Bluetooth technology, cloud-based storage, and Wi-Fi–enabled tablets have allowed data from remote devices to be uploaded automatically to a database accessible to patients, caregivers, and health care providers, either periodically or on an as-needed basis [8-10]. Remote monitoring programs are always monitored by a health care provider, even though they are sometimes referred to as self-management programs, as the recordings are taken by the patients [10]. Some remote monitoring programs also often have an educational component [11,12] such as coaching sessions to support self-management. COPD self-management behaviors include self-recognition and self-treatment of exacerbations (eg, taking medications); coping with breathlessness; and lifestyle changes such as quitting smoking, eating healthy, and exercising [13]. Self-management COPD interventions have generally been shown to be effective in improving quality of life measures [13,14], but a recent meta-analysis failed to show significant improvements in quality of life [15].

    There is a large body of literature on COPD reporting on the effects of remote monitoring on patient outcomes and health care utilization, and several recent reviews have summarized these findings [16-18]. For example, Kruse et al [16] reported that the number of articles stating that patient outcomes improved overall with telemonitoring was approximately equal to that showing no improvement. Another review [17] reported that remote monitoring decreased ED admissions and hospitalizations but failed to impact other patient outcomes (mortality, outpatient visits, and length of stay). Hong and Lee [17] suggested that integrated remote monitoring programs (those that have educational components) may be more effective, especially when they target patients with more advanced diseases.

    Educational components come at an additional cost to these programs [19] and even the simple act of monitoring patients remotely and connecting with them only when alerts are received requires dedicated staff. Few studies have looked at the effectiveness of self-monitoring programs. Self-monitoring programs ask patients to take their readings and receive automated feedback based on these readings without being actively monitored by a health provider [4,20]. Results from the few studies available in the literature have shown some promise in improving patient outcomes but they were feasibility trials that required larger samples and control group designs. A self-monitoring program, if noninferior to a remote monitoring program, would provide the opportunity for significant cost savings without compromising on patient outcomes. To our knowledge, no studies to date have directly compared a remote monitoring program with a self-monitoring program for patients with COPD.

    Objectives

    The objective of our study was to compare the effectiveness of implementing a technology-enabled self-monitoring program versus a technology-enabled self- and remote-monitoring program (or simply remote monitoring) in a population of patients with COPD, compared with a standard care group. We hypothesized that both intervention programs would lead to improvements in self-management skills and respiratory symptoms relative to the standard care program. In addition, the technology-enabled remote monitoring programs may be more effective at increasing COPD knowledge than self-monitoring alone.


    Study Setting

    The study was conducted at a 309-bed community-based hospital in Ontario. Recruitment took place in a hospital-based outpatient COPD clinic, from the private practice of respirologists affiliated with the hospital, and from an outpatient COPD rehabilitation program.

    Trial Design

    We conducted an open-label randomized controlled trial (RCT) comparing 2 technology-enabled interventions, a self-monitoring group and a remote monitoring group, relative to standard care. Patients were randomized in a 1:1:1 ratio to 1 of the 3 groups. The study recruitment started in April 2018 and was completed in September 2019. A full description of the protocol has been published [21]. We report here only on the quantitative portion of the evaluation. The qualitative results are published separately [22].

    Participants

    Eligibility Criteria

    Patients were included if they were aged 18 years or older and had an established clinical diagnosis of COPD by a respirologist, according to clinical guidelines [23]. Exclusion criteria included a diagnosis of other significant lung diseases (eg, interstitial lung disease), patients without Wi-Fi internet access in their homes, inability to read English (required for filling out the questionnaires), participation in other remote monitoring programs, or inability to use the technology because of physical or cognitive impairment.

    Recruitment Process

    The main site of recruitment was the hospital-based outpatient clinic, where all eligible patients seen within the past year were contacted for participation. Patients could also be referred to the study from outside the clinic, through the private practice of hospital-affiliated respirologists or through an outpatient COPD rehabilitation program. Patients were contacted by phone, directly approached at an appointment, or approached at the hospital’s exercise rehabilitation program by a clinical staff member (respirologist or respiratory therapist [RT]). Those who were interested were referred to the clinical project specialist and scheduled for a baseline evaluation, at which time informed consent was obtained, group allocation was revealed, and the kit was provided (if in the self-monitoring or remote monitoring group).

    Allocation

    We used a web-based random number generator [24] to allocate patients to groups, as described in the trial protocol [21]. Sequential patient group allocation was placed in a sealed envelope and revealed to the patient by the clinical project specialist after consent was obtained.

    Intervention

    Technology

    The Cloud DX Connected Health Kit (Cloud DX Inc) [25] (Multimedia Appendix 1) was used in the 2 intervention groups. It was selected as it was made by a local Ontario company (a requirement from the granting agency), was fully developed, was on the market at the time of the study, and was capable of monitoring oxygen saturation. The kit comprised the following Bluetooth devices: a custom tablet computer, a Pulsewave wrist cuff monitor (which measures blood pressure), an oximeter, a weighing scale, and a thermometer. The devices were approved by the US Food and Drug Administration and Health Canada. A digital version of the COPD Assessment Test (CAT) [26] and the modified Medical Research Council (MRC) Scale [27] were also embedded in the technology. The data from all devices were transmitted to a database, and patients and health care providers interacted with it through a web-based portal. Regular bug fixes were occurring throughout the trial, and no major revisions of the content of the platform were done. Throughout the trial, there were 3 releases and 1 service pack installed in the platform and 2 releases, 5 hotfixes, and 1 service pack released for the companion app (see Multimedia Appendix 2 for details).

    Intervention Procedures

    The intervention lasted for 6 months. Patients in the intervention groups were asked to record their vitals (oximetry and blood pressure were required, whereas temperature and weight were optional) and symptoms (CAT and MRC) with the Cloud DX platform every day. They were also provided with a written version of a personalized COPD action plan that instructed patients on what to do if their readings fell outside predetermined thresholds (Multimedia Appendix 1). Individual patient thresholds were determined by the clinical project specialist (who was an RT), in consultation with the patient’s respirologist. Patients in the self-monitoring and remote monitoring groups were additionally contacted by the clinical project specialist 2 weeks after receiving their kit to reassess the appropriateness of the thresholds. In addition, all patients had the option to email or call the clinic with any nonemergency questions they may have. All patients were advised to go to the ED if necessary, at any point in the study. Patients were also informed that data were not monitored 24 hours, 7 days a week and to respond to their clinical needs as they would normally do outside of the study.

    When a patient’s readings fell outside the predetermined thresholds, a notification was sent to both the clinical project specialist and the patient through email. The clinical project specialist reviewed the readings and responded when clinically indicated only for the remote monitoring group. Follow-up calls were made only when the readings exceeded thresholds twice or more within 2 days and were made only on weekdays. An attempt to complete the follow-up call was performed within 24 hours of receiving the notification. If the patient was unavailable, a message was left to return the call. In addition, the RT called the patients in the remote monitoring group once a week, irrespective of the values of the vitals. The purpose of the call was to check the patients, prompt action plan usage as needed, and provide education to the patients about their COPD as needed. The clinical project specialist received the readings for the self-monitoring group, but they were not actively monitored, and no follow-up calls were made in this group. Patients in the self-monitoring group were informed that their data were not actively monitored by the clinic. Patients in both intervention groups had secondary threshold levels (extreme measures) preset by the site investigator. Cloud DX staff monitored these levels and contacted the patients when necessary. For details, please refer to the protocol [21].

    Patients in the standard care group were not provided with a technology or an action plan. This group received otherwise standard care from the respiratory clinic, including routine in-person follow-up appointments and access to a certified respiratory educator. Patients in the standard care group were told that they would receive the equipment at the end of the trial to incentivize them to stay in the trial and to ensure that all participants had equal access.

    Outcomes

    All patients completed 3 assessments, at baseline, at 3 months, and at 6 months, on a series of questionnaires. Visit 1 (baseline) was in person, whereas visits 2 (3 months) and 3 (6 months) could be done in person or remotely (online through REDCap [28,29] or over the phone).

    Primary Outcome

    The primary outcome for the trial was self-management as assessed using the Partners in Health (PIH) Scale [30], a validated scale measuring the current status of self-management, with items on the knowledge of the condition and skills to monitor and respond to symptoms. This scale was selected to measure the primary outcome as we believed that both interventions could lead to self-management improvement.

    Secondary Outcomes

    The secondary outcomes included measures of COPD severity and COPD knowledge and were measured with the St George’s Respiratory Questionnaire (SGRQ) [31] and the Bristol COPD Knowledge Questionnaire (BCKQ) [32]. The SGRQ contains subsections on respiratory symptoms, activities that are limited because of breathlessness, and impacts on daily life. The BCKQ [32] is a measurement of the level of knowledge of the disease in patients with COPD. Patients were also asked to self-report at baseline, 3 months, and 6 months on their COPD-related ED presentations, hospital admissions, length of hospital stays, number of exacerbations (episodes in which antibiotics or steroids were prescribed or hospital/clinic visits because of a respiratory issue), number of COPD-related visits to a family doctor, number of COPD-related nurse contacts, self-reported use of medication, and self-reported smoking cessation. The number of contacts/calls to the outpatient clinic and deaths were tracked and reported by the clinical project specialist. In addition, hospital admission data and ED usage from the local hospital were also obtained.

    Vendor-recorded use data were also documented and sent for analysis at the end of the trial. This included the frequency of recordings for oxygen, blood pressure, temperature, weight, MRC and CAT scores, and the number of times thresholds were exceeded.

    Statistical Analysis

    Patient characteristics were summarized using descriptive statistics, including mean and SD for continuous variables (if normally distributed) or median, median absolute deviation, and absolute numbers for categorical variables.

    All quantitative continuous data were analyzed by conducting a between-group repeated measures analysis of variance (ANOVA) comparing the scores at baseline versus 3-month follow-up and baseline versus 6-month follow-up assessments. This deviation from the original protocol (where we had planned to include all 3 time points in each analysis) was done to maximize the data and avoid excluding participants who did not have data on all 3 time points. Kruskal-Wallis tests were used where data were not normally distributed or group variances were heterogeneous.

    Ethics and Dissemination

    The study was approved by the research ethics boards of the Markham Stouffville Hospital and Women’s College Hospital, Ontario, Canada (protocol version 1.8, December 7, 2018). The study was also retrospectively registered with ClinicalTrials.gov (NCT03741855).

    Patient and Public Involvement

    During the initial planning stages of the study, we used a co-design approach in the development of the intervention. Patients were given access to the technology for 2 weeks and were subsequently interviewed about their experiences. Health care providers were also interviewed about their current models of care and their experience with the technology. The goal of this process was to establish whether the technology met the needs of its users (patients and health care providers) and to determine whether any modifications to the technology and the service it provided were needed. Modifications to both service and technology were done in response to this feedback. Some of this feedback was also used to inform the decisions about primary and secondary outcome selection.

    Patient advisers were not involved directly in the development of the research question and outcome measures or recruitment. The burden of the intervention was assessed by the research ethics boards who had public member representatives. Any participants interested in receiving information about the results of the study will be provided with a summary once the results are available.


    Study Participants

    A total of 122 patients participated in the study: 40 in the standard care, 41 in the self-monitoring, and 41 in the remote monitoring groups. Of these patients, 7 in the standard care, 5 in the self-monitoring, and 6 in the remote monitoring group did not complete the study (8 patients withdrew from the trial for various reasons; 6 patients were noncompliant with their readings; 4 patients died: 1 from a COPD exacerbation, 1 from complications of comorbid conditions, 1 from cardiac arrest, and 1 from unknown causes; and 1 patient dropped out because of difficulty using the technology; Figure 1). There were no significant differences in the rates of study completion among the groups (P=.80). Patients were excluded from individual analyses, if they had missing data.

    The baseline characteristics of the patients are described in Table 1. Comparisons among groups were made with ANOVA for normally distributed variables, Kruskal-Wallis tests for variables that were not normally distributed, and chi-square tests for categorical data. Patients matched at baseline on all characteristics, except for the CAT baseline scores, where the self-monitoring group had significantly lower scores than the standard care group (P=.02).

    All patients were able to speak and read English, except for 3 patients in the remote monitoring group who were included as they had support from caregivers in completing the questionnaires. There was an equal distribution of education level across the 3 groups (P=.64; Multimedia Appendix 1). Patients from all 3 groups were present in all income brackets, except for the highest income bracket, where there were no self-monitoring patients (P=.01; Multimedia Appendix 1). Patients in all 3 groups were also matched on a series of medical conditions at baseline (Multimedia Appendix 1), except for osteoporosis, for which the rates were lower in the remote monitoring group (P=.02), and pulmonary hypertension, which was reported only in 3 cases, all in the standard care group (P=.04).

    ‎
    Figure 1. Patient flow through the study. Patient flow through each arm of the study. A total of approximately 800 patients were screened for eligibility in order to obtain the final sample of 122 participants.
    View this figure
    Table 1. Baseline characteristics of patients in each group.
    CharacteristicsStandard care groupSelf-monitoring groupRemote monitoring groupP value
    Age(years)


    		.86

    		Patients, n404141

    		Mean (SD)72.78 (9.16)71.76 (7.28)71.98 (9.52)
    Gender, n (%)


    		.93

    		Female19 (48)18 (44)18 (44)

    		Male21 (52)23 (56)23 (56)
    Patients with caregiver (%)758376.63
    Years since diagnosis of COPDa


    		.32

    		Patients, n364038

    		Median44.57

    		MADb3.715.194.45
    Currently smoking (%)231224.32
    Never smoked (%)31123.07
    Years since quitting smoking


    		.63

    		Patients, n293124

    		Median151513

    		MAD17.7910.3811.86
    FEV1 % Prec


    		.22

    		Patients, n353736

    		Median0.450.530.50

    		MAD0.220.130.25
    FEV1 (L)d


    		.09

    		Patients, n353736

    		Median1.091.261.17

    		MAD0.470.670.43
    FEV1/FVCe


    		.49

    		Patients, n353736

    		Median0.560.580.54

    		MAD0.180.160.19
    COPD Assessment Test


    		.02

    		Patients, n314141

    		Mean (SD)20.42 (7.68)15.54 (7.65)19.15 (8.18)
    Systolic blood pressure


    		.54

    		Patients, n254140

    		Mean (SD)129.36 (15.86)129.90 (20.50)125.65 (17.34)
    Diastolic blood pressure


    		.63

    		Patients, n254140

    		Mean (SD)76.76 (7.55)75.37 (10.63)74.48 (8.83)
    BMI


    		.08

    		Patients, n323531

    		Median24.6528.1023.40

    		MAD6.674.156.52
    Never been in exercise/rehabilitation (%)586880.08
    Never used technology (%)687885.16
    No medications on hold (%)635963.91
    COPD exacerbations in the past 12 months

    		.17

    		Patients, n404041

    		Median112

    		MAD1.481.482.97
    Emergency department visits in the past 12 months
    		.61

    		Patients, n404141

    		Median000

    		MAD000
    Hospitalizations in the past 12 months


    		.72

    		Patients, n394141

    		Median000

    		MAD000
    Primary care visits in the past 12 months


    		.79

    		Patients, n384041

    		Median1.511

    		MAD2.221.481.48

    aCOPD: chronic obstructive pulmonary disease.

    bMAD: median absolute deviation.

    cFEV1 % pre: % of predicted forced expiratory volume in 1 second.

    dFEV1: forced expiratory volume in 1 second.

    eFVC: forced vital capacity.

    Readings and Notifications

    There were no significant differences in the number of readings completed by each intervention group on any of the measures. There were also no significant differences in the number of notifications received on any of the measures. Patients took their readings almost daily, with a median number of 160 readings in the self-monitoring group and 162 readings in the remote monitoring group over a 182-day period (Multimedia Appendix 1).

    Incoming Calls

    There were differences among the groups in the number of incoming calls completed during the intervention (P<.001). Post hoc comparisons showed that the standard care group made significantly fewer calls (mean 0.13, SD 0.40) than the self-monitoring (mean 4.17, SD 4.17; P<.001) and the remote monitoring groups (mean 3.27, SD 4.29; P<.001). There was no difference between the number of calls made by the self-monitoring and remote monitoring groups (P=.11).

    Primary and Secondary Outcomes

    A repeated measures ANOVA showed a significant improvement in PIH scores from baseline to 3 months (P=.001) and from baseline to 6 months (P=.008) but no group effects or interactions, suggesting that there was no differential effect among the groups (Figure 2).

    ‎
    Figure 2. PIH at baseline and 3 months and baseline and 6 months for each group. Significant improvement in PIH scores from baseline to 3 months (P=.001) and from baseline to 6 months (P=.008) were observed, but no group effects or interactions, suggesting no differential effect among the groups. PIH: Partners in Health; RM: remote monitoring SC: standard care; SM: self-monitoring.
    View this figure

    A repeated measures ANOVA showed a significant improvement in BCKQ scores from baseline to 3 months (P<.001) and from baseline to 6 months (P<.001; Multimedia Appendix 1). Steeper gains were observed in the remote monitoring group compared with the self-monitoring and standard care groups, both from baseline to 3 months and from baseline to 6 months, but the interaction effect did not reach statistical significance (P=.13 and P=.07, respectively). The gains in accuracy were less than 10%, and all groups had initial scores of just above 30% accuracy, which is lower than the average of 54% accuracy reported by the original BCKQ study [32]. No group main effects were observed.

    A repeated measures ANOVA showed no changes in SGRQ activity scores (Multimedia Appendix 1) from baseline to 3 months (P=.49) or from baseline to 6 months (P=.76) and no group effects or interactions.

    A repeated measures ANOVA showed a significant improvement in SGRQ impact scores (Multimedia Appendix 1) from baseline to 3 months (P=.047), but no significant group effect or interaction, suggesting that there was no differential effect among the groups. When comparing baseline to 6 months, a repeated measures ANOVA showed a significant effect of time (P=.006) and a significant interaction effect (P=.005). Separate pairwise comparison analyses were performed to examine the interaction effect. The standard care group improved from baseline to 6 months, whereas the remote monitoring group scores deteriorated (higher score) as demonstrated by a significant interaction effect (P=.02). A significant interaction effect (P=.003) was also observed when the self-monitoring and remote monitoring groups were analyzed separately, showing that the self-monitoring group improved, whereas the remote monitoring group worsened. Both standard care and self-monitoring groups improved significantly with time in their SGRQ impact scores (P=.002), and there was no interaction or group effect.

    A repeated measures ANOVA showed no changes in SGRQ symptom scores from baseline to 3 months (P=.56) or from baseline to 6 months (P=.62) and no group effects or interactions (Multimedia Appendix 1).

    Finally, for the remote monitoring and self-monitoring groups, a repeated measures ANOVA comparing the second CAT readings to their previous CAT reading, with time as a within-subject variable and group as a between-subject variable, showed no significant main effects or interactions. The same was observed with the MRC scores. Therefore, there were no changes in the CAT and MRC scores from the beginning of the intervention until the end.

    Correlation Between Changes in Partners in Health Scores and the Number of Readings

    We ran a series of Pearson correlations between the number of readings (CAT, MRC, and oxygen saturation) and the change in score from baseline to 6 months for the participants in the self-monitoring and remote monitoring groups. No correlations were observed in any of these analyses.

    Health Care Use

    In comparing baseline to 3 months, there were no significant effects of time, group, or interaction on any of the measures, except for a decrease in primary care COPD-related visits (P=.04). This reduction was most evident in the standard care and remote monitoring groups. In comparing baseline to 6 months, there were no effects of time, group, or interaction on any of the measures. The incidence of any of the above events was quite low (Multimedia Appendix 1).

    In addition to the self-reported measures, the hospital charts of patients were reviewed to estimate the number of ED visits and hospitalizations that had occurred at the hospital during the 6 months preceding their enrollment and during their participation in the trial. The charts were also reviewed to assess the total number of clinic visits that the patients had completed during these periods (clinic visits could be ascertained only for patients who were seeing a physician at the COPD clinic). Nonparametric comparisons were run to estimate the effect of time, group, and time×group interaction. No significant main effects or interactions were observed.

    Separate data analyses were performed to compare only COPD-related ED visits and hospitalizations. These analyses showed a significant decrease in COPD-related ED visits during the 6 months before trial enrollment to the 6 months during trial enrollment (P=.007); however, there was no group effect or interaction, suggesting that there was a general decline in visits across groups. For COPD-related hospital admissions, there was a decrease but not a statistically significant effect across the 3 groups (P=.07; Table 2).

    Table 2. Health care use based on hospital data.
    GroupPatients, nSix months before enrollmentSix months post enrollment


    		Mean (SD)MedianMADaMaximum valueMean (SD)MedianMADMaximum value
    Emergency department admissions

    		SCb400.7 (0.99)0030.43 (0.9)004

    		SMc410.22 (0.52)0020.32 (0.79)004

    		RMd410.46 (0.9)0040.37 (0.77)004
    Hospital admissions

    		SC400.25 (0.54)0020.3 (0.85)005

    		SM410.15 (0.48)0020.12 (0.4)002

    		RM410.32 (0.82)0040.15 (0.42)002
    Emergency department admissions for COPDe

    		SC400.38 (0.74)0030.13 (0.52)003

    		SM410.15 (0.48)0020.07 (0.35)002

    		RM410.27 (0.71)0040.1 (0.3)001
    Hospital admissions for COPD

    		SC400.15 (0.43)0020.18 (0.81)005

    		SM410.07 (0.35)0020.02 (0.16)001

    		RM410.2 (0.56)0030.05 (0.22)001
    Clinic visits

    		SC321.25 (1.08)1061.41 (0.98)104

    		SM351.23 (0.97)11.541.57 (0.78)11.54

    		RM301.37 (0.72)1031.5 (0.97)10.74

    aMAD: median absolute deviation.

    bSC: standard care.

    cSM: self-monitoring.

    dRM: remote monitoring.

    eCOPD: chronic obstructive pulmonary disease.


    Principal Findings

    This study compared the effectiveness of a technology-enabled self-monitoring program to a remote monitoring program and standard care in a population of patients with COPD. Despite high adherence to the intervention and a low dropout rate, the study found no difference in self-efficacy or disease knowledge and disease severity measures among the groups. All 3 groups, including the standard care group, improved self-efficacy and disease knowledge measures. These changes were significant over time and were evident at both 3- and 6-month evaluations. The standard care and self-monitoring groups, but not the remote monitoring group, also reported a lower impact of COPD on their lives when comparing baseline to 6-month evaluations. There were no changes in symptoms or activity scores in any of the groups. There were also no differences (increases or decreases) in patient health care utilization, including ED visits, hospital admissions, primary care visits, or nursing visits, during participants’ participation in the trial relative to the 6 months preceding the trial, although these were secondary outcomes that the study was not powered for.

    The lack of effect in this study is not unique, as current studies and reviews on the effects of remote monitoring on patient outcomes and health utilization have shown mixed results [16-18]. Some studies have reported positive results on some quality of life measures and symptoms [10,33-35], but many have reported no effects [8,12,36-39]. With respect to health care utilization, the effects are also mixed, with some reporting reductions in hospitalizations [5,7,33,40-42], length of stay [7,33,40,43], and ED visits [33,40], but many failing to find significant effects [6,10,34,36-38]. A recent systematic review concluded that the evidence on the effectiveness of remote monitoring is mixed [16], although some meta-analyses have reported significant reductions in hospitalizations and ED visits [17,44]. Hong and Lee [17] took their meta-analysis one step further and examined the effects of patient severity and intervention type (interventions with or without an educational component). They concluded that interventions with an educational component (such as those seen in self-management programs) and those targeting patients with more severe diseases had the greatest effects, especially on health care utilization (hospitalizations and ED visits). Our intervention lacked both these components.

    First, although spirometry readings on an average suggested moderate to severe disease, there was a large variability among patients, with many patients having milder symptoms. Most patients had no hospital or ED admissions in the 12 months before joining the intervention, which also suggested that even those with moderate to severe disease had enough clinical support to avoid hospitalizations. However, we know that there was room for improvement as all 3 groups improved on several patient outcomes, including self-efficacy and disease knowledge measures. This may mean that the standard care delivered at the local clinic may already have been quite effective in improving patient outcomes, which would have made it harder for us to detect any additional effect of remote monitoring or self-monitoring over those provided in standard care during the same period. If future studies exclude milder patients from similar interventions and find effects, it may provide evidence that remote monitoring and self-monitoring monitoring programs are better suited for moderate to severe patients. This may also make such programs more affordable for health care systems as only a subset of patients will have to be monitored. If the primary goal is to examine the impact on health care utilization (which was not our focus in this study), we recommend focusing on patients with at least one ED or hospital admission, using administrative data sets and examining longer intervention periods.

    Second, our intervention did not have a formal educational component. Although the clinical project specialist was making regular calls to patients in the remote monitoring group and providing them with guidance and education when needed, there was no structured educational component in the form of coaching sessions. Some education was also already delivered as part of standard care in the clinic, which may also explain why patients with moderate to severe disease had relatively few hospitalizations. Future studies should include structured coaching sessions, covering topics on self-recognition and self-treatment of exacerbations (eg, taking medications), coping with breathlessness, and lifestyle changes [13] to make the intervention groups more distinct from standard care. More personalized educational components can be delivered by a health care professional in a remote monitoring program, whereas more standardized education modules can be delivered directly through the device in response to readings.

    In this intervention, we provided patients with action plans that were not integrated with the devices. Evidence suggests that action plans can be effective in reducing the effects of exacerbations when they are followed, but few patients follow written action plans [45]. The integration of action plans within the platform, with patients receiving feedback directly from the device, may improve their use, although a recent study found no additional benefits when action plans were embedded within a self-monitoring mobile app over those provided by a written action plan [38]. Further developments in trend analyses and predictive analytics of remote monitoring data [46] may allow for early detection of exacerbations as relative changes in vital signs may be more important than detecting vitals reaching absolute thresholds.

    Strengths and Limitations

    With regard to strengths, this is the first study to directly compare remote monitoring relative to self-monitoring and standard care, and the comparison was conducted through an RCT, which offers strong internal validity for the findings. There was a high adherence rate from both intervention groups with hundreds of oximeter recordings, subjective symptom scores, and blood pressure measurements taken from patients. Furthermore, follow-up was very good, with only 7% of the participants withdrawing, 7% being noncompliant, and only one patient finding the technology to be too difficult to use. Despite this, our design suffered from drawbacks such as a relatively short intervention period (6 months) and inclusion criteria that allowed any patients with a diagnosis of COPD, irrespective of disease severity, to participate. Some of these decisions were made because of time constraints surrounding the trial funding and associated recruitment challenges. Many studies in the literature had disease severity inclusion criteria that often required patients to be admitted at least once and often twice in the previous year [8,42,47]. With respect to intervention duration, a full-year intervention seems to be the most common, but we noted interventions ranging from 3 to 24 months. Although our intervention was only 6 months, it is worth noting that some 6-month interventions have shown positive effects [7,34,35].

    Conclusions

    Our 6-month intervention comparing technology-enabled remote monitoring and self-monitoring programs showed no intervention specific improvements in self-efficacy, disease knowledge, or quality of life. No effects were observed in health care utilization, including hospital admissions and ED visits. Future studies should focus on patients with higher health care system use and moderate to severe disease. We also recommend including structured educational components (potentially both in remote monitoring and self-monitoring programs) and predictive analytics of vitals data that detect relative rather than absolute changes in vitals.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    Supplementary results.

    DOCX File , 4543 KB
    ‎
    Multimedia Appendix 2

    Bug fixes and releases.

    DOCX File , 19 KB
    ‎
    Multimedia Appendix 3

    CONSORT-eHEALTH checklist (V 1.6.1).

    PDF File (Adobe PDF File), 1701 KB
    1. Collins LM, Murphy SA, Strecher V. The multiphase optimization strategy (MOST) and the sequential multiple assignment randomized trial (SMART): new methods for more potent ehealth interventions. Am J Prev Med 2007 May;32(5 Suppl):S112-S118 [FREE Full text] [CrossRef] [Medline]
    2. Chronic Respiratory Diseases: Burden of COPD. World Health Organization.   URL: https://www.who.int/respiratory/copd/burden/en/ [accessed 2020-02-10]
    3. All-Cause Readmission to Acute Care and Return to the Emergency Department. CIHI: Canadian Institute for Health Information. 2012.   URL: https://secure.cihi.ca/free_products/Readmission_to_acutecare_en.pdf [accessed 2018-10-18]
    4. MacNab M, Lee SH, McCloughan L, Hanley J, McKinstry B, Pinnock H. Oximetry-supported self-management for chronic obstructive pulmonary disease: mixed method feasibility pilot project. BMC Health Serv Res 2015 Oct 26;15:485 [FREE Full text] [CrossRef] [Medline]
    5. Vitacca M, Paneroni M, Grossetti F, Ambrosino N. Is there any additional effect of tele-assistance on long-term care programmes in hypercapnic copd patients? A retrospective study. COPD 2016 Oct;13(5):576-582. [CrossRef] [Medline]
    6. Sorknaes AD, Madsen H, Hallas J, Jest P, Hansen-Nord M. Nurse tele-consultations with discharged COPD patients reduce early readmissions--an interventional study. Clin Respir J 2011 Jan;5(1):26-34. [CrossRef] [Medline]
    7. de san Miguel K, Smith J, Lewin G. Telehealth remote monitoring for community-dwelling older adults with chronic obstructive pulmonary disease. Telemed J E Health 2013 Sep;19(9):652-657. [CrossRef] [Medline]
    8. Lilholt PH, Udsen FW, Ehlers L, Hejlesen OK. Telehealthcare for patients suffering from chronic obstructive pulmonary disease: effects on health-related quality of life: results from the Danish 'TeleCare North' cluster-randomised trial. BMJ Open 2017 May 9;7(5):e014587 [FREE Full text] [CrossRef] [Medline]
    9. Tupper O, Gregersen T, Ringbaek T, Brøndum E, Frausing E, Green A, et al. Effect of tele-health care on quality of life in patients with severe COPD: a randomized clinical trial. Int J Chron Obstruct Pulmon Dis 2018;13:2657-2662 [FREE Full text] [CrossRef] [Medline]
    10. Farmer A, Williams V, Velardo C, Shah SA, Yu L, Rutter H, et al. Self-management support using a digital health system compared with usual care for chronic obstructive pulmonary disease: randomized controlled trial. J Med Internet Res 2017 May 3;19(5):e144 [FREE Full text] [CrossRef] [Medline]
    11. Farias R, Sedeno M, Beaucage D, Drouin I, Ouellet I, Joubert A, et al. Innovating the treatment of COPD exacerbations: a phone interactive telesystem to increase COPD action plan adherence. BMJ Open Respir Res 2019;6(1):e000379 [FREE Full text] [CrossRef] [Medline]
    12. Mudiyanselage SB, Stevens J, Watts J, Toscano J, Kotowicz M, Steinfort C, et al. Personalised telehealth intervention for chronic disease management: a pilot randomised controlled trial. J Telemed Telecare 2019 Jul;25(6):343-352. [CrossRef] [Medline]
    13. Yadav UN, Hosseinzadeh H, Baral KP. Self-management and patient activation in COPD patients: an evidence summary of randomized controlled trials. Clin Epidemiol Glob Health 2018 Sep;6(3):148-154 [FREE Full text] [CrossRef]
    14. Wang T, Tan J, Xiao LD, Deng R. Effectiveness of disease-specific self-management education on health outcomes in patients with chronic obstructive pulmonary disease: an updated systematic review and meta-analysis. Patient Educ Couns 2017 Aug;100(8):1432-1446. [CrossRef] [Medline]
    15. Jolly K, Sidhu M, Bates E, Majothi S, Sitch A, Bayliss S, et al. Systematic review of the effectiveness of community-based self-management interventions among primary care COPD patients. NPJ Prim Care Respir Med 2018 Nov 23;28(1):44. [CrossRef] [Medline]
    16. Kruse C, Pesek B, Anderson M, Brennan K, Comfort H. Telemonitoring to manage chronic obstructive pulmonary disease: systematic literature review. JMIR Med Inform 2019 Mar 20;7(1):e11496 [FREE Full text] [CrossRef] [Medline]
    17. Hong Y, Lee SH. Effectiveness of tele-monitoring by patient severity and intervention type in chronic obstructive pulmonary disease patients: a systematic review and meta-analysis. Int J Nurs Stud 2019 Apr;92:1-15. [CrossRef] [Medline]
    18. Yang F, Wang Y, Yang C, Hu H, Xiong Z. Mobile health applications in self-management of patients with chronic obstructive pulmonary disease: a systematic review and meta-analysis of their efficacy. BMC Pulm Med 2018 Sep 4;18(1):147 [FREE Full text] [CrossRef] [Medline]
    19. Bourbeau J, Collet J, Schwartzman K, Ducruet T, Nault D, Bradley C. Economic benefits of self-management education in COPD. Chest 2006 Dec;130(6):1704-1711. [CrossRef] [Medline]
    20. Tabak M, Brusse-Keizer M, van der Valk P, Hermens H, Vollenbroek-Hutten M. A telehealth program for self-management of COPD exacerbations and promotion of an active lifestyle: a pilot randomized controlled trial. Int J Chron Obstruct Pulmon Dis 2014;9:935-944 [FREE Full text] [CrossRef] [Medline]
    21. Stamenova V, Yang R, Engel K, Liang K, van Lieshout F, Lalingo E, et al. Technology-enabled self-monitoring of chronic obstructive pulmonary disease with or without asynchronous remote monitoring: protocol for a randomized controlled trial. JMIR Res Protoc 2019 Aug 19;8(8):e13920 [FREE Full text] [CrossRef] [Medline]
    22. van Lieshout F, Yang R, Stamenova V, Agarwal P, Cornejo D, Sidhu A, et al. Evaluating the implementation of a remote monitoring program for chronic obstructive pulmonary disease using qualitative methods: a service design perspective (Preprint). J Med Interent Res 2020:- (forthcoming). [CrossRef]
    23. Dewar M, Curry RW. Chronic obstructive pulmonary disease: diagnostic considerations. Am Fam Physician 2006 Feb 15;73(4):669-676 [FREE Full text] [Medline]
    24. Urbaniak G, Plous S. Research Randomizer. 2019.   URL: https://www.randomizer.org/ [accessed 2019-09-26]
    25. Connected Health Monitoring Kit. Cloud DX.   URL: https://www.clouddx.com/#/connectedhealthkit [accessed 2019-04-04]
    26. Jones PW, Harding G, Berry P, Wiklund I, Chen W, Kline Leidy N. Development and first validation of the COPD assessment test. Eur Respir J 2009 Sep;34(3):648-654 [FREE Full text] [CrossRef] [Medline]
    27. Mahler DA, Wells CK. Evaluation of clinical methods for rating dyspnea. Chest 1988 Mar;93(3):580-586. [CrossRef] [Medline]
    28. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)--a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform 2009 Apr;42(2):377-381 [FREE Full text] [CrossRef] [Medline]
    29. Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O'Neal L, REDCap Consortium. The REDCap consortium: building an international community of software platform partners. J Biomed Inform 2019 Jul;95:103208. [CrossRef] [Medline]
    30. Petkov J, Harvey P, Battersby M. The internal consistency and construct validity of the partners in health scale: validation of a patient rated chronic condition self-management measure. Qual Life Res 2010 Sep;19(7):1079-1085. [CrossRef] [Medline]
    31. Jones P, Quirk F, Baveystock C. The St George's respiratory questionnaire. Resp Med 1991 Sep;85:25-31. [CrossRef]
    32. White R, Walker P, Roberts S, Kalisky S, White P. Bristol COPD knowledge questionnaire (BCKQ): testing what we teach patients about COPD. Chron Respir Dis 2006;3(3):123-131. [CrossRef] [Medline]
    33. Esteban C, Moraza J, Iriberri M, Aguirre U, Goiria B, Quintana JM, et al. Outcomes of a telemonitoring-based program (telEPOC) in frequently hospitalized COPD patients. Int J Chron Obstruct Pulmon Dis 2016;11:2919-2930 [FREE Full text] [CrossRef] [Medline]
    34. McDowell JE, McClean S, FitzGibbon F, Tate S. A randomised clinical trial of the effectiveness of home-based health care with telemonitoring in patients with COPD. J Telemed Telecare 2015 Mar;21(2):80-87. [CrossRef] [Medline]
    35. Davis C, Bender M, Smith T, Broad J. Feasibility and acute care utilization outcomes of a post-acute transitional telemonitoring program for underserved chronic disease patients. Telemed J E Health 2015 Sep;21(9):705-713. [CrossRef] [Medline]
    36. Soriano JB, García-Río F, Vázquez-Espinosa E, Conforto JI, Hernando-Sanz A, López-Yepes L, et al. A multicentre, randomized controlled trial of telehealth for the management of COPD. Respir Med 2018 Nov;144:74-81. [CrossRef] [Medline]
    37. Walker PP, Pompilio PP, Zanaboni P, Bergmo TS, Prikk K, Malinovschi A, et al. Telemonitoring in chronic obstructive pulmonary disease (CHROMED). A randomized clinical trial. Am J Respir Crit Care Med 2018 Sep 1;198(5):620-628. [CrossRef] [Medline]
    38. Boer L, Bischoff E, van der Heijden M, Lucas P, Akkermans R, Vercoulen J, et al. A smart mobile health tool versus a paper action plan to support self-management of chronic obstructive pulmonary disease exacerbations: randomized controlled trial. JMIR Mhealth Uhealth 2019 Oct 9;7(10):e14408 [FREE Full text] [CrossRef] [Medline]
    39. Pinnock H, Hanley J, McCloughan L, Todd A, Krishan A, Lewis S, et al. Effectiveness of telemonitoring integrated into existing clinical services on hospital admission for exacerbation of chronic obstructive pulmonary disease: researcher blind, multicentre, randomised controlled trial. Br Med J 2013 Oct 17;347:f6070 [FREE Full text] [CrossRef] [Medline]
    40. Achelrod D, Schreyögg J, Stargardt T. Health-economic evaluation of home telemonitoring for COPD in Germany: evidence from a large population-based cohort. Eur J Health Econ 2017 Sep;18(7):869-882 [FREE Full text] [CrossRef] [Medline]
    41. Pedone C, Chiurco D, Scarlata S, Incalzi RA. Efficacy of multiparametric telemonitoring on respiratory outcomes in elderly people with COPD: a randomized controlled trial. BMC Health Serv Res 2013 Mar 6;13:82 [FREE Full text] [CrossRef] [Medline]
    42. Lyth J, Lind L, Persson HL, Wiréhn AB. Can a telemonitoring system lead to decreased hospitalization in elderly patients? J Telemed Telecare 2019 Jul 10:1357633X19858178 epub ahead of print. [CrossRef] [Medline]
    43. Shany T, Hession M, Pryce D, Roberts M, Basilakis J, Redmond S, et al. A small-scale randomised controlled trial of home telemonitoring in patients with severe chronic obstructive pulmonary disease. J Telemed Telecare 2017 Aug;23(7):650-656. [CrossRef] [Medline]
    44. McLean S, Nurmatov U, Liu JL, Pagliari C, Car J, Sheikh A. Telehealthcare for chronic obstructive pulmonary disease: Cochrane review and meta-analysis. Br J Gen Pract 2012 Nov;62(604):e739-e749 [FREE Full text] [CrossRef] [Medline]
    45. Bischoff EW, Hamd DH, Sedeno M, Benedetti A, Schermer TR, Bernard S, et al. Effects of written action plan adherence on COPD exacerbation recovery. Thorax 2011 Jan;66(1):26-31. [CrossRef] [Medline]
    46. Riis HC, Jensen MH, Cichosz SL, Hejlesen OK. Prediction of exacerbation onset in chronic obstructive pulmonary disease patients. J Med Eng Technol 2016;40(1):1-7. [CrossRef] [Medline]
    47. Udsen FW, Lilholt PH, Hejlesen O, Ehlers L. Cost-effectiveness of telehealthcare to patients with chronic obstructive pulmonary disease: results from the Danish 'TeleCare North' cluster-randomised trial. BMJ Open 2017 May 17;7(5):e014616 [FREE Full text] [CrossRef] [Medline]

    ‎
    ANOVA: analysis of variance
    BCKQ: Bristol COPD Knowledge Questionnaire
    CAT: COPD Assessment Test
    COPD: chronic obstructive pulmonary disease
    ED: emergency department
    MRC: Medical Research Council
    PIH: Partners in Health
    RCT: randomized controlled trial
    RT: respiratory therapist
    SGRQ: St George’s Respiratory Questionnaire

    Edited by E Borycki; submitted 12.03.20; peer-reviewed by L Friesen, L Wang, GE Iyawa; comments to author 05.05.20; revised version received 21.05.20; accepted 31.05.20; published 30.07.20

    Copyright

    ©Vess Stamenova, Kyle Liang, Rebecca Yang, Katrina Engel, Florence van Lieshout, Elizabeth Lalingo, Angelica Cheung, Adam Erwood, Maria Radina, Allen Greenwald, Payal Agarwal, Aman Sidhu, R Sacha Bhatia, James Shaw, Roshan Shafai, Onil Bhattacharyya. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 30.07.2020.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.