The Effectiveness of Online-Only Blended Cardiopulmonary Resuscitation Training: Static-Group Comparison Study

Introduction

Background

Basic life support (BLS) education plays a critical role in improving a community’s awareness of sudden cardiac arrest (SCA) and bystander cardiopulmonary resuscitation (CPR) rates. The outbreak of emerging infectious diseases, such as COVID-19, has become an obstacle to promoting BLS education in most emergency medical service (EMS) systems worldwide [1], and public willingness to perform CPR [2] and attend BLS classes has been affected by social distancing rules [3].

Several evidence-based strategies have been proposed for promoting CPR education. For example, the American Heart Association (AHA) recommended self-directed learning and deliberate practice during the pandemic [4], whereas the European Resuscitation Council specifically recommended distance learning [5]. In settings where face-to-face learning is restricted, distance learning may be useful for delivering CPR training [6-8].

In fact, distance learning (synonymous with online learning or e-learning) was proposed for CPR training as early as 2006 [9]. To date, AHA Heartsaver courses provide two different formats for distance learning: (1) an online-only course called Heartsaver Virtual [10] and (2) a blended learning (BL) course, in which a student completes part of the course online in a self-directed manner, followed by an instructor-led hands-on skills session [11]. In a systematic review, Elgohary et al [12] reported that the BL method was at least as effective as conventional CPR training methods, if not more so. Furthermore, Han et al [7] demonstrated that an online-only BL course could improve laypersons’ CPR skills to the same extent as a classroom-based conventional CPR training course. However, evidence regarding the practical effects of online-only CPR training courses is still scarce [13,14], especially evidence from comparative studies of online-only BL and classroom-based BL (CBL).

In addition, deliberate practice is a training approach in which learners are given the following: (1) a discrete goal to achieve, (2) immediate feedback on their performance, and (3) ample time for repetition to improve their performance [4]. A scoping review by Donoghue et al [15] suggested integrating deliberate practice instructional design models to enhance BLS courses and improve educational outcomes. Using deliberate practice models during conventional CPR training improves skill acquisition and retention in many critical tasks [4]. Hence, the effect and feasibility of deliberate practice in distance learning has not been studied and needs to be clarified.

Objectives

To overcome the challenges in CPR education brought about by COVID-19, a novel online-only BL-based BLS course that implements distance learning and self-directed deliberate practice was developed to train the following: bystander CPR rate, automated external defibrillator (AED) use, and timely EMS activation for out-of-hospital cardiac arrest. The aim of this study is to describe the development of a novel online-only BLS training model—remote practice BL (RBL)—and compare its effect on learners’ performance with that of a conventional CBL course in an educational setting. We hypothesized that the RBL method would be noninferior to the CBL method in terms of the BLS sequence and CPR performance.

Methods

Study Design

A static-group comparison study was conducted to compare the effects of RBL-based BLS courses with CBL-based courses on learners’ performance in an educational setting.

Study Setting

This study was conducted during the COVID-19 nationwide level 3 epidemic alert in Taiwan by SaveANNE Education, a qualified BLS training institute that hosts over 250 BL-based BLS training courses annually.

Description of Conventional CBL

The CBL-based BLS courses at SaveANNE Education have 3 main parts. Part A is an online lecture session with 7 knowledge-related instructional videos that focus on first aid, EMS, BLS, CPR, and AED, followed by a mandatory online test with 20 multiple-choice questions (MCQs; Multimedia Appendix 1). Part B is an instructor-led hands-on deliberate practice session in which learners are given the following: (1) 3 discrete skill-related goals, including chest compressions, operating an AED, and adult BLS sequences; (2) immediate instructor and manikin feedback on their performance; and (3) ample time for repetition to improve their performance [4]. Part C is an on-site final assessment session, whose passing standard implies mastery of the learned skills. In the assessment session, learners are certified as meeting the following two criteria: (1) performing the BLS sequence correctly and (2) achieving at least 80% (80/100) in Little Anne QCPR scores for compression release, depth, and rate.

The Little Anne QCPR manikin (Laerdal Co) and its QCPR training app were used to show learners real-time and summative feedback on CPR compression performance, paired with AED Practi-TRAINER Essentials (WNL Products). The manikin to learner and instructor to learner ratios were 1:1 and 1:4, respectively. All qualified BLS instructors were paramedics with more than 3 years of practical EMS experience. All teaching materials, including instructional videos, MCQs, skill-training scenarios, and assessment criteria, were developed by the SaveANNE Education core team, comprising 2 experienced paramedics, 1 emergency physician, 1 EMS medical director, and 1 professional filmmaker.

Description of RBL

In May 2021, the Taiwan Central Epidemic Command Center raised the nationwide COVID-19 epidemic alert to level 3. As a result, most on-site educational facilities, including SaveANNE Education training classes, were suspended. Therefore, the CBL-based BLS course was modified into a new RBL-based BLS course, which also comprised 3 parts. Part A of the RBL-based BLS course was the same as the CBL-based course. Part B was modified to be a self-directed remote deliberate practice session that followed principles that were similar to the CBL-based course: (1) 3 identical discrete skill-related goals, including chest compressions, operating an AED, and adult BLS sequences; (2) immediate manikin-driven feedback on chest compression performance; and (3) ample time for repetition to improve performance [4]. Part C, the final assessment session, was conducted online and not in a classroom. The instructor evaluated the learners via video conference using the same scenario and passing criteria as in the CBL-based BLS course (Figure 1).

In the final assessment session of both the CBL and RBL-based BLS courses, the instructor had the opportunity to give feedback on learners’ BLS-related knowledge, skills, and attitudes, and each of the learners had the opportunity to repeat the final assessment session until they passed.

‎

Participants

During the study period, SaveANNE Education used the internet to invite learners from 38 and 68 RBL and CBL-based courses, respectively, to join as study participants. The exclusion criteria for the participants were as follows: (1) informed consent was not obtained and (2) course participation was insufficient.

Sample Size

The sample size was estimated based on previous preliminary data, with an expected mean chest compression score of 95 (SD 4.5) among CBL-based BLS course learners. A sample size of 27 in each group had a power of 0.8 to detect a difference of 5 in means, assuming that the common SD was 6.5, using a 2-tailed, 2-group t test with a P<.05 2-sided significance level.

Interventions

The participants in the experimental group were recruited during the nationwide COVID-19 level 3 epidemic alert, when only RBL-based BLS courses were available. As a first step, the participants were shown a web page where they watched the part-A instructional videos [16], following which they had to complete a mandatory MCQ test (Multimedia Appendix 1) off-site. When participants passed the online test, they were eligible to request a training kit (Figure 2) consisting of (1) remote practice BLS course material (Multimedia Appendix 2), (2) a Little Anne QCPR manikin, and (3) AED Practi-TRAINER Essentials course materials sent by SaveANNE Education, which were usually delivered within 3 days.

After receiving the training kit, the participants could start remote deliberate practice. As shown in the practice manual (Multimedia Appendix 2), prior to self-practicing, participants were required to scan QR codes that linked to 3 specific, goal-directed, skill-related instructional videos (Figure 3) that described and demonstrated the essential skills of compression-only CPR, AED, and adult BLS sequences for laypersons in 12 minutes. Participants were encouraged to perform self-directed deliberate practice by repeatedly following these instructional videos until they were confident that they had mastered the requisite knowledge and skills. Then, they were free to schedule a final online assessment session with a SaveANNE Education instructor.

The online final assessment session was conducted one-on-one via a Google Meet video conference between the instructor and participant (Figure 4). In this session, the participants were asked to handle a designated SCA scenario by performing the correct adult BLS sequence, high-quality CPR, and immediate AED operations on their manikin in front of the camera. Debriefing and feedback were provided by the instructor as needed to ensure that the criteria for passing were met by the participants, who also had the opportunity to repeatedly practice the SCA scenario until they passed. The length of the final online assessment session was determined by the debriefing duration and the number of retakes; it was expected to be less than an hour.

Finally, the study’s objectives and procedures were disclosed to the participants, who were invited to complete an online Google Form questionnaire consisting of 21 mandatory questions regarding the following: (1) age, gender, occupation, and motivation for attending the BLS course; (2) preexisting experience with CPR; (3) self-rated CPR performance before and after the self-directed deliberate practice session; (4) posttraining feedback regarding the difficulty of the BLS course, self-confidence and attitudes toward CPR and AED, and effectiveness of learning online, and (5) informed consent for participation in this study and provision of the studied information. For self-assessment questionnaires, we used a 5-point Likert scale ranging from 1 (totally disagree) to 5 (totally agree; Multimedia Appendix 3).

‎

‎

‎

Outcomes

The primary outcome was the Little Anne QCPR manikin–rated chest compression score. The secondary outcome was the number of retakes of the final assessment.

Data Analysis

Statistical analyses were performed using SPSS (version 24; IBM Corp). Participants’ demographics and other characteristics were expressed as numbers and percentages. The QCPR manikin–rated chest compression score, 5-point Likert scale score, and time spent on courses were expressed as the mean (SD). The Shapiro-Wilk test was used to examine the normality of the data. Differences between the 2 groups were compared with the chi-square test for categorical variables and the nonparametric Mann-Whitney U test and a parametric independent-sample t test for continuous variables. Multiple linear regression analyses were conducted to evaluate the association between the BL modalities, deliberate practice measures, and study outcomes after adjusting for age, gender, occupation, and other variables that had been revealed as significant in the univariate analysis.

Ethical Approval

The study design was approved by the National Taiwan University Hospital Institutional Review Board (202206110RINC).

Results

Inclusion of Study Participants and Their Characteristics

During the study period, 191 online questionnaires, along with informed consent forms, were sent to the RBL- and CBL-based BLS course learners, comprising 74 and 117 participants in the RBL and CBL groups, respectively. After excluding 35 participants (35/191, 18.3%) owing to criteria such as informed refusal, teaching-protocol violations, manikin errors, and invalid answers to the questionnaire, 52 and 104 participants were eligible for data analysis in the RBL and CBL groups, respectively (Figure 5).

The participants’ characteristics are shown in Table 1. Ages, occupations, motivation for attending the BLS course, prior CPR training, and experience on humans were similar in the RBL and CBL groups, except that the RBL group had more women (36/52, 69.2% vs 51/104, 49%, respectively; P=.02).

In terms of learning performance, the RBL and CBL groups’ mean scores in the online lecture sessions were not significantly different (90.9 vs 91.8, P=.38). As for their skills-related performance, both groups passed the final assessment session by achieving high QCPR manikin–rated chest compression scores. The RBL and CBL groups had mean scores, respectively, of 96.9 and 96.4 (P=.58) for release of chest compression, 99.2 and 99.5 (P=.02) for depth of chest compression, and 94.9 and 95.5 (P=.66) for rate of chest compression.

However, the RBL group tended to spend more time practicing ahead of the final assessment session (12.4 vs 8.9 days, P<.001) and retook the final assessment session more times (1.4 vs 1.1 times, P<.001). The greatest number of RBL participants spent 30 to 60 minutes (21/52, 40.4%) in self-directed deliberate practice sessions, and nearly half of them (24/52, 46.2%) self-rated themselves as having average performance.

For posttraining self-evaluation, our results revealed most participants in the RBL and CBL groups agreed that their self-confidence for CPR and AEDs, and their willingness to perform CPR and AED on a stranger, improved after the training. The mean Likert-scale scores in the RBL and CBL groups for confidence for CPR and AEDs (4.75 vs 4.81, respectively, P=.62), willingness to perform bystander CPR (4.58 vs 4.57, respectively, P=.87), and willingness to use an AED on a stranger (4.83 vs 4.74, respectively, P=.68) were very high, and there was no significant difference between the 2 groups.

‎

Association Between BL Modalities and Study Outcomes in All Participants

Table 2 shows a multiple linear regression analysis of the association between BL modalities—RBL or CBL-based BLS courses—and outcomes after adjusting for potential confounding variables, such as participants’ age, gender, occupation, time spent before the final assessment session, and online lecture-session scores. In terms of primary outcomes, the RBL and CBL groups did not have significant differences in their QCPR manikin–rated chest compression release, depth, or rate scores: P=.61, P=.27, and P=.83, respectively. However, in terms of secondary outcomes, the number of retakes of the final assessment was significantly higher in the RBL than the CBL group (P<.001); a result that was similar to that of the univariate analysis (Table 1). In addition, a significant negative correlation was noted between the online lecture-session scores and the number of retakes of the final assessment (P=.04), which indicates that better lecture session scores were associated with fewer retakes of the final assessment.

Association Between Deliberate Practice Acquisition and the RBL Group’s Study Outcomes

Multiple linear regression analysis was also conducted to assess the association between self-directed deliberate practice acquisition and study outcomes in the RBL group (Table 3). After adjusting for potential confounding variables—age, gender, occupation, and time spent before the final assessment session—the analysis showed that the participants’ time spent on deliberate practice was significantly and positively correlated with their QCPR chest compression rate score (P=.047). Furthermore, RBL group participants who had a higher self-rating after deliberate practice were found to have significantly fewer retakes of the final assessment (P=.01). It is noteworthy that in this analysis, there was a significant negative correlation between time spent before the final assessment and the RBL participants’ QCPR chest compression rate score (P=.04); this correlation was also noted in all the RBL and CBL group participants in Table 2 (P=.04).

Discussion

Principal Findings

This study made 3 major findings. First, it demonstrated a novel but feasible online-only BL-based BLS course design for implementing distance learning and self-directed deliberate practice. Second, it confirmed that this remote self-directed deliberate practice method was not inferior to conventional classroom-based instructor-led methods in terms of the BLS sequence and CPR performance. Third, it revealed that the RBL group needed more retakes to achieve the same performance as the CBL group at the end of the courses. These findings could be helpful in exploring innovative resuscitation education, which may shape better strategies or guideline modifications for enhancing bystander CPR achievements.

Comparison to Prior Work

Our RBL-based BLS course design was derived from a literature review. Although previous studies have shown that online-only learning [6], conventional CBL [12], self-directed learning [17], and deliberate practice or mastery learning [15] can provide pragmatic and reasonably effective alternatives to conventional CPR training, none of them incorporated all these evidence-based instructional methods into a BLS course, as we have done and demonstrated in our pioneer study. To the best of our knowledge, this is the first comparative study to show that online-only BL is not inferior to CBL in terms of CPR educational outcomes.

Our study’s results have strengthened the evidence that the CPR performance of self-directed deliberate practice learners is similar to that of conventional instructor-led learners. A systematic review of 22 randomized trials comparing the effect of these 2 training methods in BLS courses also found that the most frequent conclusion of these trials was that self-directed courses had similar educational outcomes as instructor-led courses [17], which is consistent with our study results. Although it remains uncertain as to which of the 2 methods is superior, the AHA 2020 guidelines recommend considering the self-directed method as a reasonable alternative to instructor-led CPR training for lay rescuers [4].

As regards cost-effectiveness, it has been postulated that as a BL approach allows for some parts of the course material to be viewed and learned online, the overall in-person course can be shortened, which in turn reduces costs and the time that participants and faculty members spend in the classroom environment [12]. Another previous study suggested that self-directed learning is a more time-efficient tool for CPR training, as it reduces costs (eg, for instructors) [18].

Nevertheless, it has been pointed out that using these approaches is not necessarily cost-effective, and consideration should be given to the following: the type of BL, staff expertise, and the educational setting [19]. Reflecting on this point, it is noteworthy that in our study the cost of RBL courses was significantly higher than that of CBL courses, while their effects were similar. To achieve the same teaching quality and learning value, the manikin to learner and instructor to learner ratios in the RBL courses were optimized to 1:1. Other than that, our results revealed that the RBL learners spent more time than the CBL learners to complete the BLS courses, including the time spent before the final assessment (12.4 vs 8.9 days, respectively; P<.001) and the number of times they retook the final assessment (1.4 vs 1.1 times, respectively; P<.001). Based on practical considerations, we surmise that the RBL group may have spent additional time for three reasons: (1) waiting for the delivery of the training kit, (2) the process of video conferencing–based feedback from instructors, and (3) the need to retake the designated SCA scenarios to pass the examination. Hence, the RBL group needed to increase their time spent on courses to achieve the same performance as the CBL group at the end of the courses. To our knowledge, there is no prior research or evidence specifically emphasizing this point; therefore, our study fills a gap to a certain extent.

This study’s self-directed deliberate practice design in BL was a novel approach. In the RBL group, increased time spent on deliberate practice was significantly associated with a better QCPR chest compression rate score (Table 3), and participants with a higher self-rating after deliberate practice had significantly fewer retakes of the final assessment (Table 3). These findings demonstrate the influence and effectiveness of self-directed deliberate practice in BL, which could reinforce the idea that this novel approach is rational and useful.

Finally, it is of interest that we noted relatively poor CPR performance among RBL group participants, who spent more time before the final assessment session. We speculate that these learners may have been less aggressive in learning or faced problems with deliberate practice. Hence, more attention should be paid to these learners in future BL-based CPR education.

Limitations

Our study had some limitations. First, it was a nonrandomized experimental study. Second, the participants and evaluators were not blinded to the interventions, given that it would have been difficult to do so in an educational study. Third, the sample size was small, although the number of participants permitted adequate power for the analyses. Fourth, we did not assess several aspects of BLS skills in specific scenarios, such as scene-safety checks, calls for help, and open airways. Fifth, as we used a questionnaire, we were only able to measure participants’ estimated time spent on deliberate practice, and not the actual time spent, in the RBL group. Sixth, considering the influence of the precondition that the participants had expertise in online learning, we were unable to determine the participants’ prior experience and familiarity with online learning, which could have influenced the study results. Seventh, we did not evaluate skill retention after a specific time period after the course. Long-term skill decay in the 2 cohorts over various periods of time (eg, 3, 6, or 9 months or longer) is unknown. Finally, as this pioneering study was conducted in a single institution, there could have been external variations in socioeconomic status, internet culture, software, and infrastructure settings. More studies are needed to fill knowledge gaps on the issue of CPR education.

Conclusions

We developed a remote practice blended-learning method for online-only distant BLS course CPR training. Layperson CPR training using a remote self-directed deliberate practice method was not inferior to the conventional classroom-based instructor-led method in terms of BLS familiarity and CPR performance. Although this novel online-only BL method tended to take more time to achieve the same effect as conventional BL, we consider it to be a reasonable alternative CPR training method.