This paper is in the following e-collection/theme issue:

e-Learning and Medical Education (691)

Published on in Vol 18, No 8 (2016): August

Evaluation of a Web-Based E-Learning Platform for Brief Motivational Interviewing by Nurses in Cardiovascular Care: A Pilot Study

Evaluation of a Web-Based E-Learning Platform for Brief Motivational Interviewing by Nurses in Cardiovascular Care: A Pilot Study

Evaluation of a Web-Based E-Learning Platform for Brief Motivational Interviewing by Nurses in Cardiovascular Care: A Pilot Study

Authors of this article:

Guillaume Fontaine1, 2 Author Orcid Image ;   Sylvie Cossette1, 2 Author Orcid Image ;   Sonia Heppell2, 3 Author Orcid Image ;   Louise Boyer2, 4 Author Orcid Image ;   Tanya Mailhot1, 2 Author Orcid Image ;   Marie-Josée Simard3 Author Orcid Image ;   Jean-Francois Tanguay1, 3, 5 Author Orcid Image
Article Authors Cited by (30) Tweetations (9) Metrics

    Original Paper

    1Montreal Heart Institute Research Center, Montréal, QC, Canada

    2Faculty of Nursing, Université de Montréal, Montréal, QC, Canada

    3Montreal Heart Institute, Montréal, QC, Canada

    4Center for Innovation in Nursing Education, Montréal, QC, Canada

    5Faculty of Medicine, Université de Montréal, Montréal, QC, Canada

    Corresponding Author:

    Guillaume Fontaine, RN, MSc

    Montreal Heart Institute Research Center

    5000 Belanger Street

    Room S-2490

    Montréal, QC, H1T 1C8

    Canada

    Phone: 1 514 376 3330 ext 3069

    Fax:1 514 593 7441

    Email: guillaume.fontaine@umontreal.ca


    Background: Brief motivational interviewing (MI) can contribute to reductions in morbidity and mortality related to coronary artery disease, through health behavior change. Brief MI, unlike more intensive interventions, was proposed to meet the needs of clinicians with little spare time. While the provision of face-to-face brief MI training on a large scale is complicated, Web-based e-learning is promising because of the flexibility it offers.

    Objective: The primary objective of this pilot study was to examine the feasibility and acceptability of a Web-based e-learning platform for brief MI (MOTIV@CŒUR), which was evaluated by nurses in cardiovascular care. The secondary objective was to assess the preliminary effect of the training on nurses’ perceived brief MI skills and self-reported clinical use of brief MI.

    Methods: We conducted a single-group, pre-post pilot study involving nurses working in a coronary care unit to evaluate MOTIV@CŒUR, which is a Web-based e-learning platform for brief MI, consisting of two sessions lasting 30 and 20 minutes. MOTIV@CŒUR covers 4 real-life clinical situations through role-modeling videos showing nurse-client interactions. A brief introduction to MI is followed by role playing, during which a nurse practitioner evaluates clients’ motivation to change and intervenes according to the principles of brief MI. The clinical situations target smoking, medication adherence, physical activity, and diet. Nurses were asked to complete both Web-based training sessions asynchronously within 20 days, which allowed assessment of the feasibility of the intervention. Data regarding acceptability and preliminary effects (perceived skills in brief MI, and self-reported clinical use of conviction and confidence interventions) were self-assessed through Web-based questionnaires 30 days (±5 days) after the first session.

    Results: We enrolled 27 women and 4 men (mean age 37, SD 9 years) in March 2016. Of the 31 participants, 24 (77%, 95% CI 63%–91%) completed both sessions in ≤20 days. At 30 days, 28 of the 31 participants (90%) had completed at least one session. The training was rated as highly acceptable, with the highest scores observed for information quality (mean 6.26, SD 0.60; scale 0–7), perceived ease of use (mean 6.16, SD 0.78; scale 0–7), and system quality (mean 6.15, SD 0.58; scale 0–7). Posttraining scores for self-reported clinical use of confidence interventions were higher than pretraining scores (mean 34.72, SD 6.29 vs mean 31.48, SD 6.75, respectively; P=.03; scale 10–50). Other results were nonsignificant.

    Conclusions: Brief MI training using a Web-based e-learning platform including role-modeling videos is both feasible and acceptable according to cardiovascular care nurses. Further research is required to evaluate the e-learning platform in a randomized controlled trial.

    Trial Registration: International Standard Randomized Controlled Trial Number (ISRCTN): 16510888; http://www.isrctn.com/ISRCTN16510888 (Archived by WebCite at http://www.webcitation.org/6jf7dr7bx)

    J Med Internet Res 2016;18(8):e224

    doi:10.2196/jmir.6298

    Keywords

    motivational interviewing; cardiovascular diseases; coronary artery disease; health behavior change; Web-based learning; e-learning; pilot study 


    Background

    Coronary artery disease contributes significantly to worldwide morbidity and mortality [1]. According to clinical practice guidelines, the reduction of cardiovascular risk factors through health behavior change plays a critical role in treatment for coronary artery disease [2]. Smoking cessation, medication adherence, physical activity, and diet are often cited as examples of health behaviors that are amenable to change and allow risk factor reduction [3,4]. Health behavior change is determined mainly by conviction (ie, knowledge and understanding of the disease, personal meaning, and the relevance of that knowledge) and confidence in one’s ability to change successfully [5,6]. These determinants of health behavior change can be addressed via client-centered interventions that target individuals’ beliefs, values, and motivation [7-10].

    Brief motivational interviewing (MI) is a client-centered approach designed to guide individuals through collaborative conversational style and to solidify their motivation and commitment to health behavior change [7,11]. Unlike longer interventions, brief MI was proposed to meet the needs of clinicians who have little time to use the full range of MI techniques in practice [12-14]. The scientific literature generally supports the efficacy of brief MI in various health care settings, including those involving smoking cessation, medication adherence, physical activity, and diet [7,14-17]. While brief MI is promising, health care practitioners often lack time, basic training, or continuous education opportunities to update their knowledge and skills regarding increasing clients’ motivation for change [18]. A systematic review [18] evaluated 10 studies involving health care practitioners’ use of brief to intensive MI training methods. The duration of the training ranged from 20 minutes to 24 hours, while the format varied from face-to-face sessions to short video modules presented in a classroom setting. Results of the review were generally favorable, suggesting that MI training generates an increase in knowledge, skills, and clinical use. In contrast, very few studies have thus far examined MI training delivered via Web-based e-learning. In fact, of 36 studies included in 3 different systematic reviews concerning MI training, none evaluated Web-based MI training [18-20].

    E-learning, defined as instruction delivered on a digital device [21], has been shown to be effective for health care practitioners, with knowledge acquisition and clinical skill development equal or superior to those observed with face-to-face instruction [22-27]. Web-based e-learning can reduce the cost and time involved in providing continuing education, as it offers flexibility with respect to learning times and locations and can reach an unlimited number of clinicians [28]. Web-based e-learning can therefore enhance health care practitioners’ knowledge and skills, as a prerequisite for effective use of health behavior interventions such as brief MI [25,29].

    User acceptance of Web-based e-learning for specific sociodemographic groups of health care practitioners, such as nurses, is a topic of great interest [30-32]. However, the literature concerning the subject is scarce. According to the unified theory of acceptance and use of technology, various factors influence user acceptance of technology, which in turn influences technology use [33]. Careful attention must then be paid to learners’ perceptions and attitudes toward workplace e-learning in order to optimize the knowledge, skills, and clinical use of brief MI [30,34]. The integration of interactivity measures and audiovisual media in e-learning may positively affect learners’ perceptions and attitudes [29].

    Video-based e-learning showcasing clinical simulation has attracted strong interest from clinicians and researchers [23,35-37]. Videos can facilitate knowledge acquisition and clinical skill development through pedagogical material that matches the reality of clinical settings [36,38-40]. Video-based e-learning has the potential to “enliven abstract concepts, demonstrate real-world applications of complex principles, motivate the learner, organize thoughts and actions of highly cognitive processes, and heighten learner attention and interest” [36]. This is particularly interesting, because MI is usually learned through observation of role models in face-to-face or, most recently, videotaped clinical simulations [11,18].

    However, little is known about the educational effectiveness of brief MI training via a Web-based e-learning platform. To our knowledge, cardiovascular nurses’ MI-related skill development and clinical use of brief MI have not been evaluated. Therefore, in this study, we developed and pilot tested a Web-based e-learning platform for brief MI, which included videos in which nurses could observe brief MI in a real-life clinical context.

    Study Objectives

    The primary objective of this pilot study was to examine the feasibility and acceptability of a Web-based e-learning platform for brief MI (MOTIV@CŒUR), which was evaluated by nurses in cardiovascular care. The primary end point of the pilot study was the proportion of nurses who had completed both training sessions 20 days after the initiation of the training session.

    The secondary objective was to assess the preliminary effect of MOTIV@CŒUR on nurses’ perceived skill in, and self-reported clinical use of, brief MI.


    Study Design and Setting

    We conducted a single-group, pre-post pilot study involving cardiovascular nurses to assess MOTIV@CŒUR. We conducted the study at the coronary care unit (CCU) at a tertiary care hospital center in Montreal, Canada. The pilot study was registered (ISRCTN16510888), as well as being approved by the Scientific and Ethics Committee of the Montreal Heart Institute Research Center (reference number: 2015-1948). Our study is reported in accordance with the CONSORT-EHEALTH checklist version 1.6.1 [41] (see Multimedia Appendix 1). No content or methodological modifications were made after study commencement.

    Participants

    We recruited a convenience sample of nurses employed at the CCU. Nurses were eligible for participation if they were working at the CCU during the study period. The inclusion criteria were employment in a temporary replacement or permanent position at the CCU and basic computer skills. The exclusion criterion was completion of MI training in the preceding year.

    Procedure

    Enrollment and follow-up occurred between March and May 2016 (see Table 1) [28,42-44]. We recruited nurses through individual face-to-face encounters at the CCU. Participants were informed that they would need to complete the training and study requirements on their personal time without financial compensation. However, it was stated that they would receive a certificate attesting to 1 hour of continuing education after completing the training. After receiving an explanation regarding the study and providing written consent, participants completed a paper-based sociodemographic questionnaire. An individual identification number, username, and password were then provided to participants, to allow them to log in to the e-learning platform throughout the study. They also received a training information sheet that explained MOTIV@CŒUR using screen captures and colorful textual content. During the 15-day period following enrollment, an initial email containing the URL for the Web-based e-learning platform was sent to each participant.

    Table 1. Schedule of enrollment, interventions, and assessments for MOTIV@CŒUR.a
    Participant timelineStudy period and time points
    EnrollmentExperimentationCloseout
    t0 
days –20 to 0t1a
day 1t1b 
day 1t2 
day 15
    (±5 days)    		t3
day 30
    (±5 days)
    Enrollment

    		Eligibility screen and informed consent×



    Intervention encounters

    		Training sessions in brief MI

    		Session 1 (30 min)Session 2 (20 min)
    Assessments

    		Sociodemographic questionnaire×




    		Primary objectives


    		Feasibility of the Web-based e-learning platform for brief MI×××××


    		Acceptability of the Web-based e-learning platform for brief MI



    		×

    		Secondary objectives


    		Perceived skill in brief MI
    		×

    		×


    		Self-reported clinical use of brief MI
    		×

    		×

    aTemplate adapted from the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) guidelines [42].

    bMI: motivational interviewing.

    cMeasured throughout the study with indicators from Feeley and Cossette [43].

    dMeasured with Cheng’s tool [28].

    eMeasured with the adapted tool of Paradis et al [44].

    The Web-Based E-Learning Platform for Brief MI: MOTIV@CŒUR

    MOTIV@CŒUR (in French, which translates as MOTIV@HEART in English) is a Web-based e-learning platform for brief MI, which includes role-modeling videos. The intervention content is based on the work of key authors in brief MI [11,44-47].

    Development Process

    The MOTIV@CŒUR Web-based platform was developed by an independent consulting firm in Montreal, Canada. We chose the firm because it designs interactive websites whose format is adaptive to computers, tablets, and smartphones. MOTIV@CŒUR is based on the open-source learning platform Moodle 3.0 (Moodle Pty Ltd, Perth, Australia). The MOTIV@CŒUR homepage (see Figure 1) was designed to create an appealing first impression, using visual material and dynamic components.

    Subsequent adaptation of the content of the e-learning platform for brief MI is possible via access to the Moodle course management system provided to the research team. However, changes in the design of the website require the involvement of the consulting firm.

    To ensure the preservation of data related to the implementation MOTIV@CŒUR and the usage statistics for nurses, the website and data regarding its use were hosted on secure computer servers at the research setting for the duration of the study.

    ‎
    Figure 1. MOTIV@COEUR homepage (in French).
    View this figure
    MOTIV@CŒUR Access

    MOTIV@CŒUR can be accessed via a fixed URL. The availability of the website was restricted to the study period. Participants could log in to the e-learning platform from home or work via the device of their choice, using their personal log-in credentials, which were provided during the face-to-face encounter at the CCU. We suggested that participants change their passwords after the initial log-in. Passwords could also be reset via their personal email accounts if forgotten.

    MOTIV@CŒUR Content

    The content of the brief MI on the Web-based e-learning platform was developed by the project team, which included 1 MI expert and an experienced cardiology researcher, who supervised the development of the intervention, led by GF. In addition, 2 MI experts validated the content. The intervention was pretested with 5 nurses who were not part of the sample of nurse participants in this study. We adjusted MOTIV@CŒUR content according to the nurses’ comments before we recruited the study sample.

    MOTIV@CŒUR was designed around 4 scenarios, each presenting a clinical case involving a client with a given level of conviction (low or high) and confidence (low or high) regarding change in a health behavior (see Figure 2) [47]. Each motivation profile was associated with one of the following health behaviors: smoking cessation, medication adherence, physical activity, or diet. For instance, clinical case #1 presents the association between low conviction and confidence levels for smoking cessation. We chose 4 different associations between motivation levels and health behaviors as examples that could be extrapolated to other health behaviors for individuals with any motivation profile. The team developed scenarios for each clinical case, based on real-life experience. During the scenarios, the nurse introduced herself, targeted the health behavior in each clinical case, assessed the level of conviction and confidence regarding change, and engaged the client in a brief MI conversation. Following each scenario, a second video showed the cardiology nurse practitioner (CNP) explaining why each intervention was retained in response to the client’s motivation profile.

    The content of brief MI for the 4 scenarios was based on the model developed by Bédard [47], who adapted the work of Miller and Rollnick [11]. In this model, conviction represents the extent to which each individual perceives practical and emotional benefits to the change of a health behavior. Confidence represents the extent to which the individual is confident of being able to achieve change [47]. After assessing the client’s motivation, the practitioner provides tailored brief MI to increase conviction and confidence regarding health behavior change. Through videotaped role modeling, nurses could observe the CNP involving brief MI in a real-life clinical context. Videos were recorded at the research setting in a real patient room, to represent the real-life context (see Multimedia Appendix 2 for screenshots), with 4 volunteers (2 men and 2 women) representing different ages.

    MOTIV@CŒUR was conceptualized to ensure that participants would observe real-life examples, allowing them to (1) familiarize themselves with the spirit of brief MI, (2) acquire basic skills in brief MI (eg, open-ended questions, validation, and reformulation), (3) recognize and reinforce the change discourse, specifically that involving conviction and confidence, (4) learn to create and strengthen the change discourse, (5) learn to accept resistance to avoid confrontation, (6) understand how to develop a plan, and (7) understand how to help clients to initiate change [11,48].

    MOTIV@CŒUR Structure

    MOTIV@CŒUR consists of 2 training sessions including 13 video modules (see Figure 3). The planned durations were 30 minutes for the first session (S1) and 20 minutes for the second session (S2). Following an introduction and statement of objectives, each session was initiated with a video containing a theoretical introduction to brief MI. Each clinical case was then separated into 3 sections: (1) a textual presentation of the clinical case on the screen, (2) a video of brief MI, in which the CNP interacted with each client, and (3) a video in which the CNP explained why each intervention was retained in response to the client’s motivation profile. Both sessions concluded with a reminder of the key concepts and tips for real-world use of brief MI.

    ‎
    Figure 2. The 4 clinical cases and motivation profiles presented in MOTIV@CŒUR.
    View this figure
    ‎
    Figure 3. Structure of MOTIV@CŒUR, a web-based e-learning platform for brief motivational interviewing.
    View this figure
    Use Parameters

    We asked participants to complete S1 within 5 days of receiving the initial email sent after enrollment. Two options were provided for completing the first MOTIV@CŒUR Web-based training session. Participants could complete the Web-based training individually in a dedicated room equipped with computers at the study hospital, during a scheduled session in which a facilitator would explain the project and procedure for accessing MOTIV@CŒUR to each participant. Participants could also complete the training at home with remote support (eg, by email or telephone). In addition, they were encouraged to practice brief MI techniques observed in the video in their regular clinical practice, if appropriate.

    We asked nurses to complete S2 either at home or at the hospital, 2 weeks after S1. There was no computer constraint limiting completion of S2 earlier or later than this. However, participants were required to complete both sessions within 20 days.

    Reminders, Level of Human Involvement, and Co-interventions

    We planned a maximum of 3 email or telephone reminders at 3-day intervals for each of the 3 time points in the study (S1, S2, and outcome measures). A maximum of 9 emails or telephone reminders could be sent throughout the study period.

    The intervention was completely asynchronous. The research team was available at all times, to provide technical support in person or via mail or telephone. Apart from the technical support provided when necessary (access to the website, log-in, and password), we offered no other intervention, such as that involving information and content explanation regarding the brief MI.

    Outcome Measures

    The primary feasibility outcome was the completion of both training sessions 20 days after initiation of S1. We also assessed additional feasibility outcomes regarding recruitment and study completion.

    Secondary outcomes included the acceptability of MOTIV@CŒUR according to the cardiovascular nurses, skills perceived in brief MI, and self-reported clinical use of brief MI with coronary patients. These outcomes were self-assessed via Web-based questionnaires.

    MOTIV@CŒUR Feasibility

    We measured the feasibility of the Web-based e-learning platform for brief MI from recruitment to closeout using indicators collected throughout the study period, based on pilot study evaluation criteria established by Feeley and Cossette [43].

    Feasibility indicators collected by the research team included the proportion of enrolled nurses in the eligible population, recruitment duration, and completion of outcome measures.

    Feasibility indicators were also extracted from the Moodle platform. Moodle collects information about each user with an exact time stamp for each action (ie, change of a page in a module or completion of a module). We interpreted the interval between 2 actions as engagement with the site or absence from the site. Since an inappropriately long latency period between the user’s actions would overestimate the time spent on each session, we defined a maximum latency period, fixed at 15 minutes. When a latency period exceeded this threshold, we deducted it from the time spent on MOTIV@CŒUR. Feasibility indicators extracted from the Moodle platform for each user included the duration of each session, number of sessions completed, and time elapsed between the completion of S1 and S2.

    We also recorded types, numbers, and timestamps for reminders sent to participants in an Excel file, version 15.16 (Microsoft).

    MOTIV@CŒUR Acceptability

    We used the model of information systems quality antecedents on nurses’ acceptance of e-learning, developed by Cheng [28], to assess posttraining acceptability of the Web-based e-learning platform for brief MI. The tool evaluates nurses’ perception of the e-learning system, using 27 items grouped into 2 main dimensions: global system quality and technology acceptance. These dimensions are based on DeLone and McLean’s [49] work in information systems quality and van der Heijden’s [50] technology acceptance model. The model is subdivided into 8 subdimensions, of which 4 are related to global system quality (system, information, service, and user interface design quality), and 4 are related to technology acceptance (perceived usefulness, perceived ease of use, perceived enjoyment, and intention to use). The items in each subdimension were described the original paper [28]. Responses are provided using a Likert scale ranging from 1 (strongly disagree) to 7 (strongly agree), with 4 representing neutral responses. The score for each subdimension is calculated by summing the scores for the responses to the items therein and dividing the result by the number of items in the subdimension. A higher total score indicates greater acceptability (possible range: 0–7). Cronbach alphas for the scale were between .70 and .96 in previous studies [28]. The tool was translated into French using the back-translation method defined by the World Health Organization [51]. The content validity of the translated items was then determined by an expert, who provided adjustments to the language and structure of the items. A pretest was performed and included nurses who were not involved in the project.

    Nurses could also provide suggestions and comments regarding MOTIV@CŒUR at the end of the acceptability questionnaire.

    Preliminary Efficacy of MOTIV@CŒUR

    We adapted the tool of nursing interventions specific to conviction and confidence levels and stages of change developed by Paradis et al [44], to assess perceived skill in brief MI and the self-reported clinical use of brief MI before and after training. We reduced the number of interventions from 55 to 26, retaining only those that targeted conviction and confidence, as this was the primary focus of the brief MI training in the study. The content was then validated by 2 MI experts.

    The scale contained 26 intervention items grouped under 2 motivational intervention dimensions: conviction (16 items) and confidence (10 items). Based on the work of Cossette et al [52], 2 questions were asked for each intervention item to assess outcomes. The first question (“How comfortable do you feel doing it?”) assessed nurses’ perceived skill in performing each intervention. The second question (“How often do you do it?”) assessed nurses’ self-reported clinical use of each intervention. Each question was used to calculate a total score and 2 subdimension scores for conviction and confidence. The response scale for each question ranged from 1 (not at all) to 5 (extremely) and provided 2 total scores ranging from 26 to 130. A higher score for the first question indicated higher perceived skill in brief MI, and a higher score for the second question indicated higher clinical use of brief MI. To calculate total scores, we recoded a maximum of 3 missing values per participant in the mode for each item.

    Other Measures

    A self-administered sociodemographic paper questionnaire was completed at enrollment to collect data regarding nurses’ general profiles concerning sex, age, language, educational level, year of entry to the hospital, employment status, duration of experience in nursing and cardiovascular acute care, shift, and type of position held at the CCU. We also asked participants whether they had previously completed Web-based training.

    Sample Size

    To examine the primary feasibility outcome, we defined success as the completion of both training sessions by 80% of participants within 20 days. We expected this rate to be 80%; therefore, we targeted a sample of 30 participants to allow estimation with accuracy of ±14.3% and a confidence level of 95%.

    Statistical Analysis

    With respect to sociodemographic, acceptability, and preliminary effect variables, we calculated means and SDs for continuous variables, and counts and percentages for categorical variables. We also used descriptive statistics for the feasibility criteria, as follows: (1) proportion of enrolled nurses in the eligible target population (expected: 50%), (2) time required to complete recruitment (expected: 60 ± 30 days), (3) proportion of nurses who completed both sessions in ≤20 days (expected: 80%), (4) proportion of nurses who completed both sessions in 60 ± 10 min (expected: 80%), and (5) proportion of nurses who completed outcome measures (expected: 80%).

    We compared changes between pre- and posttraining measures for perceived skill in brief MI and self-reported clinical use of brief MI using Student t test for paired samples, with a 2-sided significance level of .05. We also performed Student t test for paired samples, with the same parameters used, for the 4 subdimension scores for pre- and posttraining conviction and confidence. All statistical tests were 2-sided and performed using IBM SPSS version 23.0 (IBM Corporation). We verified basic assumptions, such as normal distribution, before analysis.


    Participant Characteristics

    Most participants were women, and participants’ mean age was 37 years (see Table 2). The majority had completed university-level education and worked full-time as bedside nurses. The duration of participants’ experience as critical cardiovascular care nurses ranged from 1 month to 37 years, with a mean of 11 years. Nurses were almost evenly distributed across all work shifts, with 5 working rotating shifts. More than three-quarters of participants had previously completed Web-based training, but none had undertaken MI in the preceding year.

    Table 2. Nurses’ baseline sociodemographic data (N=31).
    CharacteristicMean (SD) or n (%)
    Sex (female), n (%)27 (87%)
    Age, in years, mean (SD)37 (9)
    Education (Bachelor’s degree or higher), n (%)18 (58%)
    Position (full-time), n (%)18 (58%)
    Position in coronary care unit (bedside nurse), n (%)27 (87%)
    Experience in acute care, in years, mean (SD)11 (10)
    Shift, n (%)

    		Day9 (29%)

    		Evening9 (29%)

    		Night8 (26%)

    		Rotation5 (16%)
    Previously completed Web-based training (yes)24 (89%)a

    an=27.

    ‎
    Figure 4. MOTIV@CŒUR study participation flowchart.
    View this figure

    Feasibility Results

    Recruitment

    The feasibility criteria for participant recruitment were all met. Of the 56 nurses employed at the CCU, 44 were eligible for study participation, and 31 (70%) were enrolled in the study between March and May 2016 (see Figure 4). This exceeded the target proportion of 50%. Moreover, recruitment was completed within 11 days, which was a significantly shorter period than the expected period of 30–90 days.

    Training Nurses via the Web-Based E-Learning Platform for Brief MI

    With regard to the primary feasibility outcome, 24 of the 31 recruited participants (77%, 95% CI 63%–92%) completed both training sessions within 20 days following initiation of S1 (see Table 3). This was close to the criterion for determining success (ie, 80%). Another 2 nurses completed S2 within 26 and 30 days of S1. In addition, 28 participants had completed S1 and 26 had completed S2 at 30 days. A total of 3 participants dropped out before beginning the training, resulting in 28 participants completing pretraining and posttraining measures.

    Table 3. Feasibility of MOTIV@CŒUR (N=31).
    Feasibility or outcome variableNo. or n (%)
    Feasibility criteria

    		1. Nurses in the eligible target population (expected: 50%), n (%)31 (70%)

    		2. Duration of recruitment (expected: 30–90 days), no. of days11

    		3. Completed both sessions within ≤20 days (expected: 80%), n (%)24 (77%)


    		Completed the first session at 30 days, n (%)28 (90%)


    		Completed both sessions at 30 days, n (%)26 (84%)

    		4. Completed both sessions within 60 ± 10 min (expected: 80%), n (%)a19 (73%)

    		5. Completed posttraining measures (expected: 80%), n (%)28 (90%)
    Completion of pretraining measures and first session, n (%)

    		Completed before a reminder was sent10 (32%)

    		Completed after 1 reminder was sent10 (32%)

    		Completed after 2 reminders were sent7 (23%)

    		Completed after 3 reminders were sent1 (3%)

    		Never completed2 (6%)
    Completion of second session, n (%)b

    		Completed before a reminder was sent14 (50%)

    		Completed after 1 reminder was sent10 (36%)

    		Completed after 2 reminders were sent0

    		Completed after 3 reminders were sent2 (7%)

    		Never completed2 (7%)
    Completion of posttraining measures, n (%)b

    		Completed before a reminder was sent13 (46%)

    		Completed after 1 reminder was sent8 (29%)

    		Completed after 2 reminders were sent6 (21%)

    		Completed after 3 reminders were sent1 (4%)

    		Never completed0

    an=26.

    bn=28.

    The results showed that 25 participants completed S1 and 22 completed S2 during a single connection. The mean durations were 31 (SD 6) minutes for S1 and 19 (SD 6) minutes for S2. The mean total training duration was 50 (SD 11) minutes, which was consistent with the expected duration for MOTIV@CŒUR. The mean period between the completion of S1 and S2 was 13 (SD 7) days, which was close to the recommended time of 2 weeks.

    Of the 31 participants, 10 (32%) completed the baseline measures and S1 without requiring a reminder after the initial email providing instructions regarding accessing the Web-based e-learning platform. This proportion was higher in the rest of the study: 14 of 28 participants (50%) completed S2 without a reminder, and 13 of 28 participants (46%) completed the outcome measures without a reminder. Across the 3 time points, the first email reminder was more effective than the second and third reminders and doubled the number of participants who fulfilled the requirements.

    In total, 80 emails and telephone reminders were sent throughout the study period. More specifically, 44 email, 16 telephone, and 20 voicemail reminders were sent. Of these, the email reminders were the most effective. Of the 44 email reminders, 27 (61%) resulted in the completion of requirements at each time point (S1, S2, and outcome measures), while 9 of 16 (56%) telephone reminders and 9 of 20 (45%) voicemail reminders were effective throughout the study period.

    Acceptability Outcomes

    The Web-based e-learning platform for brief MI was considered highly acceptable by cardiovascular nurses across all 8 dimensions of Cheng’s [28] model (see Table 4).

    Table 4. Posttraining acceptability of MOTIV@CŒUR (n=28).
    Outcome variableNo. of itemsPossible rangeMean (SD) score
    Global system quality150–75.95 (0.48)

    		System quality50–76.15 (0.58)

    		Information quality40–76.26 (0.60)

    		Service quality30–75.28 (0.96)

    		User interface design quality30–76.12 (0.69)
    Technology acceptance120–75.90 (0.75)

    		Perceived usefulness30–75.64 (0.81)

    		Perceived ease of use30–76.16 (0.78)

    		Perceived enjoyment30–75.80 (1.01)

    		Intention to use30–76.01 (0.84)

    The 4 dimensions concerning system quality were evaluated favorably, and each received a mean score of >5 on the 7-point Likert scale. The 3 items that received the highest scores for system quality were the flexibility of MOTIV@CŒUR regarding learning time and location, presentation of course materials in a readable multimedia format, and the delivery schedule for the learning content. The 3 items that received the lowest scores were related to the quality of support services, as 11 nurses did not use them and provided neutral scores, which were below the observed scores of >5 for other items. The information quality subdimension received the highest score in the dimension related to global system quality.

    The 4 dimensions concerning technology acceptance were evaluated very favorably by all participants and received scores of >5 on the 7-point Likert scale. The 3 items that received the highest scores were related to the ease of use of MOTIV@CŒUR, the usefulness of MOTIV@CŒUR for learning, and the opinion that MOTIV@CŒUR should be available to other nurses and professionals. While most participants agreed or strongly agreed that MOTIV@CŒUR was useful in their learning, they appeared less convinced of the superiority of e-learning relative to traditional face-to-face methods. Indeed, the 3 items that received the lowest scores but still scored >5 were related to enhanced learning effectiveness compared with other training methods, increased learning efficiency, and enjoyment while training with MOTIV@CŒUR. Finally, the overwhelming majority of participants agreed or strongly agreed that they would use the e-learning platform again if it were made available with more content and resources.

    Comments of participants at the end of the acceptability questionnaire underlined the simplicity, clarity, and dynamism of the e-learning platform. One participant suggested developing a checklist on the training content to be made available to nurses in the clinical setting. Another participant proposed conducting practical workshops to implement the learning acquired during the Web-based training. Overall, the feedback from participants was positive and indicated significant interest in the Web-based e-learning platform for brief MI.

    Preliminary Efficacy Outcomes

    Regarding the preliminary efficacy of MOTIV@CŒUR with respect to perceived skill in brief MI, posttraining scores for all dimensions were higher than pretraining scores. However, the raw differences were small and nonsignificant (see Table 5).

    Table 5. Preliminary effect of MOTIV@CŒUR on perceived skill in brief motivational interviewing (MI) and self-reported clinical use of brief MI.
    Outcome variableNo. of itemsPossible rangeMean (SD) scoresP value
    PretrainingPosttraining
    Perceived skill in brief MIa,b2626–13095.19 (16.37)97.50 (15.38).40

    		Conviction interventions1616–8060.62 (9.79)61.53 (8.87).54

    		Confidence interventions1010–5034.59 (7.01)35.93 (6.98).30
    Self-reported clinical use of brief MIa,c2626–13089.60 (15.74)94.28 (13.64).13

    		Conviction interventions1616–8058.12 (9.44)59.56 (7.97).41

    		Confidence interventions1010–5031.48 (6.75)34.72 (6.29).03

    aHigher is better.

    bn=26.

    cn=25.

    In addition, regarding the preliminary efficacy of MOTIV@CŒUR with respect to self-reported clinical use of brief MI, posttraining scores for all dimensions were higher than pretraining scores. A significant effect was observed for self-reported clinical use of brief MI to increase clients’ confidence in change (P=.03). Other results were nonsignificant.


    This study involved the design, implementation, and evaluation of a Web-based e-learning platform for brief MI, which included role-modeling videos for nurses in cardiovascular care. We demonstrated the feasibility, acceptability, and preliminary efficacy of the intervention. In addition, preliminary posttraining results regarding perceived skill and clinical use of brief MI were all more favorable than those observed in the pretraining assessment. Overall, the feedback received from participants was positive.

    While some previous studies examined Web-based MI training with health care practitioners [53-56], to our knowledge, this study was the first to examine cardiovascular nurses’ evaluation of an asynchronous Web-based e-learning platform for brief MI. We were successful in recruiting 31 participants within 11 days, of whom 28 completed posttraining measures. This demonstrates cardiovascular care nurses’ significant interest in Web-based e-learning and interventions targeting health behavior change. The strong participation in the study could reflect the applicability and credibility of the use of brief MI in acute care settings. Brief MI demonstrated in the MOTIV@CŒUR videos lasted 3–4 minutes. This duration is more likely to be feasible in clinical settings than in longer motivational interventions [12-14].

    Previous studies suggested that technical difficulties, such as a lack of Internet access, could impede the ease with which information and communication technology could be used by health care practitioners [22,57-59]; however, this was not the case in our study, as we did not experience problems with computers. We informed nurses that they were required to be at ease with basic computer use, prior to enrollment, and the research team was available for prompt technical support via email. The e-learning training progressed very well without significant technical difficulties. Participants asked occasional questions (eg, regarding a malfunctioning URL link), but no one experienced difficulty in using the Web-based e-learning platform. This could suggest that nurses in acute care settings are familiar with the use of information and communication technology for clinical and pedagogical purposes. Of the 27 participants who completed the acceptability measures in this study, 24 (89%) had previously completed Web-based training for other topics. The streamlining and improvement of the user interface design in Web-based training platforms could also have affected the ease with which participants used the system [60].

    Participant reminders are often overlooked but crucial to asynchronous Web-based e-learning. Literature concerning the subject is scarce; only a few studies have been conducted, and they reported incomplete data regarding frequency, content, numbers, and mode of delivery (eg, telephone or email) for reminders sent to participants. For example, one study [61] proposed up to 3 automated email reminders for incomplete modules. Other studies included 2 automated emails sent 7 days apart, with an additional personalized email and telephone call if required [62], weekly reminders [63], and 2 reminders after 2 weeks [64]. This heterogeneity shows a lack of consensus regarding best practice with respect to the reminders sent to participants. In this study, we decided to send a maximum of 3 telephone or email reminders 3 days apart, at each time point to avoid oversoliciting participants. Two reminders ensured that approximately 90% of participants completed the sessions and measures. Relative to telephone and voicemail reminders, email reminders were more effective in ensuring the completion of requirements at each time point. This finding could inform future studies.

    Our study’s high acceptability scores suggested that the Web-based e-learning platform for brief MI, based on Moodle, could be ready for inclusion in a larger study. However, some participants asked for further details and interactivity measures, which could be included in future iterations of the platform. The positive aspects of e-learning observed in this study, such as flexibility and control regarding the learning time and location, are consistent with those reported in the literature [22,25,26]. This could be explained by the adaptive format of MOTIV@CŒUR, which can be used anywhere via smartphones, tablets, and computers; however, we did not collect this information. Moreover, participants appreciated the presentation of MOTIV@CŒUR course materials in a multimedia format, as they all reported acceptability scores of >6 for this item in the posttraining assessment. This extends existing literature concerning the feasibility and acceptability of illustrating complex clinical processes, such as brief MI, in video modules [18,38,56].

    The next step of this project is to optimize the tailoring, structure, and content of brief MI in the Web-based e-learning platform. Moreover, we intend to evaluate this platform in a randomized controlled trial, to assess its efficacy in comparison with alternative instructional methods such as face-to-face training and reading. Assessment of participant knowledge based on training content is an outcome we will explore in our future research. Moreover, objective measures are required for clinical skills and motivational interventions provided in health care settings. We also intend to assess the effect of brief MI, provided by health care practitioners, on health behavior change in coronary clients.

    Future research should assess tailored, interactive, Web-based e-learning platforms for brief MI, as this was not the focus of our study, and the scientific literature has demonstrated the efficacy of such features [29]. In addition to tailoring the platform to health care practitioners’ knowledge and experience, researchers should develop an algorithm that accounts for each participant’s characteristics and specific needs (for instance, some participants asked for additional content, while others were satisfied with what was provided in MOTIV@CŒUR). In doing so, they could ensure that every participant follows an individualized path that could lead to enhanced knowledge and clinical skills [25,29]. The efficacy of interactivity measures in e-learning has been demonstrated in the scientific literature [25,29]. Web-based e-learning platforms for brief MI could benefit from the inclusion of self-assessment questions, interactive models and figures, and thought-stimulating activities [29]. When combined with videos, these elements are potentially valuable for scientific, pedagogical, and clinical purposes.

    Future research should explore how to assess the effects of Web-based e-learning for brief MI on objective results in clinical settings. Indeed, despite the progress that has been made in recent years, evaluating the effects of e-learning on real clinical behavior and client outcomes remains a challenge [60,65]. With regard to clinical behavior, researchers should assess the effect of new skills acquired via Web-based e-learning for brief MI on practice using methods other than those involving self-report measures. Supervised clinical simulations of brief MI in parallel with Web-based training could be an interesting means of assessing changes in clinical practice.

    Regarding the clinical implications of the study, the results regarding feasibility and acceptability were encouraging and showed that cardiovascular nurses were willing and able to use a Web-based e-learning platform for brief MI to develop skills related to health behavior change. This suggests that Web-based training covering a larger scope of clinical situations and levels of motivation could be designed to assist health care practitioners in providing health behavior change interventions. These interventions could target a larger spectrum of risk factors other than those related to coronary artery disease.

    Strengths and Limitations of the Study

    The strengths of the study include adherence to the study protocol, the prospective registration of the study, and encouraging feasibility and acceptability results. In addition, no MOTIV@CŒUR-related technical problems occurred during the study period.

    The study demonstrated the potential of Web-based e-learning training for brief MI, but it was subject to some limitations. First, as it was a pilot study, it was not designed for adequate power. Second, the Web-based, self-administrated questionnaires used in the study are not objective measures of real clinical use of brief MI. Third, the single-group, pre-post study design did not allow for causal inferences.

    Most participants had experimented with Web-based training prior to entering the study. This could provide a partial explanation as to why the Web-based e-learning platform showed such high levels of acceptability. A study with a more diverse population of nurses and other health care practitioners could be interesting and allow researchers to determine whether sociodemographic variables increase acceptability scores and affect knowledge acquisition and clinical outcomes. However, this proved difficult in this pilot study, as the small sample size did not allow for enough power.

    Not all participants enrolled in the study ultimately used MOTIV@CŒUR for training in brief MI, as 3 individuals dropped out before beginning the training. However, the global participation rate in the study was superior to those observed in similar studies. Indeed, 28 of the 31 participants (90%) used MOTIV@CŒUR, and this proportion ranged from 82% to 89% in other studies [66-69]. While our study included cardiovascular nurses, it is possible that other health care practitioners could benefit from the training.

    Conclusion

    Information and communication technology is instrumental in the future of health care practitioners’ education. Indeed, technology is ubiquitous in clinical, professional, and academic settings. Researchers should consider a wide variety of factors, to provide rich, interactive, tailored Web-based e-learning and enhance health care practitioners’ knowledge, skills, and clinical interventions. The optimization of factors related to system quality and technology acceptance could contribute to the way in which care is learned, planned, and provided in health care settings for years to come. Further research is required to improve understanding of health care practitioners’ interactions and technology use in learning, and the impact of Web-based e-learning on patient care. Our results showed that the Web-based e-learning platform for brief MI was feasible and acceptable according to nurses in cardiovascular care. Moreover, the preliminary posttraining results regarding perceived skill and clinical use of brief MI were all more favorable than those observed in the pretraining assessment. MOTIV@CŒUR, which includes role-modeling videos, could introduce nurses to brief MI for the reduction of cardiovascular risk and exert an impact on their skills regarding motivational interventions.

    Future research should focus on tailoring Web-based e-learning platforms to health care practitioners’ existing knowledge and experience, to provide individualized paths and fulfill specific learning needs. Further, such training would benefit from the inclusion of additional interactivity measures to enhance the learning experience.

    Acknowledgments

    The authors wish to thank the multidisciplinary team responsible for the conceptualization and operationalization of MOTIV@CŒUR. We are grateful to the 4 volunteers who portrayed clients in the video modules. We are also grateful to Sophie Langlois and John Kayser, who validated the MI content. Finally, we would like to thank Eric Maillet, who validated the acceptability questionnaire, and the 5 nurses who pretested MOTIV@CŒUR.

    The authors would like to thank the Canadian Institutes for Health Research; the Quebec Ministry of Higher Education; the Montreal Heart Institute (MHI) Research Center; the MHI Foundation; and the Faculty of Nursing at the University of Montreal for their financial support.

    Authors' Contributions

    All authors contributed to the study design and protocol. GF: study conception and design, data collection and conception of the analytical plan, manuscript writing, and final approval of the manuscript. SC: study conception and design, data collection and conception of the analytical plan, manuscript writing, and final approval of the manuscript. SH: study conception and design of the brief MI content of the Web-based e-learning platform, manuscript writing, and final approval of the manuscript. LB: study conception and instructional design of the Web-based e-learning platform, manuscript writing, and final approval of the manuscript. TM: study conception and design, manuscript writing, and final approval of the manuscript. MJS: study conception and design, manuscript revision, and final approval of the manuscript. JFT: study conception and design, manuscript revision, and final approval of the manuscript.

    Conflicts of Interest

    The authors of this study own MOTIV@CŒUR.

    ‎

    Multimedia Appendix 1

    CONSORT-EHEALTH Checklist V 1.6.1.

    PDF File (Adobe PDF File), 762KB
    ‎

    Multimedia Appendix 2

    Screenshots.

    PPTX File, 14MB
    1. Finegold JA, Asaria P, Francis DP. Mortality from ischaemic heart disease by country, region, and age: statistics from World Health Organisation and United Nations. Int J Cardiol 2013 Sep 30;168(2):934-945 [FREE Full text] [CrossRef] [Medline]
    2. Perk J, De Backer G, Gohlke H, Graham I, Reiner Z, Verschuren M, European Association for Cardiovascular Prevention & Rehabilitation (EACPR), ESC Committee for Practice Guidelines (CPG). European Guidelines on cardiovascular disease prevention in clinical practice (version 2012). The Fifth Joint Task Force of the European Society of Cardiology and Other Societies on Cardiovascular Disease Prevention in Clinical Practice (constituted by representatives of nine societies and by invited experts). Eur Heart J 2012 Jul;33(13):1635-1701 [FREE Full text] [CrossRef] [Medline]
    3. Blokstra A, van Dis I, Verschuren WM. Efficacy of multifactorial lifestyle interventions in patients with established cardiovascular diseases and high risk groups. Eur J Cardiovasc Nurs 2012 Mar;11(1):97-104. [CrossRef] [Medline]
    4. Janssen V, De Gucht V, Dusseldorp E, Maes S. Lifestyle modification programmes for patients with coronary heart disease: a systematic review and meta-analysis of randomized controlled trials. Eur J Prev Cardiol 2013 Aug;20(4):620-640. [CrossRef] [Medline]
    5. Rosenstock IM, Strecher VJ, Becker MH. Social learning theory and the Health Belief Model. Health Educ Q 1988;15(2):175-183. [Medline]
    6. Strecher VJ, Rosenstock IM. The health belief model. In: Baum A, editor. Handbook of Psychology, Health and Medicine. Cambridge, UK: Cambridge University Press; 1997:113-116.
    7. Rubak S, Sandbaek A, Lauritzen T, Christensen B. Motivational interviewing: a systematic review and meta-analysis. Br J Gen Pract 2005 Apr;55(513):305-312 [FREE Full text] [Medline]
    8. Britt E, Hudson SM, Blampied NM. Motivational interviewing in health settings: a review. Patient Educ Couns 2004 May;53(2):147-155. [CrossRef] [Medline]
    9. Chow CK, Jolly S, Rao-Melacini P, Fox KA, Anand SS, Yusuf S. Association of diet, exercise, and smoking modification with risk of early cardiovascular events after acute coronary syndromes. Circulation 2010 Feb 16;121(6):750-758 [FREE Full text] [CrossRef] [Medline]
    10. de Waure C, Lauret G, Ricciardi W, Ferket B, Teijink J, Spronk S, et al. Lifestyle interventions in patients with coronary heart disease: a systematic review. Am J Prev Med 2013 Aug;45(2):207-216. [CrossRef] [Medline]
    11. Miller W, Rollnick S. Motivational Interviewing: Helping People Change. 3rd edition. New York, NY: Guilford Press; 2012.
    12. McGrady A, Burkes R, Badenhop D, McGinnis R. Effects of a brief intervention on retention of patients in a cardiac rehabilitation program. Appl Psychophysiol Biofeedback 2014 Dec;39(3-4):163-170. [CrossRef] [Medline]
    13. Pietrabissa G, Sorgente A, Castelnuovo G. Integrating motivational interviewing with brief strategic therapy for heart patients. Procedia Soc Behav Sci 2015 Jan;165:136-143. [CrossRef]
    14. Ski CF, Thompson DR. Motivational interviewing as a brief intervention to improve cardiovascular health. Eur J Cardiovasc Nurs 2013 Jun;12(3):226-229. [CrossRef] [Medline]
    15. Ren Y, Browning C, Yang H, Thomas S. Motivational interviewing and its application in the management of coronary heart disease. Family Med Commun Hlth 2013 Sep 01;1(3):48-54. [CrossRef]
    16. Heckman C, Egleston B, Hofmann M. Efficacy of motivational interviewing for smoking cessation: a systematic review and meta-analysis. Tob Control 2010;19(5):410-416. [CrossRef] [Medline]
    17. Knight K, McGowan L, Dickens C, Bundy C. A systematic review of motivational interviewing in physical health care settings. Br J Health Psychol 2006;11(2):319-332. [CrossRef] [Medline]
    18. Soderlund L, Madson M, Rubak S, Nilsen P. A systematic review of motivational interviewing training for general health care practitioners. Patient Educ Couns 2011;84(1):16-26. [CrossRef] [Medline]
    19. Madson M, Loignon A, Lane C. Training in motivational interviewing: a systematic review. J Subst Abuse Treat 2009;36(1):101-109. [CrossRef] [Medline]
    20. Barwick MA, Bennett LM, Johnson SN, McGowan J, Moore JE. Training health and mental health professionals in motivational interviewing: a systematic review. Child Youth Serv Rev 2012 Sep;34(9):1786-1795. [CrossRef]
    21. Clark R, Mayer R. E-Learning and the Science of Instruction: Proven Guidelines for Consumers and Designers of Multimedia Learning. 4th edition. Hoboken, NJ: John Wiley & Sons; 2011.
    22. Bembridge E, Levett-Jones T, Jeong S. The transferability of information and communication technology skills from university to the workplace: a qualitative descriptive study. Nurse Educ Today 2011;31(3):245-252. [CrossRef] [Medline]
    23. Button D, Harrington A, Belan I. E-learning & information communication technology (ICT) in nursing education: A review of the literature. Nurse Educ Today 2014 Oct;34(10):1311-1323. [CrossRef] [Medline]
    24. Kala S, Isaramalai S, Pohthong A. Electronic learning and constructivism: a model for nursing education. Nurse Educ Today 2010 Jan;30(1):61-66. [CrossRef] [Medline]
    25. Cook DA, Levinson AJ, Garside S, Dupras DM, Erwin PJ, Montori VM. Internet-based learning in the health professions: a meta-analysis. J Am Med Assoc 2008 Sep 10;300(10):1181-1196. [CrossRef] [Medline]
    26. Lahti M, Hätönen H, Välimäki M. Impact of e-learning on nurses' and student nurses knowledge, skills, and satisfaction: a systematic review and meta-analysis. Int J Nurs Stud 2014 Jan;51(1):136-149. [CrossRef] [Medline]
    27. Means B, Toyama Y, Murphy R, Bakia M, Jones K. Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies. Washington, DC: US Department of Education; 2009.   URL: https:/​/www.​sri.com/​sites/​default/​files/​publications/​imports/​EvaluationEvidenceBasedPracticeOnlineLearning.​pdf [accessed 2016-08-15] [WebCite Cache]
    28. Cheng Y. The effects of information systems quality on nurses' acceptance of the electronic learning system. J Nurs Res 2012 Mar;20(1):19-30. [CrossRef] [Medline]
    29. Cook DA, Levinson AJ, Garside S, Dupras DM, Erwin PJ, Montori VM. Instructional design variations in internet-based learning for health professions education: a systematic review and meta-analysis. Acad Med 2010 May;85(5):909-922. [CrossRef] [Medline]
    30. Cheng B, Wang M, Yang SJ, Kinshuk M, Peng J. Acceptance of competency-based workplace e-learning systems: effects of individual and peer learning support. Comput Educ 2011 Aug;57(1):1317-1333. [CrossRef]
    31. Nesterowicz K, Librowski T, Edelbring S. Validating e-learning in continuing pharmacy education: user acceptance and knowledge change. BMC Med Educ 2014 Feb;14(33):1-7 [FREE Full text] [CrossRef] [Medline]
    32. Chow M, Herold DK, Choo T, Chan K. Extending the technology acceptance model to explore the intention to use Second Life for enhancing healthcare education. Comput Educ 2012 Dec;59(4):1136-1144. [CrossRef]
    33. Venkatesh V, Morris M, Davis G, Davis F. User acceptance of information technology: toward a unified view. MIS Q 2003;27(3):425-478.
    34. Admiraal W, Lockhorst D. E-Learning in small and medium-sized enterprises across Europe: Attitudes towards technology, learning and training. Int Small Bus J 2009 Dec 22;27(6):743-767. [CrossRef]
    35. Bloomfield JG, Jones A. Using e-learning to support clinical skills acquisition: exploring the experiences and perceptions of graduate first-year pre-registration nursing students - a mixed method study. Nurse Educ Today 2013 Dec;33(12):1605-1611. [CrossRef] [Medline]
    36. Hartland W, Biddle C, Fallacaro M. Audiovisual facilitation of clinical knowledge: a paradigm for dispersed student education based on Paivio's Dual Coding Theory. AANA J 2008 Jun;76(3):194-198. [Medline]
    37. Zhang D, Zhou L, Briggs RO, Nunamaker JF. Instructional video in e-learning: assessing the impact of interactive video on learning effectiveness. Inform Manage 2006 Jan;43(1):15-27. [CrossRef]
    38. Kelly M, Lyng C, McGrath M, Cannon G. A multi-method study to determine the effectiveness of, and student attitudes to, online instructional videos for teaching clinical nursing skills. Nurse Educ Today 2009 Apr;29(3):292-300. [CrossRef] [Medline]
    39. Sharpnack PA, Goliat L, Baker JR, Rogers K, Shockey P. Thinking like a nurse: using video simulation to rehearse for professional practice. Clin Simulation Nurs 2013 Dec;9(12):e571-e577. [CrossRef]
    40. Cardoso AF, Moreli L, Braga FT, Vasques CI, Santos CB, Carvalho EC. Effect of a video on developing skills in undergraduate nursing students for the management of totally implantable central venous access ports. Nurse Educ Today 2012 Aug;32(6):709-713. [CrossRef] [Medline]
    41. Eysenbach G. CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. J Med Internet Res 2011;13(4):e126 [FREE Full text] [CrossRef] [Medline]
    42. Chan A, Tetzlaff JM, Altman DG, Dickersin K, Moher D. SPIRIT 2013: new guidance for content of clinical trial protocols. Lancet 2013 Jan 12;381(9861):91-92. [CrossRef] [Medline]
    43. Feeley N, Cossette S. Pilot studies for randomized clinical trials. In: Henly S, editor. Routledge International Handbook of Advanced Quantitative Methods in Nursing Research. New York, NY: Routledge; 2015.
    44. Paradis V, Cossette S, Frasure-Smith N, Heppell S, Guertin M. The efficacy of a motivational nursing intervention based on the stages of change on self-care in heart failure patients. J Cardiovasc Nurs 2010;25(2):130-141. [CrossRef] [Medline]
    45. Miller WR, Moyers TB. Eight stages in learning motivational interviewing. J Teaching Addict 2006 Jan;5(1):3-17. [CrossRef]
    46. Paradis V. Évaluation d’une Intervention Infirmière Motivationnelle Selon les Stades de Changement (MSSC) sur des Comportements d’Auto-soins Chez des Patients Insuffisants Cardiaques [master’s thesis]. Montreal, QC: Université de Montréal; 2009.
    47. Bédard J. 3-Minute Empowerment.: Jacques Bédard, MD; 2016.   URL: http://www.jbedardmd.com/files/3_Minutes_Empowerment.pdf [accessed 2016-08-13] [WebCite Cache]
    48. Schwalbe CS, Oh HY, Zweben A. Sustaining motivational interviewing: a meta-analysis of training studies. Addiction 2014 Aug;109(8):1287-1294. [CrossRef] [Medline]
    49. DeLone W, McLean E. The DeLone and McLean model of information systems success: a ten-year update. J Manage Inform Syst 2003;19(4):9-30. [CrossRef]
    50. van der Heijden H. User acceptance of hedonic information systems. MIS Q 2004;28(4):695-704.
    51. World Health Organization. Process of Translation and Adaptation of Instruments. Geneva: WHO; 2016.   URL: http://www.who.int/substance_abuse/research_tools/translation/en/ [accessed 2016-08-13] [WebCite Cache]
    52. Cossette S, Cara C, Ricard N, Pépin J. Development and psychometric evaluation of a scale to assess patient-nurse interactions with a caring worldview. Int J Nurs Stud 2005;42:673-686.
    53. Mitchell S, Heyden R, Heyden N, Schroy P, Andrew S, Sadikova E, et al. A pilot study of motivational interviewing training in a virtual world. J Med Internet Res 2011;13(3):e77 [FREE Full text] [CrossRef] [Medline]
    54. Butler CC, Simpson SA, Hood K, Cohen D, Pickles T, Spanou C, et al. Training practitioners to deliver opportunistic multiple behaviour change counselling in primary care: a cluster randomised trial. BMJ 2013;346:1-25 [FREE Full text] [Medline]
    55. Welch J. Building a foundation for brief motivational interviewing: communication to promote health literacy and behavior change. J Contin Educ Nurs 2014 Dec;45(12):566-572. [CrossRef] [Medline]
    56. Kaltman S, WinklerPrins V, Serrano A, Talisman N. Enhancing motivational interviewing training in a family medicine clerkship. Teach Learn Med 2015;27(1):80-84. [CrossRef] [Medline]
    57. Eley R, Fallon T, Soar J, Buikstra E, Hegney D. The status of training and education in information and computer technology of Australian nurses: a national survey. J Clin Nurs 2008 Oct;17(20):2758-2767. [CrossRef] [Medline]
    58. Maag MM. Nursing students' attitudes toward technology. Nurse Educ 2006;31(3):112-118. [CrossRef]
    59. Moule P, Ward R, Lockyer L. Nursing and healthcare students' experiences and use of e-learning in higher education. J Adv Nurs 2010 Dec;66(12):2785-2795. [CrossRef] [Medline]
    60. Hung J. Trends of e-learning research from 2000 to 2008: use of text mining and bibliometrics. Br J Educ Technol 2012;43(1):5-16. [CrossRef]
    61. Chang TP, Pham PK, Sobolewski B, Doughty CB, Jamal N, Kwan KY, et al. Pediatric emergency medicine asynchronous e-learning: a multicenter randomized controlled Solomon four-group study. Acad Emerg Med 2014 Aug;21(8):912-919 [FREE Full text] [CrossRef] [Medline]
    62. Stansfeld SA, Kerry S, Chandola T, Russell J, Berney L, Hounsome N, et al. Pilot study of a cluster randomised trial of a guided e-learning health promotion intervention for managers based on management standards for the improvement of employee well-being and reduction of sickness absence: GEM Study. BMJ Open 2015;5(10):e007981 [FREE Full text] [CrossRef] [Medline]
    63. Nicastro E, Lo Vecchio A, Liguoro I, Chmielewska A, De Bruyn C, Dolinsek J, et al. The impact of e-learning on adherence to guidelines for acute gastroenteritis: a single-arm intervention study. PLoS One 2015;10(7):e0132213 [FREE Full text] [CrossRef] [Medline]
    64. Lahti ME, Kontio RM, Välimäki M. Impact of an e-learning course on clinical oractice in osychiatric hospitals: Nurse managers' views. Perspect Psychiatr Care 2016 Jan;52(1):40-48. [CrossRef] [Medline]
    65. Sinclair PM, Kable A, Levett-Jones T, Booth D. The effectiveness of Internet-based e-learning on clinician behaviour and patient outcomes: A systematic review. Int J Nurs Stud 2016 May;57:70-81. [CrossRef] [Medline]
    66. van de Steeg L, IJkema R, Wagner C, Langelaan M. The effect of an e-learning course on nursing staff's knowledge of delirium: a before-and-after study. BMC Med Educ 2015;15:12 [FREE Full text] [CrossRef] [Medline]
    67. Van Lancker A, Baldewijns K, Verhaeghe R, Robays H, Buyle F, Colman R, et al. The effectiveness of an e-learning course on medication calculation in nursing students: a clustered quasi-experimental study. J Adv Nurs 2016 Sep;72(9):2054-2064. [CrossRef] [Medline]
    68. van de Steeg L, IJkema R, Langelaan M, Wagner C. Can an e-learning course improve nursing care for older people at risk of delirium: a stepped wedge cluster randomised trial. BMC Geriatr 2014;14:69 [FREE Full text] [CrossRef] [Medline]
    69. Ebben RH, van Grunsven PM, Moors ML, Aldenhoven P, de Vaan VJ, van Hout R, et al. A tailored e-learning program to improve handover in the chain of emergency care: a pre-test post-test study. Scand J Trauma Resusc Emerg Med 2015;23(1):1-11 [FREE Full text] [CrossRef] [Medline]

    ‎
    CCU: coronary care unit
    CNP: cardiology nurse practitioner
    MI: motivational interviewing
    S1: first session of MOTIV@CŒUR
    S2: second session of MOTIV@CŒUR

    Edited by G Eysenbach; submitted 30.06.16; peer-reviewed by J Welch, J Apolinário-Hagen; comments to author 27.07.16; revised version received 03.08.16; accepted 08.08.16; published 18.08.16

    Copyright

    ©Guillaume Fontaine, Sylvie Cossette, Sonia Heppell, Louise Boyer, Tanya Mailhot, Marie-Josée Simard, Jean-Francois Tanguay. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 18.08.2016.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.