This paper is in the following e-collection/theme issue:

Email Communication, Web-Based Communication, Secure Messaging (160) Digital Health, Telehealth and e-Innovation in Clinical Settings (401) Adoption and Change Management of eHealth Systems (712) Electronic Health Records (1053) eHealth Infrastructures (345)

Published on in Vol 17, No 2 (2015): February

Predictors for Assessing Electronic Messaging Between Nurses and General Practitioners as a Useful Tool for Communication in Home Health Care Services: A Cross-Sectional Study

Predictors for Assessing Electronic Messaging Between Nurses and General Practitioners as a Useful Tool for Communication in Home Health Care Services: A Cross-Sectional Study

Predictors for Assessing Electronic Messaging Between Nurses and General Practitioners as a Useful Tool for Communication in Home Health Care Services: A Cross-Sectional Study

Authors of this article:

Merete Lyngstad1 Author Orcid Image ;   Dag Hofoss2 Author Orcid Image ;   Anders Grimsmo3 Author Orcid Image ;   Ragnhild Hellesø2 Author Orcid Image
Article Authors Cited by (8) Tweetations (4) Metrics

    Original Paper

    1Institute of Health and Society, Department of Nursing Science, University of Oslo, Oslo, Norway

    2Department of Public Health and General Practice, Norwegian University of Science and Technology, Trondheim, Norway

    Corresponding Author:

    Merete Lyngstad, MNsc

    Institute of Health and Society

    Department of Nursing Science

    University of Oslo

    PO 1130 Blindern

    Oslo, 0318

    Norway

    Phone: 47 92625044

    Fax:47 22850590

    Email: Merete.Lyngstad@medisin.uio.no


    Background: Nurses providing home health care services are dependent on access to patient information and communicating with general practitioners (GPs) to deliver safe and effective health care to patients. Information and communication technology (ICT) systems are viewed as powerful tools for this purpose. In Norway, a standardized electronic messaging (e-messaging) system is currently being established in health care.

    Objective: The aim of this study was to explore home health care nurses’ assessments of the utility of the e-messaging system for communicating with GPs and identify elements that influence the assessment of e-messaging as a useful communication tool.

    Methods: The data were collected using a self-developed questionnaire based on variables identified by focus group interviews with home health care nurses (n=425) who used e-messaging and existing research. Data were analyzed using logistic regression analyses.

    Results: Over two-thirds (425/632, 67.2%) of the home health care nurses returned the questionnaire. A high proportion (388/399, 97.2%) of the home health care nurses who returned the questionnaire found the e-messaging system to be a useful tool for communication with GPs. The odds of reporting that e-messaging was a useful tool were over five times higher (OR 5.1, CI 2.489-10.631, P<.001) if the nurses agreed or strongly agreed that e-messaging was easy to use. The odds of finding e-messaging easy to use were nearly seven times higher (OR 6.9, CI 1.713-27.899, P=.007) if the nurses did not consider the system functionality poor. If the nurses had received training in the use of e-messaging, the odds were over six times higher (OR 6.6, CI 2.515-17.437, P<.001) that they would consider e-messaging easy to use. The odds that a home health care nurse would experience e-messaging as easy to use increased as the full-time equivalent percentage of the nurses increased (OR 1.032, CI 1.001-1.064, P=.045).

    Conclusions: This study has shown that technical (ease of use and system functionality), organizational (training), and individual (full-time equivalent percentage) elements had an impact on home health care nurses’ assessments of using e-messaging to communicate with GPs. By identifying these elements, it is easier to determine which interventions are the most important for the development and implementation of ICT systems in home health care services.

    J Med Internet Res 2015;17(2):e47

    doi:10.2196/jmir.4056

    Keywords

    electronic mail; home healthcare nursing; collaborating; general practitioners 


    Health care services are characterized as fragmented and dispersed [1,2]. This issue is particularly challenging for the delivery of safe and effective health care to patients who receive home health care services. Nurses in home health care services are dependent on access to accurate and relevant patient information [3]. It is also essential that nurses in home health care services have the opportunity for clinical communication and discussions about patient care with general practitioners (GPs) [2,4].

    The current study was conducted in Norway, where home health care service is managed by municipalities; furthermore, GPs are self-employed [5] and each municipality can use different electronic health record (EHR) systems [6]. Thus, new methods for information exchange and clinical communication between GPs and home health care nurses are needed. Information and communication technology (ICT) systems are viewed as powerful tools that can solve this problem [7]. One of the most important goals for ICT development and implementation in health care is to improve the exchange of information, care coordination, and communication between health care workers [7,8]. However, implementing new electronic tools in health care has not always been successful [9,10]. Studies have shown that health care professionals may assess the tools as inefficient or believe that the tools do not align with their work practices [11-13]. Health care professionals’ beliefs, assessments, and satisfaction with the ICT systems influence the structure, process, and outcome of care, which can affect the safety of patients and their next of kin [3,14,15]. Developing and implementing new electronic tools for communication has high costs; therefore, it is important to reduce the risks of low, incorrect, or incomplete use of the systems [9,16].

    A sociotechnical perspective aims to understand how ICT systems are developed, implemented, and become a part of standard work practices [17]. The integration of ICT systems into work practices is dependent on the interaction between individual, organizational, and technological elements. These elements determine whether the implementation and use of ICT systems will be successful [16]. Therefore, a technical system cannot be isolated and function on its own and instead needs to be shaped and reshaped by the people and organizations in the social environments and contexts in which it is used [17]. The sociotechnical perspective emphasizes the need for active user involvement in an iterative development and implementation process and considers strong user involvement for adopting ICT systems, and for assessing them as useful [8,15,18-20].

    Previous studies have shown that several elements impact health care professionals’ assessments of the usability of ICT systems. These elements include the health professionals’ participation in the development of the ICT system [19], the design of the ICT system [11,12,21], the user interface and functionality of the ICT system [15], the ease of use [20-24], the compatibility with work practices [11,15,21,22,25], and how the ICT systems are put into practice (eg, training, user support, technical infrastructure, and resources) [7,11,15,21,23,26-28].

    In Norway, a standardized electronic messaging (e-messaging) system is currently being implemented in primary health services [29]. The e-messaging system has been integrated into all of the major EHR systems used in home health care services and GP offices in Norway, meaning that it is a module of the EHR systems that can be procured from vendors. The e-messaging system consists of six standardized, semistructured message types that can be sent from home health care nurses to GPs and five semistructured message types that can be sent from GPs to home health care nurses. The e-message types are customized for different purposes, including the patients’ health information and medication lists. A dialogue message was designed for requests, inquiries, and discussions about patients’ health issues and special care needs, administrative information on the type of home health care services provided to the patient and information about errors and omission in the treatment and care of the patient [30]. The e-messages are sent between the different health care providers’ EHR systems via the Norwegian Health Net, which is a secure and closed net used solely for health information exchange and clinical communication.

    The development of the e-messaging system was initiated and managed by health care professionals in close cooperation with vendors [31]. Several home health care nurses specified the requirements of the e-messaging system and participated in the development and implementation phases of the e-messaging system [31]. Thus, the system was adjusted by strong user involvement as suggested in other studies [15,19,20,22]. The Norwegian government aims to implement e-messaging in home health care services, nursing homes, GP offices, and hospitals by the end of 2014 [6].

    The aim of this paper was to describe home health care nurses’ assessments of using the e-messaging system to communicate with GPs and identify which elements predict that e-messaging will be considered a useful tool.


    The study used a cross-sectional approach with a questionnaire administered between November 2011 and February 2012.

    The Questionnaire

    We searched the literature but did not find any questionnaires that measured the use of e-messaging between home health care services and GPs. Therefore, we developed a questionnaire in two phases [32]. In the first phase, we explored the recommended guidelines for the use of e-messages [33], the description of the standards for the e-messaging system [30], and the results from previous contiguous research [34-37]. We then conducted focus groups and semistructured interviews with home health care nurses from two municipalities. The results from the interviews showed that both organizational and technical elements were assessed as important dimensions for the use of e-messaging [38].

    The second phase consisted of the questionnaire development. The questionnaire was reviewed by 6 registered nurses with clinical, ICT, and research skills, and it was pilot tested by 15 registered nurses who worked in home health care services. These steps provided significant and valuable information that was used to revise the questionnaire. The final version of the questionnaire contained 62 items in six sections: (1) Demographic information, eight items, (2) Procedures for and amount of information exchange and communication with GPs, 19 items, (3) Information content, 12 items, (4) Expectations for electronic communication with GPs, 10 items, (5) Electronic communication, three items, and (6) Experiences of the use of electronic communication, 10 items (see Multimedia Appendix 1). Six items were negatively worded: Items 19 (a)-(d) and Items 20 (d) and (e). Here, we report the demographic, electronic communication, and experiences of the use of e-messaging results from Sections 1, 5, and 6, respectively.

    The items selected for this study have been previously documented as important factors for health care providers’ assessments of health information systems [7,9,11,15,21,26-28]. These items can be grouped as individual, organizational, and technological elements. The individual element consists of Items 2-6 from Section 1 and Item 16 from Section 5 of the questionnaire. The organizational element consists of Items 20 (a) and (b) from Section 6 of the questionnaire. The technological element consists of Items 19 (b)-(d) and 20 (c) from Section 6 of the questionnaire.

    The questionnaire items were rated on a 5-point Likert scale as follows: (1) strongly disagree, (2) disagree, (3) neither agree or disagree, (4) agree, and (5) strongly agree. The Cronbach alpha exceeded .7, indicating acceptable reliability [39].

    To test the validity of the questionnaire, a selection of the items from the main study was summarized and correlated with the item “useful tool for communication with GPs”, which is the questionnaire’s concluding question. Pearson’s r was .57 (P<.001), indicating a fairly strong correlation between the overarching concept of usefulness of the e-messaging tool and the selected questionnaire items, but also that there may be items or facets of items that should have been addressed in the questionnaire. However, we wanted to keep the questionnaire short to achieve a high response rate. The pilot test showed that it took approximately 10 minutes to complete the questionnaire.

    Data Collection

    The questionnaire data were collected from home health care nurses in 12 out of 428 municipalities in Norway. The inclusion criterion for the municipalities required that the e-messaging system had been in use for more than 6 months. We assumed that system usage would be stable after this time frame [40]. The 12 municipalities were the first in Norway to introduce e-messaging to support communication between home health care nurses and GPs, and they were the only municipalities that met this inclusion criteria at the time of our study. All of the home health care nurses were employed in a 50% or greater full-time equivalent position, had been using e-messaging for at least 3 months, and were able to read and write Norwegian. The home health care nurses received the questionnaire, information letter, and return envelope at their workplace from a designated contact person in each municipality. The contacts were responsible for distributing collective reminders and for collecting the envelopes with the completed questionnaire. There were 681 nurses qualified to answer the questionnaire, and the questionnaire was distributed to 632 (92.8%) nurses.

    Ethical Considerations

    The home health care nurses who were invited to answer the questionnaire received written information explaining that their participation was anonymous and that returning the questionnaire meant that they agreed to participate in the study. The methods for data collection and handling the interviews and the questionnaire were approved by the Norwegian Social Science Data Services, which is the official data protection agency for research at the University of Oslo (reference no. 26230).

    Data Analysis

    We used a descriptive analysis to determine the characteristics of the sample and the nurses’ assessments of using e-messaging. Scores for negatively worded items were reversed. Two logistic regression models were developed to determine the extent to which specific elements influenced the odds that the nurses would report that e-messaging was a useful and easy tool for communication with GPs.

    In the first logistic regression model, “the useful tool model”, we chose to include the independent variables of “easy to use” and the home health care nurses’ demographic characteristics of “age”, “gender”, “full-time equivalent percentages”, “years of experience as a registered nurse (RN)”, “years in current position”, and “number of months using e-messaging”. The reason for choosing these variables is based on results from previous research [3,8,21,26,38].

    In the second logistic regression model, “the ease-of-use model”, the dependent variable of “easy to use” was combined with the independent variables of “received training”, “access to user support”, “hindered by poor functionality”, “hindered by low system performance”, and “hindered by software error”, and the home health care nurses’ characteristics. These variables have been shown to have an impact of the assessment and adoption of ICT systems [3,7-9,11,15,21,26-28,38].

    In the pre-analysis of the data, we searched for outliers in continuous variables. The results showed that it was not necessary to transform any of the data. We used ±3.30 standard deviations (SD) to check for outliers, as suggested by Altman [41]. Two variables had outliers: “years in current position” with 24 years (0.9%) in the positive direction and “number of months using e-messaging” with 37 months (1.3%). However, working for an extended period of time in the same position or using the e-messaging system for 37 months is unlikely to affect the results.

    Homoscedasticity in both logistic regression models was assessed by a one-way analysis of variance of the standardized residuals to establish that their variance was approximately the same for all values of the predictor variables. No homoscedasticity was found. The first model was used to predict if the e-messaging system was a useful tool for communication with GPs. The item “easy to use” did not show statistically significant differences (P=.76) between the prediction errors in the group that found the e-messaging system to be a useful tool and the group that did not find the tool to be useful. The second model was used to predict if the e-messaging system was easy to use. The items “received training” (P=.88), “hindered by poor functionality” (P=.84), and “full-time equivalent percentage” (P=.77) did not show statistically significant differences between the prediction errors in the group that found the e-messaging system easy to use and the group that did not find the tool easy to use.

    We tested for possible multicollinearity among the independent variables in both models using the Pearson correlation to exclude that the independent variables were highly correlated. The highest correlation was .76 for age and years of experience as an RN; therefore, no significant multicollinearity was found [42].

    In the logistic regression analysis, we dichotomized the variables because of their skewed distribution. The variable “useful tool” was dichotomized as strongly disagree, disagree, neutral, and agree (0=1-4) and strongly agree (1=5). The rest of the ordinal variables were dichotomized as strongly disagree, disagree, neutral (0=1-3), agree, and strongly agree (1=4-5).

    The P value of the Hosmer and Lemeshow goodness of fit statistic for “the useful tool model” was .317, and for “the ease-of-use model” the P value was .650. The data were analyzed using IBM SPSS Statistics version 20.0.


    Characteristics of Home Health Care Nurses

    A total of 425 (67.2%) of the 632 home health care nurses who received the questionnaire completed it. The demographic information is presented in Table 1.

    Table 1. Demographic information of home health care nurses (N=425).
    Demographic characteristicsMeann (%)
    Gender, n (%)

    		Female
    		383 (90.4)

    		Male
    		41 (9.6)
    Age, mean (SD)39.6 (10.1)424 (99.8)
    Years of experience, mean (SD)11.5 (9.1)421 (99.1)
    Full-time equivalent percentage, mean (SD)90.9 (14.2)425 (100.0)
    Years in current position, mean (SD)5.8 (5.6)422 (99.3)
    Number of months using e-messaging, mean (SD)10.21 (7.5)382 (89.9)

    Home Health Care Nurses’ Assessments of e-Messaging

    The vast majority of the responding home health care nurses (388/399, 97.2%) agreed or strongly agreed that e-messaging was a useful tool for communication with GPs. Table 2 presents all responses in order to show the complete distribution of the responses.

    For the “easy to use e-messaging” item, the majority of home health care nurses agreed or strongly agreed (357/398, 89.7%) that e-messaging was easy to use. A high proportion of the home health care nurses agreed or strongly agreed that they had received training (333/399, 83.5%), while the remaining nurses were neutral or disagreed. The home health care nurses agreed to a lower degree that they had access to user support (256/389, 65.8%).

    A relatively high proportion of the home health care nurses were neutral or agreed that they were hindered when using e-messaging because of poor functionality (123/395, 31.1%), low system performance (123/396, 31.1%), or software errors (129/395, 32.7%).

    Table 2. Assessments of using e-messaging (N=425).
    ItemStrongly disagree,
    % (n)    		Disagree,
    % (n)    		Neutral,
    % (n)    		Agree,
    % (n)    		Strongly agree,
    % (n)    		Missing,
    n
    Received training1.7 (7)6.0 (24)8.8 (35)50.9 (203)32.6 (130)26
    Access to user support1.2 (5)3.6 (14)29.3(114)52.9 (206)12.9 (50)36
    Hindered by poor functionality18.7 (74)50.1 (198)23.3 (92)6.6 (26)1.2 (5)30
    Hindered by low system performance19.4 (77)49.5 (196)23.5 (93)6.3 (25)1.2 (5)29
    Hindered by software error21.5 (85)45.8 (181)17.2 (68)13.1 (52)2.3 (9)30
    Easy to use0.2 (1)1.5 (6)8.5 (34)52.8 (210)36.9 (147)27
    Useful tool-0.7 (3)2 (8)31.8 (127)65.4 (261)26

    Predictors That Affected Nurses’ Assessment of e-Messaging as a Useful Tool for Communication With GPs

    The logistic regression model showed that the “easy to use” item gave a statistically significant contribution to the model (Table 3).

    The odds of reporting that e-messaging was a useful tool were over five times higher if the nurses agreed or strongly agreed that e-messaging was easy to use. The “useful tool model” was controlled for the demographic variables of gender, age, years of experience as an RN, full-time equivalent percentage, and years in current position.

    Table 3. Logistic regression model examining predictors affecting the assessment of e-messaging as a useful tool (N=391).

    		B (SE)P valueOdds ratio (95% CI)
    Gender.041 (0.402).9201.041 (0.473-2.291)
    Age.009 (0.018).6211.009 (0.974-1.045)
    Years of experience as an RN-.014 (0.021).5050.986 (0.948-1.027)
    Full-time equivalent percentage.006 (0.008).5051.006 (0.989-1.022)
    Years in current position.001 (0.024).9731.1001 (0.955-1.049)
    Easy to use1.638 (0.370).0005.144 (2.489-10.631)
    Constant-1.555.1340.211

    Predictors That Affected the Nurses’ Assessment of e-Messaging as Easy to Use

    The “ease-of-use model” determined which elements influenced the assessment of e-messaging as easy to use. The results from the logistic regression model (Table 4) showed that the independent variables “hindered by poor functionality”, “training received”, and “full-time equivalent percentage” were statistically significant.

    The odds that a home health care nurse would experience e-messaging as easy to use increased as the full-time equivalent percentage of the nurses increased. If the home health care nurses agreed that they were not hindered by poor e-messaging functionality, the odds of agreeing that e-messaging was easy to use were over 6.9 times higher than if they did not agree. The home health care nurses who agreed that they had received training had odds over 6.6 times higher of agreeing that e-messaging was easy to use. The home health care nurses’ gender, number of months using e-messaging, being hindered by low system performance or software errors, or having access to user support were not statistically significant predictors for the assessment of e-messaging as easy to use.

    Table 4. Logistic regression model examining predictors affecting assessments of e-messaging as easy to use (N=364).

    		B (SE)P valueOdds ratio (95% CI)
    Gender-.561 (0.796).4800.570 (0.120-2.713)
    Age-.049 (0.038).1930.952 (0.884-1.025)
    Years of experience-.015 (0.039).7010.985 (0.913-1.063)
    Full-time equivalent percentage.031 (0.016).0451.032 (1.001-1.064)
    Years in current position-.030 (0.043).4880.971 (0.893-1.056)
    Number of months using e-messaging-.030 (0.030).3180.971 (0.915-1.029)
    Hindered by low system performance-.633 (0.731).3870.531 (0.127-2.226)
    Hindered by software error-.094 (0.548).8630.910 (0.311-2.664)
    Hindered by poor functionality1.933 (0.712).0076.914 (1.713-27.899)
    Received training1.890 (0.494)<.0016.622 (2.515-17.437)
    Having access to user support.170 (0.479).7221.186 (.464-3.031)
    Constant1.053 (2.001).5992.867

    Principal Findings

    The results from this study showed that individual, organizational, and technological elements are interrelated and affect home health care nurses’ assessments of using e-messaging to communicate with GPs. This is in line with a sociotechnical perspective [20]. This study demonstrated that the majority of the home health care nurses assessed the e-messaging system as a useful tool for communication with GPs.

    Several home health care nurses cooperated with the vendors in the development and implementation of the e-messaging system. The realization of an ICT system relies on the participation of the people who will ultimately use it [19]. This is important because the system must fit the needs and working practices of the users. ICT development and implementation projects in health care can be controversial because ICT systems change organizational routines and relationships between different health care professionals. To prevent resistance and non-utilization of the ICT systems, users need to be thoroughly and systematically involved at an early stage in the development and implementation process [20]. The involvement of home health care nurses in the development and implementation of the e-messaging system may have resulted in a system that was better aligned with nurses’ needs and working practices; therefore, a positive assessment of the e-messaging system could be anticipated.

    The only statistically significant predictor of e-messaging as a useful tool for communication with GPs was that nurses assessed e-messaging as easy to use. This is supported by a study of health care professionals’ adoption and use of a clinical information system that found that the ease of use of the system was required for it to be considered as a beneficial tool for their clinical practice [24].

    Ease of use is one of the most frequent elements reported among studies of facilitators and barriers of the adoption of ICT systems in health care [21,22,24]. Ease of use is related to individual characteristics of the people who are using ICT systems, technical features of the ICT system such as the software and hardware, and organizational implementation of the ICT system in terms of training, procedures, user support, and configuration of the system. We found that only one individual element, full-time equivalent percentage, was a statistically significant predictor for e-messaging being easy to use. Previous research has reported opposing evidence that multiple individual elements, such as age, gender, years of experience as a nurse, and full-time or part-time work, affect the assessment of ICT systems [3,8,43-45]. However, we found that the higher the full-time equivalent percentage of the home health care nurses, the more likely they were to assess e-messaging as easy to use. One explanation for this finding is that the more time home health care nurses spend at work, the more they have access to training, user support, and help from their colleagues; thus, the nurse is more familiar with the use of e-messaging, which may result in a positive experience and assessment of the e-messaging system. Another explanation could be that the more time spent at work, the more time is spent using the system, and the more adept the user becomes with the system.

    Tools/technical concerns, such as functionality and system design, are important elements that can act as barriers and facilitators for the implementation and use of ICT systems in health care [28]. In our study, a lack of poor functionality was the strongest predictor for the home health care nurses’ assessments of e-messaging as easy to use. This finding is supported by another study on nurses’ assessments of health care technology, which revealed that poor system design was among the most common elements for negative attitudes [12]. Ease of use is also related to the technical environment and the integration between ICT systems. In a study on usability, the results showed that physicians rated ICT systems as low because the integration between the ICT systems was insufficient [11]. In this study, the technological environment was important in the way that the e-messaging system was integrated into the EHR systems that home health care nurses were already using. The user interface was well known, which lowered the threshold for implementing and adopting the e-messaging system [16].

    Assessments of ICT systems are affected by organizational aspects, such as offering user support and training [11]. Our results show that a high proportion of the home health care nurses had received initial training in the use of the e-messaging system, which was a strong predictor for assessing the e-messaging system as easy to use. Training has previously been identified as a key element for the successful implementation of ICT systems in complex systems such as health care services [7,9,15,46,47]. Training is important in ensuring that the systems are used in the intended way and reducing the risk of incorrect use, which could jeopardize patient safety [7,15,27]. Nurses’ use of ICT systems is affected by training in both basic ICT and specific software [3,28,48]. Training at different levels should be offered by organizations and must be tailored to the individual needs of home health care nurses [49].

    By applying a sociotechnical perspective, we were able to detect and predict which elements were important for the development and implementation of e-messaging. All of these elements are interrelated and shape the sociotechnical system; furthermore, these elements should be considered when developing and implementing new technology in home health care services [20].

    Limitations

    This study has several limitations. The best methodology to develop a questionnaire is to include a pilot study with a smaller sample using all possible variables and subsequently identifying the relevant ones. However, we did not complete this type of study because of our limited time frame. As an alternative, we based the questionnaire on explanatory variables identified by the focus group interviews and existing research.

    The questionnaire was not assessed across all dimensions of validity and reliability. However, the aim of the study did not include a complete psychometric testing of the questionnaire.

    The mean full-time equivalent percentage may have been falsely high because one of the inclusion criteria for participation in the study was that the nurses had to be engaged in a 50% or greater full-time equivalent position. This was necessary to ensure that the nurses had enough experience in using e-messaging. According to the Norwegian Nurses Organization in 2011, 56% of the nurses in primary care in Norway did not work in a full-time positon, and 15% of those had less than a 50% full-time equivalent position [50]. The odds ratio of the full-time equivalent percentage predictor may be higher than our results suggest; thus, the results in our study may understate the odds of the full-time equivalent predictor in the general population. Another element that may have biased the results was that the home health care nurses who participated in this study worked in the first municipalities in Norway to implement e-messaging. Being among the early adopters may have caused the home health care nurses to be especially encouraged, enthusiastic, technologically optimistic, and positive toward e-messaging. These characteristics could differ in populations that were late to adopt the system.

    The strength of this study is that we questioned home health care nurses in all of the municipalities that had used the e-messaging system for at least 6 months at the time of the study. The response rate of the study was 67.2%, which can be considered fairly good for a questionnaire study [51].

    Conclusions

    By identifying elements that affect home health care nurses’ assessments of e-messaging for communication with GPs, we are better able to determine which interventions are most important for the development and implementation of e-messaging. This study demonstrated that home health care nurses assessed e-messaging as a useful tool for communication with GPs. It also shows that ICT systems must be easy to use to be assessed as a useful tool and that a higher full-time equivalent percentage, having received training, and not being hindered by poor functionality are important predictors for the assessment of the e-messaging system as easy to use. Our results imply that users should be actively involved in the development and implementation of ICT systems. Future studies should use a sociotechnical approach to consideration the complete range of elements that can affect working practices and the outcomes for the patients and organizations involved. These insights may help to increase the understanding of effective strategies for developing and implementing ICT systems in home health care services.

    Acknowledgments

    The project was funded by Grant 196365/V50 awarded by the Research Council of Norway. We would like to thank the municipalities that helped us organize the data collection and the home health care nurses who participated in our study. We would also like to thank Dr Line Melby for participating in the collection of data used to develop the questionnaire; Dr Maren Kristine Raknes Sogstad; the RNs, Edith Gjevjon, Torunn Wibe, Sissel Skarsgaard, Irene Henriksen Aune, and Astrid Simonsen; the Centre for the Development of Home Healthcare Services in Oslo for their contribution to the development of the questionnaire; and research assistant, Linda Aasvangen, for preparing the SPSS file.

    Authors' Contributions

    ML designed the work, conducted the analysis, and wrote the first draft of the paper. DH and AG contributed to the design of the study and the statistical analysis. RH contributed to the design of the study, the data collection, and the statistical analysis. All of the authors revised the manuscript and read and approved the final version.

    Conflicts of Interest

    None declared.

    ‎

    Multimedia Appendix 1

    The questionnaire.

    PDF File (Adobe PDF File), 158KB
    1. Stange KC. The problem of fragmentation and the need for integrative solutions. Ann Fam Med 2009;7(2):100-103 [FREE Full text] [CrossRef] [Medline]
    2. The Norwegian Ministry of Health and Care Services. Samhandlingsreformen: Rett behandling - på rett sted - til riktig tid [Coordination Reform: the Right Treatment - at the Right Place - to the Right Time] Vol. 47. Oslo: Departementenes servicesenter, Informasjonsforvaltning; 2009.   URL: https:/​/www.​regjeringen.no/​contentassets/​d4f0e16ad32e4bbd8d8ab5c21445a5dc/​no/​pdfs/​stm200820090047000dddpdfs.​pdf [accessed 2015-02-10] [WebCite Cache]
    3. Ward R, Stevens C, Brentnall P, Briddon J. The attitudes of health care staff to information technology: a comprehensive review of the research literature. Health Info Libr J 2008 Jun;25(2):81-97. [CrossRef] [Medline]
    4. Capurro D, Ganzinger M, Perez-Lu J, Knaup P. Effectiveness of eHealth interventions and information needs in palliative care: a systematic literature review. J Med Internet Res 2014;16(3):e72 [FREE Full text] [CrossRef] [Medline]
    5. Genet N. Home Care across Europe: Current Structure and Future Challenges. Copenhagen: World Health Organization; 2012.   URL: http://www.nivel.nl/sites/default/files/bestanden/Home-care-across-Europe-case-studies.pdf [accessed 2015-02-10] [WebCite Cache]
    6. The Norwegian Ministry of Health and Care Services. Én innbygger - én journal: digitale tjenester i helse- og omsorgssektoren [One Citizen - One Record: Digital Services in the Health and Care Services] Vol. 9. Oslo: Regjeringen; 2012.   URL: https:/​/www.​regjeringen.no/​contentassets/​33a159683925472aa15ad74f27ad04cc/​no/​pdfs/​stm201220130009000dddpdfs.​pdf [accessed 2015-02-10] [WebCite Cache]
    7. Institute of Medicine. Health IT and Patient Safety: Building Safer Systems for Better Care. Washington, DC: National Academies Press; 2012.
    8. Laramee AS, Bosek M, Shaner-McRae H, Powers-Phaneuf T. A comparison of nurse attitudes before implementation and 6 and 18 months after implementation of an electronic health record. Comput Inform Nurs 2012 Oct;30(10):521-530. [CrossRef] [Medline]
    9. Greenhalgh T, Stramer K, Bratan T, Byrne E, Russell J, Potts HW. Adoption and non-adoption of a shared electronic summary record in England: a mixed-method case study. BMJ 2010;340:c3111 [FREE Full text] [Medline]
    10. Mair FS, May C, O'Donnell C, Finch T, Sullivan F, Murray E. Factors that promote or inhibit the implementation of e-health systems: an explanatory systematic review. Bull World Health Organ 2012 May 1;90(5):357-364 [FREE Full text] [CrossRef] [Medline]
    11. Viitanen J, Hyppönen H, Lääveri T, Vänskä J, Reponen J, Winblad I. National questionnaire study on clinical ICT systems proofs: physicians suffer from poor usability. Int J Med Inform 2011 Oct;80(10):708-725. [CrossRef] [Medline]
    12. Huryk LA. Factors influencing nurses' attitudes towards healthcare information technology. J Nurs Manag 2010 Jul;18(5):606-612. [CrossRef] [Medline]
    13. Kruse CS, Regier V, Rheinboldt KT. Barriers over time to full implementation of health information exchange in the United States. JMIR Med Inform 2014;2(2):e26 [FREE Full text] [CrossRef] [Medline]
    14. Karsh B, Holden R, Escoto K, Alper S, Scanlon M, Arnold J, et al. Do beliefs about hospital technologies predict nurses' perceptions of quality of care? A study of task-technology fit in two pediatric hospitals. International Journal of Human-Computer Interaction 2009 Jun 08;25(5):374-389. [CrossRef]
    15. Ash JS, Berg M, Coiera E. Some unintended consequences of information technology in health care: the nature of patient care information system-related errors. J Am Med Inform Assoc 2004;11(2):104-112 [FREE Full text] [CrossRef] [Medline]
    16. Ludwick DA, Doucette J. Adopting electronic medical records in primary care: lessons learned from health information systems implementation experience in seven countries. Int J Med Inform 2009 Jan;78(1):22-31. [CrossRef] [Medline]
    17. Berg M, Aarts J, van der Lei J. ICT in health care: sociotechnical approaches. Methods Inf Med 2003;42(4):297-301. [CrossRef] [Medline]
    18. Christensen T, Grimsmo A. Development of functional requirements for electronic health communication: preliminary results from the ELIN project. Inform Prim Care 2005;13(3):203-208. [Medline]
    19. Kensing F, Blomberg J. Participatory Design: Issues and Concerns. Computer Supported Cooperative Work (CSCW) 1998 Sep;7(3-4):167-185. [CrossRef]
    20. Berg M. Patient care information systems and health care work: a sociotechnical approach. Int J Med Inform 1999 Aug;55(2):87-101. [Medline]
    21. Gagnon MP, Desmartis M, Labrecque M, Car J, Pagliari C, Pluye P, et al. Systematic review of factors influencing the adoption of information and communication technologies by healthcare professionals. J Med Syst 2012 Feb;36(1):241-277 [FREE Full text] [CrossRef] [Medline]
    22. Harvey J, Avery AJ, Hibberd R, Barber N. Meeting user needs in national healthcare systems: lessons from early adopter community pharmacists using the electronic prescriptions service. BMC Med Inform Decis Mak 2014;14:16 [FREE Full text] [CrossRef] [Medline]
    23. Nguyen L, Bellucci E, Nguyen LT. Electronic health records implementation: an evaluation of information system impact and contingency factors. Int J Med Inform 2014 Nov;83(11):779-796. [CrossRef] [Medline]
    24. Vedel I, Lapointe L, Lussier MT, Richard C, Goudreau J, Lalonde L, et al. Healthcare professionals' adoption and use of a clinical information system (CIS) in primary care: insights from the Da Vinci study. Int J Med Inform 2012 Feb;81(2):73-87. [CrossRef] [Medline]
    25. Nazi KM. The personal health record paradox: health care professionals' perspectives and the information ecology of personal health record systems in organizational and clinical settings. J Med Internet Res 2013;15(4):e70 [FREE Full text] [CrossRef] [Medline]
    26. Yoo S, Kim S, Lee S, Lee KH, Baek RM, Hwang H. A study of user requests regarding the fully electronic health record system at Seoul National University Bundang Hospital: challenges for future electronic health record systems. Int J Med Inform 2013 May;82(5):387-397. [CrossRef] [Medline]
    27. Coiera E, Aarts J, Kulikowski C. The dangerous decade. J Am Med Inform Assoc 2012;19(1):2-5 [FREE Full text] [CrossRef] [Medline]
    28. McGinn CA, Grenier S, Duplantie J, Shaw N, Sicotte C, Mathieu L, et al. Comparison of user groups' perspectives of barriers and facilitators to implementing electronic health records: a systematic review. BMC Med 2011;9:46 [FREE Full text] [CrossRef] [Medline]
    29. The Norwegian Ministry of Health and Care Services. Samspill 2.0 - Nasjonal strategi for elektronisk samhandling i helse- og omsorgssektoren 2008 [Teamwork 2.0: National Strategy for Electronic Cooperation in the Health and Social Sector]. Oslo: Statens trykksakekspedisjon; 2013.   URL: http:/​/www.​helsedirektoratet.no/​publikasjoner/​samspill-20-nasjonal-strategi-for-elektronisk-samhandling-i-helse--og-omsorgssektoren-2008-2013/​Publikasjoner/​samspill-20-nasjonal-strategi-for-elektronisk-samhandling-i-helse--og-omsorgssektoren-2008-2013.​pdf [accessed 2015-02-10] [WebCite Cache]
    30. Alsaker M, Askevold A. Standard for elektronisk kommunikasjon med pleie- og omsorgstjenesten. Informasjonsmodell og XML-meldingsbeskrivelse, versjon 1.4 [Standard for electronic communication with community care. Information model and XML- message description, version 1.4]. Trondheim: Kith; 2008.   URL: http://www.kith.no/upload/3757/R04-07-Pleie-og-omsorg-melding-v1.4_20-02-2008.pdf [accessed 2015-02-10] [WebCite Cache]
    31. Lyngstad M, Hellesø R, Mølstad K, Skarsgaard S, Dønåsen M. From technology driven to user driven development of ICT solutions in the health care sector – the ELIN-K Project. In: Proceedings from the 8th European Conference of ACENDIO. Dublin, Ireland: ACENDIO Secretariat; 2011 Presented at: 8th European Conference of ACENDIO; March 25-26, 2011; Madeira, Portugal   URL: http://www.acendio.net/members/proceedings/ACENDIO2011.pdf
    32. Boynton PM, Greenhalgh T. Selecting, designing, and developing your questionnaire. BMJ 2004 May 29;328(7451):1312-1315 [FREE Full text] [CrossRef] [Medline]
    33. Askevold A. Bruk av pleie- og omsorgsmeldinger i pasientforløp. Veiviser for helsepersonell og saksbehandlere [Use of community care messages in patient care trajectories. Procedures for health professionals and case managers].: The Norwegian Directorate of Health; 2012.   URL: http://kith.no/upload/6653/KITH_R06-08-2012-v2.1-Veiviser-PLO-meldinger.pdf [accessed 2015-02-10] [WebCite Cache]
    34. Hellesø R. Ord over skigard: informasjonsutveksling og samhandling mellom sykepleiere i spesialisthelsetjenesten før og etter innføring av elektronisk pasientjournal [Word Over the Fence: Information Exchange and Interaction between Nurses in Hospitals and Municipal Care before and after the Introduction of Electronic Patient Records]. Oslo: Unipub; 2005.
    35. Lærum H. Evaluation of Electronic Medical Records: A Clinical Task Perspective. Trondheim: Norwegian University of Technology and Science; 2004.
    36. Paulsen B, Grimsmo A. God vilje - dårlig verktøy: om samhandling mellom sykehus og kommunale omsorgstjenester ved utskrivninger av omsorgstrengende eldre Good Will—[Poor Tools: About the Interaction between Hospital and Municipal Care when Elderly in Need of Care are Discharged]. Trondheim: SINTEF Helse; 2008.
    37. Christensen T. Bringing the GP to the forefront of EHR development. Trondheim: Norwegian University of Technology and Science; 2009.
    38. Lyngstad M, Melby L, Grimsmo A, Helleso R. Toward increased patient safety? Electronic communication of medication information between nurses in home health care and general practitioners. Home Health Care Management & Practice 2013 Mar 14;25(5):203-211. [CrossRef]
    39. Nunnally JC. Psychometric theory. New York: McGraw-Hill; 1978.
    40. Nykänen P, Brender J, Talmon J, de Keizer N, Rigby M, Beuscart-Zephir MC, et al. Guideline for good evaluation practice in health informatics (GEP-HI). Int J Med Inform 2011 Dec;80(12):815-827. [CrossRef] [Medline]
    41. Altman D. Practical statistics for medical research. London: Chapman and Hall; 1991.
    42. Katz MH. Multivariate analysis: a practical guide for clinicians. Cambridge: Cambridge University Press; 2006.
    43. Oroviogoicoechea C, Watson R. A quantitative analysis of the impact of a computerised information system on nurses' clinical practice using a realistic evaluation framework. Int J Med Inform 2009 Dec;78(12):839-849. [CrossRef] [Medline]
    44. Dillon TW, Blankenship R, Crews T. Nursing attitudes and images of electronic patient record systems. Comput Inform Nurs 2005;23(3):139-145. [Medline]
    45. Kaya N. Factors affecting nurses' attitudes toward computers in healthcare. Comput Inform Nurs 2011 Feb;29(2):121-129. [CrossRef] [Medline]
    46. Venkatesh V, Bala H. Technology Acceptance Model 3 and a Research Agenda on Interventions. Decision Sciences 2008 May;39(2):273-315. [CrossRef]
    47. Terry AL, Giles G, Brown JB, Thind A, Stewart M. Adoption of electronic medical records in family practice: the providers' perspective. Fam Med 2009;41(7):508-512 [FREE Full text] [Medline]
    48. Lee TT. Nurses' concerns about using information systems: analysis of comments on a computerized nursing care plan system in Taiwan. J Clin Nurs 2005 Mar;14(3):344-353. [CrossRef] [Medline]
    49. Simon SR, Keohane CA, Amato M, Coffey M, Cadet B, Zimlichman E, et al. Lessons learned from implementation of computerized provider order entry in 5 community hospitals: a qualitative study. BMC Med Inform Decis Mak 2013;13:67 [FREE Full text] [CrossRef] [Medline]
    50. Norwegian Nurses Organisation. Tall og fakta om sykepleiere [Numbers and facts about registered nurses]. Oslo: Norwegian Nurses Organisation; 2012.   URL: https://www.nsf.no/ikbViewer/Content/1135708/statistikkhefte%202012-web.pdf.pdf [accessed 2015-02-10] [WebCite Cache]
    51. Polit DF, Beck CT. Nursing Research: Generating and Assessing Evidence for Nursing Practice. Philadelphia, PA: Lippincott Williams & Wilkins; 2012.

    ‎
    GP: general practitioner
    ICT: information and communication technology
    RN: registered nurse

    Edited by G Eysenbach; submitted 18.11.14; peer-reviewed by P Sockolow, T Hebda; comments to author 11.12.14; revised version received 09.01.15; accepted 03.02.15; published 17.02.15

    Copyright

    ©Merete Lyngstad, Dag Hofoss, Anders Grimsmo, Ragnhild Hellesø. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 17.02.2015.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.