This paper is in the following e-collection/theme issue:

Robots in Healthcare (79) Electronic/Mobile Data Capture, Internet-based Survey & Research Methodology (782) Nursing (87)

Published on in Vol 25 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/37731, first published .
Enhancing Nurse–Robot Engagement: Two-Wave Survey Study

Enhancing Nurse–Robot Engagement: Two-Wave Survey Study

Enhancing Nurse–Robot Engagement: Two-Wave Survey Study

Authors of this article:

Gen-Yih Liao1, 2 Author Orcid Image ;   Tzu-Ling Huang3 Author Orcid Image ;   May-Kuen Wong4 Author Orcid Image ;   Yea-Ing Lotus Shyu5 Author Orcid Image ;   Lun-Hui Ho6, 7 Author Orcid Image ;   Chi Wang5, 6 Author Orcid Image ;   T C E Cheng8 Author Orcid Image ;   Ching-I Teng4, 9, 10 Author Orcid Image
Article Authors Cited by (1) Tweetations (4) Metrics

    Original Paper

    1Department of Information Management, Chang Gung University, Taoyuan, Taiwan

    2Department of Nursing, Chang Gung Memorial Hospital, Taoyuan Branch, Taoyuan, Taiwan

    3Department of Information Management, National Central University, Taoyuan, Taiwan

    4Department of Physical Medicine and Rehabilitation, Chang Gung Memorial Hospital, Linkou, Taoyuan, Taiwan

    5School of Nursing, College of Medicine, Chang Gung University, Taoyuan, Taiwan

    6Department of Nursing, Chang Gung Memorial Hospital, Linkou, Taoyuan, Taiwan

    7Department of Nursing, Chang Gung University of Science and Technology, Taoyuan, Taiwan

    8Department of Logistics and Maritime Studies, The Hong Kong Polytechnic University, Kowloon, Hong Kong

    9Graduate Institute of Management, Chang Gung University, Taoyuan, Taiwan

    10Department of Business and Management, Ming Chi University of Technology, New Taipei City, Taiwan

    Corresponding Author:

    Chi Wang, MSc

    Department of Nursing

    Chang Gung Memorial Hospital, Linkou

    5, Fuxing St

    Taoyuan, 333

    Taiwan

    Phone: 886 3 3281200

    Email: gigy@cgmh.org.tw


    Background: Robots are introduced into health care contexts to assist health care professionals. However, we do not know how the benefits and maintenance of robots influence nurse–robot engagement.

    Objective: This study aimed to examine how the benefits and maintenance of robots and nurses’ personal innovativeness impact nurses’ attitudes to robots and nurse–robot engagement.

    Methods: Our study adopted a 2-wave follow-up design. We surveyed 358 registered nurses in operating rooms in a large-scale medical center in Taiwan. The first-wave data were collected from October to November 2019. The second-wave data were collected from December 2019 to February 2020. In total, 344 nurses participated in the first wave. We used telephone to follow up with them and successfully followed-up with 331 nurses in the second wave.

    Results: Robot benefits are positively related to nurse–robot engagement (β=.13, P<.05), while robot maintenance requirements are negatively related to nurse–robot engagement (β=–.15, P<.05). Our structural model fit the data acceptably (comparative fit index=0.96, incremental fit index=0.96, nonnormed fit index=0.95, root mean square error of approximation=0.075).

    Conclusions: Our study is the first to examine how the benefits and maintenance requirements of assistive robots influence nurses’ engagement with them. We found that the impact of robot benefits on nurse–robot engagement outweighs that of robot maintenance requirements. Hence, robot makers should consider emphasizing design and communication of robot benefits in the health care context.

    J Med Internet Res 2023;25:e37731

    doi:10.2196/37731

    Keywords

    healthcare; health care; eHealth; digital heath; health technology; personal innovativeness; robot; structural equation modeling; survey; intelligent technology; smart technology; robotics; nurse; nursing; attitude; engagement; healthcare professional; benefit; Taiwan; Asia 


    Overview

    Artificial intelligence–based technologies exhibit useful functions in medical contexts [1,2], and could share nursing workloads, thus helping reduce nurses’ time pressure, and alleviating the global issue of nurse shortages. For example, robots can be used to facilitate patient care delivery to mitigate shortages in the care workforce [3]. Past studies have indicated the important role of health care practitioners’ attitudes and perceptions on technology implementation [4] and nurses’ attitudes to health information technology [5]. That is, if nurses do not welcome the presence of the robot, they are unlikely to assist robots through maintenance, positioning, or ensuring their smooth operations. Hence, robots may hardly help health care practice. Moreover, previous research has shown that the majority of clinical professionals do not believe that artificial intelligence–based technologies can provide clinically relevant assistance [6]. This is a warning to both scholars and practitioners that clinical professionals may not engage (or may not sufficiently engage) with artificial intelligence–based technologies. However, the literature has not offered means to effectively increase clinical professionals’ engagement in the use of these technologies, indicating a research gap.

    We attempted to address this gap by examining how features of artificial intelligence–based technologies could increase clinical professionals’ engagement with them. That is, the aim of this study is to examine how robot benefits, robot maintenance, and nurses’ personal innovativeness impact nurses’ attitudes toward robots and nurse–robot engagement. We have compiled the definitions of the study variables in Table 1.

    Table 1. Definitions of the study concepts.
    ConceptDefinition
    Robot benefitsHow robots help nurses optimize their time and effort to implement nursing care
    Robot maintenanceHow robots consume nurses’ time and effort that could be used on other tasks
    Personal innovativenessThe tendency to try new technologies
    Attitudes toward robotsOverall evaluation of robots
    Nurse–robot engagementIntention to use robots and help ensure robots’ smooth operations

    Background

    Artificial intelligence–based technologies have started to reshape how health care is delivered. Such technologies have frequently been implemented in the form of robots. Robots have been devised to assist various activities: social interaction (social robots), moving of objects (mobility robots), health education (digital health care assistant chatbots), or exercise sessions for older adults. Robots can also serve as a distraction tool for pain management and facilitate conversation and rapport [7], indicating that robots have the potential to enhance nursing practice. This potential points to the advantages of accepting robots into nursing practice.

    The potential of improving clinical practice with robots does not guarantee their acceptance. Moreover, nurses have experienced stress and felt annoyed toward technology use in practice [5]. Hence, research is needed to understand how to increase nurses’ use of robots in nursing practice.

    The decision to accept robots depends on nurses’ evaluations of both their advantages and disadvantages. Such evaluations would include the formation of behavioral beliefs, which comprise the attitudes toward performing the behavior [8], justifying the necessity of including behavioral beliefs and attitudes in our study.

    Attitude is posited to foster behavioral intention that can further predict behavior, according to the theory of planned behavior [9]. In the nurse–robot context, planned behavior can be contextualized as nurses’ engagement with robots, defined as nurses’ actions to assist or collaborate with robots. Moreover, this theory posits that attitude is influenced by behavioral beliefs on behavioral outcomes [9]. In the nurse–robot context, behavioral beliefs can be contextualized as 2 types of beliefs among nurses: (1) those about robot benefits and (2) those about robot maintenance. Robot benefits represent improved efficiency in terms of the time and energy that robots introduce into the nursing workplace; that is, the advantages of using robots. Robot maintenance represents the effort that must be expended by nurses on robot operation; that is, the disadvantages of using robots. Robot benefits and robot maintenance thus correspond to the attitudinal antecedents in our research model. Furthermore, nurses’ personal innovativeness or the individual tendency to try new IT [10] should be important in the advanced technology context. Hence, we also included personal innovativeness as another source of encouraging nurse–robot engagement.

    Figure 1 illustrates the research framework, which includes concepts of robot benefits, robot maintenance, nurses’ attitudes toward robots, and nurse–robot engagement. To increase analytical rigor, we included control variables: nurses’ gender, age, education, tenure, and stage—that is, nursing skill certification [11].

    ‎
    Figure 1. Research framework. Solid lines represent the hypothesized links. H: hypothesis.

    We developed 7 hypotheses, indicated below as H1 to H7. Robotics is a technology advancement that brings noted efficiency and cost-saving potential [12]. We defined this as robot benefits in our study; that is, how robots help nurses optimize their time (thus alleviating their time pressure) and reduce their effort in carrying out nursing care. Robot benefits enable nurses to focus on clinical processes—supporting physicians and caring for patients—and on secondary procedures, such as carrying and moving heavy loads [13]. These benefits constitute positive reinforcements. According to reinforcement theory, positive reinforcements will promote positive behaviors [14]; for example, tending to use robots and helping ensure robots’ smooth operations. Moreover, lifting heavy loads has been frequently verified as the source of chronic lower back pain among nurses [15]. Accordingly, robots can improve nurses’ physical and psychological conditions, thus strengthening nurses’ intention to make efforts to ensure robots’ smooth operation. This behavioral intention is defined as nurse–robot engagement.

    Study Hypotheses

    Our first hypothesis (H1) is that perceived robot benefits are positively related to nurse–robot engagement.

    Caregivers perceive technology as useful, but they specify that it risks creating distance in their relationship with the persons in their care, and that it must complete and complement their work and not replace it [4]. That is, technologies assisting caregivers should improve caregivers’ attitudes toward such technologies. In our research context, when robots successfully assist nurses, they may create a positive attitude among nurses toward robots. The reason may be that robot assistance could be one positive environmental cue, according to reinforcement theory, which contributes to shaping desired behavior among employees [14]. Moreover, robots that can offer nurses ample time to perform their professional tasks would improve nurses’ job satisfaction and self-reported health [13]. This offers strong support that nurses will attribute their satisfaction and improved health to the assistive robots, enhancing their overall evaluation of such robots; that is, attitudes toward robots. Hence, we hypothesized that perceived robot benefits are positively related to a positive attitude toward robots (H2),

    Robots can achieve outstanding performance, but also show extreme performance variation; for example, they can be out of order [16]. Such a variation may be due to insufficient fulfillment of the requirements for keeping robots operating smoothly. The required effort; that is, robot maintenance, would become a burden and a negative stimulus to frontline professionals, such as nurses. According to reinforcement theory, negative stimuli would formulate negative reinforcement and further arouse individuals’ avoidance [17,18]. In our context, such avoidance behavior is not conducive to the development of nurse–robot engagement. Moreover, workplace effort is a critical predictor of missed care [19]—an undesirable job outcome for nurses. Therefore, such maintenance effort spent on robots may make nurses reluctant to work with them. Hence, we hypothesized that perceived robot maintenance is negatively related to nurse–robot engagement (H3).

    We predict that perceived robot maintenance will be negatively related to attitude toward robots. The reason is that taking extra time and effort to ensure robots’ smooth operation is not favorable to nurses. Nurses frequently need to cope with workplace time pressure [20]. Thus, any further time- and effort-related burdens (including those due to robots) would dismay them; that is, degrade their overall evaluation of the source of the burden (robots, in this case). Moreover, perceived robot maintenance implies that individuals would recognize such efforts as aversive consequences and thereby become one negative stimulus. According to reinforcement theory, negative stimuli would arouse individuals’ negative responses [17,18]; for example, an unfriendly attitude toward robots in our context. Hence, we hypothesized that perceived robot maintenance is negatively related to a positive attitude toward robots (H4).

    Attitude is an overall evaluation of an object [21]. A positive attitude reflects positive feelings and expectations when approaching this object [22], motivating users’ engagement, particularly in using new technologies [23]. According to reinforcement theory, when individuals observed that pleasurable consequences would follow, they are more likely to engage in a behavior [24]. As robots have only relatively recently been introduced into nurses’ workplaces [25], we may expect that a positive attitude toward robots would also motivate nurses’ engagement. Hence, we hypothesized that a positive attitude toward robots is positively related to nurse–robot engagement (H5).

    Personal innovativeness represents the individual tendency to try new IT [10]. Nurses who are digitally lagging tend to feel anxious about and avoid the use of health IT [5]. Anxiety around interacting with IT can be overcome by personal innovativeness [26], thus improving learning effectiveness in IT. Effective learning would foster correct understanding, and this sense of IT usefulness could promote nurses’ positive attitudes toward robot use [27]. Personal innovativeness encourages nurses to obtain IT knowledge [28], thus enhancing their positive evaluations of working with IT. As with all other IT, robots require user knowledge to allow meaningful collaboration. Hence, personal innovation and its effect on obtaining robot knowledge are also important in determining positive evaluations of working with robots; that is, attitudes toward robots. Furthermore, personal innovativeness enhances positive attitudes toward a new technology—for example, mobile payment [29]—thus also supporting this link. Accordingly, we hypothesized that nurses’ personal innovativeness is positively related to a positive attitude toward robots (H6).

    Personal innovativeness is an important aspect of technology use; for example, smartphone use [30]. We argue that this also applies to robot use. The reason is that personal innovativeness is the general tendency to try technology applications [10]. Applied to our research context, high levels of personal innovativeness would encourage robot use among nurses—for example, trying robots and exploring their functions—thus better understanding the use of and using (or engaging with) robots in health care workplaces. Hence, we hypothesized that nurses’ personal innovativeness is positively related to nurse–robot engagement (H7).

    After the development of the study hypotheses, we describe the methods to test them.


    Sample and Data Collection Process

    Our study used a 2-wave follow-up design. We surveyed registered nurses in operating rooms at a large-scale medical center in Taiwan. The first wave was conducted from October to November 2019, while the participants were followed up in the second wave, which was conducted from December 2019 to February 2020. We chose nurses working in operating rooms as the study participants because robots were assistive in those operating rooms, thus meeting our research purpose. Assistive robots are shown in Multimedia Appendix 1. They help carry heavy equipment and materials that are necessary for surgical procedures. One assistive robot completed more than 200 trips per day (average distance 200 m per trip) between the storage and the 60 operating rooms in an area larger than 9000 m2. That is, such assistive robots greatly reduced the time for preparing those equipment and materials and boosted nurses’ time for direct patient care in operating rooms.

    We used a census method to maximize sample representativeness because it avoids any sampling error. By definition, a census method includes all eligible participants; thus, estimating any sample size is not appropriate. Nonetheless, we calculated the estimated sample size to ensure that the testing power is sufficient. Specifically, we found that totally 358 nurses met our eligibility criteria. We then consulted Raosoft [31] to estimate the required sample size. We used the typical standard—that is, 95% confidence level and a 50% response distribution—for computations. We finally obtained an estimated sample size of 186 individuals—that is, we would need to include at least 186 participants in our study.

    We included full-time registered nurses. Based on our exclusion criteria, nursing students, nursing practitioners, nurse interns, and nursing supervisors were excluded. In total, the 358 eligible nurses in the operating rooms were approached. We obtained the consent of 344 nurses and used their responses in the first wave. We were unable to follow up with 13 nurses in the second wave. Hence, 331 nurses returned completed responses and were included in our formal analyses.

    Ethical Considerations

    This study was approved by the institutional review board of Chang Gung Memorial Hospital (approval 201900311B0C602). All included nurses were informed of the study objective, and written consent was sought for their participation in the study. All participants were volunteers and could quit the study at any time without giving a reason. Completed responses were collected by research assistants who did not work at the medical center, thus keeping responses confidential and ensuring voluntary participation.

    Measurements

    Items measuring robot benefits and robot maintenance were developed on the basis of those of Kohli et al [32] and the senior nurses who worked with robots in our context. We modified the items of You and Robert [33] to measure nurses’ attitudes toward robots. We adapted the items of Chang et al [34] to measure nurse–robot engagement. Items measuring personal innovativeness were obtained from Kalinic and Marinkovic [35]. All the items are listed in Multimedia Appendix 2. For all items, we used a 5-point Likert scale with 1=“strongly disagree” and 5=“strongly agree.” High scores represent high levels of the measured constructs. As we have adapted the study items, we needed to evaluate the reliability and validity of our measures.

    Data Analysis

    To implement the structural equation modeling technique to test our hypotheses, we used LISREL (linear structural relations; version 8.80; Scientific Software International). For all other analyses, we used SPSS (version 17.0; IBM Corp).

    Our dependent variable was nurse–robot engagement. Our independent variables were as follows: robot benefits, robot maintenance, nurses’ attitudes toward robots, and personal innovativeness. We included 5 control variables: (1) nurses’ gender, (2) nurses’ age, (3) nurses’ education level, (4) tenure (ie, number of years working as a nurse), and (5) stage (ie, nursing skill as evaluated from accreditation levels N1 to N4 according to Teng et al [11]. We obtained 0.4% of missing values, which is negligible. Thus, we used complete case analyses. We set a typical significance level at .05.


    Psychometric Properties

    Table 2 lists the loadings and cross-loadings. All the items loaded on the assumed factors. We did not observe significant cross-loadings, which preliminarily supports our data validity.

    Table 3 lists the Pearson correlations and psychometric properties of our study constructs. The minimum correlation was –0.11, while the maximum correlation was 0.66. These correlations were not high (<0.70), not indicating common method variance (CMV). We also used the method of Podsakoff et al [36] to examine CMV. We found that CMV was unlikely to interfere with our model (Δχ240=7661.9>χ240=55.8; α=.05). Moreover, our study used a 2-wave follow-up design, offering temporal separation between constructs and thus also negating CMV [36]. Moreover, the psychometric properties listed in Table 3 are acceptable.

    As listed in Table 3, items measuring each construct had a Cronbach α of ≥.90, composite reliability of ≥0.90, and average variance extracted of ≥0.69, which together suggest adequate reliability. All our items had loadings of >0.80 (Multimedia Appendix 2), which indicates convergent validity. All the positive square roots of average variance extracted values were larger than the counterpart correlation coefficients, demonstrating sufficient discriminant validity. The measurement model fit the data acceptably criteria (ie, comparative fit index=0.96, incremental fit index=0.96, nonnormed fit index=0.95, and root mean square error of approximation=0.076).

    Table 2. Loadings and cross-loadings.

    		Robot benefit, indicator loading (λ)Robot maintenance, λAttitude toward robots, λPersonal innovativeness, λNurse–robot engagement, λ
    Robot benefits-10.82a–.030.120.080.19
    Robot benefits-20.89–.020.170.100.22
    Robot benefits-30.92–.000.210.110.16
    Robot benefits-40.89–.070.150.090.20
    Robot benefits-50.93–.020.180.110.11
    Robot benefits-60.91–.020.190.110.18
    Robot maintenance-10.000.90–0.030.01–0.02
    Robot maintenance-2–0.040.96–0.030.05–0.00
    Robot maintenance-3–0.040.97–0.040.060.01
    Robot maintenance-4–0.030.97–0.040.06–0.01
    Robot maintenance-5–0.020.97–0.050.06–0.01
    Robot maintenance-6–0.030.97–0.040.040.00
    Attitude toward robots-10.41–0.010.270.150.80
    Attitude toward robots-20.420.010.290.150.80
    Attitude toward robots-30.45–0.010.240.130.73
    Personal innovativeness-10.10–0.020.090.880.20
    Personal innovativeness-20.110.000.100.860.21
    Personal innovativeness-30.090.110.080.880.00
    Personal innovativeness-40.150.150.130.82–0.06
    Nurse–robot engagement-10.22–0.050.900.100.13
    Nurse–robot engagement-20.23–0.070.900.090.17
    Nurse–robot engagement-30.18–0.060.900.130.17
    Nurse–robot engagement-40.21–0.060.890.130.15

    aItalicized values are indicator loading (λ) values in the theoretically assumed factors.

    Table 3. Correlations among the study constructs.

    		Robot benefitsRobot maintenanceAttitude toward robotsPersonal innovativenessNurse–robot engagement
    Robot benefits1.00



    Robot maintenance–0.061.00


    Attitude toward robots0.66a–0.031.00

    Personal innovativeness0.27a0.110.32a1.00
    Nurse–robot engagement0.43a–0.110.52a0.26a1.00
    Mean (SD)3.89 (0.86)3.06 (1.03)3.99 (0.79)3.65 (0.75)4.02 (0.77)
    Cronbach α.97.98.93.90.96
    Composite reliability0.970.970.930.900.95
    Average variance extracted0.830.850.820.690.82

    aSignificant at P<.05.

    Participant Profiles

    Table 4 depicts our participant profile: 311 (94.0%) were female, 307 (92.8%) were aged between 20 and 50 years, 250 (75.5%) attended college or university, 217 (65.6%) ranked N3 or N4, and 233 (70.4%) worked as a nurse for 5 or more years. The gender composition resembles the composition of the nursing body in Taiwan (96.7%) [37].

    Table 4. Profile of the participants (N=331).
    VariablesNurses, n (%)
    Gender

    		Female311 (94.0)

    		Male19 (5.7)

    		Missing1 (0.3)
    Age (years)

    		20-30122 (36.9)

    		30-4078 (23.6)

    		40-50107 (32.3)

    		50-6023 (6.9)

    		≥601 (0.3)
    Education level

    		High school or lower80 (24.2)

    		College or university241 (72.8)

    		Graduate institute9 (2.7)

    		Missing1 (0.3)
    Stage

    		N1 (basic nursing)57 (17.2)

    		N2 (acute nursing)56 (16.9)

    		N3 (holistic nursing)95 (28.7)

    		N4 (specialty nursing)122 (36.9)

    		Missing1 (0.3)
    Tenure (years)

    		<113 (3.9)

    		≥1 and <561 (18.4)

    		≥5 and <1050 (15.1)

    		≥10 and <1533 (10.0)

    		≥15 and <2051 (15.4)

    		≥2099 (29.9)

    		Missing24 (7.3)

    Hypothesis Testing

    Figure 2 illustrates the testing results. All but 2 hypotheses were supported. The first exception is the insignificant relation between robot maintenance and nurses’ attitudes toward robots (β=–.00; P=.92), not supporting H4. The second exception is the insignificant relation between personal innovativeness and nurse–robot engagement (β=–.06; P=.27), not supporting H7.

    Our structural model fit the data acceptably (CFI=0.96, IFI=0.96, NNFI=0.95, RMSEA=0.075). The RMSEA is acceptable [38]. Moreover, not all indices are expected to perform perfectly [39]. Our model explained a large proportion of the variance in the dependent variable; that is, 53% of nurse–robot engagement, representing moderately large effect sizes [40].

    ‎
    Figure 2. Analytical results. *P<.05.

    Principal Findings and Contributions

    Our study is the first to examine how robot benefits and robot maintenance of assistive robots result in nurse–robot engagement. The findings uniquely indicate that the robot benefits are an important source of nurses’ engagement with robots, while nurses’ attitudes toward robots is important in motivating their engagement with robots. Overall, our study contributes to the literature on artificial intelligence–based technologies in the health care context; that is, by illustrating the relative importance of robot benefits, when compared to robot maintenance.

    The reason for nonsupported H4 may be that the hospital had its own robot maintenance team. Thus, nurses would not be required to perform this work, thus creating no barrier to the acceptance of robots and not substantially harming the attitudes toward robots. The reason for nonsupported H7 may be that helpful robots should be widely accepted by nurses, reducing the difference generated by personal innovativeness.

    Overall, this study makes several contributions. First, it examines the means (eg, increasing robot benefits) to increase nurses’ engagement with robots. Second, it points out that robot benefits are highly important. Third, it identifies that nurses’ attitudes toward robots play a pivotal role by transforming personal innovativeness into enhanced engagement; that is, instilling a positive attitude among health care professionals toward robots is critical for boosting their engagement with them.

    Theoretical Implications

    This study reports novel means (eg, increasing robot benefits) to increase health care professionals’ engagement with artificial intelligence–based technologies, particularly in a context in which assistive robots were used by nurses.

    Boumans et al [41] verified the benefits of an assistive social robot. Our study is in line with theirs in examining the benefits of assistive robots in health care contexts. However, our study examined new benefits; that is, saving labor by carrying heavy equipment and materials. Such benefits could positively contribute to nurses’ health [13], which improves their performance [41].

    De Leeuw et al [5] examined the antecedents that influence nurses’ digital lagging in their adoption of health information technology. Our study is in concordance with theirs in investigating nurses’ attitudes toward health information technology. Uniquely, our findings indicate that 2 factors—enhanced robot benefits and reduced robot maintenance—can increase nurses’ engagement with robots and demonstrate their relative importance in attitude formation. Chang et al [13] examined the pros and cons of using assistive robots on task engagement. Our study is new in examining robot engagement—that is, how much nurses use robots—but not task engagement—that is, how much time nurses spend in delivering professional care. Moreover, all the constructs in our study were not included in Chang et al’s [13] study, further exhibiting the novelty of our study.

    The interesting findings of our study offer several unique theoretical contributions. First, we find that, compared to negative IT characteristics (robot maintenance) and user characteristics (personal innovativeness), only positive IT characteristics (robot benefits) can directly influence both nurses’ technology evaluation (attitudes toward robots) and technology use (nurse–robot engagement). Second, another interesting finding is that IT characteristics (robot benefits and maintenance) have a much stronger influence than user characteristics (personal innovativeness) on improving technology use. Third, user characteristics (personal innovativeness) are more important than negative IT characteristics (robot maintenance) in improving technology evaluation. The unbalanced role of negative IT characteristics in decreasing technology use while sustaining technology evaluation presents an interesting finding, which deserves more research, thus demonstrating the fourth contribution.

    Implications in Practice

    Our study was implemented in a large medical center, in which assistive robots were used in a number of operating rooms. Moreover, this medical center had its own IT maintenance team for robot maintenance. Our findings may be generalized to international contexts that share similar features with this medical center.

    We found that robot benefits can enhance nurse–robot engagement. Specifically, we measured robot benefits by harnessing 2 characteristics: time saving and energy keeping. Hence, it is suggested that health care robot developers should focus on designing their robots to save more time and energy for users. The robot benefits should be promoted when communicating with hospital management responsible for robot introduction. Moreover, hospital management could in turn consider practical training to introduce the robots into the work space, familiarize nurses with their functioning, and reiterate their benefits to nurses.

    Our findings also envision hospital management that are eager to introduce artificial intelligence–based technologies into their hospitals. Intuitively, health care professionals are not experts on artificial intelligence–based technologies and many may not be ready to fully engage with them. Training could be offered to nurses to do easy robot maintenance and show them evidence regarding robot benefits, thus increasing nurse–robot engagement. This finding paves the way to increasing this engagement; that is, informing health care professionals of robot benefits that help them serve better.

    We also found that personal innovativeness helps improve health care professionals’ attitudes toward robots, thereby increasing their engagement with the robots. This finding suggests that hospital management could evaluate the personal innovativeness of health care professionals; for example, through a short survey, and empowers those who are willing to try new technologies as project champions to promote robot use within their work units. As these project champions are keen to interact with new technologies, this will best spread the use of intelligent technologies within the hospitals.

    Limitations and Future Research Directions

    Our study was implemented in a large-scale medical center in Taiwan. Future studies could replicate ours at multiple research sites and in multiple countries, incorporating more organizational or cultural factors to deepen our understanding of intelligent technology use.

    Our study adopts a 2-wave design. This design offers evidence supporting the temporal sequence of the causal influences. Future studies could adopt qualitative designs to understand in depth the mechanisms underlying our study findings.

    This study was implemented in operating rooms. Hence, we were restrained from knowing whether the findings are generalizable to patient wards or outpatient departments. This study did not directly include robot features and therefore restrained us from knowing the influence of each robot feature. Future studies could seek means to address the limitations of this study.

    Conclusions

    Our study examined how health care professionals—that is, nurses—evaluated intelligent technologies, in a context where nurses evaluate assistive robots. Our findings uniquely indicate the importance of robot benefits as a key driver to form positive attitudes toward robots and to increase nurse–robot engagement. We obtained an interesting finding that robot benefits have a stronger influence on nurse–robot engagement than robot maintenance needs. This finding envisions the developers of artificial intelligence–based technology—for example, robot developers—focusing on delivering and communicating the best robot functions to health care professionals while simultaneously focusing on reducing maintenance as a secondary issue.

    Acknowledgments

    The authors thank Chang Gung Memorial Hospital for financial support (CMRPD3J0031).

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    Assistive robots in this study.

    DOCX File , 998 KB
    ‎
    Multimedia Appendix 2

    Measurement items.

    DOCX File , 17 KB
    1. Cruz F, Faria E, Ghobad P, Alves L, Reis P. A mobile app (AMOR Mama) for women with breast cancer undergoing radiation therapy: functionality and usability study. J Med Internet Res 2021 Oct 13;23(10):e24865 [FREE Full text] [CrossRef] [Medline]
    2. Ziemssen T, Giovannoni G, Alvarez E, Bhan V, Hersh C, Hoffmann O, et al. Multiple sclerosis progression discussion tool usability and usefulness in clinical practice: cross-sectional, web-based survey. J Med Internet Res 2021 Oct 06;23(10):e29558 [FREE Full text] [CrossRef] [Medline]
    3. Mackey T, Bekki H, Matsuzaki T, Mizushima H. Examining the potential of blockchain technology to meet the needs of 21st-century Japanese health care: viewpoint on use cases and policy. J Med Internet Res 2020 Jan 09;22(1):e13649 [FREE Full text] [CrossRef] [Medline]
    4. Verloo H, Kampel T, Vidal N, Pereira F. Perceptions about technologies that help community-dwelling older adults remain at home: qualitative study. J Med Internet Res 2020 Jun 04;22(6):e17930 [FREE Full text] [CrossRef] [Medline]
    5. De Leeuw JA, Woltjer H, Kool R. Identification of factors influencing the adoption of health information technology by nurses who are digitally lagging: in-depth interview study. J Med Internet Res 2020 Aug 14;22(8):e15630 [FREE Full text] [CrossRef] [Medline]
    6. Abdullah R, Fakieh B. Health care employees' perceptions of the use of artificial intelligence applications: survey study. J Med Internet Res 2020 May 14;22(5):e17620 [FREE Full text] [CrossRef] [Medline]
    7. Buchanan C, Howitt M, Wilson R, Booth R, Risling T, Bamford M. Predicted influences of artificial intelligence on the domains of nursing: scoping review. JMIR Nurs 2020 Dec 17;3(1):e23939 [FREE Full text] [CrossRef] [Medline]
    8. Madden T, Ellen P, Ajzen I. A comparison of the theory of planned behavior and the theory of reasoned action. Pers Soc Psychol Bull 2016 Jul 02;18(1):3-9 [FREE Full text] [CrossRef]
    9. Ajzen I. From intentions to actions: a theory of planned behavior. In: Action control: from cognition to behavior. Berlin: Springer; 1985:11-39.
    10. Agarwal R, Prasad J. A conceptual and operational definition of personal innovativeness in the domain of information technology. Information Systems Research 1998 Jun;9(2):204-215 [FREE Full text] [CrossRef]
    11. Teng C, Shyu Y, Dai Y, Wong M, Chu T, Chou T. Nursing accreditation system and patient safety. J Nurs Manag 2012 Apr;20(3):311-318 [FREE Full text] [CrossRef] [Medline]
    12. Archibald M, Barnard A. Futurism in nursing: technology, robotics and the fundamentals of care. J Clin Nurs 2018 Jun;27(11-12):2473-2480 [FREE Full text] [CrossRef] [Medline]
    13. Chang H, Huang T, Wong M, Ho L, Wu C, Teng C. How robots help nurses focus on professional task engagement and reduce nurses' turnover intention. J Nurs Scholarsh 2021 Mar;53(2):237-245 [FREE Full text] [CrossRef] [Medline]
    14. Skinner B. Operant behavior. American Psychologist 1963 Aug;18(8):503-515. [CrossRef]
    15. Coenen P, Gouttebarge V, van der Burght ASAM, van Dieën JH, Frings-Dresen MHW, van der Beek AJ, et al. The effect of lifting during work on low back pain: a health impact assessment based on a meta-analysis. Occup Environ Med 2014 Dec 27;71(12):871-877. [CrossRef] [Medline]
    16. Jankowski J, Grabowski A. Usability evaluation of VR interface for mobile robot teleoperation. Int J Hum-Comput Interact 2015 Nov 11;31(12):882-889 [FREE Full text] [CrossRef]
    17. Byrne D, Clore G. A reinforcement model of evaluative responses. Pers Intern J 1970;1(2):103-128.
    18. Lott A, Lott B. The role of reward in the formation of positive interpersonal attitudes. In: Foundations of Interpersonal Attraction. Cambridge, MA: Academic Press; 1974:171-192.
    19. Phelan A, McCarthy S, Adams E. Examining missed care in community nursing: a cross section survey design. J Adv Nurs 2018 Mar;74(3):626-636 [FREE Full text] [CrossRef] [Medline]
    20. Teng C, Chen A, Chang H, Fu C. Service failure, time pressure, and conscientiousness of service providers: the dual processing model perspective. Serv Bus 2013 Oct 29;8(4):659-677 [FREE Full text] [CrossRef]
    21. Sharma S, Singh G, Sharma R. For it is in giving that we receive: Investigating gamers’ gifting behaviour in online games. Int J Inf Manage 2021 Oct;60:102363 [FREE Full text] [CrossRef]
    22. Yousef C, Salgado T, Farooq A, Burnett K, McClelland LE, Abu Esba LC, et al. Health care providers' acceptance of a personal health record: cross-sectional study. J Med Internet Res 2021 Oct 21;23(10):e31582 [FREE Full text] [CrossRef] [Medline]
    23. Wichmann J, Leyer M. Factors influencing the intention of actors in hospitals to use indoor positioning systems: reasoned action approach. J Med Internet Res 2021 Oct 05;23(10):e28193 [FREE Full text] [CrossRef] [Medline]
    24. Skinner B. Science and human behavior. New York: Macmillan; 1953.
    25. Busse T, Kernebeck S, Nef L, Rebacz P, Kickbusch I, Ehlers J. Views on using social robots in professional caregiving: content analysis of a scenario method workshop. J Med Internet Res 2021 Nov 10;23(11):e20046 [FREE Full text] [CrossRef] [Medline]
    26. Thatcher J, Perrewe P. An empirical examination of individual traits as antecedents to computer anxiety and computer self-efficacy. MIS Quarterly 2002 Dec;26(4):381-396 [FREE Full text] [CrossRef]
    27. Kummer T, Schäfer K, Todorova N. Acceptance of hospital nurses toward sensor-based medication systems: a questionnaire survey. Int J Nurs Stud 2013 Apr;50(4):508-517 [FREE Full text] [CrossRef] [Medline]
    28. Hsu H, Hou Y, Chang I, Yen D. Factors influencing computer literacy of Taiwan and South Korea nurses. J Med Syst 2009 Apr;33(2):133-139 [FREE Full text] [CrossRef] [Medline]
    29. Patil P, Tamilmani K, Rana N, Raghavan V. Understanding consumer adoption of mobile payment in India: extending meta-UTAUT model with personal innovativeness, anxiety, trust, and grievance redressal. Int J Inf Manage 2020 Oct;54:102144 [FREE Full text] [CrossRef]
    30. Kuem J, Ray S, Hsu P, Khansa L. Smartphone addiction and conflict: an incentive-sensitisation perspective of addiction for information systems. Eur J Inf Syst 2020 Aug 20;30(4):403-424 [FREE Full text] [CrossRef]
    31. Raosoft.   URL: http://www.raosoft.com/samplesize.html [accessed 2022-09-22]
    32. Kohli R, Devaraj S, Mahmood M. Understanding determinants of online consumer satisfaction: a decision process perspective. J Manag Inf Syst 2014 Dec 08;21(1):115-136 [FREE Full text] [CrossRef]
    33. You S, Robert L. Emotional attachment, performance, and viability in teams collaborating with embodied physical action (EPA) robots. JAIS 2018 May;19(5):377-407 [FREE Full text] [CrossRef]
    34. Chang H, Teng C, Chu T, Chang H, Hsu W. Impact of nurse agreeableness and negative mood of nursing supervisors on intention to help colleagues. J Adv Nurs 2012 Mar;68(3):636-646 [FREE Full text] [CrossRef] [Medline]
    35. Kalinic Z, Marinkovic V. Determinants of users’ intention to adopt m-commerce: an empirical analysis. Inf Syst E-Bus Manage 2015 Jul 18;14(2):367-387 [FREE Full text] [CrossRef]
    36. Podsakoff P, MacKenzie S, Lee J, Podsakoff N. Common method biases in behavioral research: a critical review of the literature and recommended remedies. J Appl Psychol 2003 Oct;88(5):879-903 [FREE Full text] [CrossRef] [Medline]
    37. Statistics of Nursing Personnel in Taiwan and Fujian - September 109. Taiwan Union of Nurses Association. 2020 Sep 02.   URL: https://reurl.cc/EZvZo0 [accessed 2021-11-19]
    38. Browne MW, Cudeck R. Alternative ways of assessing model fit. Sociol Methods Res 2016 Jun 29;21(2):230-258. [CrossRef]
    39. Hair J, Tatham R, Anderson R, Black W. Multivariate data analysis (5th edition). Upper Saddle River, NJ: Prentice Hall; 1998.
    40. Cohen J. A power primer. Psychological Bulletin 1992;112(1):155-159 [FREE Full text] [CrossRef]
    41. Boumans R, van Meulen F, van Aalst W, Albers J, Janssen M, Peters-Kop M, et al. Quality of care perceived by older patients and caregivers in integrated care pathways with interviewing assistance from a social robot: noninferiority randomized controlled trial. J Med Internet Res 2020 Sep 09;22(9):e18787 [FREE Full text] [CrossRef] [Medline]

    ‎
    CMV: common method variance
    LISREL: linear structural relations

    Edited by R Kukafka; submitted 04.03.22; peer-reviewed by AYM Leung, A Joseph, Z Dai; comments to author 13.07.22; revised version received 18.08.22; accepted 16.09.22; published 09.01.23

    Copyright

    ©Gen-Yih Liao, Tzu-Ling Huang, May-Kuen Wong, Yea-Ing Lotus Shyu, Lun-Hui Ho, Chi Wang, T C E Cheng, Ching-I Teng. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 09.01.2023.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.