Published on in Vol 26 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/51234, first published .
An Infrastructure Framework for Remote Patient Monitoring Interventions and Research

An Infrastructure Framework for Remote Patient Monitoring Interventions and Research

An Infrastructure Framework for Remote Patient Monitoring Interventions and Research

Viewpoint

1School of Business, Wake Forest University, Winston-Salem, NC, United States

2Center for Healthcare Innovation, School of Medicine, Wake Forest University, Winston-Salem, NC, United States

3Health Science Center, University of Tennessee, Memphis, TN, United States

Corresponding Author:

Jennifer Claggett, PhD

School of Business

Wake Forest University

1834 Wake Forest Rd

Winston-Salem, NC, 27109-6000

United States

Phone: 1 3363027991

Email: claggett@gmail.com


Remote patient monitoring (RPM) enables clinicians to maintain and adjust their patients’ plan of care by using remotely gathered data, such as vital signs, to proactively make medical decisions about a patient’s care. RPM interventions have been touted as a means to improve patient care and well-being while reducing costs and resource needs within the health care ecosystem. However, multiple interworking components must be successfully implemented for an RPM intervention to yield the desired outcomes, and the design and key driver of each component can vary depending on the medical context. This viewpoint and perspective paper presents a 4-component RPM infrastructure framework based on a synthesis of existing literature and practice related to RPM. Specifically, these components are identified and considered: (1) data collection, (2) data transmission and storage, (3) data analysis, and (4) information presentation. Interaction points to consider between components include transmission, interoperability, accessibility, workflow integration, and transparency. Within each of the 4 components, questions affecting research and practice emerge that can affect the outcomes of RPM interventions. This framework provides a holistic perspective of the technologies involved in RPM interventions and how these core elements interact to provide an appropriate infrastructure for deploying RPM in health systems. Further, it provides a common vocabulary to compare and contrast RPM solutions across health contexts and may stimulate new research and intervention opportunities.

J Med Internet Res 2024;26:e51234

doi:10.2196/51234

Keywords



Overview

Remote patient monitoring (RPM; sometimes referred to as eHealth, telehealth, telemonitoring, or telemedicine) involves the capture of patient data through sensors or devices outside of a clinical setting, such as at the patient’s home or work while the patient is engaging in everyday activities. Ideally, the data captured through RPM devices are analyzed and used to inform clinicians’ decisions on patient care. For example, typical decisions include adjusting the recommended dosage or timing of a patient’s medication based on observed changes in the patient’s vital signs or patterns of activity.

RPM interventions have increased exponentially in the United States of America since 2020 [1]. The COVID-19 pandemic exacerbated the need for remote patient care solutions when there were severe resource shortages of clinicians, equipment, and capacity within health care systems [2-4] and patients were required to socially distance themselves to mitigate the spread of COVID-19. As the United States of America eased regulations and made changes to encourage reimbursements for RPM interventions, health care providers sought to reap RPM’s potential benefits along three main dimensions: (1) enhancing quality by offering more personalized care; (2) achieving scale by growing their customer (patient) base; and (3) securing new reimbursement opportunities by evolving in response to shifts in payment policies [1,3].

The excitement and promise of the benefits of RPM to improve patient care while also expanding a health system’s market are well-documented in meta-analyses that find evidence of RPM reducing hospital admissions and length of stay for certain conditions, such as cardiovascular disease or chronic obstructive pulmonary disease [5,6]. Decreased travel time, cost savings, and increased access to services are commonly ascribed as benefits for patients, and most eHealth interventions are described as successes [7]. However, other scholars counter that RPM interventions may not live up to the hype. One study finds that RPM interventions do not impact patient health factors, such as weight, body fat percentage, and blood pressure [8], and other related studies raise concerns about the limited evidence that RPM interventions can indeed adequately scale to meaningfully improve patient outcomes and demonstrably reduce health care costs [3].

These mixed results regarding the impact of RPM interventions showcase the current challenge of understanding how to design and effectively implement the infrastructure to support successful RPM programs. Successful RPM programs should meet at least one, but ideally both, of the following standards: (1) improved management of symptoms (evaluated using population-normalized values or patient feedback) and (2) reduced financial costs (evaluated in terms of the health system, payers, and patient out-of-pocket expenses). Previous work reporting on RPM interventions tends to report details on isolated projects and is focused, understandably, on a specific medical condition without offering generalizable advice to a broader audience or a catalog of best practices. Although RPM has been implemented in many different types of contexts, we contend that the key infrastructure points are consistent across interventions. Therefore, we present a framework consisting of 4 core infrastructure components necessary for any RPM intervention and identify common questions across contexts that should influence the RPM intervention design and results. This RPM infrastructure framework is useful to scholars and clinicians implementing RPM projects in that it (1) presents a shared vocabulary and reference point, (2) serves as a resource to guide some of the major decisions associated with an RPM implementation, and (3) provides a logical scaffolding to categorize and disseminate lessons learned within RPM projects to leverage them in other contexts. While the set of considerations nested within the four infrastructure components is not exhaustive, these considerations serve as a useful starting point as RPM research and interventions are planned and developed in the future.

RPM Infrastructure Framework

As an information technology (IT), RPM relies on a combined and layered infrastructure of hardware, software, and networks to support the collection, storage, processing, and management of data. By considering emergent patterns and themes from the literature, cases, and reports, discussing this topic in various panels and workshops, and reflecting on our experiences designing and assessing RPM projects, we propose a four-component infrastructure framework that is necessary in any RPM infrastructure project: (1) data collection, (2) data transmission and storage, (3) algorithmic data analysis, and (4) information presentation. The first RPM infrastructure component, data collection, collects a patient’s vital signs and other biometric data remotely through a measurement device such as a wearable sensor. Data transmission and storage, the second infrastructure component, leverages software interface services, networking, and hardware to transfer the data from the patient’s device to a centralized data architecture [9,10]. Third, software-based algorithms analyze the stored remote patient data to identify patterns and outliers for a single patient or for a patient population. The final RPM infrastructure component is to present information obtained from the analysis to support clinicians’ decision-making processes [11,12]. Figure 1 depicts the RPM infrastructure framework, and each of the following sections describes key considerations for each component.

Figure 1. Remote patient monitoring (RPM) infrastructure framework.

Overview

Patients interact with an RPM device to enable the collection of data outside of clinical settings. Some devices are worn continuously throughout a person’s day, while other devices are used at specific times to capture health indicators periodically based on the patient’s medical condition and the provider’s care protocol. Patients may use a specialized RPM device that registers a single form of biometric data (eg, a continuous glucose monitor capturing blood glucose levels) or a device that captures multiple data types (eg, a blood pressure cuff that measures blood pressure, pulse rate, and oxygen saturation). Given the growing number of technologies capable of collecting patient health data along with the need for patients to interact with a device for data collection, several questions must be carefully addressed when considering how to best collect data for an RPM intervention.

How Should Patients be Selected for RPM?

While RPM has the potential to improve patients’ quality of care and reduce clinic costs, successful implementation relies on the effective use of the device and the fidelity of the collected data. The existing literature highlights several key considerations and components for identifying patients who are a good match for remote monitoring. Of paramount importance is suitability—is the patient’s medical condition one that is likely to actually benefit from the collection and analysis of more data? Patients with chronic diseases such as diabetes, heart failure, hypertension, or chronic obstructive pulmonary disease are often more likely to benefit from RPM, as it can help them better manage their health status and condition over the long-term [13]. Comorbidities also play a significant role in patient selection, as those with multiple chronic conditions or complex health situations might require more comprehensive monitoring [14]. RPM can provide a more holistic view of their health, making it a potentially valuable tool for these patients; however, the complexity of their medical conditions may limit their ability to adhere to the monitoring program and necessitate more immediate and direct medical interventions.

Patients who are noncompliant or have a history of difficulty adhering to their treatment plans might benefit from RPM, as it can help improve compliance and provide additional support [15]. RPM solutions may make a patient feel more engaged, empowered, and informed through messaging systems that interact with patients on a routinely structured basis [16,17]. Patient motivation and engagement are key factors, as patients who are motivated and engaged in managing their health are more likely to actively participate in and adhere to the RPM program [18].

Other patient-specific factors—commonly referred to as the social determinants of health—such as socioeconomic status, age, and social support should be considered when designing RPM interventions [19]. For instance, patients with lower socioeconomic status might benefit from RPM the most, as it can help reduce health care disparities and provide better access to care [20-22]. A disproportionally large number of people affected by chronic conditions are from socioeconomically disadvantaged groups [23]. Communities of color, immigrants, and women are particularly likely to be in distress from undiagnosed chronic diseases, and even when diagnosed, these populations are more likely than their counterparts to face structural and logistical obstacles to obtaining the appropriate level of intermittent care. So long as they have reliable connectivity to the internet, patients who live in remote or rural areas or have limited access to transportation might benefit from RPM, as it can help overcome geographical barriers to care [18,24]. Age can also play a role in identifying suitable patients for RPM, in that elderly patients or those with age-related conditions may benefit from RPM. The patient’s living situation is another important factor. A strong support system, such as family or caregivers, can facilitate device use, data collection, and overall engagement, making these patients more suitable for RPM [25].

Finally, technological competence plays a crucial role in a patient’s ability to engage with an RPM device. Patients with some level of technology literacy (eg, “digital natives”) are more likely to engage with and effectively use RPM devices and systems [26]. However, patients with lower socioeconomic status or those who are elderly may have lower levels of technological competence or may have other barriers that could limit the effectiveness of an RPM program [27-29]. There is a natural continuum of sophistication and familiarity with devices and the inevitable troubleshooting they often require, and a more “set and forget” approach may be advisable for certain populations.

Which Device and Which Types of Data?

A fundamental characteristic of RPM is the acquisition of data outside of conventional clinical environments. Consequently, patient data must be collected remotely using sensors and equipment such as wearable devices, mobile phones, or portable devices installed at a patient’s residence or other environments [30]. One strategy involves using data from off-the-shelf, general-purpose smart health consumer electronics purchased by the patient, while another option is to rely on data from specialized devices or software prescribed or supplied by the health care provider. Technological advancements enable the collection, through devices within the RPM infrastructure, of various types of data, such as electrocardiograms, electroencephalograms, heartbeats and respiration rates, oxygen saturation in the blood or pulse oximetry, nervous system signals, blood pressure, body or skin temperature, blood glucose levels, patient weight, and sleep patterns, among others [31].

A crucial consideration is the optimal combination of metrics to be collected for a specific patient. The US Centers for Disease Control report that 51.8% of US adults have at least one chronic condition, and 27.2% have multiple chronic conditions such as obesity, diabetes, and cardiovascular disease [32]. Emerging evidence indicates that RPM initiatives are more likely to succeed when multiple metrics are evaluated concurrently [33]. For instance, compiling data from various physiological sensors measuring heart rate, blood oxygen saturation, and blood glucose levels simultaneously can offer a more comprehensive overview of a patient’s health, which is particularly significant for patients with comorbidities and additional complications. This suggests that the diagnostic value of data can be enhanced by carefully considering what health indicators are needed to manage a patient’s care.

How Frequently are Data Collected?

Determining the optimal frequency of data collection in RPM scenarios is a critical consideration, as it can significantly impact the effectiveness of patient care and the efficient use of health care resources. The appropriate frequency for data collection depends on various factors, including the severity and type of the patient’s condition, the objectives of monitoring, and the required patient involvement in data collection [34]. For instance, some conditions may necessitate multiple data readings per day, while others may only require weekly monitoring [35]. Passive data collection methods, such as continuous monitoring of vital signs using wearable sensors, can be advantageous for patients requiring frequent monitoring, whereas active data collection methods, which involve patient involvement and interaction, may be suitable for other conditions [16,36]. Passive methods are usually less likely to cause patient burnout and abandonment [37].

Health care providers should consider adopting several best practices to ensure that patients remain engaged and compliant with RPM protocols. These typically include providing personalized and clear instructions, offering training and support to ensure device functionality, improving patients’ understanding and comfort with the technology, and fostering regular remote communication between patients and health care providers [38]. Furthermore, involving patients in the decision-making process regarding their monitoring plans and adjusting the frequency and type of data collection based on their individual needs and preferences can lead to increased patient engagement and satisfaction [13,39].


Overview

Once remote patient data are collected by one or more devices, the data must be transmitted and shared with clinicians, and stored in a data architecture. The manner in which the data are transmitted from an RPM device is dependent on the device and the network access of the patient. RPM data transmission may occur through a network using a wired link, or high-speed wireless link with or without human intervention. In some cases, patients or caregivers may be asked to record readings or values from devices into an app available on their smartphone or computer that will transmit data to the medical provider. Another option could be that a patient must physically visit a clinician’s office with the device to upload the data to the patient’s electronic medical record. The storage of remote patient data may be in a system that is managed by the device manufacturer and accessed through a web portal, and the data may or may not be integrated within the patient’s electronic medical record.

Is There Sufficient Connectivity?

Connectivity plays a vital role in the successful implementation of RPM, as it enables the transmission of patient data from monitoring devices to health care providers and fosters timely interventions and informed decision-making. Addressing the digital divide is crucial to ensuring equitable access to RPM services, as patients with limited internet access or low digital literacy may face barriers to fully benefiting from RPM [40]. This disparity is particularly concerning for patients from socioeconomically disadvantaged backgrounds, who may experience greater difficulties in accessing health care services and could benefit the most from RPM [40,41]. Some patients may have access to home internet solutions through local internet service providers that include Wi-Fi networks at home, while others may be limited to cellular network access through mobile devices. Often, the latter is subject to slower connections and data caps that place constraints on the patient’s connectivity.

Strategies for addressing connectivity for RPM interventions should consider alternatives, such as the constant connectivity approach or using batch or episodic data uploads when data connections are available [42]. Constant connectivity can facilitate real-time monitoring and immediate interventions, which may be especially beneficial for patients with critical or rapidly changing health conditions [43]. However, this approach may not be feasible for patients living in areas with limited or unreliable internet access or for those who cannot afford consistent connectivity. In these cases, episodic data uploads when a connection is possible may provide a more accessible and cost-effective solution, allowing health care providers to track patient progress and identify potential issues while accommodating the patients’ connectivity limitations [44]. Additionally, some RPM hardware solutions may include direct cellular network connectivity, where the device sends the data through a connection provided by the wearable device to the provider, bypassing the need for a patient home network. These solutions will incur additional costs related to data transmission and may not naturally provide a patient dashboard or a way for patients to easily view data that may traditionally be housed in a patient application.

Is the Transmission Secure?

The sensitive nature of medical data necessitates robust protection measures to maintain patient privacy and prevent unauthorized access. Data breaches and cyberattacks can have severe consequences for patients and their health care providers, including identity theft, financial loss, and reputational damage [45]. The increasing connectivity of medical devices and the use of cloud-based data storage have created new opportunities for cybercriminals, leading to the emergence of threats such as medjacking [46]. Medjacking, a term coined from “medical device hijacking,” refers to the unauthorized access and manipulation of medical devices, such as pacemakers or insulin pumps, to cause harm to patients or extract sensitive data [47]. As RPM technologies rely on a variety of connected devices for data collection across multiple networks, they can be vulnerable to medjacking and other cybersecurity risks. Furthermore, the rapid expansion of the internet of things in health care has amplified these risks, as a larger number of interconnected devices create more potential entry points for attackers [48,49].

Health care providers and technology developers should prioritize the implementation of robust security measures to mitigate the risks associated with medjacking and other security threats in RPM. These may include strong encryption protocols for data transmission (“in flight”) and storage (“at rest”), regular security updates, and the development of secure communication channels between devices and health care providers [45,48]. Additionally, health care organizations should adopt a proactive approach to security by conducting regular risk assessments, promoting cybersecurity awareness and training among staff, and fostering a culture of security-mindedness [50].

Can Data Move Across Health Systems Software?

Interoperability is a crucial aspect of RPM projects, as it enables seamless communication and data sharing among different health information systems, devices, and providers. This encompasses not only the technical aspects of data exchange but also the semantic understanding and interpretation of shared data, ensuring that the information can be effectively used by health care providers, patients, and other stakeholders. Effective interoperability contributes to improved patient care by ensuring that clinicians have access to comprehensive and up-to-date medical information, allowing for better decision-making and coordination of care [51]. However, achieving interoperability in RPM poses several challenges, including the need to balance data accessibility with patient privacy and maintain control over personal health information.

One of the primary challenges in achieving interoperability in RPM is the heterogeneity of health information systems and devices used by health care providers. These systems often rely on different (often proprietary) data formats, communication protocols, and standards, which can create barriers to effective information exchange. To address this issue, several major standards have been developed to facilitate interoperability in health IT (eg, [52,53]). For example, the US Department of Health and Human Services Office of the National Coordinator for Health IT released the third version (V3) of the US Core Data for Interoperability in 2022 [54].

Another challenge in achieving interoperability is protecting patient privacy while sharing data freely among authorized health care providers [44]. Using privacy-preserving techniques, such as pseudonymization, which replaces personally identifiable information with unique identifiers to maintain patient anonymity, may reinforce privacy during the transmission of data between systems. However, these approaches must be rigorously tested to systematically mitigate privacy risks [55]. One-way hashing of sensitive identifiers is another technique that can reduce the risk of leakage of personal health identifiers. Additionally, the implementation of access control mechanisms can help ensure that only authorized users can access and share patient data, further safeguarding privacy [56].

A related issue to moving data across health systems is determining the appropriate granularity to share between stakeholders and systems. For example, in a remote blood pressure monitoring project, should each reading be recorded, transmitted, and made available, including any relevant metadata about time, place, and cuff placement, or should only summary data about daily or weekly averages be shared between systems? Like any sensor-based technology, the amount of raw data generated by RPM initiatives may be overwhelming [57]; however, providing only summarized data limits the transparency and future uses of the data.


Overview

Remote patient data that are stored within an information system and are not analyzed provide no value to the patient or the clinician. After transmitting and storing RPM data, they should be processed and analyzed to identify and summarize patterns and trends in individual patients and patient populations [58]. The process of analyzing raw data to deliver actionable insights could also form the basis for financial reimbursement, which is fundamental to any sustainable RPM program.

What Analysis Techniques are Appropriate?

Data analysis involves the use of algorithms, or a series of steps, to process the data in a meaningful way. Algorithms may use static rule logic, which can be used to draw attention to results over a certain threshold, or they may leverage machine learning techniques to dynamically adapt and learn from large sets of patient data, such as adjusting the threshold based on similar patients with similar conditions recorded in the data [59]. The distinction between static and dynamic rules has implications that need to be explored.

Static rules can be based on established medical guidelines, such as thresholds for vital signs or other clinical parameters, which can help health care providers identify potential health issues and take appropriate actions [60]. While this method can be effective in some cases, it may not account for the unique characteristics and complexities of individual patients, which may limit its ability to provide personalized care [61].

Alternatively, machine learning techniques offer more advanced and adaptable solutions for analyzing RPM data [62]. These techniques use algorithms that can learn from data patterns and make predictions or decisions without being explicitly programmed [63,64]. Machine learning can be used to identify trends, anomalies, and correlations in patient data, enabling health care providers to make more informed decisions and deliver personalized care [65,66]. Adaptive interpretation techniques take RPM data analysis a step further by dynamically adjusting their approach based on real-time patient data. These methods, which often rely on artificial intelligence and machine learning algorithms, can continuously refine their analysis and predictions to better understand the evolving health status of individual patients [63]. This adaptive approach can help health care providers identify subtle changes in patients’ conditions that may not be evident through traditional analysis techniques, leading to more proactive and personalized care [67].

Which Comorbidities Should be Included in the Analysis?

This question centers around the appropriate complexity level of analyses of RPM solutions. Incorporating comorbidities into the analysis of RPM data can help health care providers better understand the complex interactions between various conditions and their impact on patients’ health. This, in turn, can lead to more accurate and personalized treatment recommendations. Static rules that solely focus on a single condition, such as high blood pressure, may not adequately account for the impact of comorbidities on patients’ overall health status. For instance, a patient with both diabetes and hypertension may require a different treatment approach than a patient with hypertension alone, which is why any given individual should be managed holistically with a consolidated approach, rather than divided by symptoms and specialty [68].

This comprehensive monitoring can provide a more accurate representation of the patient’s health status, allowing health care providers to make more informed decisions regarding treatment and care management [69,70]. However, these solutions may be so patient-specific that cognitive efficiencies and the ability to scale the solution are compromised in the absence of built-in coordination systems with well-defined decision-making heuristics and robust care protocols.

What Biases Exist Within the Analysis and How Should They be Mitigated?

Biases in the analysis of remote patient data can have a significant impact on the accuracy and effectiveness of health care services. Particularly in machine learning-based analysis techniques, biases can arise from various sources, such as data sampling, measurement errors, or algorithmic design, leading to potentially biased predictions or recommendations [71,72]. It is essential to detect and account for biases to ensure that the solutions provided are equitable and reliable for all patients.

One primary source of bias in data analysis is the data itself. If the training data used to develop machine learning models do not accurately represent the diverse patient population, the resulting models may be skewed toward specific subgroups, leading to suboptimal or even harmful recommendations for other groups [73,74]. For instance, if a model is trained predominantly on data from patients of a particular age, gender, or ethnicity, it may not perform well on patients from other demographics. To mitigate such biases, it is crucial to ensure that the training data are representative of the target patient population, considering factors such as age, gender, ethnicity, and socioeconomic status [75].

Another source of bias can arise from the choice of features or variables used in the analysis. If certain relevant variables are not included, or if irrelevant variables are considered, the resulting predictions or recommendations may be biased or even spurious [76]. Careful feature selection, based on domain knowledge and a thorough understanding of the underlying data, can help address this issue.

Algorithmic biases can also emerge from the choice of machine learning methods or algorithms, as well as their specific implementations. To address this, it is essential to evaluate and compare multiple algorithms and implementations to identify potential biases and select the most appropriate method for the specific application [77]. Patients themselves can serve as their own baselines too, particularly for measurements that do not lend themselves as easily to a population approach (eg, mood and gastric motility).

Lastly, ongoing monitoring and evaluation of the performance of data analysis solutions, including machine learning models, is critical to detecting and addressing biases. Regular assessments of model performance, particularly with respect to various subgroups within the patient population, can help identify potential biases and ensure that the solutions remain equitable and effective for all patients [78].


Overview

Once the data have been analyzed, the results need to be presented as information to support clinicians’ decision-making. Unless the RPM data are used to inform patient care, the RPM intervention will not yield the intended results. Therefore, it is critical that the information is presented in a manner that is likely to inform clinicians as they make decisions that affect specific patients and patient populations.

Is RPM Information Accessible in the Right Electronic Health Record Software?

Physicians and other clinical decision makers often face significant time constraints and high cognitive workloads in their daily practice, making it challenging for them to manage and monitor patient data effectively. A study by Sinsky et al [79] found that primary care physicians spent nearly half of their workday interacting with EHR systems, leaving them with limited time for direct patient care. The high volume of clinical tasks and responsibilities can lead to cognitive overload, increasing the risk of burnout and negatively impacting the quality of care provided [80]. Given these constraints, it is critical to ensure that RPM data are easily accessible within the existing EHR systems without requiring clinicians to log into additional platforms or apps. Integrating RPM data into EHRs can help streamline clinical workflows and reduce the cognitive burden on health care providers, enabling them to focus on essential tasks such as patient evaluation, diagnosis, and treatment planning [81]. This underscores the importance of seamless integration and interoperability between RPM solutions and EHR systems, ultimately supporting more efficient and effective patient care by easing the pathway of the information being used in decision-making.

One of the key benefits of integrating RPM data into EHR systems is the ability to provide a comprehensive and up-to-date view of a patient’s health status. By combining RPM data with other health information such as medical history, laboratory results, and imaging studies, clinicians can gain a more holistic understanding of a patient’s condition, enabling them to make more informed decisions about treatment plans and care management strategies [82].

Integration of RPM data into EHR systems can also support the development and implementation of clinical decision support (CDS) tools, which can help health care providers make more informed, evidence-based decisions about patient care [83]. By leveraging RPM data, CDS tools can provide real-time alerts or recommendations to clinicians, assisting them in diagnosing, treating, or managing a patient’s condition more effectively.

How Should the Decision Maker Receive Information?

In the context of RPM solutions, there is a delicate balance between providing exception reporting and summary data reporting. Exception reporting involves the generation of alerts or notifications only when specific events or abnormal values are detected, which require immediate attention from health care providers. This yields the advantage of focusing health care providers’ attention on situations that need prompt intervention, potentially improving the efficiency and timeliness of care and reducing the number of alerts [84]. However, exception reporting may not always provide sufficient context or information about a patient’s overall health status, making it difficult for clinicians to assess the impact of treatment strategies or identify more subtle changes in condition over time. On the other hand, summary data reporting provides a broader overview of a patient’s progress over time, allowing clinicians to evaluate trends and assess the overall effectiveness of treatment plans. Both approaches have their merits and challenges, making the choice between them a critical consideration in RPM projects.

Alert fatigue is a critical concern in the context of RPM solutions, as it can have significant implications for the effectiveness of the system and the quality of patient care. Alert fatigue occurs when health care providers are exposed to a high volume of alerts, leading to desensitization and potentially reduced responsiveness to these notifications [85-87]. This phenomenon has been observed in various clinical settings, including electronic health record systems and CDS tools, where excessive alerts can contribute to cognitive overload, increased stress, and the risk of overlooking critical information [88].

In RPM systems, balancing the type and frequency of messaging is essential to minimize alert fatigue. The choice between push and pull messaging strategies can play a significant role in this regard. Push messaging involves automatically sending alerts or notifications to health care providers, whereas pull messaging requires providers to actively request or retrieve the information. Although push messaging can ensure timely delivery of critical information, it may also contribute to alert fatigue if used indiscriminately or too frequently. Solutions to alleviate this tension may involve tailoring alert thresholds based on individual patient needs, incorporating CDS algorithms to filter and prioritize alerts, and using a combination of push and pull messaging to strike the right balance between proactively notifying providers and allowing them to access information on demand.

What is the Right Amount of Information to Provide to Decision Makers?

Balancing transparency and detail in the presentation of RPM data with cognitive ease is crucial for ensuring that health care providers effectively use the information in their decision-making processes. While transparency is essential for building trust and understanding of the underlying data analysis, providing excessive detail can overwhelm clinicians and hinder their ability to quickly assimilate the information [89]. Consequently, it is vital to strike an optimal balance between presenting comprehensive information and ensuring cognitive ease for end users.

One approach to achieving this balance is to use a tiered or “drill-down” presentation of data, which allows health care providers to access additional layers of detail only if they require it [90]. This design can present a high-level summary of the patient’s condition and only flag critical alerts, while enabling providers to delve deeper into the data if they desire further context or clarification. This, in turn, helps mitigate information overload and supports more efficient decision-making by prioritizing the most relevant and actionable insights [91]. Moreover, incorporating the principles of cognitive ergonomics and human-centered design can further enhance the usability of RPM solutions. This may involve the use of visual aids, such as graphs, charts, and color-coding, to facilitate rapid comprehension of complex data and even presenting proposed treatment plans based on the algorithmic analysis of the patient’s full record [92] and providing reference statistics from the health system’s relevant patient population.

Conclusion

The mixed results with RPM interventions have raised concerns about the scalability and value of this technology. This viewpoint paper highlights some of the key questions and core considerations that affect the various infrastructure components of an RPM intervention. Differences between health conditions, metrics, devices, storage, analysis, and information presentation across RPM implementations result in countless permutations. If scholars fail to document and clearly explain the RPM infrastructure and choices made for an RPM implementation, it will be difficult to create an evidence-based research tradition. Having a shared vocabulary and more consistent documentation of the RPM infrastructure can support future literature reviews and meta-analyses seeking to evaluate the outcomes of RPM interventions. The RPM infrastructure framework presented in this article offers scholars a means to describe the different choices and constraints associated with their RPM interventions.

We also identify how each of the infrastructure components can stimulate new research and intervention opportunities in Table 1. While not exhaustive, the list offers a sampling of the many research questions that could be studied to further increase the understanding associated with RPM interventions. The RPM framework offers scholars and clinicians a more comprehensive guide to exploring various aspects of RPM implementation. As a result, they can further optimize the design and functionality of RPM solutions for improved patient care and health care provider experiences.

Table 1. Key questions and considerations per remote patient monitoring (RPM) infrastructure component.
Infrastructure component and relevant questionsResearch considerationsIntervention considerations
Data collection

Which patients?
  • Examining lesser-studied chronic and acute health conditions that could benefit from RPM interventions
  • Exploring which comorbidities benefit from RPM data collection
  • Determining ways to improve patient compliance with RPM protocols
  • Understanding how to identify and improve technology competence among patients suitable for RPM interventions
  • Using RPM interventions for health conditions with known positive patient outcomes
  • Collecting additional data through RPM based on the comorbidities of the patient
  • Identifying patient populations most likely to benefit from RPM intervention outcomes
  • Developing strategies to increase technology competence among patient populations who can benefit from RPM interventions

Which device and data?
  • Comparing the effectiveness of device types (eg, invasive vs noninvasive and prescribed devices vs consumer electronics) for RPM
  • Identifying which metrics (and combinations of metrics) are most useful (and least obtrusive) to collect that will yield the desired patient outcomes
  • Choosing an RPM device by considering the patient’s needs and the type of data needed to provide patient care
  • Determining which metrics are most appropriate to capture for a patient given their health condition and comorbidities
  • Evaluating the business models for device purchases and maintenance
How frequent?
  • Determining best practices for the frequency of RPM data collection while considering the patient’s health condition and likelihood of adhering to the schedule
  • Reviewing evidence-based practices to determine the frequency of RPM data collection for clinical care pathways
Data transmission and storage

How to transmit data?
  • Identifying systematic bias or limitations in transmitting RPM data due to lack of access to broadband, technology competence, or ability to physically visit a clinician office
  • Determining the data transmission approach most feasible for the patient
  • Providing connectivity through the device (direct cell network transmission) versus leveraging patient networks and device apps

How to secure data?
  • Determining means to limit the vulnerability of RPM data when transmitted and stored
  • Informing patients of the security, privacy, and risks of their RPM data during transmission and storage of data

How interoperable?
  • Creating robust methods to maintain patient privacy when sharing RPM data across health care information systems
  • Determining the appropriate level of granularity of data to share (raw vs summary)
  • Leveraging interoperability standards to ensure RPM data can be shared across systems (eg, from a device’s proprietary system to an electronic health record)
Data analysis

What algorithm?
  • Examining the advantages and disadvantages associated with different forms of algorithms and rules (ie, static vs dynamic) used to analyze RPM data
  • Understanding the implications associated with the manner in which RPM data are analyzed

Which co-morbidities?
  • Identifying the interactions between comorbidities affect clinical care pathways when using RPM interventions
  • Determining which comorbidities to control for or consider when implementing RPM for a patient population

What is the potential for bias?
  • Benchmarking and validating algorithms to detect and mitigate bias
  • Considering how biases within the patient’s RPM data (or across multiple patients’ RPM data) could influence the findings or recommendations
Information presentation

How to make information accessible?
  • Evaluating the outcomes of patients when RPM information is embedded within electronic health record systems
  • Ensuring the RPM information is part of the clinician’s workflow

How to share information for decision-making?
  • Determining how to present information effectively to improve decision-making while avoiding cognitive overload
  • Examining methods of presentation that encourage clinicians to use the results to augment (rather than replace) human judgment
  • Designing information presentation to avoid alert fatigue
  • Developing alternative strategies, such as digital nudges, to encourage clinicians to apply RPM data in patient care decisions

How to present information for decision-making?
  • Identifying factors (eg, trust, transparency, and usability) related to RPM information that affect clinician’s decision-making
  • Exploring presentation methods to enable effective use of RPM information for decision-making

Acknowledgments

This research is supported in part by funding from Wake Forest University through the School of Business and the School of Medicine Center for Healthcare Innovation. These sponsors had no involvement in the research.

Conflicts of Interest

None declared.

  1. Tang M, Mehrotra A, Stern AD. Rapid growth of remote patient monitoring is driven by a small number of primary care providers. Health Aff (Millwood). 2022;41(9):1248-1254. [CrossRef] [Medline]
  2. Birkmeyer JD, Barnato A, Birkmeyer N, Bessler R, Skinner J. The impact of the COVID-19 pandemic on hospital admissions in the United States. Health Aff (Millwood). 2020;39(11):2010-2017. [FREE Full text] [CrossRef] [Medline]
  3. Mecklai K, Smith N, Stern AD, Kramer DB. Remote patient monitoring: overdue or overused? N Engl J Med. 2021;384(15):1384-1386. [CrossRef] [Medline]
  4. Mann DM, Chen J, Chunara R, Testa PA, Nov O. COVID-19 transforms health care through telemedicine: evidence from the field. J Am Med Inform Assoc. 2020;27(7):1132-1135. [FREE Full text] [CrossRef] [Medline]
  5. de Farias FAC, Dagostini CM, de Assunção Bicca Y, Falavigna VF, Falavigna A. Remote patient monitoring: a systematic review. Telemed J E Health. 2020;26(5):576-583. [CrossRef] [Medline]
  6. Taylor ML, Thomas EE, Snoswell CL, Smith AC, Caffery LJ. Does remote patient monitoring reduce acute care use? A systematic review. BMJ Open. 2021;11(3):e040232. [FREE Full text] [CrossRef] [Medline]
  7. LeBlanc M, Petrie S, Paskaran S, Carson DB, Peters PA. Patient and provider perspectives on eHealth interventions in Canada and Australia: a scoping review. Rural Remote Health. 2020;20(3):5754. [FREE Full text] [CrossRef] [Medline]
  8. Noah B, Keller MS, Mosadeghi S, Stein L, Johl S, Delshad S, et al. Impact of remote patient monitoring on clinical outcomes: an updated meta-analysis of randomized controlled trials. NPJ Digit Med. 2018;1(1):20172. [FREE Full text] [CrossRef] [Medline]
  9. Silva BMC, Rodrigues JJPC, de la Torre Díez I, López-Coronado M, Saleem K. Mobile-health: a review of current state in 2015. J Biomed Inform. 2015;56:265-272. [FREE Full text] [CrossRef] [Medline]
  10. Verma P, Sood SK. Fog assisted-IoT enabled patient health monitoring in smart homes. IEEE Internet Things J. 2018;5(3):1789-1796. [CrossRef]
  11. Gold R, Bunce A, Cowburn S, Dambrun K, Dearing M, Middendorf M, et al. Adoption of social determinants of health EHR tools by community health centers. Ann Fam Med. 2018;16(5):399-407. [FREE Full text] [CrossRef] [Medline]
  12. Kwon BC, Choi MJ, Kim JT, Choi E, Kim YB, Kwon S, et al. RetainVis: visual analytics with interpretable and interactive recurrent neural networks on electronic medical records. IEEE Trans Vis Comput Graph. 2019;25(1):299-309. [CrossRef] [Medline]
  13. Kvedar J, Coye MJ, Everett W. Connected health: a review of technologies and strategies to improve patient care with telemedicine and telehealth. Health Aff (Millwood). 2014;33(2):194-199. [CrossRef] [Medline]
  14. Bogyi P, Vamos M, Bari Z, Polgar B, Muk B, Nyolczas N, et al. Association of remote monitoring with survival in heart failure patients undergoing cardiac resynchronization therapy: retrospective observational study. J Med Internet Res. 2019;21(7):e14142. [FREE Full text] [CrossRef] [Medline]
  15. Lippke S, Gao L, Keller FM, Becker P, Dahmen A. Adherence with online therapy vs face-to-face therapy and with online therapy vs care as usual: secondary analysis of two randomized controlled trials. J Med Internet Res. 2021;23(11):e31274. [FREE Full text] [CrossRef] [Medline]
  16. Midaglia L, Mulero P, Montalban X, Graves J, Hauser SL, Julian L, et al. Adherence and satisfaction of smartphone- and smartwatch-based remote active testing and passive monitoring in people with multiple sclerosis: nonrandomized interventional feasibility study. J Med Internet Res. 2019;21(8):e14863. [FREE Full text] [CrossRef] [Medline]
  17. Rojas G, Guajardo V, Martínez P, Castro A, Fritsch R, Moessner M, et al. A remote collaborative care program for patients with depression living in rural areas: open-label trial. J Med Internet Res. 2018;20(4):e158. [FREE Full text] [CrossRef] [Medline]
  18. Seto E. Cost comparison between telemonitoring and usual care of heart failure: a systematic review. Telemed J E Health. 2008;14(7):679-686. [CrossRef] [Medline]
  19. NEJM Catalyst. Social Determinants of Health (SDOH). NEJM Catalyst. 2017;3(6). [FREE Full text]
  20. Najarian M, Goudie A, Bona JP, Rezaeiahari M, Young SG, Bogulski CA, et al. Socioeconomic determinants of remote patient monitoring implementation among rural and urban hospitals. Telemed J E Health. 2023;29(11):1624-1633. [CrossRef] [Medline]
  21. Bailey JE, Gurgol C, Pan E, Njie S, Emmett S, Gatwood J, et al. Early patient-centered outcomes research experience with the use of telehealth to address disparities: scoping review. J Med Internet Res. 2021;23(12):e28503. [FREE Full text] [CrossRef] [Medline]
  22. Yong J, Yang O. Does socioeconomic status affect hospital utilization and health outcomes of chronic disease patients? Eur J Health Econ. 2021;22(2):329-339. [CrossRef] [Medline]
  23. Veisani Y, Jenabi E, Nematollahi S, Delpisheh A, Khazaei S. The role of socio-economic inequality in the prevalence of hypertension in adults. J Cardiovasc Thorac Res. 2019;11(2):116-120. [FREE Full text] [CrossRef] [Medline]
  24. Kruse CS, Stein A, Thomas H, Kaur H. The use of electronic health records to support population health: a systematic review of the literature. J Med Syst. 2018;42(11):214. [FREE Full text] [CrossRef] [Medline]
  25. Demiris G, Speedie SM, Finkelstein S. Change of patients' perceptions of TeleHomeCare. Telemed J E Health. 2001;7(3):241-248. [CrossRef] [Medline]
  26. Birati Y, Yefet E, Perlitz Y, Shehadeh N, Spitzer S. Cultural and digital health literacy appropriateness of app- and web-based systems designed for pregnant women with gestational diabetes mellitus: scoping review. J Med Internet Res. 2022;24(10):e37844. [FREE Full text] [CrossRef] [Medline]
  27. Tseng KC, Hsu CL, Chuang YH. Designing an intelligent health monitoring system and exploring user acceptance for the elderly. J Med Syst. 2013;37(6):9967. [CrossRef] [Medline]
  28. Martínez A, Everss E, Rojo-Alvarez JL, Figal DP, García-Alberola A. A systematic review of the literature on home monitoring for patients with heart failure. J Telemed Telecare. 2006;12(5):234-241. [CrossRef] [Medline]
  29. Rodríguez I, Herskovic V, Gerea C, Fuentes C, Rossel PO, Marques M, et al. Understanding monitoring technologies for adults with pain: systematic literature review. J Med Internet Res. 2017;19(10):e364. [FREE Full text] [CrossRef] [Medline]
  30. Baig MM, GholamHosseini H, Moqeem AA, Mirza F, Lindén M. A systematic review of wearable patient monitoring systems: current challenges and opportunities for clinical adoption. J Med Syst. 2017;41(7):115. [CrossRef] [Medline]
  31. Jagadeeswari V, Subramaniyaswamy V, Logesh R, Vijayakumar V. A study on medical internet of things and big data in personalized healthcare system. Health Inf Sci Syst. 2018;6(1):14. [FREE Full text] [CrossRef] [Medline]
  32. Nguyen T, Barefield A, Nguyen GT. Social determinants of health associated with the use of screenings for hypertension, hypercholesterolemia, and hyperglycemia among American adults. Med Sci (Basel). 2021;9(1):19. [FREE Full text] [CrossRef] [Medline]
  33. Kalid N, Zaidan AA, Zaidan BB, Salman OH, Hashim M, Muzammil H. Based real time remote health monitoring systems: a review on patients prioritization and related "big data" using body sensors information and communication technology. J Med Syst. 2018;42(2):30. [CrossRef] [Medline]
  34. Matthews M, Abdullah S, Gay G, Choudhury T. Tracking mental well-being: balancing rich sensing and patient needs. Computer. 2014;47(4):36-43. [CrossRef]
  35. Maguire R, Connaghan J, Arber A, Klepacz N, Blyth KG, McPhelim J, et al. Advanced symptom management system for patients with malignant pleural mesothelioma (ASyMSmeso): mixed methods study. J Med Internet Res. 2020;22(11):e19180. [FREE Full text] [CrossRef] [Medline]
  36. Simblett S, Greer B, Matcham F, Curtis H, Polhemus A, Ferrão J, et al. Barriers to and facilitators of engagement with remote measurement technology for managing health: systematic review and content analysis of findings. J Med Internet Res. 2018;20(7):e10480. [FREE Full text] [CrossRef] [Medline]
  37. Hunt D. Passive analytics and the future of RPM (remote patient monitoring). Healthcare IT Today. 2021. URL: https:/​/www.​healthcareittoday.com/​2021/​02/​12/​passive-analytics-and-the-future-of-rpm-remote-patient-monitoring/​ [accessed 2023-05-29]
  38. Greenhalgh T, Wherton J, Papoutsi C, Lynch J, Hughes G, A'Court C, et al. Analysing the role of complexity in explaining the fortunes of technology programmes: empirical application of the NASSS framework. BMC Med. 2018;16(1):66. [FREE Full text] [CrossRef] [Medline]
  39. Su D, Michaud TL, Estabrooks P, Schwab RJ, Eiland LA, Hansen G, et al. Diabetes management through remote patient monitoring: the importance of patient activation and engagement with the technology. Telemed J E Health. 2019;25(10):952-959. [CrossRef] [Medline]
  40. Choi NG, Dinitto DM. The digital divide among low-income homebound older adults: internet use patterns, eHealth literacy, and attitudes toward computer/internet use. J Med Internet Res. 2013;15(5):e93. [FREE Full text] [CrossRef] [Medline]
  41. Leidig M, Teeuw RM. Quantifying and mapping global data poverty. PLoS One. 2015;10(11):e0142076. [FREE Full text] [CrossRef] [Medline]
  42. Pappas G. Planning for internet connectivity in remote patient monitoring. Telemed J E Health. 2010;16(5):639-641. [CrossRef] [Medline]
  43. McConnell MV, Turakhia MP, Harrington RA, King AC, Ashley EA. Mobile health advances in physical activity, fitness, and atrial fibrillation: moving hearts. J Am Coll Cardiol. 2018;71(23):2691-2701. [FREE Full text] [CrossRef] [Medline]
  44. Ancker JS, Witteman HO, Hafeez B, Provencher T, Van de Graaf M, Wei E. The invisible work of personal health information management among people with multiple chronic conditions: qualitative interview study among patients and providers. J Med Internet Res. 2015;17(6):e137. [FREE Full text] [CrossRef] [Medline]
  45. Kramer DB, Baker M, Ransford B, Molina-Markham A, Stewart Q, Fu K, et al. Security and privacy qualities of medical devices: an analysis of FDA postmarket surveillance. PLoS One. 2012;7(7):e40200. [FREE Full text] [CrossRef] [Medline]
  46. Cuningkin V, Riley E, Rainey L. Preventing medjacking. Am J Nurs. 2021;121(10):46-50. [CrossRef] [Medline]
  47. Williams PAH, Woodward AJ. Cybersecurity vulnerabilities in medical devices: a complex environment and multifaceted problem. Med Devices (Auckl). 2015;8:305-316. [FREE Full text] [CrossRef] [Medline]
  48. Kelly JT, Campbell KL, Gong E, Scuffham P. The Internet of Things: impact and implications for health care delivery. J Med Internet Res. 2020;22(11):e20135. [FREE Full text] [CrossRef] [Medline]
  49. Djenna A, Harous S, Saidouni DE. Internet of Things meet internet of threats: new concern cyber security issues of critical cyber infrastructure. Appl Sci. 2021;11(10):4580. [FREE Full text] [CrossRef]
  50. Roman R, Zhou J, Lopez J. On the features and challenges of security and privacy in distributed internet of things. Comput Netw. 2013;57(10):2266-2279. [CrossRef]
  51. Adler-Milstein J, Jha AK. HITECH act drove large gains in hospital electronic health record adoption. Health Aff (Millwood). 2017;36(8):1416-1422. [FREE Full text] [CrossRef] [Medline]
  52. Pathak N, Misra S, Mukherjee A, Kumar N. HeDI: healthcare device interoperability for IoT-based e-Health platforms. IEEE Internet Things J. 2021;8(23):16845-16852. [CrossRef]
  53. Finet P, Gibaud B, Dameron O, Le Bouquin Jeannès R. Interoperable infrastructure and implementation of a health data model for remote monitoring of chronic diseases with comorbidities. IRBM. 2018;39(3):151-159. [CrossRef]
  54. United States Core Data for Interoperability (USCDI). Office of the National Coordinator for Health Information Technology. 2022. URL: https://www.healthit.gov/isa/united-states-core-data-interoperability-uscdi [accessed 2024-04-19]
  55. El Emam K, Jonker E, Arbuckle L, Malin B. A systematic review of re-identification attacks on health data. PLoS One. 2011;6(12):e28071. [FREE Full text] [CrossRef] [Medline]
  56. Fernández-Alemán JL, Señor IC, Lozoya PÁO, Toval A. Security and privacy in electronic health records: a systematic literature review. J Biomed Inform. 2013;46(3):541-562. [FREE Full text] [CrossRef] [Medline]
  57. Azodo I, Williams R, Sheikh A, Cresswell K. Opportunities and challenges surrounding the use of data from wearable sensor devices in health care: qualitative interview study. J Med Internet Res. 2020;22(10):e19542. [FREE Full text] [CrossRef] [Medline]
  58. Lowery C. What is digital health and what do i need to know about it? Obstet Gynecol Clin North Am. 2020;47(2):215-225. [CrossRef] [Medline]
  59. El-Rashidy N, El-Sappagh S, Islam SMR, El-Bakry HM, Abdelrazek S. Mobile health in remote patient monitoring for chronic diseases: principles, trends, and challenges. Diagnostics (Basel). 2021;11(4):607. [FREE Full text] [CrossRef] [Medline]
  60. Zhou N, Wang L, Almirall D. Estimating tree-based dynamic treatment regimes using observational data with restricted treatment sequences. Biometrics. 2023;79(3):2260-2271. [CrossRef] [Medline]
  61. Norton EH, Fleming SM, Daw ND, Landy MS. Suboptimal criterion learning in static and dynamic environments. PLoS Comput Biol. 2017;13(1):e1005304. [FREE Full text] [CrossRef] [Medline]
  62. Kumari J, Kumar E, Kumar D. A structured analysis to study the role of machine learning and deep learning in the healthcare sector with big data analytics. Arch Comput Methods Eng. 2023;30:3673-3701. [FREE Full text] [CrossRef] [Medline]
  63. Jiang F, Jiang Y, Zhi H, Dong Y, Li H, Ma S, et al. Artificial intelligence in healthcare: past, present and future. Stroke Vasc Neurol. 2017;2(4):230-243. [FREE Full text] [CrossRef] [Medline]
  64. Gomez-Garcia CA, Askar-Rodriguez M, Velasco-Medina J. Platform for healthcare promotion and cardiovascular disease prevention. IEEE J Biomed Health Inform. 2021;25(7):2758-2767. [CrossRef] [Medline]
  65. Marimuthu P, Perumal V, Vijayakumar V. Intelligent personalized abnormality detection for remote health monitoring. Int J Intell Inf Technol. 2020;16(2):87-109. [CrossRef]
  66. Ukil A, Jara AJ, Marin L. Data-driven automated cardiac health management with robust edge analytics and de-risking. Sensors (Basel). 2019;19(12):2733. [FREE Full text] [CrossRef] [Medline]
  67. Trohman RG, Huang HD, Larsen T, Krishnan K, Sharma PS. Sensors for rate-adaptive pacing: how they work, strengths, and limitations. J Cardiovasc Electrophysiol. 2020;31(11):3009-3027. [CrossRef] [Medline]
  68. Sloan FA, Bethel MA, Ruiz D, Shea AM, Feinglos MN. The growing burden of diabetes mellitus in the US elderly population. Arch Intern Med. 2008;168(2):192-199; discussion 199. [FREE Full text] [CrossRef] [Medline]
  69. Mancia G, Grassi G. The autonomic nervous system and hypertension. Circ Res. 2014;114(11):1804-1814. [FREE Full text] [CrossRef] [Medline]
  70. Shimada SL, Brandt CA, Feng H, McInnes DK, Rao SR, Rothendler JA, et al. Personal health record reach in the veterans health administration: a cross-sectional analysis. J Med Internet Res. 2014;16(12):e272. [FREE Full text] [CrossRef] [Medline]
  71. Gianfrancesco MA, Tamang S, Yazdany J, Schmajuk G. Potential biases in machine learning algorithms using electronic health record data. JAMA Intern Med. 2018;178(11):1544-1547. [FREE Full text] [CrossRef] [Medline]
  72. Shaw J, Rudzicz F, Jamieson T, Goldfarb A. Artificial intelligence and the implementation challenge. J Med Internet Res. 2019;21(7):e13659. [FREE Full text] [CrossRef] [Medline]
  73. Rajkomar A, Hardt M, Howell MD, Corrado G, Chin MH. Ensuring fairness in machine learning to advance health equity. Ann Intern Med. 2018;169(12):866-872. [FREE Full text] [CrossRef] [Medline]
  74. Panch T, Mattie H, Atun R. Artificial intelligence and algorithmic bias: implications for health systems. J Glob Health. 2019;9(2):010318. [FREE Full text] [CrossRef] [Medline]
  75. Obermeyer Z, Powers B, Vogeli C, Mullainathan S. Dissecting racial bias in an algorithm used to manage the health of populations. Science. 2019;366(6464):447-453. [FREE Full text] [CrossRef] [Medline]
  76. Seyyed-Kalantari L, Zhang H, McDermott MBA, Chen IY, Ghassemi M. Underdiagnosis bias of artificial intelligence algorithms applied to chest radiographs in under-served patient populations. Nat Med. 2021;27(12):2176-2182. [FREE Full text] [CrossRef] [Medline]
  77. Wiens J, Saria S, Sendak M, Ghassemi M, Liu VX, Doshi-Velez F, et al. Do no harm: a roadmap for responsible machine learning for health care. Nat Med. 2019;25(9):1337-1340. [CrossRef] [Medline]
  78. Vyas DA, Eisenstein LG, Jones DS. Hidden in plain sight: reconsidering the use of race correction in clinical algorithms. N Engl J Med. 2020;383(9):874-882. [FREE Full text] [CrossRef] [Medline]
  79. Sinsky C, Colligan L, Li L, Prgomet M, Reynolds S, Goeders L, et al. Allocation of physician time in ambulatory practice: a time and motion study in 4 specialties. Ann Intern Med. 2016;165(11):753-760. [CrossRef] [Medline]
  80. West CP, Dyrbye LN, Shanafelt TD. Physician burnout: contributors, consequences and solutions. J Intern Med. 2018;283(6):516-529. [FREE Full text] [CrossRef] [Medline]
  81. Scott Kruse C, Karem P, Shifflett K, Vegi L, Ravi K, Brooks M. Evaluating barriers to adopting telemedicine worldwide: a systematic review. J Telemed Telecare. 2018;24(1):4-12. [FREE Full text] [CrossRef] [Medline]
  82. Menachemi N, Rahurkar S, Harle CA, Vest JR. The benefits of health information exchange: an updated systematic review. J Am Med Inform Assoc. 2018;25(9):1259-1265. [FREE Full text] [CrossRef] [Medline]
  83. Osheroff JA, Teich J, Levick D, Saldana L, Velasco F, Sittig D, et al. Improving Outcomes with Clinical Decision Support: An Implementer's Guide, Second Edition. New York. HIMSS Publishing; 2012.
  84. Weenk M, van Goor H, Frietman B, Engelen LJLPG, van Laarhoven CJHM, Smit J, et al. Continuous monitoring of vital signs using wearable devices on the general ward: pilot study. JMIR Mhealth Uhealth. 2017;5(7):e91. [FREE Full text] [CrossRef] [Medline]
  85. Sendelbach S, Funk M. Alarm fatigue: a patient safety concern. AACN Adv Crit Care. 2013;24(4):378-386; quiz 387-388. [CrossRef] [Medline]
  86. van der Sijs H, Baboe I, Phansalkar S. Human factors considerations for contraindication alerts. Stud Health Technol Inform. 2013;192:132-136. [Medline]
  87. van der Sijs H, van Gelder T, Vulto A, Berg M, Aarts J. Understanding handling of drug safety alerts: a simulation study. Int J Med Inform. 2010;79(5):361-369. [CrossRef] [Medline]
  88. Ancker JS, Edwards A, Nosal S, Hauser D, Mauer E, Kaushal R, et al. HITEC Investigators. Effects of workload, work complexity, and repeated alerts on alert fatigue in a clinical decision support system. BMC Med Inform Decis Mak. 2017;17(1):36. [FREE Full text] [CrossRef] [Medline]
  89. Kawamoto K, Houlihan CA, Balas EA, Lobach DF. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ. 2005;330(7494):765. [FREE Full text] [CrossRef] [Medline]
  90. Miller K, Mosby D, Capan M, Kowalski R, Ratwani R, Noaiseh Y, et al. Interface, information, interaction: a narrative review of design and functional requirements for clinical decision support. J Am Med Inform Assoc. 2018;25(5):585-592. [FREE Full text] [CrossRef] [Medline]
  91. Rand V, Coleman C, Park R, Karar A, Khairat S. Towards understanding the impact of EHR-related information overload on provider cognition. Stud Health Technol Inform. 2018;251:277-280. [Medline]
  92. Baker J, Jones D, Burkman J. Using visual representations of data to enhance sensemaking in data exploration tasks. J Assoc Inf Syst. 2009;10(7):533-559. [FREE Full text] [CrossRef]


CDS: clinical decision support
IT: information technology
RPM: remote patient monitoring


Edited by T de Azevedo Cardoso; submitted 26.07.23; peer-reviewed by M Baucum, H Ewald, E Vashishtha, R Williams, A Georgiou, R Bidkar; comments to author 24.08.23; revised version received 12.10.23; accepted 09.04.24; published 30.05.24.

Copyright

©Jennifer Claggett, Stacie Petter, Amol Joshi, Todd Ponzio, Eric Kirkendall. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 30.05.2024.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.