This paper is in the following e-collection/theme issue:

Viewpoints and Perspectives (483) Digital Medicine Society (DiMe) (11) Wearable Devices and Sensors (811) Big Data (215) Data Science (223)

Published on in Vol 23, No 11 (2021): November

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/34493, first published .
Sensor Data Integration: A New Cross-Industry Collaboration to Articulate Value, Define Needs, and Advance a Framework for Best Practices

Sensor Data Integration: A New Cross-Industry Collaboration to Articulate Value, Define Needs, and Advance a Framework for Best Practices

Sensor Data Integration: A New Cross-Industry Collaboration to Articulate Value, Define Needs, and Advance a Framework for Best Practices

Authors of this article:

Ieuan Clay1 Author Orcid Image ;   Christian Angelopoulos2 Author Orcid Image ;   Anne Lord Bailey3 Author Orcid Image ;   Aaron Blocker4 Author Orcid Image ;   Simona Carini5 Author Orcid Image ;   Rodrigo Carvajal6 Author Orcid Image ;   David Drummond7 Author Orcid Image ;   Kimberly F McManus3 Author Orcid Image ;   Ingrid Oakley-Girvan8 Author Orcid Image ;   Krupal B Patel6 Author Orcid Image ;   Phillip Szepietowski6 Author Orcid Image ;   Jennifer C Goldsack1 Author Orcid Image
Article Authors Cited by (7) Tweetations (20) Metrics

    Viewpoint

    1Digital Medicine Society (DiMe), Boston, MA, United States

    2HumanFirst, San Fransisco, CA, United States

    3Department of Veterans Affairs, Washington, DC, United States

    4Savvy Cooperative, Queens, NY, United States

    5University of California San Francisco, San Francisco, CA, United States

    6H Lee Moffitt Cancer Center and Research Institute, Tampa, FL, United States

    7Evidation Health, San Mateo, CA, United States

    8Medable, San Fransisco, CA, United States

    Corresponding Author:

    Ieuan Clay, PhD

    Digital Medicine Society (DiMe)

    90 Canal Street

    Boston, MA, 02114

    United States

    Phone: 1 765 234 3463

    Email: ieuan@dimesociety.org


    Data integration, the processes by which data are aggregated, combined, and made available for use, has been key to the development and growth of many technological solutions. In health care, we are experiencing a revolution in the use of sensors to collect data on patient behaviors and experiences. Yet, the potential of this data to transform health outcomes is being held back. Deficits in standards, lexicons, data rights, permissioning, and security have been well documented, less so the cultural adoption of sensor data integration as a priority for large-scale deployment and impact on patient lives. The use and reuse of trustworthy data to make better and faster decisions across drug development and care delivery will require an understanding of all stakeholder needs and best practices to ensure these needs are met. The Digital Medicine Society is launching a new multistakeholder Sensor Data Integration Tour of Duty to address these challenges and more, providing a clear direction on how sensor data can fulfill its potential to enhance patient lives.

    J Med Internet Res 2021;23(11):e34493

    doi:10.2196/34493

    Keywords

    digital measures; data integration; patient centricity; utility 


    Data integration has been defined as “...the technical and business processes used to (aggregate and) combine data from multiple sources to provide a unified, single view of the data” [1]. In practice, this means building bridges across different sources of data, to create an integrated data set that enables you to ask bigger questions or new questions (ie, integration followed by utilization) [2].

    Data integration has been a force for innovation and scaling in many technological fields, helping new products become part of our everyday lives. Why do your new headphones work with your phone? Cross-industry collaboration on standards fueled the growth of Bluetooth from its initial invention at Ericsson in the late 1990s to one of the most prevalent current-day technologies [3], incorporated into an estimated 5 billion new devices in 2021 [4]. Love that your credit card works practically everywhere, including internationally? This would not be possible without the Payment Card Industry Data Security Standard (and associated Security Council), which has been a globally accepted standard since 2004 [5]. Trying to get home the fastest way? The apps and services that help us plan and navigate our journeys rely on the General Transit Feed Specification [6], which began in 2005 as a collaboration between Google and the TriMet transport agency and is now a global standard driving the utilization of transit data [7]. All of these examples underline not only the practical impact of successful data integration, but also the critical role of multisector collaboration in achieving success.

    Where is the new field of digital health, and sensor data in particular, in its data integration journey and what needs to be done to move it forward?

    The Digital Medicine Society (DiMe), a nonprofit organization dedicated to advancing the safe, effective, ethical, and equitable use of digital medicine to optimize health [8], will examine these questions and more as part of a new Sensor Data Integration Tour of Duty. The tour will convene multistakeholder experts from Amazon Web Services, Evidation Health, the Food and Drug Administration (FDA) Center for Drug Evaluation and Research (CDER) and the Center for Devices and Radiological Health (CDRH), Human First, the Institute of Electrical and Electronics Engineers, Medable, the Moffitt Cancer Center, Oracle, Open mHealth, Savvy Cooperative, Takeda, and the United States Department of Veterans Affairs. The Sensor Data Integration Tour of Duty will build off other initiatives like The Playbook [9] in advancing the adoption and utility of digital medicine tools. In this paper, we will describe the current state of sensor data integration in health care, examine the importance of sensor data integration in achieving the promise of digital health to improve clinical research and patient care at scale, and offer a vision of what overcoming these challenges and continuing progress will enable.


    In the world of health care, examples of data integration can be found across the drug development and care delivery continuum:

    • Modeling and understanding complex disease systems is typically only possible by considering and integrating a wide range of relevant data sources [10,11];
    • Data integration supports translating observations from preclinical models to studies with human subjects and is common in early phase drug discovery [12,13];
    • Similar data sources combined across different studies create meta-studies to increase statistical power to detect differences and improve the generalizability of results [14,15];
    • Bridging clinical to real-world evidence studies aids the translation of observations from clinical development to the market. Examples include converting an outcome used in a clinical trial to deployment to support reimbursement [16] or treatment [17], or comparing error from research or clinical-grade and consumer-grade sensors to better validate large-scale observations [18].

    Data integration is ubiquitous in digital health, but the definition above highlights three critical considerations pertaining to sensor data from digital health products:

    • Solutions to sensor data integration challenges will be found in both “technical and business processes”;
    • “Aggregating and combining data from multiple sources” will provide the critical context for sensor data to drive a learning health care system [19];
    • Creating a “unified, single view of the data” will allow the use and reuse of trustworthy data to make better and faster decisions.

    Sensor data (ie, data collected by wearable devices, smartphones, and other sensor-equipped connected digital medicine products [20]) is not a silver bullet. We cannot develop new sensor-based measures without combining data from different data sources [21,22], and we cannot deploy those measures without contextualization [23,24].

    When we develop a sensor-based digital measure, establishing that it is fit for purpose in a given population involves cross-referencing with clinical and behavioral anchor data to demonstrate accuracy and validity [20,25]. As a therapy moves from clinical development into the hands of patients, it is also critical that clinical outcomes are integrated with real-world data, and that researcher stakeholders and other decision-makers such as payers and clinical policy makers can access and assess those data.

    To support utilization and full patient value, health care providers and hospital administrators making treatment decisions all need access to the sensor data and digital measures captured during care and need to be able to digest and infer the same conclusions. Similarly, participants, investigators, statisticians, heads of medical affairs, or regulators need those data to be contextualized and appropriately presented to them, such that they are able to draw insights and value.

    Currently, we are far from achieving this potential to improve lives, and it has been claimed that limitations in data integration and utilization are the primary rate limiter [26,27]. Improving lives is always at the front of our minds, making it worthwhile to think about how these tools and applications “look” from the patient’s perspective. Data integration should minimize additional burden caused by management and assessment tools to patients already burdened by their condition(s). Widespread adoption will require interfaces that provide immediate value and are simple, interactive, and intuitive. No longer should patients ask: why does my health care provider not have access to all relevant information? Why should I have to perform the same test in multiple trials, and why do they all have separate apps? I think this data is important; how do I share it with my doctor? Achieving truly integrated continuous care is not possible without effective data integration [28].


    There are several specific technical hurdles that get in the way of effective data integration, including the plethora of formats [29,30] and the corresponding lack of consensus around common metadata standards [14,26], although progress is being made [31]. Perhaps more worrisome is the fact that permissioning and consent often exclude integration and exploration [32], and massive gaps in digital health research remain regarding data rights and governance [33,34].

    Yet, perhaps the biggest hurdles are cultural adoption, that is, effective incentivization to share data (within and across organizations) and make it easier to integrate [35-37]; recognition that data integration, while perhaps not a glorious pursuit, is central to scaling any digital health tool [38]; and lack of a unified signal from clinical (and other) stakeholders that would enable vendors to address needs around data integration [39,40].

    Data integration for digital health, and for sensor data specifically, is in the early phases, and we have yet to see the kind of progress that has been made in other data-heavy health fields (eg, genomics) [41-44]. Currently, no widely adopted data standards or repositories exist, and while progress is being made on the integration of other data types (eg, electronic health records [EHRs], molecular data, patient reported outcomes), we see limited progress around sensor data specifically. This presents an opportunity to provide an early framework for sensor-based data integration and future success of this technology and avoid barriers in integrating other health care data (eg, EHRs). Moreover, understanding the legal and ethical consequences of sharing and integrating sensor data is at a nascent stage [45]. Recent work has shown that “the three most underrepresented areas of research into digital clinical measures were ethics, security, and data rights and governance” [33].


    Data integration has been recognized as a key driver of value creation in the private sector. In the past few years, we have seen companies invest to improve their data integration abilities through smaller venture capital deals [46], larger acquisitions [47], or internal initiatives like data42 from Novartis [48].

    The public space has also been very active, perhaps helped by the inherently precompetitive nature of such work (ie, progress in data integration helps all parties, without any individual party needing to share proprietary data). Across research, clinical development, and in real-world practice, we are starting to see encouraging progress.

    Research has been boosted by a number of initiatives, often focused on improving the awareness and availability of digital health data sets. Examples include meta-reviews of publicly available data sets in specific fields to accelerate integration and use of these data, as well as highlighting potential issues and shortcomings like demographic and ethnic underrepresentation [14]. Similarly, new repositories and portals are helping researchers connect and make their data available, such as Synapse and their Digital Health portal [49] or Zenodo [50]. Zenodo is a robust example as it grew out of OpenAIRE [51], a public project focused on enabling open science, demonstrating the concrete progress that specific projects can drive. The COVID-19 Evidence Accelerator [52] has also contributed to integration across the colossal volumes of data being developed as part of the pandemic response.

    Clinical development and care delivery are also benefiting from public initiatives around data standards like Substitutable Medical Applications, Reusable Technologies on Fast Healthcare Interoperability Resources (SMART on FHIR) [53], which focuses on EHRs, or the Clinical Data Interchange Standards Consortium, which has had a substantial impact on the submission of evidence to regulatory bodies [54]. RADAR-base (Remote Assessment of Disease and Relapse) [55] grew out of the Innovative Medicine Initiative’s RADAR-CNS (RADAR in Central Nervous System Disorders) [56] and aims to generalize data integration tools and best practices. These initiatives focus both on the integration of a range of devices and data sources, including mobile apps, and the utilization of the data through standardized visualization and analysis tools. Additional examples are the data integration centers in German medical universities, which have been set up to enable use of data across research and care [57]. Establishing these centers is a “meta-collaboration” of 4 consortia funded by the German Ministry of Education and Research. The recently formed Graphite Health is a nonprofit creating solutions for better health system interoperability [58].

    Subsequent data utilization efforts bring data rights to the forefront. Who should be able to use the integrated data sets, and for what purpose? How can consenting and integration be structured such that innovation is not hindered and we remain within the ethical boundaries protecting patient rights? The FDA Sentinel Initiative combines claims data from multiple insurers, data from EHRs and patient reports provided by multiple health systems, and even some sensor technologies to evaluate the safety of medical products in the real world [59]. It combines a common data model with a distributed data architecture. Approved users are given secure, structured access to digital health data while respecting privacy and proprietary concerns. The Sentinel Initiative thus protects the data rights of organizations and individuals by keeping data with the holder while still allowing that data to be used for beneficial (eg, research) purposes. Similarly, the SELFIE Horizon 2020 consortium [60] also puts data rights at the forefront, recognizing that data integration is a key pillar of patient-centric, integrated, continuous care, while attempting to balance “preservation of individual privacy and the need for health data sharing” [28].

    What does all this mean for sensor data? To achieve real impact on patient lives, sensor data needs to be integrated and contextualized with many other data types. Concerted progress must therefore be made across digital health, and sensor data must keep up with other sources of data like EHRs and break out of condition-specific efforts.


    Sensor data that is accessible, trustworthy, and relevant

    Overcoming data integration challenges is immeasurably worthwhile. If we are to realize the potential of these new data flows to improve patient lives, then we will move toward integrated, holistic, and continuous care [28]. We will provide a smoother, less burdensome, and more valuable experience for patients. We will accelerate research and innovation, and enable the incorporation of data collected from everyday experiences to be included in decision-making. We will dovetail with more mature efforts across health care and do this using a collaborative, ethical, and multisector approach that will ensure that the potential of this data is realized for all stakeholders.

    Imagine a situation where a diabetes patient is diagnosed with chronic obstructive pulmonary disease (COPD). The patient can log medication use via an app, and securely and privately funnel activity and sleep data from their user-friendly smartwatch into their doctor’s health care systems. This data is of sufficient quality and accompanied by enough contextual information to facilitate the conversation between patient and doctor (“how have you been feeling?” becomes “I see you have been sleeping better; do you also feel better?’’), and enable better shared decision-making. Exacerbations are tracked and alerts are shared with the patient’s caregivers, which gives the patient peace of mind, and positive reinforcement to further improve this tool. The patient consents that researchers can access their data to improve the detection algorithm, and this data is later reused by a cross-industry consortium to drive qualification of a new COPD outcome.

    In oncology settings, the potential is equally appealing. Passive biometric data provides additional data points on a patient’s physical well-being, complementing patient reported outcomes and other data. Worrisome symptoms and activities can be triaged and brought to the clinical care team’s attention. With just-in-time interventions, treatment toxicities can be mitigated or managed early, reducing the downstream costs of readmissions or emergency room visits. Simple interfaces that help patients track their data and symptoms would provide positive reinforcement to support behavior changes. Properly integrated, this data can also help industry partners such as pharmaceutical companies track outcomes and treatment toxicities in clinical trials.

    A future where real-world data helps drive the health care system ultimately for preventive actions versus reactive care is a bright one. It is an environment where clinical research and care are not siloed and the data we generate can be referenced again and again, with appropriate consent, to reimagine a system informed by our physiology and how we feel, function, and survive.

    Outlook

    Integration and utilization of sensor data as part of the wider landscape of health-relevant data is still in its infancy, but progress is being made. Resolving current shortcomings will reduce burden to, and better serve, all stakeholders: patients, caregivers, clinicians, health care administrators, payers, industry partners, technology manufacturers, analytics companies, and researchers. The Sensor Data Integration Tour of Duty from DiMe includes experts from Amazon Web Services, Evidation Health, the FDA CDER and CDRH, Human First, the Institute of Electrical and Electronics Engineers, Medable, the Moffitt Cancer Center, Oracle, Open mHealth, Savvy Cooperative, Takeda, and the United States Department of Veterans Affairs. Our focus will be to examine stakeholder needs and define a framework for integrating sensor data and making it more useful for decision-making within the wider health care landscape.

    Sign up as a DiMe member to stay up to date on findings and resources from this and other projects [8], and check the DiMe e-collection of articles for relevant papers at https://jmir.org/themes/1160-digital-medicine-society-dime.

    Acknowledgments

    The authors would like to thank all the Sensor Data Integration Tour of Duty participants for their inspiring ideas, energy, and enthusiasm.

    Conflicts of Interest

    None declared.

    1. Data Integration. OmniSci, Inc. 2021.   URL: https://www.omnisci.com/technical-glossary/data-integration [accessed 2021-09-14]
    2. Peng C, Goswami P, Bai G. A literature review of current technologies on health data integration for patient-centered health management. Health Informatics J 2020 Sep;26(3):1926-1951 [FREE Full text] [CrossRef] [Medline]
    3. Haartsen J. How we made Bluetooth. Nat Electron 2018 Dec 13;1(12):661-661. [CrossRef]
    4. Zeadally S, Siddiqui F, Baig Z. 25 Years of Bluetooth Technology. Future Internet 2019 Sep 09;11(9):194. [CrossRef]
    5. PCI Security. PCI Security Standards Council.   URL: https://www.pcisecuritystandards.org/pci_security/ [accessed 2021-09-16]
    6. GTFS: Making Public Transit Data Universally Accessible. General Transit Feed Specification.   URL: https://gtfs.org/ [accessed 2021-09-16]
    7. Chapter 10 Pioneering Open Data Standards: The GTFS Story. Beyond Transparency.   URL: https://beyondtransparency.org/chapters/part-2/pioneering-open-data-standards-the-gtfs-story/ [accessed 2021-09-16]
    8. Digital Medicine Society (DiMe). Advancing digital medicine to optimize human health. 2018.   URL: https://www.dimesociety.org/ [accessed 2021-09-29]
    9. The Playbook. Digital Medicine Society (DiMe).   URL: https://playbook.dimesociety.org/ [accessed 2021-10-28]
    10. Stephenson D, Alexander R, Aggarwal V, Badawy R, Bain L, Bhatnagar R, et al. Precompetitive Consensus Building to Facilitate the Use of Digital Health Technologies to Support Parkinson Disease Drug Development through Regulatory Science. Digit Biomark 2020;4(Suppl 1):28-49 [FREE Full text] [CrossRef] [Medline]
    11. Beattie Z, Miller LM, Almirola C, Au-Yeung WM, Bernard H, Cosgrove KE, et al. The Collaborative Aging Research Using Technology Initiative: An Open, Sharable, Technology-Agnostic Platform for the Research Community. Digit Biomark 2020;4(Suppl 1):100-118 [FREE Full text] [CrossRef] [Medline]
    12. Hartl D, de Luca V, Kostikova A, Laramie J, Kennedy S, Ferrero E, et al. Translational precision medicine: an industry perspective. J Transl Med 2021 Jun 05;19(1):245 [FREE Full text] [CrossRef] [Medline]
    13. De Maria Marchiano R, Di Sante G, Piro G, Carbone C, Tortora G, Boldrini L, et al. Translational Research in the Era of Precision Medicine: Where We Are and Where We Will Go. J Pers Med 2021 Mar 18;11(3) [FREE Full text] [CrossRef] [Medline]
    14. Khan SM, Liu X, Nath S, Korot E, Faes L, Wagner SK, et al. A global review of publicly available datasets for ophthalmological imaging: barriers to access, usability, and generalisability. The Lancet Digital Health 2021 Jan;3(1):e51-e66 [FREE Full text] [CrossRef] [Medline]
    15. Mitchell WG, Dee EC, Celi LA. Generalisability through local validation: overcoming barriers due to data disparity in healthcare. BMC Ophthalmol 2021 May 21;21(1):228 [FREE Full text] [CrossRef] [Medline]
    16. Wyner Z, Dublin S, Chambers C, Deval S, Herzig-Marx C, Rao S, et al. The FDA MyStudies app: a reusable platform for distributed clinical trials and real-world evidence studies. JAMIA Open 2020 Dec;3(4):500-505 [FREE Full text] [CrossRef] [Medline]
    17. Whitelaw S, Pellegrini DM, Mamas MA, Cowie M, Van Spall HGC. Barriers and facilitators of the uptake of digital health technology in cardiovascular care: a systematic scoping review. Eur Heart J Digit Health 2021 Mar;2(1):62-74 [FREE Full text] [CrossRef] [Medline]
    18. Bent B, Goldstein BA, Kibbe WA, Dunn JP. Investigating sources of inaccuracy in wearable optical heart rate sensors. NPJ Digit Med 2020;3:18 [FREE Full text] [CrossRef] [Medline]
    19. Learning Healthcare System. The Learning Healthcare Project. 2017.   URL: http://learninghealthcareproject.org/background/learning-healthcare-system/ [accessed 2021-10-15]
    20. Goldsack JC, Coravos A, Bakker JP, Bent B, Dowling AV, Fitzer-Attas C, et al. Verification, analytical validation, and clinical validation (V3): the foundation of determining fit-for-purpose for Biometric Monitoring Technologies (BioMeTs). NPJ Digit Med 2020;3:55 [FREE Full text] [CrossRef] [Medline]
    21. Mueller A, Hoefling HA, Muaremi A, Praestgaard J, Walsh LC, Bunte O, et al. Continuous Digital Monitoring of Walking Speed in Frail Elderly Patients: Noninterventional Validation Study and Longitudinal Clinical Trial. JMIR Mhealth Uhealth 2019 Nov 27;7(11):e15191 [FREE Full text] [CrossRef] [Medline]
    22. Servais L, Camino E, Clement A, McDonald C, Lukawy J, Lowes L, et al. First Regulatory Qualification of a Novel Digital Endpoint in Duchenne Muscular Dystrophy: A Multi-Stakeholder Perspective on the Impact for Patients and for Drug Development in Neuromuscular Diseases. Digit Biomark 2021 Aug 5;5(2):183-190. [CrossRef]
    23. Lin YL, Trbovich P, Kolodzey L, Nickel C, Guerguerian A. Association of Data Integration Technologies With Intensive Care Clinician Performance: A Systematic Review and Meta-analysis. JAMA Netw Open 2019 May 03;2(5):e194392 [FREE Full text] [CrossRef] [Medline]
    24. Smart data integration along the patient pathway. Healthcare IT News. 2021 Jul 19.   URL: https://www.healthcareitnews.com/news/smart-data-integration-along-patient-pathway [accessed 2021-09-16]
    25. Goldsack JC, Dowling AV, Samuelson D, Patrick-Lake B, Clay I. Evaluation, Acceptance, and Qualification of Digital Measures: From Proof of Concept to Endpoint. Digit Biomark 2021;5(1):53-64 [FREE Full text] [CrossRef] [Medline]
    26. Brayanov J, Goldsack J, Byrom B. With Covid-19 halting clinical trials, wearables could be key — but data ‘wild west’ gets in the way. STAT. 2020 Aug 11.   URL: https:/​/www.​statnews.com/​2020/​08/​11/​with-covid-19-halting-clinical-trials-wearables-could-be-key-but-data-wild-west-gets-in-the-way/​ [accessed 2021-09-15]
    27. Melchiorre MG, Papa R, Rijken M, van Ginneken E, Hujala A, Barbabella F. eHealth in integrated care programs for people with multimorbidity in Europe: Insights from the ICARE4EU project. Health Policy 2018 Jan;122(1):53-63 [FREE Full text] [CrossRef] [Medline]
    28. Baltaxe E, Czypionka T, Kraus M, Reiss M, Askildsen JE, Grenkovic R, et al. Digital Health Transformation of Integrated Care in Europe: Overarching Analysis of 17 Integrated Care Programs. J Med Internet Res 2019 Sep 26;21(9):e14956 [FREE Full text] [CrossRef] [Medline]
    29. Ilan Y. Second-Generation Digital Health Platforms: Placing the Patient at the Center and Focusing on Clinical Outcomes. Front Digit Health 2020 Dec 3;2. [CrossRef]
    30. Eschrich S, Teer J, Reisman P, Siegel E, Challa C, Lewis P, et al. Enabling Precision Medicine in Cancer Care Through a Molecular Data Warehouse: The Moffitt Experience. JCO Clinical Cancer Informatics 2021 Jun(5):561-569. [CrossRef]
    31. IEEE. 1752.1-2021 - IEEE Standard for Open Mobile Health Data—Representation of Metadata, Sleep, and Physical Activity Measures. IEEE Std 1752.1-2021 2021:1-24 [FREE Full text] [CrossRef]
    32. Ventresca M, Schünemann HJ, Macbeth F, Clarke M, Thabane L, Griffiths G, et al. Obtaining and managing data sets for individual participant data meta-analysis: scoping review and practical guide. BMC Med Res Methodol 2020 May 12;20(1):113 [FREE Full text] [CrossRef] [Medline]
    33. Shandhi M, Goldsack J, Ryan K, Bennion A, Kotla A, Feng A, et al. Recent Academic Research on Clinically Relevant Digital Measures: Systematic Review. J Med Internet Res 2021 Sep 15;23(9):e29875 [FREE Full text] [CrossRef] [Medline]
    34. Proudlock D. Quality Generation & Ethical Use of Digital Health Data in Clinical Studies. Pistoia Alliance. 2020.   URL: https://www.pistoiaalliance.org/projects/current-projects/digital-health-data-in-clinical-studies/ [accessed 2021-10-11]
    35. FAIR Principles. FAIR. 2017.   URL: https://www.go-fair.org/fair-principles/ [accessed 2021-09-15]
    36. Wilkinson MD, Sansone S, Schultes E, Doorn P, Bonino da Silva Santos LO, Dumontier M. A design framework and exemplar metrics for FAIRness. Sci Data 2018 Jun 26;5:180118 [FREE Full text] [CrossRef] [Medline]
    37. Koers H, Bangert D, Hermans E, van Horik R, de Jong M, Mokrane M. Recommendations for Services in a FAIR Data Ecosystem. Patterns (N Y) 2020 Aug 14;1(5):100058 [FREE Full text] [CrossRef] [Medline]
    38. Labrique AB, Wadhwani C, Williams KA, Lamptey P, Hesp C, Luk R, et al. Best practices in scaling digital health in low and middle income countries. Global Health 2018 Nov 03;14(1):103 [FREE Full text] [CrossRef] [Medline]
    39. Weber S, Heitmann KU. [Interoperability in healthcare: also prescribed for digital health applications (DiGA)]. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz 2021 Oct;64(10):1262-1268 [FREE Full text] [CrossRef] [Medline]
    40. Abbas A, Schultebraucks K, Galatzer-Levy I. Digital Measurement of Mental Health: Challenges, Promises, and Future Directions. Psychiatric Annals 2021 Jan;51(1):14-20. [CrossRef]
    41. Alterovitz G, Heale B, Jones J, Kreda D, Lin F, Liu L, et al. FHIR Genomics: enabling standardization for precision medicine use cases. NPJ Genom Med 2020;5:13 [FREE Full text] [CrossRef] [Medline]
    42. Jensen MA, Ferretti V, Grossman RL, Staudt LM. The NCI Genomic Data Commons as an engine for precision medicine. Blood 2017 Jul 27;130(4):453-459 [FREE Full text] [CrossRef] [Medline]
    43. Villanueva AG, Cook-Deegan R, Robinson JO, McGuire AL, Majumder MA. Genomic Data-Sharing Practices. J Law Med Ethics 2019 Mar;47(1):31-40 [FREE Full text] [CrossRef] [Medline]
    44. Huang S, Chaudhary K, Garmire LX. More Is Better: Recent Progress in Multi-Omics Data Integration Methods. Front Genet 2017;8:84 [FREE Full text] [CrossRef] [Medline]
    45. Coravos A, Doerr M, Goldsack J, Manta C, Shervey M, Woods B, et al. Modernizing and designing evaluation frameworks for connected sensor technologies in medicine. NPJ Digit Med 2020;3:37 [FREE Full text] [CrossRef] [Medline]
    46. Press G. Centaur Labs Gets $15 Million To Improve Data For Health care AI. Forbes. 2021 Sep 3.   URL: https:/​/www.​forbes.com/​sites/​gilpress/​2021/​09/​03/​centaur-labs-gets-15-million-to-improve-data-for-healthcare-ai/​?sh=251eb12863a0 [accessed 2021-09-10]
    47. Roche completes acquisition of Flatiron Health. F Hoffmann-La Roche Ltd. 2018 Apr 6.   URL: https://www.roche.com/media/releases/med-cor-2018-04-06.htm [accessed 2021-09-10]
    48. Mijuk G. The data42 program shows Novartis’ intent to go big on data and digital. Novartis. 2020 Mar 11.   URL: https:/​/www.​novartis.com/​stories/​discovery/​data42-program-shows-novartis-intent-go-big-data-and-digital [accessed 2021-09-10]
    49. Synapse Digital Health Portal. Synapse.   URL: https://dhealth.synapse.org/ [accessed 2021-09-10]
    50. Zenodo - Research.   URL: https://zenodo.org/ [accessed 2021-09-15]
    51. OpenAIRE.   URL: https://www.openaire.eu/ [accessed 2021-09-15]
    52. COVID-19 Evidence Accelerator.   URL: https://www.evidenceaccelerator.org/ [accessed 2021-09-16]
    53. Mandel JC, Kreda DA, Mandl KD, Kohane IS, Ramoni RB. SMART on FHIR: a standards-based, interoperable apps platform for electronic health records. J Am Med Inform Assoc 2016 Sep 17;23(5):899-908 [FREE Full text] [CrossRef] [Medline]
    54. CDISC.   URL: https://www.cdisc.org/ [accessed 2021-09-29]
    55. RADAR-base. 2018.   URL: https://radar-base.org/ [accessed 2021-09-29]
    56. RADAR-CNS: Remote Assessment of Disease and Relapse in Central Nervous System Disorders. Innovative Medicine Initiative.   URL: http://www.imi.europa.eu/projects-results/project-factsheets/radar-cns [accessed 2021-09-10]
    57. Data integration centres. Medical Informatics Initiative Germany.   URL: https://www.medizininformatik-initiative.de/en/consortia/data-integration-centres [accessed 2021-09-16]
    58. Graphite Health. 2021.   URL: https://www.graphitehealth.io/ [accessed 2021-10-11]
    59. Sentinel Initiative.   URL: https://www.sentinelinitiative.org/ [accessed 2021-09-16]
    60. Leijten FRM, Struckmann V, van Ginneken E, Czypionka T, Kraus M, Reiss M, SELFIE consortium. The SELFIE framework for integrated care for multi-morbidity: Development and description. Health Policy 2018 Jan;122(1):12-22 [FREE Full text] [CrossRef] [Medline]

    ‎
    CDER: Center for Drug Evaluation and Research
    CDRH: Center for Devices and Radiological Health
    COPD: chronic obstructive pulmonary disease
    DiMe: Digital Medicine Society
    EHR: electronic health record
    FDA: Food and Drug Administration
    RADAR: Remote Assessment of Disease and Relapse
    RADAR-CNS: RADAR in Central Nervous System Disorders
    SMART on FHIR: Substitutable Medical Applications, Reusable Technologies on Fast Healthcare Interoperability Resources

    Edited by G Eysenbach; This is a non–peer-reviewed article. submitted 26.10.21; accepted 27.10.21; published 09.11.21

    Copyright

    ©Ieuan Clay, Christian Angelopoulos, Anne Lord Bailey, Aaron Blocker, Simona Carini, Rodrigo Carvajal, David Drummond, Kimberly F McManus, Ingrid Oakley-Girvan, Krupal B Patel, Phillip Szepietowski, Jennifer C Goldsack. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 09.11.2021.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.