Published on in Vol 20, No 4 (2018): April

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/9477, first published .
Identifying Unmet Treatment Needs for Patients With Osteoporotic Fracture: Feasibility Study for an Electronic Clinical Surveillance System

Identifying Unmet Treatment Needs for Patients With Osteoporotic Fracture: Feasibility Study for an Electronic Clinical Surveillance System

Identifying Unmet Treatment Needs for Patients With Osteoporotic Fracture: Feasibility Study for an Electronic Clinical Surveillance System

Original Paper

1Graduate Institute of Biomedical Electronics and Bioinformatics, National Taiwan University, Taipei, Taiwan

2Department of Pharmacy, National Taiwan University Hospital, Taipei, Taiwan

3Graduate Institute of Clinical Pharmacy, College of Medicine, National Taiwan University, Taipei, Taiwan

4School of Pharmacy, College of Medicine, National Taiwan University, Taipei, Taiwan

5Information Technology Office, National Taiwan University Hospital, Taipei, Taiwan

6Department of Development and Planning, National Taiwan University Hospital, Taipei, Taiwan

7Department of Internal Medicine, National Taiwan University Hospital, Taipei, Taiwan

8Department of Internal Medicine, National Taiwan University Hospital Hsinchu Branch, Hsinchu, Taiwan

9Institute of Epidemiology and Preventive Medicine, College of Public Health, National Taiwan University, Taipei, Taiwan

10Department of Computer Science & Information Engineering, National Taiwan University, Taipei, Taiwan

11Department of Electrical Engineering, National Taiwan University, Taipei, Taiwan

*these authors contributed equally

Corresponding Author:

Chih-Fen Huang, PhD

Department of Pharmacy

National Taiwan University Hospital

33 Linsen S. Rd

Taipei, 10050

Taiwan

Phone: 886 223562162

Fax:886 223310930

Email: cfhuang1023@ntu.edu.tw


Background: Traditional clinical surveillance relied on the results from clinical trials and observational studies of administrative databases. However, these studies not only required many valuable resources but also faced a very long time lag.

Objective: This study aimed to illustrate a practical application of the National Taiwan University Hospital Clinical Surveillance System (NCSS) in the identification of patients with an osteoporotic fracture and to provide a high reusability infrastructure for longitudinal clinical data.

Methods: The NCSS integrates electronic medical records in the National Taiwan University Hospital (NTUH) with a data warehouse and is equipped with a user-friendly interface. The NCSS was developed using professional insight from multidisciplinary experts, including clinical practitioners, epidemiologists, and biomedical engineers. The practical example identifying the unmet treatment needs for patients encountering major osteoporotic fractures described herein was mainly achieved by adopting the computerized workflow in the NCSS.

Results: We developed the infrastructure of the NCSS, including an integrated data warehouse and an automatic surveillance workflow. By applying the NCSS, we efficiently identified 2193 patients who were newly diagnosed with a hip or vertebral fracture between 2010 and 2014 at NTUH. By adopting the filter function, we identified 1808 (1808/2193, 82.44%) patients who continued their follow-up at NTUH, and 464 (464/2193, 21.16%) patients who were prescribed anti-osteoporosis medications, within 3 and 12 months post the index date of their fracture, respectively.

Conclusions: The NCSS systems can integrate the workflow of cohort identification to accelerate the survey process of clinically relevant problems and provide decision support in the daily practice of clinical physicians, thereby making the benefit of evidence-based medicine a reality.

J Med Internet Res 2018;20(4):e142

doi:10.2196/jmir.9477

Keywords



Clinical surveillance can provide information on disease prognosis and postmarketing medication safety, which helps researchers identify potential clinical issues [1,2]. We describe the development and implementation of a Web-based National Taiwan University Hospital Clinical Surveillance System (NCSS) that is an interoperable, reusable, and scalable platform for collaborative data sharing using the ASP.Net framework (Microsoft, WA, USA).

Traditional clinical surveillance relied on the results from clinical trials and observational studies of administrative databases. However, these studies not only required a lot of valuable resources but also faced a very long time lag. Several studies [3-15] have described the difficulty of reducing gaps between clinical research needs and proper data management technique. Therefore, we aimed to develop an automated system with the capability to use routinely collected electronic health care data to support clinical surveillance is an important issue.

The National Taiwan University Hospital launched a new 3-year strategic plan to build the NCSS in 2015. Therefore, we reviewed the literature to gain insights into the challenges of cross-networking, patient privacy, user-friendliness, and reusability (Table 1). To achieve data harmonization, we referenced the common data model from the Sentinel [4,5]. In addition, the PCORnet [3,9] developed a common data model derived from the Sentinel [4,5] to support the development of an analyzable research database that enhanced the performance of a cross-networking query. We now need to consider the system architectural and data management structures. The Research Electronic Data Capture [14] developed reusable tools for project-specific clinical and translational research data. We found that the design of the Stanford Translational Research Integrated Database Environment [15] for an anonymous patient cohort discovery tool provides a flexible research data management solution. In addition, the Integrating Biology and the Bedside [13] proposed a self-scaling, interoperable platform for collaborative data sharing. Finally, the Observational Health Data Sciences and Informatics is an international collaboration on open-source data analytic solutions [12].

Nonetheless, only a few successful efforts for high reusability and computerized workflow infrastructure have been accomplished in Taiwan to date. Therefore, we decided to implement a Web-based clinical surveillance system extensible to interdisciplinary collaboration and data sharing.

Our efforts are based on 2 highly diffusible, highly reusable, and thin client architectures for research network. The platform provides a high reusability infrastructure for a computerized workflow that captures relevant longitudinal clinical data and makes those data repositories reusable. Finally, the platform has been used for multi-municipality surveillance.

Table 1. Literature summary on electronic clinical surveillance, sorted by year of publication.
AuthorYearMain conceptCountry
Brown et al [4,5]2010Data harmonizationUnited States
Obeid et al [14]2013Reusable tools for project-specific clinical and translational research dataInternational
Natter et al [13]2013A self-scaling, interoperable platform for collaborative data sharingUnited States
Lowe et al [15]2014An anonymous patient cohort discovery tool and data management solutionUnited States
Waitman et al [3] and Fleurence et al [9]2014An analyzable research database that enhanced performance of a cross-networking queryUnited States
Hripcsak et al [12]2015An international collaboration on open-source data analytic solutionsInternational

Data Warehouse

The NCSS integrates a database of electronic medical records at National Taiwan University Hospital (NTUH), which is a medical center in Taiwan with over 2000 beds. The clinical data models were built using an Oracle 11g relational database; included the demographics, diagnosis, pharmacies, procedures, laboratories, and death records; and were implemented into the data warehouse process.

The data warehouse process is the collection of electronic medical records from the Integrated Medical Database (IMDB) through scheduling using an extraction, transformation, and loading tool. We refreshed the database during nonbusiness hours using 3 steps. First, the system extracted data changes by comparing the time difference with IMDB. Second, personal identifiable information was fully anonymized. Finally, the data are synchronized back to the IMDB with a timestamp. This data warehouse provides a data access infrastructure for the NCSS.

Workflow

We aimed to present a Web-based NCSS for clinical surveillance in a secure, efficient, and interoperable platform. The NCSS used ASP.Net framework (version 4.5, Microsoft) for Web development and cloud batch process. The NCSS is configured to run using load balancing, including failover modes, to secure the system’s availability and scalability. Firewalls were also installed to enhance the security of the NCSS. In addition, all queries were audited and logged, which assures compliance with institutional review board and other regulatory protections for subjects.

We designed thin client architecture so that the researchers can focus on the research design. After setting the parameters on the webpage, the researcher can leave the large computing delegate to cloud. Therefore, the researchers do not need to own a good performance of the computer and lower the computation of big data of barriers. The overall workflow of the NCSS is depicted in Figure 1.

Stage 1. Build a Template of Clinical Orders

The process supports the end user, typically a clinical researcher, to predefine a template of clinical orders using a Clinical Orders Navigator on the client side. The researcher can browse and search different dimensions, such as the diagnosis (International Classification of Diseases, ICD-9 or ICD-10), pharmacy (anatomical therapeutic chemical code), procedure, and laboratory in the integrated interface. The details of Clinical Orders Navigator are provided in Multimedia Appendix 1.

The stage can help clinical researchers build a protocol-based standardized process and save those clinical orders and specific guidelines to the database. The creator of the templates can choose to commit them to Template Library publicly. All templates submitted to the public Template Library will be reviewed by clinical professionals to ensure the quality and accuracy. All researchers can create their own template or use the open template applied to the Identification process.

Stage 2. Patient Identification

The stage of patient identification includes matching of the clinical needs to the optimal cohort study. The stage contains 5 processes, consisting of identification, REC (Research Institutional Ethics Committee) verify, cloud batch process, data mart of patient level, and report service.

  1. Identification: We developed an electronic form to meet the cohort study flow that contains 2 setting as input as follows (when researchers finished the electronic form, the system will save that setting to the database and generate a universally unique identifier as case number of this setting.):
    • Basic setting: In this step, the researcher fills the surveillance topic, and the duration of observation from a particular data source, such as outpatient, admission, and emergency. In addition, this setting also supports the selection of specific patient list from data mart (patient level).
    • Order setting: In this step, the researcher chooses the order setting in Clinical Orders Navigator. The clinical orders can be in different dimensions, such as the diagnosis, pharmacy, procedure, and laboratory. For example, a disease can be defined using several diagnosis codes, such as hip or vertebral fractures, including ICD-9-codes 820, 805, and 806 in the Template Library. The researchers can reuse these templates as include or exclude criteria to design their study flow.
  2. REC verify: All settings of Identification need to be been verified by REC. If the setting had been authorized, it will add a task to the Task Queue for cloud batch process in server side.
  3. Cloud batch process: The cloud batch process maintains a Task Queue. Every task will be executed follow First-In-First-Out mechanism in batch server that read the eligible patients in IMDB. The batch process also records the cost of each query and the number of patients identified. After completion of the task, the patient list will be stored into the database and a mail notification is will be sent to the researchers.
  4. Data mart (patient level): The data mart is a collection of the patient list that presents the result of every identification process. The researcher can adopt a patient list from data mart as their patient data source to query the next Identification process. Therefore, the identification process can support a hierarchical structure. This means that the process can generate a new study population based on a previous screening result. The researchers can reuse these patient lists to design a cohort study or case control study in fine-grained categorization.
  5. Report service: The report service contains 3 views of summary statistics for patient list in data mart as follows:
    • View of characteristics: The view is a demographic summary that helps clarify the characteristics for the patient list, for example, the descriptive statistics of age, gender, body mass index (BMI), and income level.
    • View of longitudinal incidence trend: The view presents incidence trend by time series chart and provides a real-time interactive query by time interval, including monthly, quarterly, or yearly.
    • View of source record: The view presents the number of included/excluded patients in every Identification process. If the patient list contains a hierarchical structure that runs the process of identification more than once, the report service can track all results of identification in the aggregation table.
Figure 1. System workflow of the National Taiwan University Hospital Clinical Surveillance System (NCSS). REC: Research Institutional Ethics Committee.
View this figure

A Practical Example of a Clinical Application of the National Taiwan University Hospital Clinical Surveillance System in the Identification of Osteoporotic Fracture Patients

For a practical example of a clinical application of the NCSS, we looked at the identification of osteoporotic fracture patients and their utilization in pharmacological therapy. Osteoporotic fractures, a major consequence of osteoporosis, are associated with a high mortality rate, increased risk of re-fracture, and poor quality of life, and incur heavy economic burden on the society.

According to a report from the Global Burden of Disease Study project, the global burden of osteoporosis-related problems has doubled in the past two decades and has shown a continuous increase in recent years. In 2016, 441,230 documented deaths could be attributed to osteoporosis-related problems [16,17].

In the United States, the direct economic burden of osteoporotic fractures was approximately US $17 billion in 2005, and is projected to increase 50% by 2025 [18]. Fortunately, the safety and efficacy of anti-osteoporosis medications (AOMs) used by patients with established osteoporotic fractures have been ascertained [19-23]. However, despite the readily available and effective treatment for osteoporosis, a care gap between established osteoporotic fractures and the pharmacological prevention of subsequent fractures is still being discussed worldwide [24-27]. We aimed to identify the unmet treatment needs for patients encountering major osteoporotic fractures with the NTUH-based clinical surveillance system.

Using NCSS as our data source, we identified patients newly diagnosed with a hip (ICD-9-code 820) or vertebral fracture (ICD-9-codes 805 and 806) between 2010 and 2014 as our study subjects, and defined them as patients requiring treatment. The initial diagnosis date of a hip or vertebral fracture was defined as the index date of the study subject. Patients under 50 years of age; with a diagnosis of malignant neoplasm (ICD-9-code 140-208), osteoporotic fracture (ICD-9-codes 820, 805, and 806), or Paget disease (ICD-9-code 731.0); or who had been prescribed AOMs within 1 year before the index date were excluded. Among them, we investigated the prescription pattern of the AOMs by distinguishing patients into those who began taking an AOM within 1 year after the index date, and those who did not. The AOMs evaluated in this study included alendronate, zolendronate, ibandronate, denosumab, raloxifene, teriparatide, estradiol valerate, conjugated estrogens, and calcitonin. The system setting of the identification process used by the NCSS, the demographics of the study population, and the treatment pattern of the study population were presented quarterly.


The NCSS design uses a protocol-based standardized process of incremental development, testing, and deployment to meet specific clinical needs. We demonstrated a practical example of identifying the unmet treatment needs for patients encountering major osteoporotic fractures and implemented the hierarchical study population using the NCSS, as depicted in Figure 2.

We initially selected older patients diagnosed with a hip or vertebral fracture between 2010 and 2014. By adopting the identification and filter function of the NCSS, patients with a history of malignant neoplasm (n=557), or osteoporotic vertebral and hip fracture (n=1769) within 1 year before the index date, were excluded. In addition, to identify a new AOM user, we excluded 179 patients with an AOM prescription before the index date. We identified 2193 incidence cases for hip or vertebral fractures within the period of 2010-2014. These patients were defined as “patients requiring treatment” according to the current treatment guidelines. In addition, in the Report Service, we used visualization tools for displaying the summary statistics for each patient list. This is depicted in Figure 3.

To ensure those participants are having a continuous follow-up, we excluded 385 patients who had not visited the hospital within 3 months after the index date. We enrolled in the study 1808 patients who had continued to follow-up at NTUH within 3 months post the index date of their fracture. To investigate the prescription pattern of the AOMs, we established 2 groups that were classified based on their AOM prescription date, and by adopting a filter function, we identified 1808 (1808/2193, 82.44%) patients who continued to follow-up at NTUH, and 464 (464/2193, 21.16%) patients prescribed with an AOM, within 3 and 12 months post the index date of their fracture, respectively.

The NCSS provided a summary of the baseline characteristics of the study population including gender, age, BMI, socioeconomic status, occupation types, and marital status, as shown in Figure 4. For example, among the patients who began taking an AOM within 1 year after the index date, their mean age was 76.47 (SD 10.10) and their mean BMI was 22.95 (SD 3.86) kg/m2; in addition, the proportion of females was 82.7% (384/464). This population showed a high proportion of married patients 71.98% (334/464) with a normal income level 99.8% (463/464). NCSS provided information regarding the drug utilization of AOMs for the study population.

The longitudinal trends of patients newly diagnosed with an osteoporotic fracture and those who began taking an AOM within 1 year after the index date of their fracture are illustrated in Figure 5. For example, taking the information from Figure 5, we found that there were approximately 130 newly diagnosed osteoporotic fracture patients continuing their follow-up at NTUH in Quarter 4 2014, and among them, 42 (42/130, 32.3%) began taking an AOM within 1 year post the index date of their fracture.

Furthermore, the NCSS provides the choice of information stratification based on gender, index date, fracture type, and other types of information, which can be provided monthly, quarterly, and yearly, thereby increasing the flexibility of the clinical interpretation. For example, as shown in part (b) of Figure 5, there were 87 female and 43 male fracture patients in 2014 Q4, and among them, 30 (30/87, 35%) females and 12 (28%, 12/43) males began taking an AOM within 1 year post the index date of their fracture. Information on patients with different fracture types can be seen in part (c) of Figure 5.

Figure 2. Study flowchart implemented by National Taiwan University Hospital Clinical Surveillance System (NCSS). Each identification process had been assigned a universally unique identifier with a case number (marked by the blue background, such as 73, F124, F133, F134, F135, F136, and F137). The case number with an F as a prefix stands for its’ own hierarchical structure. NTUH: National Taiwan University Hospital; AOMs: anti-osteoporosis medications.
View this figure
Figure 3. Snapshot of a source record in National Taiwan University Hospital Clinical Surveillance System (NCSS). Through the source record, we can get the number of included (and excluded) patients and the data source (patient list).
View this figure
Figure 4. Snapshot of Report of characteristics in the National Taiwan University Hospital Clinical Surveillance System (NCSS).
View this figure
Figure 5. Snapshot of the quarterly report for incidence trend of drug utilization of study cohorts.
View this figure

Principal Findings

To the best of our knowledge, NCSS is a pioneering electronic clinical surveillance system in its attempt to organize decision-making activities and facilitate the standard-based process for clinical needs in Taiwan. In this study, we demonstrated a practical example of an NCSS application. We can efficiently and correctly gather information on those patients requiring disease treatment and understand their treatment patterns, as well as identify any unmet treatment requirements in the hospital.

Through this practical example, we found that the pharmacological treatment rate of patients with an osteoporotic fracture is suboptimal at NTUH. On average, only 35% (30/87) of female and 28% (12/43) of male osteoporotic fracture patients initiated AOM therapy to prevent a subsequent fracture. More effort is warranted to improve the quality of care for these patients.

Limitations

Studies from a hospital-wide database require less time for data collection and can achieve a faster response to meet the needs of clinical research. However, there is a certain limitation to this study, that is, bias in the estimates may exist because it is difficult to determine whether the patient in a hospital-wide database is suffering from such injury for the first time.

Comparison With Prior Work

Clinical surveillance systems have been widely implemented [13,15,28], and studies have demonstrated the use of various algorithms to identify potential research patient cohorts. There are several important core concepts to our research, including access to clinical data for research purposes, the design of a flexible research data management solution, and clarifying the characteristics of each study population. However, previous studies [8,9,13,15] have not proposed how to integrate a protocol-based process in the building of a cohort discovery. The clinical surveillance systems should also have the capability to bring guidelines to the clinical practitioners. The NCSS integrates the workflow of cohort identification to accelerate the survey process based on certain guidelines. In particular, for quality assurance, clinical researchers or medical policy makers need to monitor specific quality indicators to ensure the quality of patient care. They can focus on clinical needs to achieve a continuous process integration using standardized NCSS templates. The different clinical contexts can be refined using a new scaffold to meet clinical needs based on the original standardized templates. In fact, different methodologies of capturing cases of patients would result in disparate estimates of incidence or mortality. For example, in the case on sepsis identification, there are four methods available, [29-32] including Angus et al, Martin et al, Dombrovskiy et al, and Wang et al. We believe this clinical knowledge should be preserved and converted into a shareable template for a collaborative research network. These templates can be quickly searched and reused for inclusion/exclusion criteria of patient identification in the Template Library. Therefore, the researchers can embrace change courageously because they only need to focus on any existing differences. More importantly, these processes should be conceptualized as continuous organizational efforts to lead to self-organizing innovation of the NCSS.

The hierarchical structure of the system design has not been proposed for system reusability. We designed a mechanism for reusing the patient list in data mart. We believe this identified list of patients can be reused by other researchers, especially for the design of a subgroup study, a case control study, or a similar context of research. To better interpret the process of identification of each patient list, we designed a hierarchical structure where each patient list could be traced back to its patient data source and researchers could compare every patient data source with characteristics and longitudinal incidence trend in the Report Service. This innovative method allows dynamically generating a clinical data mart and reduces the computation overhead through the reuse of the same patient list. This design can inspire researchers and allow them to focus on the research design rather than data processing.

Until 2017, the NCSS has been well constructed and continuously improving. The active users of NCSS are now in the form of research teams. These teams consist of multidisciplinary specialties such as a clinical doctor, pharmacist, epidemiologist, bio-medical engineer, and research assistants. Several research teams have been adopting the NCSS to improve the problem-solving process of their relevant clinical issue. This includes cardiovascular, diabetic, renal, liver, neurologic, and orthopedic medical teams. Each team consists of 5-7 people. These research teams regularly hold monthly meetings to discuss the problems related to the application of NCSS. In the period between 2015 and 2017, dozens of cohorts were created by each research team. Moreover, a large sum of meaningful feedback has been received for not only the problem related to using the NCSS but also recommendations for improving the NCSS. For example, the cardiovascular research team raised the problem of using different brands of drugs during different periods. Therefore, we retrieved the relevant drug products available and used in 2014 as well as 2004. This modification allows the research to more precisely capture and study the drug exposure across a population. The orthopedic research team also revealed the problems regarding the inconsistent days listed for a prescription and the pharmacological duration of the prescription. Some medication has a 1 year of effect duration; however, the prescription was recorded for only 1 day. Therefore, the NCSS modified the duration according to each drug property to correct the measurement of exposure. Finally, we accomplished the assistant resources such as the user handbook and Web-based video tutorials. This helps the research team readily assess the NCSS. These application experiences and associated feedback help to improve the NCSS efficiency and quality of clinical research at NTUH.

Future Work

The identification of the problem is the first step to solving and improving the clinical outcome of the patient. By applying computerized patient identification derived from the NCSS, we can create the infrastructure of an informatics system at NTUH. Furthermore, we can provide decision support in daily practice, thereby making the benefit of evidence-based medicine a reality. In fact, we believe that the best way to promote medical care is to provide relevant evidence to assist doctors in their decision-making process during their clinical daily practice. For example, an evaluation of the longitudinal trends of health care utilization can help create a baseline, track progress over time, and generate real-world evidence. Besides providing clinical support for physicians, the next step will be providing integrated real-time, interactive, and personalized support to individual patients [33,34]. This will be focused on in a future study. Finally, we strongly advocate developing a consistent strategy, as well as celebrating success and continuously sharing different experiences. The continual reduction in the gap between evidence and practice is an ongoing journey and not an end that can be simply reached shortly after the NCSS is implemented.

Conclusions

The results of this study confirm that the NCSS is an efficient electronic clinical surveillance system that can integrate the workflow of cohort identification to accelerate the survey process of disease and medication prescription patterns. The NCSS can serve the critical role of gathering data and making associations between evidence and practice in a rapid fashion, and can be a support system for researchers who wish to confirm certain clinical issues as well as for those requiring a computerized system to complete their studies. Finally, the NCSS can provide decision support in the daily practice of clinical physicians and make the benefit of evidence-based medicine a reality.

Acknowledgments

This research received an Asia number one plan grant from National Taiwan University Hospital. This work was supported by National Taiwan University Hospital grant numbers 104-A129, 105-A129, and 106-A129.

Authors' Contributions

FL built the clinical surveillance system and was part of the final draft writing. CW designed the study, interpreted the results, and wrote the draft. CH and FH conceptualized and designed the study, interpreted the data, and critically revised the manuscript. All authors helped to critically review and revise the manuscript and approved the final version.

Conflicts of Interest

None declared.

Multimedia Appendix 1

A real-world use‐case deployed at National Taiwan University Hospital Clinical Surveillance System.

PDF File (Adobe PDF File), 1MB

  1. Linder JA, Ma J, Bates DW, Middleton B, Stafford RS. Electronic health record use and the quality of ambulatory care in the United States. Arch Intern Med 2007 Jul 09;167(13):1400-1405. [CrossRef] [Medline]
  2. Classen DC, Bates DW. Finding the meaning in meaningful use. N Engl J Med 2011 Sep 01;365(9):855-858. [CrossRef] [Medline]
  3. Waitman LR, Aaronson LS, Nadkarni PM, Connolly DW, Campbell JR. The Greater Plains Collaborative: a PCORnet Clinical Research Data Network. J Am Med Inform Assoc 2014 Jul;21(4):637-641 [FREE Full text] [CrossRef] [Medline]
  4. Brown J, Syat B, Lane K, Platt R. Effective Health Care AHRQ. 2010 Jun 23. Blueprint for a distributed research network to conduct population studies and safety surveillance   URL: https://effectivehealthcare.ahrq.gov/topics/distributed-network-blueprint/research/ [accessed 2018-03-27] [WebCite Cache]
  5. Brown JS, Holmes JH, Shah K, Hall K, Lazarus R, Platt R. Distributed health data networks: a practical and preferred approach to multi-institutional evaluations of comparative effectiveness, safety, and quality of care. Med Care 2010 Jun;48(6 Suppl):S45-S51. [CrossRef] [Medline]
  6. Curtis LH, Weiner MG, Boudreau DM, Cooper WO, Daniel GW, Nair VP, et al. Design considerations, architecture, and use of the Mini-Sentinel distributed data system. Pharmacoepidemiol Drug Saf 2012 Jan;21(Suppl 1):23-31. [CrossRef] [Medline]
  7. Behrman RE, Benner JS, Brown JS, McClellan M, Woodcock J, Platt R. Developing the Sentinel System--a national resource for evidence development. N Engl J Med 2011 Feb 10;364(6):498-499. [CrossRef] [Medline]
  8. Ferranti JM, Gilbert W, McCall J, Shang H, Barros T, Horvath MM. The design and implementation of an open-source, data-driven cohort recruitment system: the Duke Integrated Subject Cohort and Enrollment Research Network (DISCERN). J Am Med Inform Assoc 2012 Jun;19(e1):e68-e75 [FREE Full text] [CrossRef] [Medline]
  9. Fleurence RL, Curtis LH, Califf RM, Platt R, Selby JV, Brown JS. Launching PCORnet, a national patient-centered clinical research network. J Am Med Inform Assoc 2014 Jul;21(4):578-582 [FREE Full text] [CrossRef] [Medline]
  10. Zerhouni EA. US biomedical research: basic, translational, and clinical sciences. JAMA 2005 Sep 21;294(11):1352-1358. [CrossRef] [Medline]
  11. Sung NS, Crowley Jr WF, Genel M, Salber P, Sandy L, Sherwood LM, et al. Central challenges facing the national clinical research enterprise. JAMA 2003 Mar 12;289(10):1278-1287. [Medline]
  12. Hripcsak G, Duke JD, Shah NH, Reich CG, Huser V, Schuemie MJ, et al. Observational Health Data Sciences and Informatics (OHDSI): Opportunities for Observational Researchers. Stud Health Technol Inform 2015;216:574-578 [FREE Full text] [Medline]
  13. Natter MD, Quan J, Ortiz DM, Bousvaros A, Ilowite NT, Inman CJ, et al. An i2b2-based, generalizable, open source, self-scaling chronic disease registry. J Am Med Inform Assoc 2013 Jan 01;20(1):172-179 [FREE Full text] [CrossRef] [Medline]
  14. Obeid JS, McGraw CA, Minor BL, Conde JG, Pawluk R, Lin M, et al. Procurement of shared data instruments for Research Electronic Data Capture (REDCap). J Biomed Inform 2013 Apr;46(2):259-265 [FREE Full text] [CrossRef] [Medline]
  15. Lowe HJ, Ferris TA, Hernandez PM, Weber SC. STRIDE--An integrated standards-based translational research informatics platform. AMIA Annu Symp Proc 2009 Nov 14;2009:391-395 [FREE Full text] [Medline]
  16. Sànchez-Riera L, Carnahan E, Vos T, Veerman L, Norman R, Lim SS, et al. The global burden attributable to low bone mineral density. Ann Rheum Dis 2014 Sep;73(9):1635-1645. [CrossRef] [Medline]
  17. GBD 2016 Risk Factors Collaborators. Global, regional, and national comparative risk assessment of 84 behavioural, environmental and occupational, and metabolic risks or clusters of risks, 1990-2016: a systematic analysis for the Global Burden of Disease Study 2016. Lancet 2017 Sep 16;390(10100):1345-1422 [FREE Full text] [CrossRef] [Medline]
  18. Burge R, Dawson-Hughes B, Solomon DH, Wong JB, King A, Tosteson A. Incidence and economic burden of osteoporosis-related fractures in the United States, 2005-2025. J Bone Miner Res 2007 Mar;22(3):465-475 [FREE Full text] [CrossRef] [Medline]
  19. Cosman F, de Beur SJ, LeBoff MS, Lewiecki EM, Tanner B, Randall S, National Osteoporosis Foundation. Clinician's Guide to Prevention and Treatment of Osteoporosis. Osteoporos Int 2014 Oct;25(10):2359-2381 [FREE Full text] [CrossRef] [Medline]
  20. Compston J, Cooper A, Cooper C, Francis R, Kanis JA, Marsh D, National Osteoporosis Guideline Group (NOGG). Guidelines for the diagnosis and management of osteoporosis in postmenopausal women and men from the age of 50 years in the UK. Maturitas 2009 Feb 20;62(2):105-108. [CrossRef] [Medline]
  21. Watts NB, Bilezikian JP, Camacho PM, Greenspan SL, Harris ST, Hodgson SF, AACE Osteoporosis Task Force. American Association of Clinical Endocrinologists Medical Guidelines for Clinical Practice for the diagnosis and treatment of postmenopausal osteoporosis. Endocr Pract 2010;16(Suppl 3):1-37 [FREE Full text] [Medline]
  22. Orimo H, Nakamura T, Hosoi T, Iki M, Uenishi K, Endo N, et al. Japanese 2011 guidelines for prevention and treatment of osteoporosis--executive summary. Arch Osteoporos 2012;7:3-20 [FREE Full text] [CrossRef] [Medline]
  23. Hwang JS, Chan DC, Chen JF, Cheng TT, Wu CH, Soong YK, et al. Clinical practice guidelines for the prevention and treatment of osteoporosis in Taiwan: summary. J Bone Miner Metab 2014 Jan;32(1):10-16. [CrossRef] [Medline]
  24. Formiga F, Rivera A, Nolla JM, Coscujuela A, Sole A, Pujol R. Failure to treat osteoporosis and the risk of subsequent fractures in elderly patients with previous hip fracture: a five-year retrospective study. Aging Clin Exp Res 2005 Apr;17(2):96-99. [Medline]
  25. Rabenda V, Vanoverloop J, Fabri V, Mertens R, Sumkay F, Vannecke C, et al. Low incidence of anti-osteoporosis treatment after hip fracture. J Bone Joint Surg Am 2008 Oct;90(10):2142-2148. [CrossRef] [Medline]
  26. Wilk A, Sajjan S, Modi A, Fan CP, Mavros P. Post-fracture pharmacotherapy for women with osteoporotic fracture: analysis of a managed care population in the USA. Osteoporos Int 2014 Dec;25(12):2777-2786 [FREE Full text] [CrossRef] [Medline]
  27. Klop C, Gibson-Smith D, Elders PJ, Welsing PM, Leufkens HG, Harvey NC, et al. Anti-osteoporosis drug prescribing after hip fracture in the UK: 2000-2010. Osteoporos Int 2015 Jul;26(7):1919-1928 [FREE Full text] [CrossRef] [Medline]
  28. Yoo S, Kim S, Lee KH, Jeong CW, Youn SW, Park KU, et al. Electronically implemented clinical indicators based on a data warehouse in a tertiary hospital: its clinical benefit and effectiveness. Int J Med Inform 2014 Jul;83(7):507-516. [CrossRef] [Medline]
  29. Martin GS, Mannino DM, Eaton S, Moss M. The epidemiology of sepsis in the United States from 1979 through 2000. N Engl J Med 2003 Apr 17;348(16):1546-1554. [CrossRef] [Medline]
  30. Angus DC, Linde-Zwirble WT, Lidicker J, Clermont G, Carcillo J, Pinsky MR. Epidemiology of severe sepsis in the United States: analysis of incidence, outcome, and associated costs of care. Crit Care Med 2001 Jul;29(7):1303-1310. [CrossRef]
  31. Wang HE, Shapiro NI, Angus DC, Yealy DM. National estimates of severe sepsis in United States emergency departments. Crit Care Med 2007 Aug;35(8):1928-1936. [CrossRef] [Medline]
  32. Dombrovskiy VY, Martin AA, Sunderram J, Paz HL. Rapid increase in hospitalization and mortality rates for severe sepsis in the United States: a trend analysis from 1993 to 2003. Crit Care Med 2007 May;35(5):1244-1250. [CrossRef] [Medline]
  33. Duane S, Tandan M, Murphy AW, Vellinga A. Using Mobile Phones to Collect Patient Data: Lessons Learned From the SIMPle Study. JMIR Res Protoc 2017 Apr 25;6(4):e61 [FREE Full text] [CrossRef] [Medline]
  34. Fukuoka Y, Kamitani E, Bonnet K, Lindgren T. Real-time social support through a mobile virtual community to improve healthy behavior in overweight and sedentary adults: a focus group analysis. J Med Internet Res 2011 Jul 14;13(3):e49 [FREE Full text] [CrossRef] [Medline]


AOMs: anti-osteoporosis medications
BMI: body mass index
ICD: International Classification of Diseases
IMDB: Integrated Medical Database
NCSS: National Taiwan University Hospital Clinical Surveillance System
NTUH: National Taiwan University Hospital
REC: Research Institutional Ethics Committee


Edited by G Eysenbach; submitted 26.11.17; peer-reviewed by ZP Ho, N Zarinabad; comments to author 21.12.17; revised version received 23.01.18; accepted 26.01.18; published 24.04.18

Copyright

©Fong-Ci Lin, Chen-Yu Wang, Rung Ji Shang, Fei-Yuan Hsiao, Mei-Shu Lin, Kuan-Yu Hung, Jui Wang, Zhen-Fang Lin, Feipei Lai, Li-Jiuan Shen, Chih-Fen Huang. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 24.04.2018.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.