Importance-Performance Analysis of Personal Health Records in Taiwan: A Web-Based Survey

Introduction

A personal health record (PHR) is an electronic record of health-related information on an individual that conforms to nationally recognized interoperability standards, and that can be drawn from multiple sources while being managed, shared, and controlled by the individual [1]. PHR includes medical records, lab results, physical assessments, medical history, medication history, physiologic measurements, dietary records, exercise records, and so on. These data can be updated by the user, measured by the measurement equipment automatically uploaded, or by hospitals or clinics that allow data import [2]. The purpose of PHR is to integrate patient health information from a variety of sources, including all patient records, and allow authorized persons to access these records any time and at any place.

PHR is that part of the electronic medical records (EMRs) or Electronic Health Records (EHR) that an individual “owns” and controls. In Taiwan, hospitals adopted EMR in 2004. It was related with the introduction of a basic format of EMR. In 2007, the National Health Informatics Project (NHIP) was promoted to implement the infrastructure of health information by the government to prepare the EMR exchange, and encourage hospitals to use EMR. In 2008, clinical document architecture (CDA) was adopted by the government to create 108 basic formats of EMR. The government of Taiwan also provided incentives to hospitals that adopted EMR. Until 2015, 406 hospitals (90% of Taiwan’s hospitals) already earned rewards and could exchange EMR with each other.

The research on PHR has increased. In the past, EMRs were stored in a large database; different medical service providers in the hospital could access the medical records in the database, but transfer between different hospitals was a problem. Thus, the implementation of PHRs allowed patients to achieve the integration of their PHRs and medical records [3]. Traditionally, most people use paper to write their records, whereas PHRs allow people to easily record and maintain their own health information [4]. With the increasing number of people using EMRs, PHRs were also managed and authorized to be shared through a network in some foreign countries. This approach was found to improve the medical satisfaction of performance, and reduce the cost of medical care with better quality [5].

Some studies listed the benefits of using PHR, including reducing health care costs, improving personal health outcomes, and improving the experience of care for patients and their families [6-10].

The current mechanism of medical record exchange in an EMR exchange center plays a role of a personal EMR platform. Through the Exchange Center, a medical record previously created in any hospital can be accessed from another hospital to reduce duplicate examinations, accelerate diagnosis and treatment, and reduce the medical resource burden. The medication record in the EMR is very conducive to decision-making by doctors to avoid drug allergies and other medical disputes. The importance of a personal EMR platform to a medical institution and its members is like the importance of the clients’ information to an enterprise, which is the basis for providing good service.

Although EMR is already being used well, the medical records are still owned by hospitals; people cannot own and manage their health care record. Therefore, the Ministry of Health and Welfare introduced the concept of “My health bank” in 2015 to let patients own their PHR. In the last three years, this initiative permitted people to download the integrated medical record from the Internet, which includes outpatient and hospital records, diagnosis, drug use records, cost, laboratory test and health examination report, allergies, and so on. It lets people view and manage their health care record at any time and from any place. However, “My health bank” still has some problems. The information it includes is a general report with no detailed content; it doesn’t have medical images, the content is still not standardized, and people can not add their own data regarding diet, exercise, nutrition records, or the health examination report from another examination center.

We still do not have a platform that can let patient manage their own PHR. This study creates a vision of a value-added platform for personal health data analysis and management of health records on the basis of the contents of the "My health bank"; patients can retrieve their health records and medical records through the personal EMR platform to manage their own health conditions. The availability of medical records can contribute to the transparency of the medical records and facilitate immediate access to the medical contents, thereby allowing discussions of disease conditions with the patients’ relatives and friends and related medical personnel. Thus, the ownership of the medical record is reverted to the patient.

The National Committee on Vital and Health Statistics found that a critical success factor for PHRs is the provision of software tools that help patients manage their own health conditions [11].

This research gives a vision of the electronic PHR management platform and uses importance-performance analysis (IPA) to identify the important factors from patients' perspectives. The purpose of this study was to explore consumer perception regarding this kind of platform, and try to both identify the key success factors and important aspects using importance-performance analysis, and give some suggestions for future development based on the findings.

Methods

Study Design

In this study, we used a cross-sectional study design. We let the participants watch a Web-based video on the vision of personal EMR platform. After the video introduction, we asked them to fill a structured questionnaire on the Internet (created by Google Form) for quantization of their acceptance and importance of the personal EMR platform’s functions and security.

In this study, we developed a Web-based video simulation describing the scenario of the personal EMR platform's operation, as shown in Figure 1. This 2:17-min video presented the functions of the personal EMR platform using a case of a patient seeking medical treatment in hospital A. Through the personal EMR platform, after returning home, the patient could use or manage in a secure and private home environment their continuous and integrated PHR, which include personal general information, their health examination record, hospital visit record, PHR, and so on. They can also let doctors in hospital B, family members, and insurance companies use these files through the sharing mechanism when needed.

After viewing the video, the participants were asked to fill out a Web-based questionnaire in Google Form regarding the importance and satisfaction of the performance of the personal EMR platform.

‎View this figure

Questionnaire Design

In order to explore their impact on public acceptance of the personal EMR platform and its importance, this study utilized a questionnaire on importance-performance analysis [12]. The original version of this questionnaire has been used for marketing research to understand consumer perception regarding satisfaction and importance of a product.

We modified this questionnaire into 2 main constructs including (1) system functions and (2) system design and security and privacy, with 12 and 7 questions, respectively. The questionnaire was designed following 5-point Likert scale with the scale ranging from 1 (“disagree strongly”) to 5 (“Agree strongly”).

Before the study, this study invited 4 experts to do expert validity and was pretested by 30 patients. No major problems emerged during this pretest. As showed in Table 1, the questionnaire is highly reliable. The Cronbach alpha of these 2 parts were both more than .9. It means that this questionnaire has a good consistency, and that the subjects could understand the question and fill it in clearly.

Sampling and Exclusion Criteria

This study used random sampling of the Internet users. We put the video on the YouTube platform from 31st March 2014 to 9th April and publicized it through email and Facebook. After participants finished watching this video, they were asked to fill the questionnaire (Web-based questionnaire in Google sheet format).

The sample size was calculated by using the Magnani [13] formula. It was calculated by reliability coefficient, population proportion (parameter), and width (CI) / margin of error. After calculation, we got the minimum sample size of 323, which meant we would have at least 323 valid respondents after the announcement for 10 days. In total, 614 people have watched this video and 400 people finished the questionnaire survey (response rate: 65.1%); after excluding incomplete and repeated questionnaires, we got 350 valid respondents, which is more than the minimum required case number.

Data Analysis

This study used Excel (Microsoft) and SPSS (IBM Corp) as statistic tools for analysis. We used descriptive statistics to calculate the mean, standard deviation, median, frequency distribution, and percentage statistics to ascertain the data distribution in system functions, and system design and security. The objective was to examine the relationship between characteristics of participants, as well as all of the aspects above, and set 0.05 as the significance level; if P<.05, then it is statistically significant.

We also performed IPA to measure the participants’ attitudes toward the personal EMR platform’s functions. We calculated the mean of every factor in “system functions” and “system design and security” aspects, and we put them in a quadrant diagram.

Results

Respondent Characteristics

This research gathered 350 valid questionnaires. As shown in Table 2, most respondents were female (n=219), 21-30 years old (n=238), with a university degree (n=228). Or they were still students (n=195), with a monthly income of less than NT $30,000 (n=230), and lived in the north area (n=236), with a good self-identified health status (n=171).

Importance-Performance Analysis

The Importance-performance Analysis (IPA) framework was introduced by Martilla and James [12]. It uses the mean of importance and satisfaction of performance of all items, and employs the intersection point as the origin to draw a quadrant diagram. As defined in quadrant 1 of Figure 2, it indicates high importance and high satisfaction of performance, which indicates that existing systems have strengths and should be maintained. Items in quadrant 2 have high importance but low satisfaction of performance. This quadrant is labeled as “Concentrate Here.” This category is labeled as “Keep up the good work.” In quadrant 3, low importance and low satisfaction of performance items renders it as “Low Priority.” Finally, quadrant 4 represents low importance and high satisfaction of performance, which suggests insignificant strengths and a possibility that the resources invested may be better used elsewhere.

In this study, the questionnaire was divided into “system functions” and “system design and security,” the two aspects that evaluate the relationship between importance and satisfaction of performance. We focused on the key area for improvement in the second quadrant of the IPA to identify the services showing high importance and low satisfaction of performance to determine the improvement priorities. This analysis is expected to provide direction for future enhancement and implementation of the personal EMR platform as a reference for government agencies and system developers.

In the system function part, as shown in Table 3, F7 (can maintain and keep complete personal health examination record) and F10 (can maintain and keep complete personal medical record) both have the highest satisfaction of performance. They are followed by F6 (can maintain and keep complete personal health record), F3 (can access PHR from other hospitals to avoid duplication of examinations, tests, and medication), and F8 (can maintain and keep complete personal medical image).The lowest satisfaction of performance is F1 (have detailed operating instructions). F3 has the highest importance, followed by F10 and F6.

Figure 2 shows the quadrant distribution of the importance and satisfaction of performance of every system function of the personal EMR platform. The first quadrant (high importance and high satisfaction of performance) has F3, F5 (allows doctor to add more details on the medical records), F6, F7, F8, and F10. The items in the second quadrant (high importance and low satisfaction of performance) are F1 and F4 (can integrate their own PHR data and provide continuous numerical statistics). The items in the third quadrant (low importance and low satisfaction of performance) are F2 (existing paper-based medical history can be integrated), F11 (can be shared PHR with family), and F12 (can share PHR with physicians). The item in the fourth quadrant (low importance and high satisfaction of performance) is F9 (can maintain and keep complete personal endoscopic images).

In Figure 2, there are 4 functions with below average importance, including “sharing PHR with family and physician” (F11, F12), “integrating existing paper-based medical history” (F2), and “maintaining and keeping complete personal endoscopic image” (F9).

It also has 5 functions with below average satisfaction of performance, including “detailed personal EMR platform operating instructions” (F1), “integrating existing paper-based medical history” (F2), “sharing PHR with family or physician” (F11, F12), and “integrating their own PHR data and provide continuous numerical statistics” (F4).

It means a paperless process or sharing with others is not seen as important functions by the participants. They just want to have a platform that can let them maintain and keep complete personal records and basic medical images.

After conducting the Analysis of Variance (ANOVA) test, we didn’t find any significant difference between the various age groups, annual income groups, and health status groups, meaning that the results described above are consistent in every group.

In the system design and security part, as shown in Table 4, S2 (can let patients access their own PHR quickly) have highest satisfaction of performance and followed by S3 (lets patients login by multiple methods), S1 (interface should be simple and easy to understand) and S4 (can let patients access their own PHR under a secure environment). The lowest satisfaction of performance is S5 (let patients can login by id and password). S3 have highest importance, followed by S4 and S7 (can let patients set access right).

Figure 3 shows the quadrant distribution of the importance and satisfaction with performance of the system design and security aspects of the Personal EMR Platform. The item in the first quadrant (high importance and high satisfaction with performance) is S3. The item in the second quadrant (high importance and low satisfaction with performance) is S4. The items in the third quadrant (low importance and low satisfaction with performance) are S5, S6 (lets patients log in using a citizen digital certificate) and S7. The fourth quadrant (low importance and high satisfaction with performance) includes S1 and S2.

In Figure 3, we also can find most of the system design and security below average in importance, besides letting patients log in by multiple methods (S3) and letting patients access their own PHR under a secure environment (S4); however, even the next personal EMR platform has been designed with multiple security protection methods. Participants still feel concerned about the system security issue; the satisfaction of performance of most questions is low, besides S1, S2, and S3. Thus, system security is still a big issue when building this kind of platform in the future.

After conducting the ANOVA test, we found some differences in system design and security part in terms of the importance attributed to system design and security part, as shown in Table 5. The mean importance of the age group of less than 20 years is lower than the values of other groups (P=.05). It means this group is not very concerned about the security issue. Also, in satisfaction with performance of system security (according to a group's monthly income and health status), the group of monthly income between NT $50K and NT $70K have lowest satisfaction with performance (P=.02). This was also found in the group which thinks they are poor health participants. (P=.002).

Table 6 shows the result of the ANOVA test of importance and satisfaction regarding performance between every demographic class in system functions. In this part, only the group with the monthly income between NT $50k and NT $70k, the mean satisfaction of performance, is lower than that of others (P=.01). This means income has a strong correlation to the satisfaction with performance of system functions.

‎View this figure

‎View this figure

Discussion

Principal Findings

Liang’s [14] awareness, want, and adoption gap ratio (AWAG) segment matrix that analyzes the digital divide in eHealth services divides into four groups: strong opened group, generic opened group, generic closed group, and strong closed group by the participants’ awareness and want rate. Results showed that for both eHealth services, the digital divides of awareness, want, and adoption existed across demographic variables, as well as between computer owners and nonowners, and between Internet users and nonusers. It means users' attitudes and experience are the most important factors determining whether and how eHealth services will be used.

This study focused on system functions and system design and security to identify the key functions of patients’ views by using IPA to determine which functions people think are important for them. The study can serve as a guide when this kind of platform is built in the future. We found people do not need overly complex functions; they just want a platform that lets them integrate and manage their medical visits, health examination, and life behavior record. However, viewing the Web-based medical image is not an important function for them, and they also do not care if their PHR is shared with others. Surprisingly, most of the participants think the system security design is not important. The importance of 5 of 7 questions in total is below average (4.29, 1: most not important, 5: most important); they only think “letting patients login by multiple methods, such as citizen digital certificate, id and password” and “letting patients access their own PHR under a secure environment” is important. Satisfaction in performance is also not high. The significance of only 3 of 7 questions is higher than average (3.8). We also found that the satisfaction regarding performance is of lower importance not only in system functions aspects but also in system design and security aspects. This means that although they think some of the system functions and system security design are not very important, they are not satisfied even when the system has these functions. However, although future personal EMR platform could have many system security designs, people may still not think these are enough to make sure the system is secure.

With increased acceptance of PHR, users increasingly believe that the use of a personalized EMR could help them understand their own medical records. Research on PHR became more popular in recent years; however, most of the research was focused on investigating the use of doctors and nurses’ satisfaction. Rarely were the patients’ views given consideration. Some studies have also pointed out that if the patients are satisfied with the use of information in this context, one could improve the feasibility of using PHR [15]. Some surveys have indicated that consumers want Web-based access to their PHR [16,17]; however, they still have some doubts, including the possibility that full and open access to personal medical information could bring up privacy concerns [18]; the problems of usability and security issues, complexity in the use of PHRs [2]; and perceived usefulness, motivation, patient and health professional interaction, lack of time and workload, resources availability, management, outcome expectancy, and interoperability [19]. Agarwal et al [20] found provider satisfaction, interactions between environmental factors (communication tactics and value of the tool functionality), and interactions between patient activation and tool empowerment potential were significantly associated with behavioral intentions to use the PHR. Patients who believed the tool to be empowering demonstrated greater intention to use it, which was further enhanced for highly motivated patients. Baird [21] and Liu [22] also thinks that the concerns and challenges of using PHR are more focused on discussions regarding confidentiality, integrity, authorization, access control, portability, efficiency, scalability of solutions, and issues related to user experiences.

Compared with these studies, our results are similar; however, our study focused on system functions and system design and security. These questions are related to perceived usefulness, patient and health professional interaction, and management and interoperability aspects for perceived usefulness. Our research found participants pay more attention to how PHR can help them manage their health records, such as medical records, health examination records, and medical images, while also helping them avoid duplication of examinations, tests, and medication. For patient and health professional interactions, participants think PHR can let physicians add more details to the medical records; regarding management and interoperability, it was found in our study that detailed operating instructions, log in methods, and operation with secure methods are important for the participants, but the satisfaction with performance are below average.

Overall, the issues receiving the most user attention were the system functions, circulation, integrity, ease of use, continuity of the PHR, and data security and privacy protection. “My health bank” query service implemented by the government in recent years allows patients to check medical records (including the date of medical treatment, drug use, inspection report, and the doctor's advice) for 1 year through a personal certificate. Through this access, the integrity and continuity of PHRs can be achieved, but the propaganda for publicity still needs to be strengthened. In future, the government should provide functions and services that can meet the needs of the users, which will also enable the users to understand their own medical records, enhance understanding of the disease for the doctors, enhance the quality of EMR writing, reduce duplicated examinations, and develop holistic care.

Limitations

The personal EMR platform concept proposed in this study is relatively new in Taiwan. Most people are not yet aware of this process. Therefore, their understanding of the personal EMR platform may be poor. In this study, the system was introduced by way of a video to ensure that the participants understood as much as possible before they began to fill out the Web-based questionnaire, which we expected to reduce possible errors. Although the accuracy and validity of the data were not validated due to the lack of sample representation and extrapolation of the results, this prospective study can act as a reference for future studies on the development of the domestic personal EMR platform.

This study was conducted only by a Web-based questionnaire survey. Most of the participants were people with high Internet usage, young, and the areas of residence were concentrated in the north, which could cause the findings to be generalized to the whole population. Therefore, if the results were to extend to other regions or remote areas, there may be a gap. We suggest that future researches could use diversification methods for the survey.