Original Paper
Abstract
Background: Hospital progress notes can serve as an important communication tool. However, they are criticized for their length, preserved content, and for the time physicians spend writing them.
Objective: We aimed to describe hospital progress note content, writing and reading practices, and the preferences of those who create and read them prior to the implementation of a new electronic health record system.
Methods: Using a sample of hospital progress notes from 1000 randomly selected admissions, we measured note length, similarity of content in successive daily notes for the same patient, the time notes were signed and read, and who read them. We conducted focus group sessions with note writers, readers, and clinical leaders to understand their preferences.
Results: We analyzed 4938 inpatient progress notes from 418 authors. The average length was 886 words, and most were in the Assessment & Plan note section. A total of 29% of notes (n=1432) were signed after 4 PM. Notes signed later in the day were read less often. Notes were highly similar from one day to the next, and 26% (23/88) had clinical risk associated with the preserved content. Note content of the highest value varied according to the reader’s professional role.
Conclusions: Progress note length varied widely. Notes were often signed late in the day when they were read less often and were highly similar to the note from the previous day. Measuring note length, signing time, when and by whom notes are read, and the amount and safety of preserved content will be useful metrics for measuring how the new electronic health record system is used, and can aid improvements.
doi:10.2196/30165
Keywords
Introduction
Inpatient progress notes can serve as an important communication tool across the physician team, nurses, therapists, consultants, and the patient. Because safety problems that occur in hospitals can be traced to communication lapses [
], progress notes are vital to achieve safer care. However, some feel that few read progress notes, and that they therefore no longer serve the purpose of communication and are now primarily billing documents [ ]. Many physicians feel they spend too much time writing progress notes [ , ] and employ methods to shorten writing time. These include copy-paste [ - ] and extensive templating with “note bloat,” which can introduce error [ - ], harm patients [ ], and make it difficult for note readers to separate current from outdated content [ ].We have used our current electronic health record (EHR) system at the University of Washington (UW) Medical Center and the Harborview Medical Center for 17 years with little change in the format of the inpatient progress note used in the Medicine service. In preparation for the transition to a new inpatient EHR system, we conducted this analysis of progress notes on inpatient medical services to take stock of current practices. The purpose of this study was to describe current hospital progress note writing and reading practices, as well as the preferences of those who create progress notes and those who read them.
Methods
Overview
This work retrieved its data from the inpatient general medicine services at the UW Medical Center and the Harborview Medical Center, which are major teaching hospitals of the UW with approximately 35,000 combined admissions annually. The EHR system was installed in 2003, and the transition from paper to electronic notes occurred in 2006 using Cerner Millennium (Cerner Corp). Nearly all progress notes pertaining to these inpatient services are typed using the Clinical Notes Editor, based on templates that automatically import patient-specific data such as medication lists, vital signs, and laboratory results [
]. Daily progress notes are required by hospital bylaws and are mostly written by residents (usually interns) and attending hospitalists.Selection of Notes
We randomly selected 1000 patient admissions to the general Medicine service of UW Medical Center and the Harborview Medical Center between July 1, 2016, and June 30, 2017. The Medicine services at both facilities share the same progress note template. We excluded patients admitted to subspecialty services with unique progress note templates (oncology, cardiology, and geriatrics). For each admission, we extracted the data for all daily progress notes as shown in
from the analytical data repository (Enterprise Data Warehouse, Caradigm), which contains a subset of EHR data extracted for research. Progress notes were identified by the title “Medicine - Inpt Record,” the note type used within our system for Medicine service daily progress notes. Given that this study was focused on practices around the use of progress notes by those who create and those who read them, we excluded all notes other than progress notes (admission notes, procedure notes, consult notes, interim summaries, discharge summaries, and other notes).Metadata obtained for each progress note.
Full text of the note and other data listed were gathered for each note. Authenticators are supervising physicians whose note cosignature finalizes the note.
Metadata obtained:
- Note date and time
- Note title
- Note authors and authenticators
- Note identifier
- Note text
- Note action log (provided by the electronic health record system), which includes the following:
- Action (eg, perform, transcribe, modify, sign and CC/review, verify)
- Performed by (name)
- Performed date and time
- Action status
- Comment
- Proxy personnel
- Requested by (name)
Note Analysis
We deidentified each note using published methods [
] and stored them securely. Using Python scripts written for this project, we determined the total number of words in each note and in each note section (Identification/Chief Concern, Interim History, etc) ( ). We also determined when notes were signed; before progress notes are signed, they cannot be viewed except by the author.Progress note sections.
Sections are automatically created using the template used to create Medicine progress notes.
HOSPITAL DAY
IDENTIFICATION/CHIEF CONCERN
INTERVAL HISTORY
INPATIENT PROBLEM LIST
ALLERGIES
SCHEDULED MEDICATIONS
PRN MEDICATIONS
PHYSICAL EXAM
LABS
- Micro
IMAGING
ASSESSMENT & PLAN
- Fluids/electrolytes/nutrition
- Prophylaxis
- Tubes/lines
- Disposition
- Code status
- Contacts
ATTENDING STATEMENT
- Additional diagnoses
Copy-Paste Analysis
We identified the sequence of daily notes written for each patient during their hospital stay and then determined the percentage of text within each and in the note as a whole that overlapped with the note written on that same patient the previous day using natural language processing methods [
, ].To determine the clinical implications of copy-paste, we used methods described by Hammond et al [
] to highlight shared content across progress notes from one day compared to the previous day for the same patient. We then used the same 6-point scale as in that paper to rank the clinical importance of copy-paste. Since this required time-consuming manual review by clinicians, we performed this for a subset of notes.Measuring Note Readership
Note reading practices were analyzed by extracting a note-viewing record using auditing software (P2Sentinel, Cerner Corporation). Each time a note was viewed, the username, user role (resident physician, attending physician, registered nurse, etc), and timestamp were recorded in the auditing database. To determine views within the same hospital day—which have unique potential to communicate the patient’s current clinical state and today’s plan—we assessed note views within 12 hours after the note was signed. Usernames were used to identify members of the patient’s primary team. Views by physicians on the patient’s primary team were assumed to be related to the note writing process, and were excluded from the note-reading analysis. Statistical testing was performed using Stata/IC 13 (StataCorp LLC).
Focus Groups
To understand different perspectives on the current use of progress notes, we conducted 3 sets of focus groups: note authors (Medicine interns and hospitalists), note consumers (nurses, therapists, and consultants who view Medicine progress notes that others had written), and leaders (hospital service leaders who form documentation policies and standards). Each focus group was led by a coinvestigator who followed a script and showed PowerPoint slides of the results of the note analysis and the copy-paste analyses. The 5 focus group sessions were recorded, and transcripts were made for all but one of the focus groups.
The UW Institutional Review Board approved this work and designated it as “minimal risk.”
Results
From 1000 randomly selected hospital admissions to the Medicine service, we obtained 4938 inpatient progress notes written by 418 authors, an average of 4.9 daily progress notes per patient admission.
The results of the note analysis are summarized in
- . The average note length was 886 words (median 827), and most of the length (~500 words) was in the Assessment & Plan section, which comprised on average two-thirds of the note. There was marked variation in note length—some notes contained over 2000 words in the Assessment & Plan section alone. The Interval History and Physical Exam sections were among the shortest sections. These findings reflect the common practice of copying one day’s Assessment & Plan into the next day’s note and appending each day’s assessment to those of the previous days. (While the History and Physical sections are also frequently copied, the lack of appending new information to old information prevents these sections from lengthening over the hospital course.)Progress note authors signed their notes at various times of the day as shown in
. A total of 29% (n=1432) of notes were signed after 4 PM, and some were signed as late as 10 PM.Notes had high levels of similarity to the prior day’s note on the same patient. The median note similarity was 66% using the methods described above. While note similarity was high for all author types (
and ), it was higher for trainees than attendings (P<.001), and higher when both notes were written by the same author rather than by different authors (P<.001) ( ).We conducted manual reviews of note pairs to assess the clinical importance of note similarity. Preserved content from one day to the next was visually highlighted, using the CopyFind program [
]. Physician reviewers then assessed the preserved content for risk using the Hammond scale [ ] ( ). The results showed that 26% (23/88) of the pairs were assessed to have minimal or some risk because of human copying; a second set of reviews found 17% (5/29) of the pairs had minimal or some risk in the preserved content. In this sample then, about 1 in 5 notes had clinical risk associated with preserved content, which was very likely the result of copy-paste practices. An example of copying assessed to be of minimal risk (code 4) was including the phrase “Gen Surg to take to the OR today” when this happened the day before. An example of copying regarded to be of some risk (code 5) was when the History section was completely copied from the day before, incurring a legal risk of fraud. In the Plan section of the same note was the phrase “will obtain MRI” copied forward, but the MRI (magnetic resonance imaging) was obtained the day before as evidenced by the results of the MRI appearing elsewhere in the note.Risk scale for duplicated material appearing in notes.
The scale below is used to assess the risk associated with duplicated note text, derived from Hammond et al [
] ( ).Code risk description:
- 1 = Artifact, not misleading, no risk
- 2 = Artifact, minimally misleading, minimal risk
- 3 = Human, not misleading, no risk
- 4 = Human, minimally misleading, minimal risk
- 5 = Human, misleading, some risk
- 6 = Human, clinically misleading, major risk
Note-reading practices were analyzed on a random subset of 250 notes (limited by auditing time constraints). The 250 notes in this sample were similar to the overall progress note library: the authors who wrote them were representative of the pool of authors in the larger library, and because they were randomly sampled, other note characteristics (eg, time written, length) were similar to the overall note library. This sample had 4036 note views, an average of 16.1 views per note, which includes many types of professionals beyond bedside nurses and physicians.
A and 8B describe note readership by note sign time. Notes signed before noon were read more than notes signed between noon and 4 PM (P=.002), and those signed between noon and 4PM were read more than those between 4 PM and 8 PM (P=.05), with successively fewer reads for notes signed between 4 PM and 8 PM. Analysis of note reading by role revealed that more notes were read by providers (physicians, nurse practitioners, physician assistants, medical students) when published before noon (ie, early in the day) (P=.003). Nursing readership was not correlated with the time the notes were signed (P=.95).Focus Groups
Note Authors
We learned that note authors vary widely in how they use progress notes (ie, section of note reviewed, such as Labs, Scheduled Medications, etc), and in the purposes for which they use them, such as regarding them to be a billing document, as a “note to self” to remember important items from one day to the next, and as a communication tool to colleagues. Note authors mentioned this as one reason there is so much heterogeneity in the length and content of inpatient progress notes.
Note Consumers
Nursing and other ancillary service staff said they value medical progress notes and prefer detailed notes. They regarded them to be an important communication tool that helps them understand what is going on with patients and the plan for the day and for the hospital stay. They frequently used the progress note to assist their communication with families. They reported wanting to see more details regarding the disposition plan and preferred to have the Labs and Radiology sections deleted.
Leaders
Leaders believed the collective memory in notes to be important to prevent “reinventing the wheel.” They believed that the primary focus of a note should be communication and patient safety, but that we should also make trainees aware of future billing pressures when they finish training and are able to bill. They felt, as a group, that the medication list is important to include in progress notes.
Readership
shows that notes are read by authorized users from a wide range of disciplines, including registered nurses, physicians, and administrators.
Discussion
Our analysis of a large set of randomly selected hospital progress notes found that notes were often long and highly similar to the prior day’s note. Additionally, notes that were signed later were read less frequently; about one-third were signed after 4 PM when their value as a communication tool for other providers is diminished. Given the vast quantity of physician hours spent on their creation, inpatient progress notes have been relatively neglected as an area of study. Limitations in duty hours, increased patient complexity, and decline in physician morale suggest a need to re-evaluate our note-writing practices.
We found broad variation in note-writing and reading practices. Some notes in our sample were over 2000 words (approximately half the length of this paper); this may reflect the common practice of copying one day’s assessment into the next day’s note and adding each day’s findings to those of the previous days. The progress notes often become a running summary of the hospitalization.
Our analysis showed a high degree of similarity between notes on the same patient on successive days. Though methods for measuring note content similarity vary across studies [
], it is interesting that others also noted this [ , ]. Note similarity could occur from either note templating or from copy-paste; we believe that the high similarity in our sample was mainly due to copy-paste, as the most heavily templated sections of our progress note (Allergies, Medications, and Labs) make up just 22% of the average note length. Our focus group with note authors provided further evidence that this was the case.Note similarity was high across training levels, and while trainee notes had more similarity than attending notes, attending notes were still over 50% similar to the prior day’s note. Perhaps equally concerning was a high degree of similarity between notes with distinct authors. While our Medicine community sees the progress note as more of a living, communal document (where the practice of copy-paste is not viewed as flagrant plagiarism), this practice nevertheless is a clear setup for miscommunication and medical error [
, ]. Indeed, manual review revealed that 1 in 5 notes had clinical risk associated with preserved content, which was very likely the result of copy-paste practices. Reassuringly, this was primarily in the minimal-risk category with no examples of major human risk captured in the small sample we reviewed. This may suggest that careful use of copy-paste with a diligent review (defined as a review sufficient to assure that the note is accurate on the day it is written) of the information that is carried forward is not associated with a major risk of error.Progress notes in our sample were read frequently by nonprimary team members. Readership of timely clinical data (within 12 hours of note signing) was highly sensitive to the time of day the note was signed, with significantly more notes read if signed before noon. This was especially true of physicians, who tend to have day schedules on the acute care services and are thus unlikely to view a note that is published late in the evening (as many notes are). Nurse views were not sensitive to note-signing time, likely reflecting the presence of night-shift nurses, who also want to use the progress note as a means to communicate the plan of care. (However, if a night-shift nurse reads a note, the content from the morning rounds is over 12 hours old.)
In the focus groups, we heard many and different reasons nurses and physicians value progress notes. Some nurses read them soon after they were created even if it was late in the day and appreciated the detail of Medicine progress notes compared with other services. For nurses, these notes served as an important communication tool to help them understand the Medicine team’s plan. Most expressed interest in more information tailored to their needs. Note authors—largely house staff and hospitalists—also valued notes, though what they valued differed by group. House staff are charged with tracking details, critical and minor, and used their notes for their “future selves”—as a way to remind them of what is to be done and for the collective memory of what has occurred. For hospitalists, there was wide variation in the attitude toward progress note writing, with some hospitalists favoring a more succinct note that concisely summarizes why the patient remains hospitalized and focuses on changes in patient status and plan for that day, while others (especially those who also worked nights) also focused on the importance of a note as a communication tool. Ultimately, the use of the note as a repository or collective memory of hospital course was a hotly contested topic among the hospitalists depending on their attitude toward and group practice with regards to interim summary writing. This suggests a need for direction from leadership regarding the use and role of medical inpatient progress notes versus interim summaries as collective memory of a patient’s hospital course.
Recent literature offers additional perspectives and hopes for progress notes. We know that attendings and house staff physicians differ in their perception of note quality but agree that communication is an important purpose for them [
]. Some senior authors advocated restoring the story to clinical notes [ , ]. If this is an objective, using voice to create notes could fit this into the workflow because it may be faster than typing a more narrative note. Creating a wiki-style note, broadly adopting the APSO (Assessment, Plan, Subjective, Objective) format, utilizing vendor tools to create an ongoing hospital course, or drastically shortening notes were not explored in this study but may be embraced by a segment of physicians.These results have implications for those who develop electronic documentation systems used in EHRs. Documentation methods that facilitate the completion of notes sooner in the day may result in greater readership, fulfilling an important communication objective for electronic notes. However, the opportunity cost of earlier documentation may be diverting physician hours away from other time-sensitive tasks, such as contacting specialists or meeting with families. Permitting the simple creation of a summary of the hospital course, outside of the progress note itself, could result in more succinct notes that convey what progress occurred that day, and would be simpler to read. Developing note-writing tools that permit more rapid note creation, tailored to the aptitudes of the note author, such as use of voice [
, ] or scribes, could permit the notes to be signed earlier in the day, resulting in increased readership, which is an important objective of the daily progress note.Templates can also speed note writing but is done so at the risk of retaining content of the history or physical exam, which is included in some templates. Many clinicians who read notes are most interested in what the note author has to say rather than what is within the template text. Every change to note-writing approaches has potential for side-effects. For example, methods that reduce the time to create notes and that permit them to be completed earlier in the day may also decrease note quality.
There is an important role for hospital leaders in setting the direction for this critical part of clinical care and training [
]. As a result of this work, our community has expressed agreement on increasing the communication value of progress notes, in part by making it possible for them to be completed earlier, and to reduce the time devoted to writing them.Acknowledgments
We greatly appreciate the assistance of Xi Li, who performed the note content analysis, and of Jacki DeNonno and Johnathan Bubalo, Cerner Corporation, for obtaining the data on note readership.
This work was funded by a University of Washington Department of Medicine Accelerator Grant.
Conflicts of Interest
None declared.
References
- Schriefer J, Leonard MS. Patient safety and quality improvement: an overview of QI. Pediatr Rev 2012 Aug 01;33(8):353-9; quiz 359. [CrossRef] [Medline]
- Siegler EL, Adelman R. Copy and paste: a remediable hazard of electronic health records. Am J Med 2009 Jun;122(6):495-496. [CrossRef] [Medline]
- Sinsky C, Colligan L, Li L, Prgomet M, Reynolds S, Goeders L, et al. Allocation of Physician Time in Ambulatory Practice: A Time and Motion Study in 4 Specialties. Ann Intern Med 2016 Sep 06;165(11):753. [CrossRef]
- Sulmasy LS, López AM, Horwitch CA, ‚ American College of Physicians Ethics‚ ProfessionalismHuman Rights Committee. Ethical Implications of the Electronic Health Record: In the Service of the Patient. J Gen Intern Med 2017 Aug;32(8):935-939 [FREE Full text] [CrossRef] [Medline]
- Hirschtick RE. A piece of my mind. Copy-and-paste. JAMA 2006 May 24;295(20):2335-2336. [CrossRef] [Medline]
- Tsou A, Lehmann C, Michel J, Solomon R, Possanza L, Gandhi T. Safe Practices for Copy and Paste in the EHR. Appl Clin Inform 2017 Dec 20;26(01):12-34. [CrossRef]
- Thornton JD, Schold JD, Venkateshaiah L, Lander B. Prevalence of Copied Information by Attendings and Residents in Critical Care Progress Notes*. Critical Care Medicine 2013;41(2):382-388. [CrossRef]
- Weis JM, Levy PC. Copy, paste, and cloned notes in electronic health records: prevalence, benefits, risks, and best practice recommendations. Chest 2014 Mar 01;145(3):632-638. [CrossRef] [Medline]
- Turchin A, Goldberg SI, Breydo E, Shubina M, Einbinder JS. Copy/paste documentation of lifestyle counseling and glycemic control in patients with diabetes: true to form? Arch Intern Med 2011 Aug 08;171(15):1393-1394 [FREE Full text] [CrossRef] [Medline]
- Thielke S, Hammond K, Helbig S. Copying and pasting of examinations within the electronic medical record. Int J Med Inform 2007 Jun;76 Suppl 1:S122-S128. [CrossRef] [Medline]
- Yadav S, Kazanji N, Paudel S, Falatko J, Shoichet S, Maddens M, et al. Comparison of accuracy of physical examination findings in initial progress notes between paper charts and a newly implemented electronic health record. J Am Med Inform Assoc 2017 Jan;24(1):140-144 [FREE Full text] [CrossRef] [Medline]
- Roddy JT, Arora VM, Chaudhry SI, Rein LM, Banerjee A, Swenson SL, et al. The prevalence and implications of copy and paste: internal medicine program director perspectives. J Gen Intern Med 2018 Dec 31;33(12):2032-2033 [FREE Full text] [CrossRef] [Medline]
- Khorana AA. Physician As Typist. JCO 2010 Aug 20;28(24):3899-3900. [CrossRef]
- Payne TH, Perkins M, Kalus R, Reilly D. The transition to electronic documentation on a teaching hospital medical service. AMIA Annu Symp Proc 2006:629-633 [FREE Full text] [Medline]
- Neamatullah I, Douglass MM, Lehman LH, Reisner A, Villarroel M, Long WJ, et al. Automated de-identification of free-text medical records. BMC Med Inform Decis Mak 2008 Jul 24;8(1):32 [FREE Full text] [CrossRef] [Medline]
- Rehurek R, Sojka P. Software framework for topic modelling with large corpora. 2010 Presented at: Proceedings of the LREC 2010 Workshop on New Challenges for NLP Frameworks; March; Valletta, Malta p. 46-50 URL: https://radimrehurek.com/lrec2010_final.pdf
- RaRe-Technologies/gensim | gensim – Topic Modelling in Python. GitHub. URL: https://github.com/RaRe-Technologies/gensim [accessed 2021-01-13]
- Hammond KW, Helbig ST, Benson CC, Brathwaite-Sketoe BM. Are electronic medical records trustworthy? Observations on copying, pasting and duplication. AMIA Annu Symp Proc 2003:269-273 [FREE Full text] [Medline]
- Wrenn JO, Stein DM, Bakken S, Stetson PD. Quantifying clinical narrative redundancy in an electronic health record. Journal of the American Medical Informatics Association 2010 Jan 01;17(1):49-53. [CrossRef]
- Zhang R, Pakhomov S, McInnes BT, Melton GB. Evaluating measures of redundancy in clinical texts. AMIA Annu Symp Proc 2011;2011:1612-1620 [FREE Full text] [Medline]
- Wang MD, Khanna R, Najafi N. Characterizing the Source of Text in Electronic Health Record Progress Notes. JAMA Intern Med 2017 Aug 01;177(8):1212-1213 [FREE Full text] [CrossRef] [Medline]
- Weir C, Hurdle J, Felgar M, Hoffman J, Roth B, Nebeker J. Direct Text Entry in Electronic Progress Notes. Methods Inf Med 2018 Feb 07;42(01):61-67. [CrossRef]
- Singh H, Giardina TD, Meyer AND, Forjuoh SN, Reis MD, Thomas EJ. Types and origins of diagnostic errors in primary care settings. JAMA Intern Med 2013 Mar 25;173(6):418-425 [FREE Full text] [CrossRef] [Medline]
- Stewart E, Kahn D, Lee E, Simon W, Duncan M, Mosher H, et al. Internal medicine progress note writing attitudes and practices in an electronic health record. J Hosp Med 2015 Aug;10(8):525-529. [CrossRef] [Medline]
- Gantzer HE, Block BL, Hobgood LC, Tufte J. Restoring the Story and Creating a Valuable Clinical Note. Annals of Internal Medicine 2020 Sep 01;173(5):380-382. [CrossRef]
- Morgan M. Matt Morgan: When bullet points miss the heart. BMJ 2019 Oct 17;366:l5500. [CrossRef] [Medline]
- Payne TH, Alonso WD, Markiel JA, Lybarger K, White AA. Using voice to create hospital progress notes: Description of a mobile application and supporting system integrated with a commercial electronic health record. J Biomed Inform 2018 Jan;77:91-96 [FREE Full text] [CrossRef] [Medline]
- Payne T, Alonso W, Markiel J, Lybarger K, Lordon R, Yetisgen M, et al. Using voice to create inpatient progress notes: effects on note timeliness, quality, and physician satisfaction. JAMIA Open 2018 Oct;1(2):218-226 [FREE Full text] [CrossRef] [Medline]
- Siegler EL. Electronic medical records and hospital progress notes. JAMA 2012 Dec 12;308(22):2336; author reply 2337. [CrossRef] [Medline]
Abbreviations
APSO: Assessment, Plan, Subjective, Objective |
EHR: electronic health record |
MRI: magnetic resonance imaging |
UW: University of Washington |
Edited by R Kukafka; submitted 03.05.21; peer-reviewed by G Schiff, R Marshall; comments to author 23.05.21; revised version received 13.07.21; accepted 27.07.21; published 06.10.21
Copyright©Thomas H Payne, Carolyn Keller, Pallavi Arora, Allison Brusati, Jesse Levin, Monica Salgaonkar, Xi Li, Jennifer Zech, A Fischer Lees. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 06.10.2021.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.