Evaluating the Usefulness of AI Scribing in the Clinical Setting: Note Reliability and Readability for Patient Access in the CURES Act Era.

Author: Faraz Ghoddusi, MD, MCiM, FAAFP
4 Oct 2024

Abstract

The integration of AI scribing technology into clinical settings offers the potential to significantly reduce documentation burden, enhance note reliability, and improve patient engagement. This paper explores the effectiveness of AI-generated clinical notes by examining the reliability of notes compared to a transcript of the patient interactions, and the readability of the resulting note given the implementation of the 21st Century CURES Act, which grants patients immediate access to their medical records. We assess these factors through a review of AI-generated notes from different vendors and their alignment with the accuracy and usability expected in clinical practice. The findings provide a comprehensive overview of the strengths and limitations of AI scribing technologies and found that of all services reviewed, Empathia.ai was found to both clinical accuracy and patient-centered care in readability.

Introduction

Documentation in healthcare settings has long been recognized as a significant source of physician burnout. A particular concern is the crucial nature of comprehensive documentation for maintaining patient safety, supporting accurate billing, and reducing legal risk. The advent of AI scribing technology presents a solution that promises to improve efficiency by automating the generation of clinical notes. However, the implementation of these tools requires rigorous evaluation to ensure they meet clinical needs and regulatory standards. As patients increasingly access their medical records due to the 21st Century CURES Act, the readability and accuracy of these notes become critical not only for clinical continuity but also for fostering patient understanding and engagement. This paper examines the utility of AI scribing in two key areas:

1. Reliability of AI-generated notes compared to transcripts of actual clinical encounters, and

2. Readability of notes considering patient access under the CURES Act.

Methods

To assess the usefulness of AI scribing, we conducted a mixed-methods study involving both quantitative and qualitative analyses. Six different AI-scribing companies generated notes that were compared against the transcript of a standardized patient encounter. In selecting vendors, we specifically selected options with a low barrier to entry (no start-up cost), with a subscription model that has a price of less than $200/month per user. The intent is to help guide AI-scribing selection for smaller clinical settings, focusing on primary care. We recorded various scripted clinical interactions in a primary care setting and created clinical notes using the selected AI Scribing companies. A multimodal generative pre-trained transformer was used to objectively evaluate the reliability and readability of each note, broken down as follows:

1. Reliability of the Notes: Assessed through a detailed comparison of the notes with the original transcript, focusing on accuracy, completeness, and alignment with clinical best practices. We automated the process to remove bias and used a Large Language Model to review the note and determine a score (percentage out of 100%) that evaluates objective measures such as:

   1. Inclusion of Patient History: Does this note accurately capture the patient's background, symptoms, and social context?

   2. Symptom and Review of Systems (ROS): Are the patient's symptoms accurately reflected?

   3. Plan and Follow-up Instructions: Are the prescribed medications, lab orders, health maintenance, and follow-up instructions presented?

   4. Ease of Use for Subsequent Visits: Can a clinician easily pick up the patient's care based on this note?

2. Readability and Patient Access Considerations: We then evaluated the notes using the Flesch-Kincaid readability formula and a qualitative assessment of how well the notes would be understood by patients given immediate access under the CURES Act.

- Encounter transcript, notes and prompt are available upon request.

Results

1. Reliability of Notes: The reliability of AI-generated notes varied among different systems. While some notes captured 95-100% of the critical information from the transcript, others exhibited significant omissions or inaccuracies. The most reliable notes were those that included both comprehensive documentation and detailed follow-up instructions, essential for continuity of care. Of all the notes that were evaluated in this price range, we've found Empathia.ai and Scribeberry to be the most reliable given the metrics provided.

   

2. Readability and Patient Access Considerations: Readability scores of the AI-generated notes ranged from a Flesch-Kincaid reading ease score of 0.5 (very difficult to read) to 45.4. Notes with higher readability scores were generally more patient-friendly, adhering to the principles of plain language communication. However, all notes were at a level recommending at least some college education, which might be challenging for patients to fully comprehend. Of the AI scribes evaluated, Empathia.ai had the highest Flesch-Kincaid Readability Ease Score, with Nabla Copilot and Getfreed.ai coming closely behind.

   

AI scribing presents a promising solution for reducing the time burden associated with physician documentation, contributing to improved workflow efficiency. The reliability of AI-generated notes, however, is highly dependent on the specific algorithms and customization settings used. Not all systems consistently captured the nuances of clinical encounters, leading to potential gaps in continuity of care. This variability underscores the need for robust validation processes before integrating AI scribes into regular practice.

In our head-to-head evaluation of AI medical scribing companies at competitive price points, we have found that Empathia.ai stands out with its emphasis on empathetic and accurate patient narratives in a format that makes it more readable for the patient, thus enhancing patient engagement in their care. With the implementation of the CURES Act, readability has become an increasingly critical factor. Notes that are too clinically complex may overwhelm patients, potentially leading to confusion, misinterpretation, and additional responses from clinical staff for clarification. Thus, the balance between clinical detail and patient-friendly language is crucial. Empathia.ai can adapt to produce both technically accurate and accessible notes, providing the greatest value to end users.

Conclusion

The use of AI scribing in clinical settings offers substantial benefits in terms of time savings and documentation efficiency. However, the variability in reliability and readability of notes remains a concern. Although companies like Empathia.ai demonstrate reliable output, future research should focus on the continued refinement of AI algorithms to enhance both the clinical accuracy and readability of notes while further exploring the impact of these tools on physician satisfaction and patient engagement.

Future Directions

To optimize the utility of AI scribing, ongoing research should aim to:

• Develop standardized benchmarks for note reliability and readability.

• Investigate the integration of patient feedback into AI-generated note formats.

• Explore how AI scribes can be tailored to specific clinical settings and specialties for maximum benefit.

To maintain objectivity, most of the data review, analysis, and compilation was performed by: OpenAI. (2024). ChatGPT-40 [Large language model]. https://chat.openai.com/chat
Prompt available upon request.

APPENDIX

Data for Chart 1: Note Accuracy Across Metrics

Data for Chart 2: Accuracy and Readability

Evaluation of Note 1 (Empathia.ai):

1. Inclusion of Patient History:
   Strengths: Note 1 provides a comprehensive background, including the patient's move to Portland, new job, anxiety history, use of therapy, propranolol for presentations, and smoking habits. It accurately reflects the patient's social situation, including moving alone and feeling more settled.

   Limitations: The note does not explicitly mention the challenges Tina faced adjusting to Portland, nor does it highlight the importance of her supportive friends, as discussed in the transcript.

   Accuracy Score: 95% (The patient's history is well captured with minor omissions regarding adjustment and support).

2. Symptoms and Review of Systems:
   Strengths: The note thoroughly documents symptoms related to anxiety, including constant anxiety worsening with stress, use of propranolol, occasional headaches, and heart racing. The review of systems is detailed, covering cardiovascular, gastrointestinal, musculoskeletal, integumentary, and genitourinary systems.

   Limitations: The review of systems is well documented, but there is a slight generalization in areas like back pain, which was discussed in the transcript as occasional but not emphasized here.

   Accuracy Score: 90% (Captures almost all major symptoms, with only minor generalization).

3. Plan and Follow-up Instructions
   Strengths: The treatment plan is highly detailed and clear. It outlines the prescription of sertraline 50 mg for anxiety, lisinopril with specific dosage instructions, and smoking cessation strategies including nicotine replacement therapy, medications, and referral to a program. Follow-up is scheduled in one month to assess multiple aspects, and fasting labs are specified.

   Limitations: The plan is robust, but it slightly paraphrases the detailed conversations about the smoking cessation program and lab work. However, the essential points are still covered.

   Accuracy Score: 95% (Clear, comprehensive plan with only minor paraphrasing).

4. Ease of Use for Subsequent Visits:
   Strengths: The note is structured and organized in a way that makes it easy for any clinician to understand the patient's history, current issues, and treatment plan. Follow-up instructions are clear, including specific assessments for anxiety, blood pressure, and smoking cessation progress.

   Limitations: The note is very comprehensive, but the abundance of details could be slightly overwhelming for a quick review during a busy clinic visit.

   Continuity of Care Score: 95% (Highly supportive of continuity, with all critical details present and clear).

Readability Analysis:

• Flesch-Kincaid Grade Level:
  Flesh-Kincaid Grade Level: 9.2 Flesch Reading Ease Score: 45.4
  Reading Level: College ( Difficult to read ) Average Words per Sentence: 9
  Average Syllables per Word: 1.8 Sentences: 46
  Words: 415

• Patient Accessibility:
  The note includes clinical terms that may not be easily understood by all patients (e.g., “beta blocker,” “propranolol,” “hemoglobin A1C”). However, these terms are necessary for medical accuracy and could be clarified in patient communications.

Overall Support for Continuity of Care:

• Strengths: Note 1's structure, detail, and organization make it highly effective for supporting continuity of care. It is comprehensive enough to guide follow-up visits with clear next steps for treatment.

• Limitations: The note's level of detail might be slightly overwhelming in fast-paced clinical settings, but this is a minor drawback given the overall completeness.

Final Accuracy and Continuity Scores:

• Inclusion of Patient History: 95%

• Symptoms and Review of Systems: 90%

• Plan and Follow-up Instructions: 95%

• Ease of Use for Subsequent Visits: 95%

• Overall Score for Note 1: 94%

• Readability Sidenote: While the note is thorough and accurate, some clinical terms might require patient-friendly explanations for those accessing their records under the CURES Act.

Evaluation of Note 2 (Nabla Copilot):

1. Inclusion of Patient History:
   Strengths: Note 2 provides a solid overview of the patient's history, including anxiety, the use of propranolol for presentations, and the patient's elevated blood pressure treated with lisinopril. It also mentions Tina's move to Portland and her new job as a project manager.

   Limitations: While the essential details are captured, the note is more summarized compared to Notes 1 and 3. It doesn't fully explore the patient's adjustment to Portland, her support system, or the specific challenges she's faced.

   Accuracy Score: 85% (The history is accurate but lacks the depth and contextual details seen in other notes).

2. Symptoms and Review of Systems:
   Strengths: The note accurately mentions the primary symptoms of anxiety, stress triggers, and the patient's use of propranolol with limited success. It also captures the patient's smoking habits and mentions the need to refill her lisinopril prescription. The review of systems is present but not detailed, focusing primarily on major systems like cardiovascular and respiratory.

   Limitations: The review of systems is less comprehensive, lacking the detailed checks for gastrointestinal, musculoskeletal, and integumentary symptoms. Additionally, symptoms like back pain and occasional headaches are mentioned briefly without detail.

   Accuracy Score: 80% (Covers key symptoms but omits details in the review of systems and generalizes certain aspects).

3. Plan and Follow-up Instructions:
   Strengths: The treatment plan is concise and covers the essentials, including the prescription of sertraline for anxiety and lisinopril for blood pressure. It also mentions the importance of follow-up in a month and provides some information about smoking cessation options. The plan includes ordering basic labs, though it lacks details on specific instructions (e.g., fasting labs).

   Limitations: The note is less detailed in its follow-up instructions. It doesn't fully specify the expectations for the next visit, such as checking for progress in anxiety management, smoking cessation, and blood pressure control. The smoking cessation discussion is minimal and lacks the depth of Note 1 and Note 3.

   Accuracy Score: 85% (The plan is clear but summarized, with less detail on follow-up expectations and patient education).

4. Ease of Use for Subsequent Visits:
   Strengths: The note's summary format makes it quick and easy to review, which could be beneficial in a busy clinical environment. The core information needed for continuity of care is present, making it functional for subsequent visits.

   Limitations: The lack of detail might require a clinician to gather additional information during follow-up visits. For example, the absence of a thorough review of systems could lead to missed details in the patient's ongoing care.

   Continuity of Care Score: 85% (While functional and easy to review, the lack of detail could affect continuity in more complex cases).

Readability Analysis:

• Flesch-Kincaid Grade Level:
  Flesh-Kincaid Grade Level: 9.2 Flesch Reading Ease Score: 40
  Reading Level: College ( Difficult to read ) Average Words per Sentence: 6
  Average Syllables per Word: 1.9 Sentences: 47
  Words: 281

• Patient Accessibility: The note is relatively accessible for patients, though some medical terms like “sertraline” and “propranolol” might still require explanation. The simplified language could improve patient comprehension compared to more detailed notes.Overall Support for Continuity of Care:

• Strengths: Note 2's clarity and concise format make it easy for clinicians to review. The essential information is present, and the treatment plan is straightforward.

• Limitations: The summarized nature of the note could result in gaps in care, particularly if another clinician needs to pick up on subtle symptoms or nuances that were not documented. The follow-up instructions, while clear, could be more detailed.Final Accuracy and Continuity Scores:

• Inclusion of Patient History: 85%

• Symptoms and Review of Systems: 80%

• Plan and Follow-up Instructions: 85%

• Ease of Use for Subsequent Visits: 85%

Overall Score for Note 2: 84%

Readability Sidenote: The note is more readable than most, with a simplified format and language that could benefit both clinicians and patients accessing their records under the CURES Act.

Conclusion:

Note 2 provides an accurate but summarized version of the patient interaction. It captures the critical elements needed for clinical care but omits some details that could be important for comprehensive follow-up. The note's readability is a key strength, making it more accessible for patients and easier to review for busy clinicians. However, the trade-off is a lack of depth, which might impact continuity in more complex cases.

Evaluation of Note 3 (Scribeberry):

1. Inclusion of Patient History:
   Strengths: Note 3 captures the patient's history comprehensively, including her anxiety history, use of propranolol, the impact of stress due to moving and starting a new job, and her smoking habits. The note even elaborates on the patient's response to propranolol ("with minimal benefit") and includes more detailed context than some of the other notes.

   Limitations: While the history is well-documented, the note does not emphasize Tina's supportive social network in Portland, which was part of the original conversation. It also generalizes some aspects of her experience with anxiety.

   Accuracy Score: 95% (The patient's history is captured with a high level of detail, though some social context is omitted).

2. Symptoms and Review of Systems:
   Strengths: The note is very thorough in covering symptoms, including constant anxiety, stress triggers, occasional headaches, and heart racing. The review of systems includes all major areas, such as cardiovascular, respiratory, gastrointestinal, and musculoskeletal systems, making it one of the most comprehensive reviews.

   Limitations: While detailed, the note slightly paraphrases the patient's responses during the review of systems. The occasional back pain mentioned in the transcript is minimized and generalized.

   Accuracy Score: 90% (The review of systems is highly detailed, but some minor details are paraphrased or generalized).

3. Plan and Follow-up Instructions:
   Strengths: The treatment plan is comprehensive, addressing anxiety with sertraline, restarting lisinopril for hypertension, and providing specific details on smoking cessation options. The note discusses non-pharmacologic options for anxiety management and emphasizes the importance of medication adherence, showing a strong patient-centered approach. Follow-up instructions are clear and include a one-month reassessment for multiple health concerns.

   Limitations: The note does not emphasize the exact logistics of the lab work (e.g., the timing of fasting labs) and slightly paraphrases the detailed smoking cessation conversation that occurred in the transcript.

   Accuracy Score: 95% (The plan is detailed and patient-centered, with only minor omissions or paraphrasing).

4. Ease of Use for Subsequent Visits:
   Strengths: The note is well-structured and detailed, making it easy for another clinician to understand the patient's history, current treatment plan, and necessary follow-up steps. Theinclusion of both pharmacologic and non-pharmacologic options provides comprehensive guidance for ongoing care.

   Limitations: The detailed nature of the note is a strength, but it may require additional time for a clinician to review, especially in fast-paced settings.

   Continuity of Care Score: 95% (The note is clear, comprehensive, and highly supportive of continuity of care).

Readability Analysis:

• Flesch-Kincaid Grade Level:
  Flesh-Kincaid Grade Level: 14.2 Flesch Reading Ease Score: 10.9
  Reading Level: College graduate ( Very difficult to read ) Average Words per Sentence: 9.7
  Average Syllables per Word: 2.2 Sentences: 33
  Words: 320

• Patient Accessibility: While the note is appropriate for clinical use, some terms like "non- pharmacologic options," "medication adherence," and specific medication names may require additional explanation for patients.Overall Support for Continuity of Care:

• Strengths: Note 3 excels in providing comprehensive documentation that supports continuity of care. It is well-organized, with clear follow-up instructions, making it easy for subsequent visits.

• Limitations: The detailed nature of the note could be overwhelming for a quick review in a busy clinical setting, but this is a minor drawback given the overall utility.

Final Accuracy and Continuity Scores:

• Inclusion of Patient History: 95%

• Symptoms and Review of Systems: 90%

• Plan and Follow-up Instructions: 95%

• Ease of Use for Subsequent Visits: 95%

Overall Score for Note 3: 94%

Readability Sidenote: The note is comprehensive and detailed but may include clinical terms that are difficult for some patients to understand without further explanation.

Conclusion:

Note 3 is highly effective for clinical documentation, providing a detailed and accurate reflection of the patient interaction. The note's strength lies in its comprehensive review of systems, patient-centered treatment plan, and detailed follow-up instructions, making it highly supportive of continuity of care. While the readability level is appropriate for clinicians, some medical jargon might require simplification for patient access under the CURES Act. The thoroughness of this note makes it a reliable resource for both clinicians and patients, ensuring smooth transitions in care during follow-up visits.

Evaluation of Note 4 (Heidi Health):

1. Inclusion of Patient History:
   Strengths: Note 4 accurately captures the main points of the patient's history, including the long-standing anxiety, the use of propranolol for situational anxiety, her history of hypertension managed with lisinopril, and the impact of her recent move to Portland. The note mentions her smoking habits and expresses her openness to smoking cessation options.

   Limitations: The note is more summarized compared to Notes 1 and 3. It omits some social context, such as her supportive friends in Portland and the challenges of settling into the new environment. It also generalizes some aspects of her anxiety and stress response without elaborating.

   Accuracy Score: 85% (The patient's history is captured, but it is more summarized and lacks contextual details).

2. Symptoms and Review of Systems:
   Strengths: The note covers the primary symptoms, such as constant anxiety that worsens with stress, occasional headaches, and heart racing. The review of systems is adequate, touching on major systems like cardiovascular, respiratory, and musculoskeletal systems.

   Limitations: The review of systems is less comprehensive than in Note 1 and Note 3. It does not fully explore gastrointestinal, integumentary, or genitourinary symptoms, and the occasional back pain mentioned by the patient is only briefly noted.

   Accuracy Score: 80% (Key symptoms are mentioned, but the review of systems is generalized and lacks thoroughness).

3. Plan and Follow-up Instructions:
   Strengths: The treatment plan includes appropriate medications for anxiety (sertraline) and hypertension (lisinopril), with clear dosage instructions. The plan mentions smoking cessation options like nicotine replacement therapy and medications, along with a referral to a smoking cessation program. Preventive care is addressed with lab orders for metabolic panels and lipid tests.

   Limitations: The follow-up instructions are less detailed than in other notes. The note mentions a general one-month follow-up but does not specify what will be reassessed (e.g., anxiety management, blood pressure control, smoking cessation). The discussion around smoking cessation is also less detailed, with fewer specifics on the counseling and support options.

   Accuracy Score: 85% (The plan is clear but less detailed, especially in follow-up instructions and patient education).

4. Ease of Use for Subsequent Visits:
   Strengths: The note is concise and organized, making it easy for a clinician to quickly review the key information. The treatment plan is clear, and essential details are present.

   Limitations: The summarized nature of the note means that some important context and details are missing, which could result in gaps in care. For example, the lack of a detailed review of systems or specific follow-up instructions could lead to missed information during follow-up visits.

   Continuity of Care Score: 85% (The note is functional and clear, but the lack of detail could impact continuity in complex cases).

Readability Analysis:

• Flesch-Kincaid Grade Level:
  Flesh-Kincaid Grade Level: 14 Flesch Reading Ease Score: 0.5
  Reading Level: College graduate ( Very difficult to read ) Average Words per Sentence: 3.2
  Average Syllables per Word: 2.4 Sentences: 53
  Words: 172

• Patient Accessibility: The note is more readable than other notes due to its summarized format and simpler language. However, it still includes some medical terminology (e.g., “sertraline,” “lisinopril”) that might require additional explanation for patients.Overall Support for Continuity of Care:

• Strengths: The note is easy to review and captures the core elements needed for clinical follow- up. The treatment plan is clear, and essential medications and lab orders are specified.

• Limitations: The lack of detail in the review of systems and follow-up instructions could affect continuity, especially if a different clinician needs to take over care during the next visit. The more general nature of the note could lead to important information being overlooked.Final Accuracy and Continuity Scores:

• Inclusion of Patient History: 85%

• Symptoms and Review of Systems: 80%

• Plan and Follow-up Instructions: 85%

• Ease of Use for Subsequent Visits: 85%

Overall Score for Note 4: 84%

Readability Sidenote: The note is highly readable, with a straightforward format and simpler language. However, the trade-off is a loss of detail, which could impact both clinical care and patient understanding.

Conclusion:

Note 4 provides a concise summary of the patient interaction, capturing the key information needed for clinical care. While the note is clear and easy to review, it sacrifices depth and detail, which could be problematic for complex cases or when transitioning care to another clinician. The readability level is appropriate for most patients, making it accessible under the CURES Act, but the lack of context and thoroughness may limit its overall effectiveness in supporting continuity of care.

Evaluation of Note 5 (Tali AI):

1. Inclusion of Patient History:
   Strengths: Note 5 provides a basic overview of the patient's history, including her long-standing anxiety, the use of propranolol for presentations, her history of hypertension, and her smoking habits. It also mentions her recent move to the city and her job.

   Limitations: The note is very summarized and lacks depth. It omits important context such as the patient's adjustment to her new environment, the support she receives from friends, and the impact of stress on her health. The social history is briefly mentioned without elaboration.

   Accuracy Score: 75% (The history is accurate but lacks important contextual details, leading to a more superficial understanding of the patient's situation).

2. Symptoms and Review of Systems:
   Strengths: The note includes the major symptoms of anxiety, occasional headaches, heart racing during anxiety episodes, and the history of blood pressure management with lisinopril. It mentions the patient's occasional back pain and smoking habits.

   Limitations: The review of systems is minimal and lacks coverage of several important areas. There's no mention of digestive system health, urinary or gynecological issues, or other details that could have been relevant. The review is general and leaves out some symptoms entirely, making it less comprehensive.

   Accuracy Score: 75% (Key symptoms are mentioned, but the review of systems is highly generalized and incomplete).

3. Plan and Follow-up Instructions:
   Strengths: The treatment plan covers the basics: prescribing sertraline for anxiety, restarting lisinopril for hypertension, and discussing smoking cessation options. The note mentions nicotine replacement therapy and provides general information about medications like bupropion and varenicline. Lab orders for metabolic and lipid panels are also included.

   Limitations: The follow-up instructions are vague and lack specific details. The note mentions a follow-up in a month but does not provide guidance on what aspects should be reassessed (e.g., response to anxiety treatment, blood pressure control, progress with smoking cessation). The discussion about smoking cessation is very brief and does not delve into patient counseling or specific strategies, which could be crucial in helping the patient quit.

   Accuracy Score: 75% (The plan is functional but lacks detailed instructions and specific follow-up guidance, making it less actionable).

4. Ease of Use for Subsequent Visits:
   Strengths: The note's brevity and summary format make it easy to review in a busy clinical setting. The key points are presented in a straightforward manner, which can save time.

   Limitations: The lack of detail makes it harder for another clinician to fully understand the patient's condition and treatment plan. Missing details in the review of systems, history, and follow-up plan could lead to gaps in care. Subsequent visits might require additional information gathering, which could have been avoided with a more comprehensive note.

   Continuity of Care Score: 75% (The note is quick to review but sacrifices important details that could impact continuity in ongoing care).

Readability Analysis:

• Flesch-Kincaid Grade Level:
  Flesh-Kincaid Grade Level: 12.2
  Flesch Reading Ease Score: 15.9
  Reading Level: College graduate ( Very difficult to read ) Average Words per Sentence: 4.7
  Average Syllables per Word: 2.2 Sentences: 31
  Words: 146

• Patient Accessibility: The note's simplicity and straightforward language make it accessible for most patients. However, the lack of depth might result in insufficient information being conveyed to patients, leading to confusion about their care plan.Overall Support for Continuity of Care:

• Strengths: The note is concise and easy to understand, making it accessible for both clinicians and patients. It quickly covers the essentials, which is useful in fast-paced clinical environments.

• Limitations: The brevity of the note comes at the cost of important details, leading to potential gaps in care. The lack of a comprehensive review of systems, detailed follow-up instructions, and context around the patient's situation could hinder effective continuity of care. Another clinician might have difficulty piecing together the full picture from this note alone.Final Accuracy and Continuity Scores:

• Inclusion of Patient History: 75%

• Symptoms and Review of Systems: 75%

• Plan and Follow-up Instructions: 75%

• Ease of Use for Subsequent Visits: 75%

Overall Score for Note 5: 75%

Readability Sidenote: The note is highly readable and accessible for most patients but lacks the detail necessary for optimal continuity of care.

Conclusion:

Note 5 provides a very basic and summarized version of the patient interaction. While it captures the essentials needed for clinical care, it omits a significant amount of detail that could be critical for comprehensive follow-up. The note's strength lies in its readability and simplicity, making it suitable for quick reviews in busy settings. However, this comes at the expense of depth and thoroughness, which could lead to gaps in care during follow-up visits. The trade-off between simplicity and detail makes this note less effective in supporting continuity of care, especially for more complex cases or when transitioning care between clinicians.

Evaluation of Note 6 (Getfreed.ai):

1. Inclusion of Patient History:
   Strengths: Note 6 effectively summarizes key historical information: anxiety history, treatment with propranolol, high blood pressure managed with lisinopril, and smoking habits. The note appropriately includes the patient's social context (recent move and new job).

   Limitations: While the note captures the major elements, some nuances are missing. For instance, there's no mention of the patient's adjustment to Portland or the specific concerns raised during the review of systems.

   Accuracy Score: 90% (Comprehensive but lacks some specific details from the interaction transcript).

2. Symptoms and Review of Systems:
   Strengths: Note 6 covers key symptoms such as constant anxiety, the impact of stress, and the occasional use of propranolol. It also captures the patient's smoking habits and occasional headaches.

   Limitations: The note misses details regarding the heart racing during anxiety episodes and omits the full review of systems. Specifically, the digestive system, muscle/joint pain, and urinary/gynecological symptoms are not addressed in detail.

   Accuracy Score: 85% (Captures most major symptoms but lacks depth in the review of systems).

3. Plan and Follow-up Instructions:
   Strengths: The treatment plan is detailed and comprehensive, addressing anxiety, hypertension, tobacco use, and preventive care. The note outlines the prescription of sertraline and lisinopril with specific instructions. Smoking cessation strategies, including nicotine replacement and medications, are also clearly discussed.

   Limitations: The follow-up instructions are generally good, but they don't emphasize some key aspects discussed in the transcript, like the importance of checking fasting labs immediately or adjusting the lisinopril dosage based on response.

   Accuracy Score: 90% (Well-structured plan, but slightly less detailed than the interaction transcript).

4. Ease of Use for Subsequent Visits:
   Strengths: Note 6 provides a comprehensive overview that would be easy for another clinician to use for continuity of care. The inclusion of detailed follow-up instructions and preventive care screening is valuable.

   Limitations: The note's slight lack of detail in the review of systems and some specific aspects of the patient's history could result in minor gaps when using this note for follow-up care.

   Continuity of Care Score: 85% (Clinically useful and clear, but the absence of certain details could impact continuity).

Readability Analysis:

• Flesch-Kincaid Grade Level:
  Flesh-Kincaid Grade Level: 10.4 Flesch Reading Ease Score: 36.8
  Reading Level: College ( Difficult to read ) Average Words per Sentence: 9.2
  Average Syllables per Word: 1.9 Sentences: 50
  Words: 462

• Patient Accessibility: While mostly accessible, some clinical terms might be challenging for patients to fully understand without explanation (e.g., "hemoglobin A1C," "nicotine replacement therapy").Overall Support for Continuity of Care:

• Strengths: Note 6 is structured and clear, making it easy to follow for both clinicians and patients. The treatment plan is comprehensive, and follow-up instructions are well-defined.

• Limitations: Minor details missing in the review of systems and social context could impact continuity, especially if another clinician relies solely on this note. Final Accuracy and Continuity Scores:

• Inclusion of Patient History: 90%

• Symptoms and Review of Systems: 85%

• Plan and Follow-up Instructions: 90%

• Ease of Use for Subsequent Visits: 85%

Overall Score for Note 6: 88%

Readability Sidenote: Readability is generally good, but certain clinical terms may require patient-friendly explanations for those accessing their records under the CURES Act.

Conclusion:

Note 6 is a solid representation of the clinical interaction, capturing the main points and providing a clear, actionable plan. While it is comprehensive, certain details—especially regarding the review of systems—could be more thoroughly documented to improve accuracy and continuity in subsequent visits. Its readability is suitable for clinical purposes but might require further simplification for optimal patient engagement.