Health Catalyst Real-World Testing Plan
General Information
Developer Name: Health Catalyst, Inc.
Product Name(s): Health Catalyst Data Operating System
Version Number(s): 18
Certified Health IT Product List (CHPL) ID(s): 15.04.04.3034.Heal.18.00.1.181231
Justification
Our approach will demonstrate the successful Real-World testing of the following elements of our certification:
- 170.315(c)(1) – Clinical Quality Measures – Record and Export
- 170.315(c)(2) – Clinical Quality Measures – Import and Calculate
- 170.315(c)(3) – Clinical Quality Measures – Report
We will be using direct comparisons against source systems or other references to ensure that we are accurately importing, calculating, and exporting data and results from our product. We feel this approach is appropriate in demonstrating our product’s use in the real-world environment. Since our product is marketed and used for quality reporting, we think our approach will sufficiently show that our quality reporting product meets the requirements of the certification.
Standards Updates
Standard (and version): None
Updated certification criteria and associated product: N/A
Health IT Module CHPL ID: N/A
Method used for standard update: N/A
Date of ONC ACB notification: N/A
Date of customer notification (SVAP only): N/A
Conformance measures: N/A
USCDI updated certification criteria (and USCDI version): N/A
Measurement
Each measurement for our real-world testing plan has the following elements:
- Description of the measurement
- Associated certification criteria
- Justification
- Care setting(s) that is addressed
- We only have one client using our system. All our tests will be performed at that one client.
- Expected outcomes
RWT#1 – QRDA1 Export
Description
To test that we can export QRDA1 files from system and that the files are accurate and contain the appropriate information.
Associated Certification Criteria
170.315(c)(1) – Clinical Quality Measures – Record and Export
Justification
This measurement will test whether our not our system can generate a QRDA1 file and that QRDA1 file is accurate and contains information that is expected.
Care Setting
Ambulatory
Expected Outcomes
Generate 10 QRDA1 files from our client system which confirms that we can export QRDA1 files. We will then compare the contents of the QRDA1 files against our client’s EDW to ensure accuracy of the data in the QRDA1 files.
RWT#2 – Record Data
Description
To test that we can accurately record data from our client’s source system.
Associated Certification Criteria
170.315(c)(1) – Clinical Quality Measures – Record and Export
Justification
This measurement will test whether our system can accurately record data from our client’s source systems. Accurately recording data from our client’s source system is critical to accurately calculating our quality measures.
Care Setting
Ambulatory
Expected Outcomes
We will work with our client to do chart level validation against 30 randomized patient charts to ensure accuracy of the data we capture from their source systems.
RWT#3 – Import QRDA1
Description
To test if we can import QRDA1 files.
Associated Certification Criteria
170.315(c)(2) – Import and Calculate
Justification
This measurement will test whether our system can appropriately import QRDA1 files. This test will also measure if we can import QRDA1 files and accurately store that information.
Care Setting
Ambulatory
Expected Outcome
We will export a QRDA1 export from our client’s system and then ingest that export into our EDW. We will then run reports off the client’s system and our EDW to ensure that the information matches.
RWT#4 – Calculate Measure Results
Description
To test if we can calculate the following eCQMs accurately:
- CMS2: Preventive Care and Screening: Screening for Depression and Follow-Up Plan
- CMS22: Preventive Care and Screening: Screening for High Blood Pressure and Follow-Up Documented
- CMS50: Closing the Referral Loop: Receipt of Specialist Report
- CMS69: Preventive Care and Screening: Body Mass Index (BMI) Screening and Follow-Up Plan
- CMS75: Children Who Have Dental Decay or Cavities
- CMS122: Diabetes: Hemoglobin A1c (HbA1c) Poor Control (> 9%)
- CMS124: Cervical Cancer Screening
- CMS125: Breast Cancer Screening
- CMS127: Pneumococcal Vaccination Status for Older Adults
- CMS130: Colorectal Cancer Screening
- CMS131: Diabetes: Eye Exam
- CMS134: Diabetes: Medical Attention for Nephropathy
- CMS137: Initiation and Engagement of Alcohol and Other Drug Dependence Treatment
- CMS138: Preventive Care and Screening: Tobacco Use: Screening and Cessation Intervention
- CMS139: Falls: Screening for Future Fall Risk
- CMS146: Appropriate Testing for Children with Pharyngitis
- CMS147: Preventive Care and Screening: Influenza Immunization
- CMS149: Dementia: Cognitive Assessment
- CMS155: Weight Assessment and Counseling for Nutrition and Physical Activity for Children and Adolescent
- CMS156: Use of High-Risk Medications in the Elderly
- CMS160: Depression Utilization of the PHQ-9 Tool
- CMS165: Controlling High Blood Pressure
- CMS347: Statin Therapy for the Prevention and Treatment of Cardiovascular Disease
Associated Certification Criteria
170.315(c)(2) – Import and Calculate
Justification
This measurement will test whether our system can accurately calculate the quality measures we are certified for.
Care Setting
Ambulatory
Expected Outcome
We will run the quality measure calculations on our client system for specific patients. We will then run the same patient information through Cypress and compare our client’s results against the Cypress results. We will also run some chart level comparisons against the client’s EMR.
RWT#5 – Export QRDAIII
Description
To test that we can generate QRDAIII files and that the information contained in the files are accurate.
Associated Certification Criteria
170.315(c)(3) – Report
Justification
This measurement will test whether our system can generate QRDAIII files necessary for reporting out quality measures.
Care Setting
Ambulatory
Expected Outcome
We will generate our client’s QRDAIII file and compare it against their EDW and the calculation results in the EDW. We will ensure that the QRDAIII file contains accurate information.
Key Milestones
- Q12022 – Begin communization with client to ask for their support and participation in real-world testing
- Q2-Q32022 – Prep the client for real-world testing and perform real-world testing for CY2022. If, non-conformity with the Certification Program requirements are found, notify ONC-ACB
- Q42022 – Submit real-world testing plan for CY2023
- February 2023 – Submit our real-world test results to our ONC-ACB