No part of this publication may be reproduced or distributed in any form or by any means, electronic or mechanical,
including photocopying, recording, scanning, any information storage and retrieval system, or otherwise, without
the prior written permission of the National Association for Healthcare Quality. For permission or questions about
permissible usage, contact the National Association for Healthcare Quality at info@nahq.org or by mail at National
Association for Healthcare Quality, 8735 W. Higgins Road, Suite 300, Chicago, IL 60631.
Project Sponsors
Lenard (Len) L. Parisi, MA RN CPHQ FNAHQ, President, National Association for Healthcare Quality (NAHQ); Vice
President Quality Management/Performance Improvement, Metropolitan Jewish Health System (MJHS)
Stephanie Mercado, CAE, Executive Director, National Association for Healthcare Quality (NAHQ)
PERFORMANCE
QUALITY REVIEW & & PROCESS
ACCOUNTABILITY IMPROVEMENT
Competency Dimensions
1. Data Management
1.1. Acquire data from disparate sources.
1.2. Validate the structural integrity of data sets.
1.3. Store data efficiently.
1.4. Ensure the protection of confidential and sensitive data.
1.5. Understand standard administrative health, clinical, and quality data.
1.6. Prevent business interruption by ensuring continuity based on valid and reliable documentation.
1.7. Develop and maintain databases for small-scale analytic projects that are executed solely by the quality department.
2. Applying Statistical Methods
2.1. Understand statistics concepts and accurately apply statistical methods under minimal supervision.
2.2. Demonstrate ability to select, use, and support the most appropriate dedicated statistical programming environments
and general-purpose scripting languages given specific analytics and reporting requirements.
2.3. Assess the relative fitness of data for specific statistical purposes.
2.4. Understand and apply statistical methods associated with various improvement projects to ensure that methodologi-
cal rigor is maintained.
3. Transforming Data into Information
3.1. Clarify expectations about the scope and purpose of the deliverables requested as part of an analytics work effort.
3.2. Fully understand the lessons of the data in light of relevant clinical and operational subject-matter expertise.
3.3. Summarize complex findings through appropriate methods of data visualization.
3.4. Transform a data-driven work product into a comprehensive narrative structure that tells the whole story of the anal-
ysis to a nontechnical audience.
2.1. Understand statistics concepts 2.1.1a. Apply analytics approaches such 2.1.2a. Develop regression models, including
and accurately apply statistical as decision analysis, risk adjustment, linear, multiple, and logistic regression methods.
methods under minimal supervision. benchmarking, outcomes analysis, and 2.1.2b. Assess Bayesian as well as frequentist
patient risk prediction/stratification. approaches to specific problems.
2.1.1b. Understand and apply 2.1.2c. Develop specific mathematical models
probabilistic concepts such as use of to isolate trends or reveal improvement
diagnostic tests (e.g., determination of opportunities.
sensitivity and specificity), calculation of 2.1.2d. Understand machine learning and
prevalence, and probability distributions pattern recognition methods such as artificial
(e.g., normal, binomial, Poisson). neural networks, decision trees, and support-
2.1.1c. Understand and apply hypothesis vector machines.
testing concepts and methods (e.g., one-
vs. two-sided tests, types of error, power
calculation, sample size estimation, t-tests,
variance analysis).
2.2. Demonstrate ability to 2.2.1a. Understand current range of tools 2.2.2a. Train others on the use of a specific
select, use, and support the most well enough to meaningfully engage with analytics platform, including coaching about
appropriate dedicated statistical vendor/platform selection. the appropriate procedure available within the
programming environments and 2.2.1b. Evaluate prospective tools for platform that will most effectively address a specific
general-purpose scripting languages their functional capabilities, conformance problem.
given specific analytics and reporting to specifications, and their ability to meet 2.2.2b. Serve, as needed, as analytics platform
requirements. requirements of the analytic environment administrator or content steward.
such as interfacing to source systems and
local or cloud storage.
2.3 Assess the relative fitness of data 2.3.1a. Perform various tests of normality 2.3.2a. Transform data to meet specific
for specific statistical purposes. and validity. requirements.
2.3.1b. Impute missing values as 2.3.2b. Propose methods to minimize
appropriate. confounding variables and limitations of data.
2.3.1c. Recommend specific
improvements to data-collection
procedures.
2.4. Understand and apply statistical 2.4.1a. Apply appropriate advanced 2.4.2a. Provide statistical mentoring and
methods associated with various statistical methods common to defined methodological support to quality and process
improvement projects to ensure that quality and process improvement activities improvement work efforts.
methodological rigor is maintained. (e.g., process capability, Pareto analysis, 2.4.2b. Write protocols for targeted experiments.
reliability analysis, control charts).
2.4.1b. Apply knowledge to execute
targeted experiments.
3.1. Clarify expectations about 3.1.1a. Develop a clear understanding of 3.1.2a. Educate consumers, including
the scope and purpose of the the questions and analytic goals of the target consumers at an executive level, about the most
deliverables requested as part of audience (clinical, business unit) to gain a full efficient ways of framing questions or requests
an analytics work effort. understanding of the project. Assist end user to to obtain desired information early in a project
clarify questions and goals when needed. or requests lifecycle.
3.1.1b. Obtain consensus among stakeholders 3.1.2b. Coach project stakeholders to focus
about the specific analytic deliverables required on the broad business or clinical questions, so
to successfully answer the core business the analysts can frame deliverables according
questions presented within a given project or to their expertise, rather than constraining
data request. the analytics process through overly targeted
3.1.1c. Appropriately scope a new analytics requests for analytic works products that may
project to define expected deliverables of the preclude the serendipitous discovery of relevant
project before work begins. wisdom.
3.2. Fully understand the lessons 3.2.1a. Coordinate analytic findings with 3.2.2a. Lead efforts to interpret counterintuitive
of the data in light of relevant relevant subject-matter experts to ensure harmony data in light of alternative scenarios not
clinical and operational subject- of interpretation between the data and evidence- otherwise foreseen by clinical evidence or the
matter expertise. based or standard-work procedures. organizations standard work.
3.2.1b. Develop subject-matter expertise in 3.2.2b. Publish salient findings or procedures in
the topic, service line, or area of inquiry to journals or at conferences to advance the state
ensure that the data are interpreted according of the industry.
to an accurate understanding of best-practice
literature and standard work procedures.
3.3. Summarize complex 3.3.1a. Select specific visualization techniques 3.3.2a. Develop dashboards and scorecards
findings through appropriate based on the most appropriate use (e.g., when using advanced visualization techniques
methods of data visualization. or why to use bar charts, control charts, bullet and data capabilities such as embedding
charts, run charts). analytics in clinical and business process tools
3.3.1b. Incorporate appropriate elements to or designing dashboards tailored to strategic
create an informative graph (i.e., descriptive goals.
graph title, succinct axis titles, lack of repetition, 3.3.2b. Translate business requirements for
use of appropriate significant digits, lack of dashboard data into an accurate business-
clutter, appropriate use of zero as a baseline on intelligence layer that correctly reflects nuanced
vertical axes). information, avoids hiding unwelcome
3.3.1c. Develop basic dashboards and information, and meets customer needs while
scorecards to show internal data as well as maintaining high standards of methodological
benchmark comparisons (regionally, nationally, integrity.
across hospital systems, or hospital to hospital)
that frame PI/QI initiatives, using appropriate
graphical representation of comparative data.