SAFER
Safety Assurance Factors
for EHR Resilience
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Self-Assessment
Computerized Provider Order
Entry with Decision Support
General Instructions
for the SAFER Self-Assessment Guides
The SAFER Guides are designed to help
healthcare organizations conduct self-assessments
to optimize the safety and safe use of electronic
health records (EHRs) in the following areas.
High Priority Practices
Organizational Responsibilities
Contingency Planning
System Configuration
System Interfaces
Patient Identification
Computerized Provider Order Entry
with Decision Support
Test Results Reporting and Follow-up
Clinician Communication
Each of the nine SAFER Guides begins with a Checklist
of recommended practices. The downloadable SAFER
Guides provide fillable circles that can be used to indicate
the extent to which each recommended practice has been
implemented. Following the Checklist, a Practice Worksheet
gives a rationale for and examples of how to implement
each recommended practice, as well as likely sources of
input into assessment of each practice, and fillable fields to
record team members and follow-up action. In addition to
the downloadable version, the content of each SAFER
Guide, with interactive references and supporting materials,
can also be viewed on ONC’s website at www.healthit.gov/
SAFERGuide.
The SAFER Guides are based on the best evidence
available at this time (2016), including a literature review,
expert opinion, and field testing at a wide range of
healthcare organizations, from small ambulatory practices to
large health systems. The recommended practices in the
SAFER Guides are intended to be useful for all EHR users.
However, every organization faces unique circumstances
and will implement a particular practice differently. As a
result, some of the specific examples in the SAFER Guides
for recommended practices may not be applicable to every
organization.
The SAFER Guides are designed in part to help deal with
safety concerns created by the continuously changing
landscape that healthcare organizations face. Therefore,
changes in technology, practice standards, regulations and
policy should be taken into account when using the SAFER
Guides. Periodic self-assessments using the SAFER Guides
may also help organizations identify areas in which it is
particularly important to address the implications of change
for the safety and safe use of EHRs. Ultimately, the goal is
to improve the overall safety of our health care system.
The SAFER Guides are not intended to be used for legal
compliance purposes, and implementation of a
recommended practice does not guarantee compliance with
HIPAA, the HIPAA Security Rule, Medicare or Medicaid
Conditions of Participation, or any other laws or regulations.
The SAFER Guides are for informational purposes only and
are not intended to be an exhaustive or definitive source.
They do not constitute legal advice. Users of the SAFER
Guides are encouraged to consult with their own legal
counsel regarding compliance with Medicare or Medicaid
program requirements, HIPAA, and any other laws.
For additional, general information on Medicare and Medicaid
program requirements, please visit the Centers for Medicare
& Medicaid Services website at www.cms.gov. For more
information on HIPAA, please visit the HHS Office for Civil
Rights website at www.hhs.gov/ocr.
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
1 of 45
SAFER
Safety Assurance Factors
for EHR Resilience
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Self-Assessment
Computerized Provider Order
Entry with Decision Support
Introduction
The Computerized Provider Order Entry with Decision
Support SAFER Guide identifies recommended safety
practices associated with computerized provider order entry
(CPOE) and clinical decision support (CDS). Completing
this self-assessment in collaboration with a multi-
disciplinary team will help an organization optimize the
safety and safe use of CPOE with CDS in the EHR. The
implementation and use of CPOE with CDS is complex and
fragile, requiring careful planning, implementation, and
maintenance to function properly. In the EHR-enabled
healthcare environment, providers rely on technology to
support and manage the complex processes related to
CPOE with CDS, and this reliance creates potential safety
risks that can be minimized by the adoption of the
recommended practices in this guide.
The use of CPOE with CDS can improve medication safety
as well as ensure that providers who electronically order
diagnostic tests and consultations remain in the
communication loop.
1, 2, 3, 4, 5, 6, 7, 8, 9, 10
However, certain
CPOE-related practices can create safety risks.
11, 12, 13, 14, 15,
16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30
For example, partial
adoption of CPOE, or a lack of CPOE monitoring (e.g.,
incomplete data entry, excessive use of free text), can
create hazardous conditions.
CDS, whether stand-alone or integrated within an EHR, is
designed to aid the clinical decision-making process at the
point of care. The current scope of CDS focuses primarily
on medications, laboratory testing, radiology procedures,
and clinical references literature.
31
Substantial evidence
suggests that well-designed CDS not only
enhances the quality of care, but directly improves patient
safety by decreasing common errors and preventing
omissions or missed opportunities that result in patient
harm.
3, 32, 33, 34, 35
In spite of this, poorly implemented EHR
systems have been shown to introduce errors that
adversely affect care.
11, 15, 20, 25, 36, 37, 38, 39, 40
Completing the self-assessment in the Computerized
Provider Order Entry with Decision Support SAFER Guide
requires the engagement of people both within and
outside of the organization (e.g., EHR technology
developers, diagnostic services providers). Because this
guide is designed to help organizations prioritize EHR-
related safety concerns, clinician leadership in the
organization should be engaged in assessing whether
and how any particular recommended practice affects the
organization’s ability to deliver safe, high quality care.
41
Collaboration between clinicians and staff members while
completing the self-assessment in this guide will enable
an accurate snapshot of the organization’s CPOE and
CDS status, in terms of safety. Even more importantly,
collaboration should lead to a consensus about the
organization’s future path to optimize EHR-related safety
and quality: setting priorities among the recommended
practices not yet addressed, ensuring a plan is in place to
maintain recommended practices already in place,
dedicating the required resources to make necessary
improvements, and working together to mitigate the
CPOE-related safety risks introduced by the EHR.
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
2 of 45
SAFER
Safety Assurance Factors
for EHR Resilience
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Self-Assessment
Computerized Provider Order
Entry with Decision Support
Table of Contents
1
2
4
5
8
General Instructions
Introduction
About the Checklist
Checklist
Team Worksheet
About the Recommended
Practice Worksheets
Recommended Practice
Worksheets
References
9
The SAFER Self-Assessment Guides were developed by health IT safety researchers and informatics experts:
Joan Ash, PhD, MLS, MS, MBA, Professor and Vice Chair, Department of Medical Informatics and Clinical Epidemiology, School of Medicine, Oregon
Health & Science University;
Hardeep Singh, MD, MPH, Associate Professor of Medicine at the Michael E. DeBakey Veterans Affairs Medical Center and Baylor College of
Medicine and Chief of the Health Policy, Quality and Informatics Program at the Houston VA HSR&D Center of Excellence, and Director of the Houston
VA Patient Safety Center of Inquiry; and
Dean Sittig, PhD, University of Texas School of Biomedical Informatics at Houston, UT–Memorial Hermann Center for Healthcare Quality & Safety.
This guide was developed under the contract Unintended Consequences of Health IT and Health Information Exchange, Task Order HHSP23337003T/HHSP23320095655WC.
The ONC composite mark is a mark of the U.S. Department of Health and Human Services. The contents of the publication or project are solely the responsibility of the authors and do not necessarily represent the
official views of the U.S. Department of Health and Human Services, Office of the National Coordinator for Health Information Technology.
10
39
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
3 of 45
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
About the Checklist
>Practice Worksheets
>Table of Contents
>About the Checklist
>Team Worksheet
>About the Practice Worksheets
The Checklist is structured as a quick way to enter and print your self-assesment.
Your selection on the checklist will automatically update the related section of the
corresponding Recommended Practice Worksheet.
The Domain associated with the Recommended Practice(s) appears at
the top of the column.
The Recommended
Practices(s) for the
topic appear below
the associated
Domain.
Select the level of
implementation
achieved by your
organization for each
Recommended
Practice.
Your Implementation
Status will be
reflected on the
Recommended
Practice Worksheet in
this PDF.
To the right of each Recommended Practice is a link
to the Recommended Practice Worksheet in this PDF.
The Worksheet provides guidance on implementing
the Practice.
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
4 of 45
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Checklist
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practices for Domain 1 — Safe Health IT
1.1
Coded allergen and reaction information (or "no
known allergies" [NKA]) are entered and updated
in the EHR prior to any order entry.
Worksheet 1.1
Implementation Status
Fully
in all areas
Partially
in some areas
Not
implemented
reset
1.2
Evidence-based order sets are available in the
EHR for common tasks and conditions and are
updated regularly.
Worksheet 1.2
1.3
User-entered orderable items are matched to, or can
be looked up from, a list of standard terms.
Worksheet 1.3
1.4
The EHR can facilitate both cancellation and
acknowledgment of receipt of orders for laboratory,
radiology, and pharmacy.
Worksheet 1.4
1.5
CDS alerts are displayed in the relevant clinical
context.
Worksheet 1.5
1.6
CDS incorporates current best practices and
guidelines from authoritative sources (e.g.,
national organizations, medical specialty
professional associations).
Worksheet 1.6
Recommended Practices for Domain 2 — Using Health IT Safely
2.1
Clinicians are trained and tested on CPOE
operations before being issued login credentials.
Worksheet 2.1
Implementation Status
Fully
in all areas
Partially
in some areas
Not
implemented
reset
2.2
Clinicians are engaged in implementing, reviewing,
and updating CDS.
Worksheet 2.2
2.3
CPOE is used for ordering all medications,
diagnostic tests, and procedures for which CPOE is
available.
Worksheet 2.3
2.4
There is minimal use of free-text order entry.
Orders are entered and stored in standardized,
coded form.
Worksheet 2.4
2.5
Order entry information is electronically
communicated (e.g., through the computer or
mobile messaging) to the people responsible
for carrying out the order.
Worksheet 2.5
reset
reset
reset
reset
reset
reset
reset
reset
reset
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
5 of 45
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Checklist
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practices for Domain 2 — Using Health IT Safely
Implement
Fully Par
2.6
Interruptive alerts (e.g., pop-ups at the time of
ordering) are used with discretion and only for
high risk, high priority conditions.
Worksheet 2.6
ation Status
in all areas
tially
in some areas
Not
implemented
reset
2.7
Drug-allergy interaction checking occurs during the
entry of new medication orders and new allergies.
Worksheet 2.7
2.8
Duplicate order checking occurs for high risk
medication, diagnostic tests, and procedure
orders (excluding "as needed" [PRN]
medications).
Worksheet 2.8
2.9
Drug-condition checking occurs for important
interactions between drugs and selected conditions.
Worksheet 2.9
2.10
Drug-patient age checking occurs for important age-
related medication issues.
Worksheet 2.10
2.11
Dose range checking (e.g., maximum single dose or
daily dose) occurs before medication orders are
submitted for dispensing.
Worksheet 2.11
2.12
A process is in place to review interactions so that
only the most significant interaction-related alerts, as
determined by the organization, are presented to
clinicians.
Worksheet 2.12
2.13
Clinicians are required to re-enter their password, or
a unique PIN, to “sign” (authenticate) an order.
Worksheet 2.13
2.14
When appropriate, corollary (or consequent) orders
are automatically suggested and linked together with
the original order such that changes are reflected
when the original order is rescheduled, renewed, or
discontinued.
Worksheet 2.14
2.15
Users can access authoritative clinical reference
materials directly from the EHR, including
organization-specific information when available.
Worksheet 2.15
2.16
CPOE and CDS functionality are tested to ensure
proper operation before go-live and with test patients
in the production system before clinical use.
Worksheet 2.16
reset
reset
reset
reset
reset
reset
reset
reset
reset
reset
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
6 of 45
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Checklist
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practices for Domain 2 — Using Health IT Safely
2.17
Questions presented to the user by CPOE or CDS
are unambiguous.
Worksheet 2.17
Implementation Status
Fully
in all areas
Partially
in some areas
Not
implemented
reset
2.18
CPOE and CDS implementation and use are
supported by usability testing based on best
practices from human factors engineering.
Worksheet 2.18
2.19
Critical patient information is visible during the order
entry process.
Worksheet 2.19
2.20
The clinician is informed during the ordering process
when additional steps are needed to complete the
order being requested.
Worksheet 2.20
2.21
Use of abbreviations and acronyms is minimized and
standardized.
Worksheet 2.21
2.22
Additional safeguards (e.g., double checking by a
second specialist) are implemented in the EHR
before high risk medications are prescribed.
Worksheet 2.22
Recommended Practices for Domain 3 — Monitoring Safety
3.1
Key metrics related to CPOE and CDS (e.g.,
override rates) are defined, monitored, and acted on
to optimize safety and use.
Worksheet 3.1
Implementation Status
Fully
in all areas
Partially
in some areas
Not
implemented
reset
reset
reset
reset
reset
reset
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
7 of 45
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Team Worksheet
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
reset page
A multi-disciplinary team should complete this self-assessment and evaluate potential health IT-related patient safety risks
addressed by this specific SAFER Guide within the context of your particular healthcare organization.
This Team Worksheet is intended to help organizations document
the names and roles of the self-assessment team, as well as
individual team members’ activities. Typically, team members will
be drawn from a number of different areas within your
organization, and in some instances, from external sources. The
suggested Sources of Input section in each Recommended
Practice Worksheet identifies the types of expertise or services to
consider engaging. It may be particularly useful to engage specific
clinician and other leaders with accountability for safety practices
identified in this guide.
The Worksheet includes fillable boxes that allow you to document
relevant information. The Assessment Team Leader box allows
documentation of the person or persons responsible for ensuring
that the self-assessment is completed. The section labeled
Assessment Team Members enables you to record the names of
individuals, departments, or other organizations that contributed
to the self-assessment. The date that the self-assessment is
completed can be recorded in the Assessment Completion Date
section and can also serve as a reminder for periodic
reassessments. The section labeled Assessment Team Notes is
intended to be used, as needed, to record important
considerations or conclusions arrived at through the assessment
process. This section can also be used to track important factors
such as pending software updates, vacant key leadership
positions, resource needs, and challenges and barriers to
completing the self-assessment or implementing the
Recommended Practices in this SAFER Guide.
Assessment Team Leader
Assessment Completion Date
Assessment Team Members
Assessment Team Notes
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
8 of 45
SAFERSAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
About the Recommended
Practice Worksheets
>Table of Contents
>About the Checklist
>Team Worksheet
>About the Practice Worksheets
>Practice Worksheets
Each Recommended Practice Worksheet provides guidance on implementing a specific
Recommended Practice, and allows you to enter and print information about your self-assessment.
The Rationale section
provides guidance
about "why" the
safety activities
are needed.
Enter any notes
about your self-
assessment.
Enter any follow-up
activities required.
Enter the name of
the personal
responsible for the
follow-up activities.
The Suggested
Sources of Input
section indicates
categories of
personnel
who can provide
information to help
evaluate your level of
implementation.
The Examples
section lists
potentially useful
practices or
scenarios to inform
your assessment and
implementation of the
specific
Recommended
Practice.
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
9 of 45
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Recommended Practice 1.1
Worksheet
Domain 1 —
Safe Health IT
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practice
Implementation Status
1.1
Coded allergen and reaction information (or "no known
allergies" [NKA]) are entered and updated in the EHR prior
to any order entry.
42
Checklist
Rationale for Practice or Risk Assessment
One of the main purposes of CDS is automated drug-allergy
checking, which requires coded entry of allergies in the EHR.
Suggested Sources of Input
Clinicians, support staff, and/or
clinical administration
EHR developer
Examples of Potentially Useful Practices/Scenarios
Users are reminded to enter patients’ allergies or “no known
allergies” before entering any medication orders.
A standard, controlled vocabulary of allergens and reactions (e.g.,
SNOMED-CT) is available and used.
There is a defined hierarchy of authority to edit or remove allergy-
related information from a patient’s EHR.
The EHR system permits entry of medication intolerances,
distinguished from true allergies.
Assessment Notes
Follow-up Actions
Person Responsible for Follow-up Action
reset page
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
10 of 45
Off
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Recommended Practice 1.2
Worksheet
Domain 1 —
Safe Health IT
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practice
Implementation Status
1.2
Evidence-based order sets are available in the EHR for
common tasks and conditions and are updated
regularly.
43
Checklist
Rationale for Practice or Risk Assessment
Order sets minimize errors of omission through
standardization. Requiring clinicians to enter each of the
individual orders for routine clinical practices increases the
risk of overlooking one or more items.
Suggested Sources of Input
Clinicians, support staff, and/or
clinical administration
EHR developer
Pharmacy
Examples of Potentially Useful Practices/Scenarios
Order sets for medications are developed on the basis of Institute
for Safe Medication Practices (ISMP) guidelines.
44
Similar
standard formatting approaches are used for developing
diagnostic test- and procedure-related order sets.
Order sets exist for the ten most common clinical conditions (e.g.,
management of chest pain), procedures (e.g., insulin
administration and monitoring), and clinical services (e.g.,
admission to labor and delivery).
45
Clinical content is developed or modified based on evidence from
authoritative sources (e.g., the AHRQ CDS Initiative, specialists
within the organization).
EHR developer-provided clinical content is based on authoritative
sources and is reviewed for accuracy on a regular basis, and the
EHR’s software is upgraded whenever those sources are
updated.
Order sets for medications include complete pre-written
medication orders (order sentences) that include dose (unless the
dose should be modified based on patient data, such as blood
pressure, creatinine clearance, or blood glucose), dose form when
necessary, route of administration, frequency, and a PRN flag and
indication, if appropriate.
42
Pre-written medication orders use doses that are weight-based,
when appropriate.
Personalized order sets should be used sparingly. If an
organization permits them, there is an annual review process
(e.g., clinical quality committee or medical director approval).
45
Medications requiring complex dosing guidelines (e.g., insulin
sliding scale) are standardized and available electronically.
The CPOE list of orderable items (i.e., medication dictionary or
orderable catalog) includes all formulary medications to reduce
the necessity of entering free-text orders.
The CPOE list of orderable items includes acceptable, non-
formulary medications, which are clearly marked, that users can
order for out-of-formulary fulfillment.
Prescribing systems for children use weight-based dosing
recommendations, age-appropriate dosing calculators and dose-
range checking, and pediatric-specific drug-drug interaction
alerts.
46
Assessment Notes
Follow-up Actions
Person Responsible for Follow-up Action
reset page
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
11 of 45
Off
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Recommended Practice 1.3
Worksheet
Domain 1 —
Safe Health IT
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practice
Implementation Status
1.3
User-entered orderable items are matched to, or can be
looked up from, a list of standard terms.
47
Checklist
Rationale for Practice or Risk Assessment
CDS is important to patient safety. CDS can be supported
by orders of standardized items, but not on free-text
orders.
Suggested Sources of Input
Clinicians, support staff, and/or
clinical administration
EHR developer
Pharmacy
Examples of Potentially Useful Practices/Scenarios
Users' orders are matched to a codified set of orderable
items (e.g., medications, laboratory and radiology tests).
The EHR's search facility should support various word
orders (e.g., “abdominal ultrasound” or “ultrasound,
abdominal”), various names (e.g., generic, brand,
synonym), and should be able to be browsed
alphabetically.
48
Assessment Notes
Follow-up Actions
Person Responsible for Follow-up Action
reset page
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
12 of 45
Off
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Recommended Practice 1.4
Worksheet
Domain 1 —
Safe Health IT
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practice
Implementation Status
1.4
The EHR can facilitate both cancellation and acknowledgment
of receipt of orders for laboratory, radiology, and pharmacy.
Checklist
Rationale for Practice or Risk Assessment
Communication errors, especially related to medication
orders and diagnostic services, are frequent
occurrences. Order tracking can reduce these errors.
Suggested Sources of Input
Diagnostic services EHR
developer
Health IT support staff
Pharmacy
Examples of Potentially Useful Practices/Scenarios
The user can look up whether the lab has received the
specimen for testing or not.
When medication orders are cancelled, information is
received and acted on appropriately by the responsible
pharmacy.
49, 50
The two-way interfaces that facilitate order tracking are
tested pre- and post-go-live.
Assessment Notes
Follow-up Actions
Person Responsible for Follow-up Action
reset page
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
13 of 45
Off
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Recommended Practice 1.5
Worksheet
Domain 1 —
Safe Health IT
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practice
Implementation Status
1.5
CDS alerts are displayed in the relevant clinical
context.
40, 51, 52, 53, 54, 55, 56, 57, 58
Checklist
Rationale for Practice or Risk Assessment
CDS to improve diagnostic or therapeutic decision
making should be accessible in real time at the point
of care; otherwise, the advice generated may be
useless or underutilized.
59
Risks include information
overload and clinician dissatisfaction.
3, 33, 34
Suggested Sources of Input
Clinicians, support staff, and/or
clinical administration
EHR developer
Health IT support staff
Examples of Potentially Useful Practices/Scenarios
Assessment Notes
Follow-up Actions
Person Responsible for Follow-up Action
reset page
A process is in place to identify and remove alerts that do
not make sense in the particular clinical context. In some
cases, the process may require communication with the
EHR developer.
Ambulatory alerts for cancer screening protocols should not
be presented during the inpatient stay.
60, 61
The discharge
time period may be more appropriate for this type of CDS.
Alerts for diabetic foot screening should not be presented
for patients with bilateral lower extremity amputations.
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
14 of 45
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Recommended Practice 1.6
Worksheet
Domain 1 —
Safe Health IT
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practice
Implementation Status
1.6
CDS incorporates current best practices and guidelines
from authoritative sources (e.g., national organizations,
medical specialty professional associations).
62
Checklist
Rationale for Practice or Risk Assessment
Out of date or incorrect knowledge provided by
the CDS system may be harmful.
3, 33, 34
Suggested Sources of Input
Clinicians, support staff, and/or
clinical administration
EHR developer
Health IT support staff
Examples of Potentially Useful Practices/Scenarios
For organizations that rely on EHR developer-provided
CDS, a process is in place to ensure that CDS is based on
authoritative sources and is regularly updated.
The evidence supporting CDS is reviewed and approved by
EHR users before adoption.
Authoritative sources such as AHRQ’s CDS Initiative and
professional associations are used to develop CDS content.
For example:
Colon cancer screening reminders follow U.S. Preventive
Services Task Force guidelines.
63
Vaccination reminders use the latest recommendations from the
Advisory Committee on Immunization Practices.
64
Consider the “Choosing Wisely” guidelines to reduce
unnecessary tests and procedures.
65, 66, 67
Assessment Notes
Follow-up Actions
Person Responsible for Follow-up Action
reset page
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
15 of 45
Off
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Recommended Practice 2.1
Worksheet
Domain 2 —
Using Health IT Safely
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practice
Implementation Status
2.1
Clinicians are trained and tested on CPOE operations
before being issued login credentials.
50
Checklist
Rationale for Practice or Risk Assessment
CPOE is a complex tool. To maximize its safe and
effective use, clinicians must be trained rigorously and
should not be expected to “learn the basics on the
job.”
Suggested Sources of Input
Clinicians, support staff, and/or
clinical administration
Pharmacy
EHR developer
Health IT support staff
Examples of Potentially Useful Practices/Scenarios
Incentives such as continuing education (e.g., CME, CEU)
credits are awarded to clinicians who have been trained
on CPOE.
Clinicians are required to demonstrate basic CPOE skills
before getting their login credentials.
68
The organization evaluates whether specialized CPOE
training should be required in high risk areas.
Training is reinforced periodically, particularly with system
changes and upgrades.
Assessment Notes
Follow-up Actions
Person Responsible for Follow-up Action
reset page
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
16 of 45
Off
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Recommended Practice 2.2
Worksheet
Domain 2 —
Using Health IT Safely
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practice
Implementation Status
2.2
Clinicians are engaged in implementing, reviewing,
and updating CDS.
62, 69, 70, 71, 72, 73
Checklist
Rationale for Practice or Risk Assessment
Failure to include clinicians in decisions that affect their
clinical work environment, their decision making
capabilities, or how their decisions are communicated and
recorded significantly increases the risk of hazardous
events. CDS systems can be optimized through
monitoring of use, overrides, and clinician satisfaction.
Suggested Sources of Input
Clinicians, support staff, and/or
clinical administration
Diagnostic services
Pharmacy
Examples of Potentially Useful Practices/Scenarios
Assessment Notes
Follow-up Actions
Person Responsible for Follow-up Action
reset page
Clinicians are involved in developing and maintaining CDS
content consistent with updated guidelines and algorithms.
There is a process that involves clinicians in managing,
evaluating, and prioritizing CDS updates.
62, 72, 73, 74, 75
Developing and maintaining high quality CDS interventions
is difficult and time consuming.
41
The organization should
incentivize, or otherwise reward, clinicians for their time
spent working on CDS-related activities.
Clinician-provided feedback is reviewed and used for
refinement and maintenance of CDS and the relevant
clinical content.
62, 71, 72, 73, 75
Clinician overrides (i.e., decisions not to follow a computer-
generated suggestion) for high priority CDS elements are
logged and available for review and reporting.
76, 77, 78
For EHR developer-provided or -controlled CDS, a process
is in place to communicate the need for CDS
improvements with the developer.
Compendia CDS and clinical terminology updates should
be done on a frequent and regular basis. Doing this
enables prescribers to have access to the most up-to-date
information at all times.
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
17 of 45
Off
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Recommended Practice 2.3
Worksheet
Domain 2 —
Using Health IT Safely
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practice
Implementation Status
2.3
CPOE is used for ordering all medications, diagnostic
tests, and procedures for which CPOE is available.
43
Checklist
Rationale for Practice or Risk Assessment
While full use of CPOE with advanced CDS has
been shown to reduce errors,
59
partial use of CPOE
can introduce errors.
Suggested Sources of Input
Clinicians, support staff, and/or
clinical administration
Diagnostic services
EHR developer
Health IT support staff
Pharmacy
Examples of Potentially Useful Practices/Scenarios
Assessment Notes
Follow-up Actions
Person Responsible for Follow-up Action
reset page
Except in unusual situations, providers are required to enter
their orders into the CPOE system. This includes orders for
controlled substances.
Exceptions (e.g., emergency orders in resuscitation
situations) are clearly defined, and processes are in place
and followed for their proper documentation in the EHR.
Recommendations from The Joint Commission are followed
when submitting orders to RNs by text messaging. This is
acceptable as long as the texting platform has:
79
A secure sign-on process
Encrypted messaging
Delivery and read receipts
Date and time stamps
Customized message retention time frames
A specified contact list for individuals authorized to receive and
record orders
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
18 of 45
Off
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Recommended Practice 2.4
Worksheet
Domain 2 —
Using Health IT Safely
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Implementation Status
Recommended Practice
2.4
There is minimal use of free-text order entry. Orders are
entered and stored in standardized, coded form.
43, 80, 81
Checklist
Rationale for Practice or Risk Assessment
Free-text data can introduce errors if it is inconsistent with
structured data or is not used or communicated properly.
50
Free-text orders cannot be effectively supported with CDS.
Suggested Sources of Input
Clinicians, support staff, and/or
clinical administration
EHR developer
Health IT support staff
Examples of Potentially Useful Practices/Scenarios
When medications are entered using standardized, coded
terms, corresponding narrative text is minimized. Processes
are in place to ensure timely use and review of any narrative
text.
The organization takes specific safety precautions whenever
full free-text ordering is allowed.
When medications must be ordered using free text, as
constrained by organizational policy, a pharmacist reviews
the order to identify and address any drug-drug or drug-
allergy interactions.
Assessment Notes
Follow-up Actions
Person Responsible for Follow-up Action
reset page
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
19 of 45
Off
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Recommended Practice 2.5
Worksheet
Domain 2 —
Using Health IT Safely
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practice
Implementation Status
Rationale for Practice or Risk Assessment
For effective CPOE, orders must be electronically
communicated. An automated process minimizes lapses
in communication.
Suggested Sources of Input
Clinicians, support staff, and/or
clinical administration
EHR developer
Health IT support staff
Examples of Potentially Useful Practices/Scenarios
In-patient nurses are notified via the EHR when new results
or orders are entered into the system for one of their
patients (e.g., when they login to the system an alert tells
them that new orders are available, or they are sent an
informative page or text message).
83
In the ambulatory setting, clinical workflow is evaluated and
optimized to ensure that nursing and other support staff
responsible for carrying out orders are alerted to the
presence of new orders. Examples of alerts could be a task
in-box, messages on the edge of the screen, alerts at log
on, text messages, or pages.
Orders that are not acknowledged by the individual
responsible for carrying them out within appropriately
defined time periods are automatically escalated to a
supervisor.
84
Workflow is evaluated to ensure that all electronic orders go
to the intended recipient and that person documents their
actions in the EHR.
Assessment Notes
Follow-up Actions
Person Responsible for Follow-up Action
reset page
Order entry information is electronically communicated (e.g.,
through the computer or mobile messaging) to the people
responsible for carrying out the order.
82
Checklist
2.5
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
20 of 45
Off
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Recommended Practice 2.6
Worksheet
Domain 2 —
Using Health IT Safely
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practice
Implementation Status
2.6
Interruptive alerts (e.g., pop-ups at the time of ordering)
are used with discretion and only for high risk, high priority
conditions.
40, 51, 52, 53, 54, 55, 56, 72, 85, 86
Checklist
Rationale for Practice or Risk Assessment
Excessive use of interruptive alerts creates clinician
dissatisfaction and reduces their effectiveness,
causing clinicians to miss important alerts.
31
Suggested Sources of Input
Clinicians, support staff, and/or
clinical administration
EHR developer Health
IT support staff
Examples of Potentially Useful Practices/Scenarios
For lower priority conditions, passive alerts that do not force
an interruption of workflow are available.
54
High risk, high priority conditions that justify interruptive
alerts are identified by clinicians and are subject to review.
Interruptive alerts at the point of care are used only after
considering other available options.
87
Assessment Notes
Follow-up Actions
Person Responsible for Follow-up Action
reset page
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
21 of 45
Partially in some areas
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Recommended Practice 2.7
Worksheet
Domain 2 —
Using Health IT Safely
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practice
Implementation Status
2.7
Drug-allergy interaction checking occurs during the entry of
new medication orders and new allergies.
59, 80, 88
Checklist
Rationale for Practice or Risk Assessment
Interaction checking minimizes the risk of adverse
drug events related to allergies.
Suggested Sources of Input
Clinicians, support staff, and/or
clinical administration
EHR developer
Examples of Potentially Useful Practices/Scenarios
Allergy checking occurs for all current medications
whenever a new allergy is entered into the system.
Testing of high risk drug-allergy pair interactions should be
done at initial EHR implementation and with periodic EHR
upgrades to the medication and allergy database. Specific
pairs selected for testing should be those most relevant to
the care setting. For example, checking an ACE inhibitor
prescription for the allergic reaction of ACE inhibitor-
induced angioedema.
Assessment Notes
Follow-up Actions
Person Responsible for Follow-up Action
reset page
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
22 of 45
Partially in some areas
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Recommended Practice 2.8
Worksheet
Domain 2 —
Using Health IT Safely
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practice
Implementation Status
2.8
Duplicate order checking occurs for high risk medication,
diagnostic tests, and procedure orders (excluding "as
needed" [PRN] medications).
59, 80, 89
Checklist
Rationale for Practice or Risk Assessment
Duplicate order checking reduces the risk of inadvertent
drug overdoses and unnecessary tests and procedures.
59, 80
Suggested Sources of Input
Clinicians, support staff, and/or
clinical administration
EHR developer
Examples of Potentially Useful Practices/Scenarios
Therapeutic duplication checking that occurs before new
medication orders are submitted (e.g., two orders for the
same or two different beta-blockers are placed) is carefully
implemented and monitored. Note that there are situations
where it is clinically indicated to prescribe duplicate
therapies. For example, duplicate alerts should NOT fire for
an order for an IV bolus, followed by an order for a
continuous drip of the same medication.
There are rules to determine how and when diagnostic tests
or procedures receive duplicate checking before they are
ordered.
90
Duplicate checking does not include PRN (i.e., as needed)
medication orders.
PRN orders should not include overlapping criteria (e.g., for
pain 1-3, give aspirin AND for pain 2-4, give Vicodin).
Assessment Notes
Follow-up Actions
Person Responsible for Follow-up Action
reset page
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
23 of 45
Partially in some areas
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Recommended Practice 2.9
Worksheet
Domain 2 —
Using Health IT Safely
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practice
Implementation Status
2.9
Drug-condition checking occurs for important interactions
between drugs and selected conditions.
59
Checklist
Rationale for Practice or Risk Assessment
Electronic drug-condition checking reduces the risk of
preventable adverse drug events related to specific
conditions.
Suggested Sources of Input
Clinicians, support staff, and/or
clinical administration
EHR developer
Examples of Potentially Useful Practices/Scenarios
Drug-condition interaction checking occurs when new
medications are ordered or new conditions are
identified (e.g., Accutane or tetracycline prescribed for
a pregnant woman).
Assessment Notes
Follow-up Actions
Person Responsible for Follow-up Action
reset page
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
24 of 45
Partially in some areas
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Recommended Practice 2.10
Worksheet
Domain 2 —
Using Health IT Safely
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practice
2.10
Drug-patient age checking occurs for important age-related
medication issues.
15, 91
Checklist
Implementation Status
Rationale for Practice or Risk Assessment
Drug-patient age checking reduces the risk of preventable
age-related adverse drug events.
Suggested Sources of Input
Clinicians, support staff, and/or
clinical administration
EHR developer
Examples of Potentially Useful Practices/Scenarios
Drug-patient age interaction checking occurs when new
medication orders are submitted for dispensing (e.g.,
medications contraindicated in the elderly).
Changes in frequency, dose, or therapeutic substitutions
are suggested for pediatric patients.
92
Assessment Notes
Follow-up Actions
Person Responsible for Follow-up Action
reset page
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
25 of 45
Partially in some areas
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Recommended Practice 2.11
Worksheet
Domain 2 —
Using Health IT Safely
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practice
2.11
Dose range checking (e.g., maximum single dose or daily
dose) occurs before medication orders are submitted for
dispensing.
59, 93
Checklist
Implementation Status
Rationale for Practice or Risk Assessment
Dose range checking reduces the risk of medication
overdose.
Suggested Sources of Input
Clinicians, support staff, and/or
clinical administration
EHR developer
Examples of Potentially Useful Practices/Scenarios
Renal dose adjustment suggestions and information
on the patient’s renal status are clearly displayed
prospectively for relevant medications. In cases where
actual dose adjustments are not possible within the
existing software, EHR developers should provide
reference dosing guidelines either within the EHR or
through info button links.
Patient context (e.g., age, renal function) dynamically
changes the dosing or administration timing defaults
prospectively.
Maximum single dose and maximum daily dose are
independently checked.
Dose limits are appropriate for age, weight, and body
surface area.
Assessment Notes
Follow-up Actions
Person Responsible for Follow-up Action
reset page
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
26 of 45
Partially in some areas
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Recommended Practice 2.12
Worksheet
Domain 2 —
Using Health IT Safely
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practice
Implementation Status
2.12
A process is in place to review interactions so that only the
most significant interaction-related alerts, as determined by
the organization, are presented to clinicians.
53, 54
Checklist
Rationale for Practice or Risk Assessment
Tiered alerting by severity (significance) is associated
with higher compliance rates for drug-drug interaction
alerts.
Suggested Sources of Input
Clinicians, support staff, and/or
clinical administration
EHR developer
Examples of Potentially Useful Practices/Scenarios
Less significant alerts are presented as information
only, rather than as interruptive alerts.
53
Alerts that are displayed are modifiable (e.g., show
only the most severe interactions versus all
interactions) based on feedback from the users and
monitoring of user behavior (e.g., alert override
rates).
Assessment Notes
Follow-up Actions
Person Responsible for Follow-up Action
reset page
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
27 of 45
Partially in some areas
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Recommended Practice 2.13
Worksheet
Domain 2 —
Using Health IT Safely
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practice
Implementation Status
2.13
Clinicians are required to re-enter their password, or a unique
PIN, to “sign” (authenticate) an order.
Checklist
Rationale for Practice or Risk Assessment
Explicit order authentication reduces the risk of
inadvertently entering orders under the wrong identity
when someone else is logged in. It gives users an
additional opportunity to confirm that the orders they
entered are correct, and prevents them from
inadvertently signing orders they did not intend to sign.
Suggested Sources of Input
Clinicians, support staff, and/or
clinical administration
EHR developer
Examples of Potentially Useful Practices/Scenarios
An explicit re-authentication process occurs for orders in
addition to the original login for access to the EHR.
Providers should be shown a summary view of orders
before signing.
Assessment Notes
Follow-up Actions
Person Responsible for Follow-up Action
reset page
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
28 of 45
Partially in some areas
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Recommended Practice 2.14
Worksheet
Domain 2 —
Using Health IT Safely
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practice
Implementation Status
2.14
When appropriate, corollary (or consequent) orders are
automatically suggested and linked together with the original
order such that changes are reflected when the original order
is rescheduled, renewed, or discontinued.
94
Checklist
Rationale for Practice or Risk Assessment
Automatically suggested, linked orders reduce
order inconsistencies by managing closely
associated orders in tandem.
Suggested Sources of Input
Clinicians, support staff, and/or
clinical administration
EHR developer
Examples of Potentially Useful Practices/Scenarios
Examples include: prothrombin time monitoring when
warfarin is prescribed, or drug level measurements with
Vancomycin or aminoglycoside orders.
94
Corollary orders are deleted whenever the main order is
deleted (e.g., if a colonoscopy is cancelled, the bowel
prep is also cancelled).
Assessment Notes
Follow-up Actions
Person Responsible for Follow-up Action
reset page
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
29 of 45
Partially in some areas
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Recommended Practice 2.15
Worksheet
Domain 2 —
Using Health IT Safely
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practice
2.15
Users can access authoritative clinical reference materials
directly from the EHR, including organization-specific
information when available.
47, 62, 71, 72, 74, 95
Checklist
Implementation Status
Rationale for Practice or Risk Assessment
Ready access to information can reduce the risk of
errors. CDS to improve diagnostic or therapeutic
decision making should be accessible in real time
at the point of care; otherwise, the advice
generated may be useless or underutilized.
59
Suggested Sources of Input
EHR developer
Health IT support staff
Examples of Potentially Useful Practices/Scenarios
Relevant reference materials should be accessible
through info buttons or similar functionality in the order
entry screen/module. Examples include: medication
monographs (such as Micromedex), dosing calculators,
diagnostic guides, laboratory reference materials, image
atlases, anatomical diagrams, patient education
materials, and disease-specific treatment guidelines.
96
Assessment Notes
Follow-up Actions
Person Responsible for Follow-up Action
reset page
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
30 of 45
Partially in some areas
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Recommended Practice 2.16
Worksheet
Domain 2 —
Using Health IT Safely
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practice
Implementation Status
2.16
CPOE and CDS functionality are tested to ensure proper
operation before go-live and with test patients in the production
system before clinical use.
97
Checklist
Rationale for Practice or Risk Assessment
Appropriate testing reduces the risk of errors
associated with inappropriate CPOE or CDS system
behavior.
Suggested Sources of Input
Clinicians, support staff, and/or
clinical administration
EHR developer
Health IT support staff
Examples of Potentially Useful Practices/Scenarios
A CPOE evaluation tool (e.g., the Leapfrog Group's
CPOE "flight simulator" for hospitals) is used to
evaluate the safety and effectiveness of CPOE and
CDS functionality.
98, 99, 100
CDS rules should be tested in the live environment
after any CDS-related change and after major EHR
software upgrades. This testing should be done for
both new rules and existing rules (i.e., regression
testing).
101
CDS interventions are evaluated to ensure correct
firing of alters and reminders.
102
Assessment Notes
Follow-up Actions
Person Responsible for Follow-up Action
reset page
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
31 of 45
Partially in some areas
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Recommended Practice 2.17
Worksheet
Domain 2 —
Using Health IT Safely
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practice
2.17
Questions presented to the user by CPOE or CDS are
unambiguous.
57, 59
Checklist
Implementation Status
Rationale for Practice or Risk Assessment
Misunderstanding queries posed by the system can
lead to risks of errors and adverse events.
103
Suggested Sources of Input
Clinicians, support staff, and/or
clinical administration
EHR developer Health
IT support staff
Examples of Potentially Useful Practices/Scenarios
There are policies and procedures to evaluate the clarity of
questions posed to users.
Questions should be kept simple and focused. For example,
“Is IV contrast contraindicated?” may be confusing. It might
be better to ask, "Is IV contrast safe to administer? Yes,
safe. No, not safe."
Avoid negatively and poorly worded questions (e.g., “Do you
want to cancel this alert? Yes, No, Cancel.”).
Assessment Notes
Follow-up Actions
Person Responsible for Follow-up Action
reset page
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
32 of 45
Off
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Recommended Practice 2.18
Worksheet
Domain 2 —
Using Health IT Safely
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practice
Implementation Status
2.18
CPOE and CDS implementation and use are supported by
usability testing based on best practices from human
factors engineering.
104, 105
Checklist
Rationale for Practice or Risk Assessment
Risks of untested usability include decreased clinician
efficiency and clinician dissatisfaction, as well as errors
and adverse events due to unintended consequences of
CDS use.
Suggested Sources of Input
Clinicians, support staff, and/or
clinical administration
Diagnostic services
EHR developer
Health IT support staff
Pharmacy
Examples of Potentially Useful Practices/Scenarios
Major CDS and CPOE changes and interventions
are tested with representative end users.
104
Clinician-reported hazards associated with CPOE and
CDS due to poor usability are regularly communicated to
a team charged with reviewing complaints and relaying
validated hazards to the creator of the CPOE or CDS for
management. Regular review and follow-up of validated
issues and solutions should occur.
Assessment Notes
Follow-up Actions
Person Responsible for Follow-up Action
reset page
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
33 of 45
Off
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Recommended Practice 2.19
Worksheet
Domain 2 —
Using Health IT Safely
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practice
Implementation Status
2.19
Critical patient information is visible during the order
entry process.
106
Checklist
Rationale for Practice or Risk Assessment
Ensuring that critical data are visible in the EHR
minimizes errors related to misidentification or failing
to account for common clinical issues.
Suggested Sources of Input
Clinicians, support staff, and/or
clinical administration
EHR developer
Examples of Potentially Useful Practices/Scenarios
Pertinent clinical information (e.g., age, weight, allergies,
pregnancy status, creatinine clearance/GFR) and
identifying patient information is easily accessible from the
ordering screen (e.g., in a patient header bar, on the
ordering screen, from a hide/show panel). If screen
resolution allows, it is preferable that the information be
accessed without scrolling.
106
Assessment Notes
Follow-up Actions
Person Responsible for Follow-up Action
reset page
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
34 of 45
Off
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Recommended Practice 2.20
Worksheet
Domain 2 —
Using Health IT Safely
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practice
Implementation Status
2.20
The clinician is informed during the ordering process when
additional steps are needed to complete the order being
requested.
Checklist
Rationale for Practice or Risk Assessment
Clinicians may not be aware that an order will not be
completed without additional steps, leading to delays in
performing the order.
Suggested Sources of Input
Diagnostic services EHR
developer
Pharmacy
Examples of Potentially Useful Practices/Scenarios
Clinicians are informed when non-formulary medications
require additional pre-approval.
Clinicians are informed when “send out” tests require special
forms or procedures.
The mode of informing clinicians or their team members of
incomplete orders could include passive notifications (e.g.,
an informative icon).
Assessment Notes
Follow-up Actions
Person Responsible for Follow-up Action
reset page
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
35 of 45
Off
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Recommended Practice 2.21
Worksheet
Domain 2 —
Using Health IT Safely
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practice
2.21
Use of abbreviations and acronyms is minimized and
standardized.
107, 108, 109
Checklist
Implementation Status
Rationale for Practice or Risk Assessment
Acronyms and abbreviations are a source of errors in
both paper and electronic records. Minimizing and
standardizing use of acronyms and abbreviations
reduces the risk of errors related to misunderstanding.
Suggested Sources of Input
Clinicians, support staff, and/or
clinical administration
EHR developer
Examples of Potentially Useful Practices/Scenarios
Organizational policies on the use of abbreviations and
acronyms incorporate, and are consistent with, their
use in EHRs.
Use of abbreviations and acronyms is consistent with
industry best practices.
Abbreviations such as "qd" or "qid" are avoided.
Assessment Notes
Follow-up Actions
Person Responsible for Follow-up Action
reset page
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
36 of 45
Off
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Recommended Practice 2.22
Worksheet
Domain 2 —
Using Health IT Safely
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practice
Implementation Status
2.22
Additional safeguards (e.g., double checking by a second
specialist) are implemented in the EHR before high risk
medications are prescribed.
Checklist
Rationale for Practice or Risk Assessment
Medication errors are the most common type of
error that reach patients and cause harm. For high
risk medications, additional safeguards are
justified to reduce the likelihood of harm.
Suggested Sources of Input
Clinicians, support staff, and/or
clinical administration
EHR developer
Pharmacy
Examples of Potentially Useful Practices/Scenarios
A clinician- or specialist-driven process is in place to
identify high risk medications that justify additional
safeguards and integrate those safeguards into the
EHR.
Chemotherapy agents require special authorization and
are displayed in a visually distinct way (e.g., different
color, italics).
"TALLman lettering" is used to reduce CPOE errors
from orthographically similar medication names (i.e.,
look-alike or sound-alike medication names; for
example, acetaZOLAMIDE and acetoHEXAMIDE).
110,
111, 112
Assessment Notes
Follow-up Actions
Person Responsible for Follow-up Action
reset page
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
37 of 45
Off
SAFER
Self-Assessment
Computerized Provider Order Entry
with Decision Support
Recommended Practice 3.1
Worksheet
Domain 3 —
Monitoring Safety
> Table of Contents > About the Checklist > Team Worksheet > About the Practice Worksheets
> Practice Worksheets
Recommended Practice
Implementation Status
3.1
Key metrics related to CPOE and CDS (e.g.,
override rates) are defined, monitored, and
acted on to optimize safety and use.
40, 43, 113
Checklist
Rationale for Practice or Risk Assessment
Well-designed and correctly used CPOE and CDS can
reduce the most common errors that harm patients.
Monitoring and oversight of the performance and clinician
use of CPOE and CDS functionality allows optimization
of a powerful driver of improved patient safety in an EHR-
enabled healthcare system.
Suggested Sources of Input
Clinicians, support staff, and/or
clinical administration
EHR developer
Health IT support staff
Examples of Potentially Useful Practices/Scenarios
Key CPOE and CDS safety indicators are monitored and
reported to leadership on a periodic basis. Examples
include:
Rates of preventable ADEs
CPOE use rate
Frequency (i.e., volume) of orders that generate an alert
Override rate (i.e., percent of alerts that are overridden) in
comparison to alert volume
Median turnaround time for STAT laboratory or radiology
results
Percent of all orders requiring modification by someone other
than the ordering provider
Alerts with the highest percent of overrides (note: these
should be evaluated periodically for effectiveness and turned
off if deemed unacceptable)
Usage of evidence-based order sets
Clinician satisfaction with CDS alert functionality
Results of any CPOE evaluation tool
Assessment Notes
Follow-up Actions
Person Responsible for Follow-up Action
reset page
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
38 of 45
Off
SAFER
Safety Assurance Factors
for EHR Resilience
References
1. Ammenwerth, E., Schnell-Inderst, P., Machan, C., & Siebert, U. (2008). The effect of electronic prescribing on medication errors
and adverse drug events: a systematic review. Journal of the American Medical Informatics Association, 15(5), 585-600.
2. Bates, D. W., Teich, J. M., Lee, J., Seger, D., Kuperman, G. J., Ma'Luf, N., ... & Leape, L. (1999). The impact of computerized
physician order entry on medication error prevention. Journal of the American Medical Informatics Association, 6(4), 313-321.
3. Bates, D. W., Cohen, M., Leape, L. L., Overhage, J. M., Shabot, M. M., & Sheridan, T. (2001). Reducing the frequency of errors in
medicine using information technology. Journal of the American Medical Informatics Association, 8(4), 299-308.
4. Bobb, A., Gleason, K., Husch, M., Feinglass, J., Yarnold, P. R., & Noskin, G. A. (2004). The epidemiology of prescribing errors: the
potential impact of computerized prescriber order entry. Archives of Internal Medicine, 164(7), 785-792.
5. Franklin, B. D., O’Grady, K., Donyai, P., Jacklin, A., & Barber, N. (2007). The impact of a closed-loop electronic prescribing and
administration system on prescribing errors, administration errors and staff time: a before-and-after study. Quality and Safety in
Healthcare, 16(4), 279-284.
6. Mekhjian, H. S., Kumar, R. R., Kuehn, L., Bentley, T. D., Teater, P., Thomas, A., ... & Ahmad, A. (2002). Immediate benefits realized
following implementation of physician order entry at an academic medical center. Journal of the American Medical Informatics
Association, 9(5), 529-539.
7. Sittig, D. F., & Stead, W. W. (1994). Computer-based physician order entry: the state of the art. Journal of the American Medical
Informatics Association, 1(2), 108-123.
8. Wolfstadt, J.I., Gurwitz, J.H., Field, T.S. (2008). The effect of computerized physician order entry with clinical decision support on the
rates of adverse drug events: a systematic review. Journal of General Internal Medicine, 23, 451-458.
9. Radley, D. C., Wasserman, M. R., Olsho, L. E., Shoemaker, S. J., Spranca, M. D., & Bradshaw, B. (2013). Reduction in medication
errors in hospitals due to adoption of computerized provider order entry systems. Journal of the American Medical Informatics
Association, 20(3), 470-476.
10. Ranji, S. R., Rennke, S., & Wachter, R. M. (2014). Computerised provider order entry combined with clinical decision support
systems to improve medication safety: a narrative review. BMJ Quality & Safety, 23(9), 773-780.
11. Ash, J. S., Sittig, D. F., Poon, E. G., Guappone, K., Campbell, E., & Dykstra, R. H. (2007). The extent and importance of unintended
consequences related to computerized provider order entry. Journal of the American Medical Informatics Association, 14(4), 415-423.
12. Ash, J. S., Sittig, D. F., Dykstra, R. H., Guappone, K., Carpenter, J. D., & Seshadri, V. (2007). Categorizing the unintended
sociotechnical consequences of computerized provider order entry. International Journal of Medical Informatics, 76, S21-S27.
13. Ash, J. S., Sittig, D. F., Dykstra, R., Campbell, E., & Guappone, K. (2009). The unintended consequences of computerized provider
order entry: findings from a mixed methods exploration. International Journal of Medical Informatics, 78, S69-S76.
14. Berger, R. G., & Kichak, J. P. (2004). Computerized physician order entry: helpful or harmful? Journal of the American Medical
Informatics Association, 11(2), 100-103.
15. Caldwell, N.A., & Power, B. (2012). The pros and cons of electronic prescribing for children. Archives of Disease in Childhood, 97,
124-128.
16. Campbell, E. M., Sittig, D. F., Ash, J. S., Guappone, K. P., & Dykstra, R. H. (2006). Types of unintended consequences related to
computerized provider order entry. Journal of the American Medical Informatics Association, 13(5), 547-556.
17. Campbell, E. M., Sittig, D. F., Guappone, K. P., Dykstra, R. H., & Ash, J. S. (2007). Overdependence on technology: an unintended
adverse consequence of computerized provider order entry. American Medical Informatics Association.
18. FitzHenry, F., Peterson, J. F., Arrieta, M., Waitman, L. R., Schildcrout, J. S., & Miller, R. A. (2007). Medication administration
discrepancies persist despite electronic ordering. Journal of the American Medical Informatics Association, 14(6), 756-764.
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
39 of 45
SAFER
Safety Assurance Factors
for EHR Resilience
References
19. Gandhi, T. K., Weingart, S. N., Seger, A. C., Borus, J., Burdick, E., Poon, E. G., ... & Bates, D. W. (2005). Outpatient prescribing
errors and the impact of computerized prescribing. Journal of General Internal Medicine, 20(9), 837-841.
20. Han, Y. Y., Carcillo, J. A., Venkataraman, S. T., Clark, R. S., Watson, R. S., Nguyen, T. C., ... & Orr, R. A. (2005). Unexpected
increased mortality after implementation of a commercially sold computerized physician order entry system. Pediatrics, 116(6),
1506-1512.
21. Horsky, J., Kuperman, G. J., & Patel, V. L. (2005). Comprehensive analysis of a medication dosing error related to CPOE. Journal of
the American Medical Informatics Association, 12(4), 377-382.
22. Koppel, R., Metlay, J. P., Cohen, A., Abaluck, B., Localio, A. R., Kimmel, S. E., & Strom, B. L. (2005). Role of computerized
physician order entry systems in facilitating medication errors. The Journal of the American Medical Association, 293(10), 1197-1203.
23. Koppel, R., Leonard, C. E., Localio, A. R., Cohen, A., Auten, R., & Strom, B. L. (2008). Identifying and quantifying medication errors:
evaluation of rapidly discontinued medication orders submitted to a computerized physician order entry system. Journal of the American
Medical Informatics Association, 15(4), 461-465.
24. Koppel, R., Wetterneck, T., Telles, J. L., & Karsh, B. T. (2008). Workarounds to barcode medication administration systems: their
occurrences, causes, and threats to patient safety. Journal of the American Medical Informatics Association, 15(4), 408-423.
25. Metzger, J., Welebob, E., Bates, D. W., Lipsitz, S., & Classen, D. C. (2010). Mixed results in the safety performance of computerized
physician order entry. Health Affairs, 29(4), 655-663.
26. Nanji, K. C., Rothschild, J. M., Salzberg, C., Keohane, C. A., Zigmont, K., Devita, J., ... & Poon, E. G. (2011). Errors associated with
outpatient computerized prescribing systems. Journal of the American Medical Informatics Association, 18(6), 767-773.
27. Nebeker, J. R., Hoffman, J. M., Weir, C. R., Bennett, C. L., & Hurdle, J. F. (2005). High rates of adverse drug events in a highly
computerized hospital. Archives of Internal Medicine, 165(10), 1111-1116.
28. Singh, H., Mani, S., Espadas, D., Petersen, N., Franklin, V., & Petersen, L. A. (2009). Prescription errors and outcomes related to
inconsistent information transmitted through computerized order entry: a prospective study. Archives of Internal Medicine, 169(10),
982-989.
29. Zhan, C., Hicks, R. W., Blanchette, C. M., Keyes, M. A., & Cousins, D. D. (2006). Potential benefits and problems with computerized
prescriber order entry: analysis of a voluntary medication error-reporting database. American Journal of Health-System Pharmacy, 63(4).
30. Allen, A. S., & Sequist, T. D. (2012). Pharmacy dispensing of electronically discontinued medications. Annals of Internal Medicine,
157(10), 700-705.
31. Bates, D. W., Kuperman, G. J., Wang, S., Gandhi, T., Kittler, A., Volk, L., ... & Middleton, B. (2003). Ten commandments for effective
clinical decision support: making the practice of evidence-based medicine a reality. Journal of the American Medical Informatics
Association, 10(6), 523-530.
32. Bates, D. W., Pappius, E., Kuperman, G. J., Sittig, D., Burstin, H., Fairchild, D., ... & Teich, J. M. (1999). Using information systems
to measure and improve quality. International Journal of Medical Informatics, 53(2), 115-124.
33. Garg A., Adhikari N., & McDonald, H. (2005). Effects of computerized clinical decision support systems on practitioner performance
and patient outcomes: a systematic review. Journal of the American Medical Association, 293, 1223-1238.
34. Kawamoto, K., Houlihan, C. A., Balas, E. A., & Lobach, D. F. (2005). Improving clinical practice using clinical decision support
systems: a systematic review of trials to identify features critical to success. BMJ, 330(7494), 765.
35. Saxena, K., & Jody, R. B. C. (2011). Improving patient safety by modifying provider ordering behavior using alerts (CDSS) in CPOE
system. American Medical Informatics Association Annual Symposium Proceedings, 2011, 1207-1216.
36. Ash, J. S., Berg, M., & Coiera, E. (2004). Some unintended consequences of information technology in health care: the nature of
patient care information system-related errors. Journal of the American Medical Informatics Association, 11(2), 104-112.
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
40 of 45
SAFER
Safety Assurance Factors
for EHR Resilience
References
37. Bloomrosen, M., Starren, J., Lorenzi, N. M., Ash, J. S., Patel, V. L., & Shortliffe, E. H. (2011). Anticipating and addressing the
unintended consequences of health IT and policy: a report from the AMIA 2009 health policy meeting. Journal of the American Medical
Informatics Association, 18(1), 82-90.
38. Harrington, L., Kennedy, D., & Johnson, C. (2011). Safety issues related to the electronic medical record (EMR): synthesis of the
literature from the last decade, 2000-2009. Journal of Healthcare Management, 56(1), 31.
39. Magrabi, F., Ong, M. S., Runciman, W., & Coiera, E. (2012). Using FDA reports to inform a classification for health information
technology safety problems. Journal of the American Medical Informatics Association, 19(1), 45-53.
40. McCoy, A. B., Wright, A., & Sittig, D. F. (2015). Cross-vendor evaluation of key user-defined clinical decision support capabilities: a
scenario-based assessment of certified electronic health records with guidelines for future development. Journal of the American
Medical Informatics Association, 22(5), 1081–1088.
41. Wright, A., Ash, J. S., Erickson, J. L., Wasserman, J., Bunce, A., Stanescu, A., ... & Middleton, B. (2014). A qualitative study of the
activities performed by people involved in clinical decision support: recommended practices for success. Journal of the American
Medical Informatics Association, 21(3), 464-472.
42. Kuperman, G. J., Bobb, A., Payne, T. H., Avery, A. J., Gandhi, T. K., Burns, G., ... & Bates, D. W. (2007). Medication-related clinical
decision support in computerized provider order entry systems: a review. Journal of the American Medical Informatics Association,
14(1), 29-40.
43. Sittig, D. F., & Singh, H. (2012). Electronic health records and national patient-safety goals. New England Journal of Medicine,
367(19), 1854-1860.
44. Institute for Safe Medication Practices. (2012). ISMP's guidelines for standard order sets.
45. Wright, A., Feblowitz, J. C., Pang, J. E., Carpenter, J. D., Krall, M. A., Middleton, B., & Sittig, D. F. (2012). Use of order sets in
inpatient computerized provider order entry systems: a comparative analysis of usage patterns at seven sites. International Journal of
Medical Informatics, 81(11), 733-745.
46. Sittig, D. F., Longhurst, C. A., Russo, E., & Singh, H. (2016). Electronic health record features, functions, and privileges that
clinicians need to provide safe and effective care for adults and children. Healthcare Information Management Systems, pp. 21-38.
Springer International Publishing.
47. Sittig, D. F., & Singh, H. (2009). Eight rights of safe electronic health record use. Journal of the American Medical Association,
302(10), 1111-1113.
48. Rosenbloom, S. T., Miller, R. A., Johnson, K. B., Elkin, P. L., & Brown, S. H. (2006). Interface terminologies. Journal of the American
Medical Informatics Association, 13(3), 277-288.
49. Surescripts. (2016). Is there any notification that a prescriber can send if they want to cancel a patient’s therapy or e-prescription?
Surescripts FAQ.
50. Dhavle, A. A., Yang, Y., Rupp, M. T., Singh, H., Ward-Charlerie, S., & Ruiz, J. (2016). Analysis of prescribers’ notes in electronic
prescriptions in ambulatory practice. JAMA Internal Medicine, 176(4), 463-470.
51. Bates, D. W. (2011). Clinical decision support and the law: the big picture. St. Louis University Journal of Health Law and Policy, 5,
319.
52. Hoffman, S., & Podgurski, A. (2012). Drug-drug interaction alerts: emphasizing the evidence. St. Louis University Journal of Health
Law & Policy, Vol. 5.
53. Paterno, M. D., Maviglia, S. M., Gorman, P. N., Seger, D. L., Yoshida, E., Seger, A. C., ... & Gandhi, T. K. (2009). Tiering drug–drug
interaction alerts by severity increases compliance rates. Journal of the American Medical Informatics Association, 16(1), 40-46.
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
41 of 45
SAFER
Safety Assurance Factors
for EHR Resilience
References
54. Phansalkar, S., van der Sijs, H., Tucker, A. D., Desai, A. A., Bell, D. S., Teich, J. M., ... & Bates, D. W. (2013). Drug—drug
interactions that should be non-interruptive in order to reduce alert fatigue in electronic health records. Journal of the American Medical
Informatics Association, 20(3), 489-493.
55. Ridgely, M. S., & Greenberg, M. D. (2011). Too many alerts, too much liability: sorting through the malpractice implications of drug-
drug interaction clinical decision support. St. Louis University Journal of Health Law and Policy, 5, 257.
56. Strom, B. L., Schinnar, R., Aberra, F., Bilker, W., Hennessy, S., Leonard, C. E., & Pifer, E. (2010). Unintended effects of a
computerized physician order entry nearly hard-stop alert to prevent a drug interaction: a randomized controlled trial. Archives of Internal
Medicine, 170(17), 1578-1583.
57. Slight, S. P., Eguale, T., Amato, M. G., Seger, A. C., Whitney, D. L., Bates, D. W., & Schiff, G. D. (2015). The vulnerabilities of
computerized physician order entry systems: a qualitative study. Journal of the American Medical Informatics Association, 23(2), 311-316.
58. Payne, T. H., Hines, L. E., Chan, R. C., Hartman, S., Kapusnik-Uner, J., Russ, A. L., ... & Glassman, P. A. (2015). Recommendations
to improve the usability of drug-drug interaction clinical decision support alerts. Journal of the American Medical Informatics Association,
22(6), 1243-1250.
59. Sengstack, P. (2010). CPOE configuration to reduce medication errors: a literature review on the safety of CPOE systems and design
recommendations. Journal of Healthcare Informatics Management, 24(4), 26-32.
60. Sittig, D. F., & Singh, H. (2012). Improving test result follow-up through electronic health records requires more than just an alert.
Journal of General Internal Medicine, 1-3.
61. Agency for Healthcare Research & Quality. (2009). Overview of CDS five rights.
62. Sittig, D. F., Wright, A., Ash, J. S., & Middleton, B. (2009). A set of preliminary standards recommended for achieving a national
repository of clinical decision support interventions. American Medical Informatics Association, 614-618.
63. U.S. Preventive Services Task Force. (2010). USPSTF recommendations.
64. Centers for Disease Control and Prevention Advisory Committee for Immunization Practice. (2011). ACIP recommendations.
65. Cassel, C. K., & Guest, J. A. (2012). Choosing wisely: helping physicians and patients make smart decisions about their care. Journal
of the American Medical Association, 307(17), 1801-1802.
66. Livingston, C. J., Freeman, R. J., Mohammad, A., Costales, V. C., Titus, T. M., Harvey, B. J., & Sherin, K. M. (2016). Choosing
Wisely® in preventive medicine: the American College of Preventive Medicine’s top 5 list of recommendations. American Journal of
Preventive Medicine.
67. Gottheil, S., Khemani, E., Copley, K., Keeney, M., Kinney, J., Chin-Yee, I., & Gob, A. (2016). Reducing inappropriate ESR testing with
computerized clinical decision support. BMJ Quality Improvement Reports, 5(1).
68. Sittig, D. F., & Classen, D. C. (2010). Safe electronic health record use requires a comprehensive monitoring and evaluation
framework. Journal of the American Medical Association, 303(5), 450-451.
69. Ash, J. S., Sittig, D. F., Wright, A., McMullen, C., Shapiro, M., Bunce, A., & Middleton, B. (2011). Clinical decision support in small
community practice settings: a case study. Journal of the American Medical Informatics Association, 18(6), 879-882.
70. Ash, J. S., Sittig, D. F., Guappone, K. P., Dykstra, R. H., Richardson, J., Wright, A., ... & Middleton, B. (2012). Recommended
practices for computerized clinical decision support and knowledge management in community settings: a qualitative study. BMC Medical
Informatics and Decision Making, 12(1), 1.
71. Sittig, D. F., Wright, A., Simonaitis, L., Carpenter, J. D., Allen, G. O., Doebbeling, B. N., ... & Middleton, B. (2010). The state of the art
in clinical knowledge management: an inventory of tools and techniques. International Journal of Medical Informatics, 79(1), 44-57.
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
42 of 45
SAFER
Safety Assurance Factors
for EHR Resilience
References
72. Wright, A., Phansalkar, S., Bloomrosen, M., Jenders, R. A., Bobb, A. M., Halamka, J. D., ... & Bates, D. W. (2010). Best practices in
clinical decision support: the case of preventive care reminders. Applied Clinical Informatics, 1(3), 331-345.
73. Wright, A., Sittig, D. F., Ash, J. S., Bates, D. W., Feblowitz, J., Fraser, G., ... & Starmer, J. (2011). Governance for clinical decision
support: case studies and recommended practices from leading institutions. Journal of the American Medical Informatics Association,
18(2), 187-194.
74. Horsky, J., Schiff, G. D., Johnston, D., Mercincavage, L., Bell, D., & Middleton, B. (2012). Interface design principles for usable
decision support: a targeted review of best practices for clinical prescribing interventions. Journal of Biomedical Informatics, 45(6),
1202-1216.
75. Osheroff, M. D., Jerome, A., Teich, & Levick, M. D. (2012). Improving outcomes with clinical decision support: an implementer's guide.
Healthcare Information and Management Systems Society.
76. Bennett, J. W., & Glasziou, P. P. (2003). Computerised reminders and feedback in medication management: a systematic review of
randomised controlled trials. Medical Journal of Australia, 178(5), 217-222.
77. Morris, A. H. (2000). Developing and implementing computerized protocols for standardization of clinical decisions. Annals of Internal
Medicine, 132(5), 373-383.
78. van der Sijs, H., Aarts, J., Vulto, A., & Berg, M. (2006). Overriding of drug safety alerts in computerized physician order entry. Journal
of the American Medical Informatics Association, 13(2), 138-147.
79. The Joint Commission. (2016). Joint Commission update: texting orders.
80. Carvalho, C. J., Borycki, E. M., & Kushniruk, A. (2009). Ensuring the safety of health information systems: using heuristics for patient
safety. Healthcare Quarterly, 12(Sp).
81. Dhavle, A. A., & Rupp, M. T. (2014). Towards creating the perfect electronic prescription. Journal of the American Medical Informatics
Association.
82. Aarts, J., Ash, J., & Berg, M. (2007). Extending the understanding of computerized physician order entry: implications for professional
collaboration, workflow and quality of care. International Journal of Medical Informatics, 76, S4-S13.
83. Geissbühler, A., Grande, J. F., Bates, R. A., Miller, R. A., & Stead, W. W. (1997). Design of a general clinical notification system based
on the publish-subscribe paradigm. Proceedings of the AMIA Annual Fall Symposium, p. 126. American Medical Informatics Association.
84. Kuperman, G. J., Teich, J. M., Tanasijevic, M. J., Ma'Luf, N., Rittenberg, E., Jha, A., ... & Bates, D. W. (1999). Improving response to
critical laboratory results with automation. Journal of the American Medical Informatics Association, 6(6), 512-522.
85. Phansalkar, S., Zachariah, M., Seidling, H. M., Mendes, C., Volk, L., & Bates, D. W. (2014). Evaluation of medication alerts in
electronic health records for compliance with human factors principles. Journal of the American Medical Informatics Association, 21(e2).
86. Centers for Medicare & Medicaid Services. (2014). Clinical decision support: more than just ‘alerts’ tipsheet.
87. Sittig, D. F., Teich, J. M., Osheroff, J. A., & Singh, H. (2009). Improving clinical quality indicators through electronic health records: it
takes more than just a reminder. Pediatrics, 124(1), 375-377.
88. Schiff, G. D., Amato, M. G., Eguale, T., Boehne, J. J., Wright, A., Koppel, R., ... & Bates, D. W. (2015). Computerised physician order
entry-related medication errors: analysis of reported errors and vulnerability testing of current systems. BMJ Quality & Safety.
89. Wetterneck, T. B., Walker, J. M., Blosky, M. A., Cartmill, R. S., Hoonakker, P., Johnson, M. A., ... & Carayon, P. (2011). Factors
contributing to an increase in duplicate medication order errors after CPOE implementation. Journal of the American Medical Informatics
Association, 18(6), 774-782.
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
43 of 45
SAFER
Safety Assurance Factors
for EHR Resilience
References
90. Bates, D. W., Boyle, D. L., Rittenberg, E., Kuperman, G. J., Ma’Luf, N., Menkin, V., ... & Tanasijevic, M. J. (1998). What proportion of
common diagnostic tests appear redundant? The American Journal of Medicine, 104(4), 361-368.
91. Lowry, S. Z., Quinn, M. T., Ramaiah, M., Brick, D., Patterson, E. S., Zhang, J., ... & Gibbons, M. C. (2013). A human factors guide to
enhance EHR usability of critical user interactions when supporting pediatric patient care (NISTIR 7865). Electronic Health Records:
Challenges in Design and Implementation, p. 79.
92. Sittig, D. F., Singh, H., & Longhurst, C. A. (2013). Rights and responsibilities of electronic health records (EHR) users caring for
children. Archivos Argentinos de Pediatria, 111(6), 468-471.
93. Zhou, L., Maviglia, S. M., Mahoney, L. M., Chang, F., Orav, E. J., Plasek, J., ... & Rocha, R. A. (2012). Supratherapeutic dosing of
acetaminophen among hospitalized patients. Archives of Internal Medicine, 172(22), 1721-1728.
94. Overhage, J. M., Tierney, W. M., Zhou, X. H., & McDonald, C. J. (1997). A randomized trial of “corollary orders” to prevent errors of
omission. Journal of the American Medical Informatics Association, 4(5), 364-375.
95. Wright, A., Bates, D. W., Middleton, B., Hongsermeier, T., Kashyap, V., Thomas, S. M., & Sittig, D. F. (2009). Creating and sharing
clinical decision support content with Web 2.0: issues and examples. Journal of Biomedical Informatics, 42(2), 334-346.
96. Del Fiol, G., Huser, V., Strasberg, H. R., Maviglia, S. M., Curtis, C., & Cimino, J. J. (2012). Implementations of the HL7 context-aware
knowledge retrieval (“infobutton”) standard: challenges, strengths, limitations, and uptake. Journal of Biomedical Informatics, 45(4),
726-735.
97. Wright, A., Aaron, S., & Sittig, D. F. (2016). Testing electronic health records in the “production” environment: an essential step in the
journey to a safe and effective health care system. Journal of the American Medical Informatics Association, ocw039.
98. Birkmeyer, J. D., Birkmeyer, C. M., Wennberg, D. E., & Young, M. (2000). Leapfrog patient safety standards: the potential benefits of
universal adoption. The Leapfrog Group, Washington.
99. Kilbridge, P. M., Welebob, E. M., & Classen, D. C. (2006). Development of the Leapfrog methodology for evaluating hospital
implemented inpatient computerized physician order entry systems. Quality and Safety in Health Care, 15(2), 81-84.
100. Metzger, J. B., Welebob, E., Turisco, F., & Classen, D. C. (2008). The Leapfrog Group’s CPOE standard and evaluation tool.
Patient Safety & Quality Healthcare, 5(4), 22-25.
101. Wright, A., Hickman, T. T. T., McEvoy, D., Aaron, S., Ai, A., Andersen, J. M., ... & Bates, D. W. (2016). Analysis of clinical decision
support system malfunctions: a case series and survey. Journal of the American Medical Informatics Association, ocw005.
102. McCoy, A. B., Waitman, L. R., Lewis, J. B., Wright, J. A., Choma, D. P., Miller, R. A., & Peterson, J. F. (2012). A framework for
evaluating the appropriateness of clinical decision support alerts and responses. Journal of the American Medical Informatics
Association, 19(3), 346-352.
103. Sittig, D. F., & Singh, H. (2011). Defining health information technology–related errors: new developments since to err is human.
Archives of Internal Medicine, 171(14), 1281-1284.
104. Schumacher, R. M., & Lowry, S. Z. (2010). NIST guide to the processes approach for improving the usability of electronic health
records. National Institute of Standards and Technology.
105. Lowry, S. Z., Quinn, M. T., Ramaiah, M., Schumacher, R. M., Patterson, E. S., North, R., ... & Abbott, P. (2012). Technical
evaluation, testing, and validation of the usability of electronic health records. National Institute of Standards and Technology.
106. Khajouei, R., & Jaspers, M. W. (2008). CPOE system design aspects and their qualitative effect on usability. Studies in Health
Technology and Informatics, 136, 309.
107. Institute of Safe Medication Practices. (2012). ISMP's list of error-prone abbreviations, symbols, and dose designations.
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
44 of 45
SAFER
Safety Assurance Factors
for EHR Resilience
References
108. The Joint Commission. (2010). Information management standards. IM.02.02.01. Elements of Performance 2 and 3.
109. Passiment, E., Meisel, J. L., Fontanesi, J., Fritsma, G., Aleryani, S., & Marques, M. (2013). Decoding laboratory test
names: a major challenge to appropriate patient care. Journal of General Internal Medicine, 28(3), 453-458.
110. Institute for Safe Medical Practices. (2012). ISMP's list of confused drug names.
111
. The Joint Commission. (2010). Medication management standards. MM.01.02.01, Element of Performance 1.
112. Filik, R., Purdy, K., Gale, A., & Gerrett, D. (2004). Drug name confusion: evaluating the effectiveness of capital (“Tall
Man”) letters using eye movement data. Social Science & Medicine, 59(12), 2597-2601.
113. Weir, C. R., & McCarthy, C. A. (2009). Using implementation safety indicators for CPOE implementation. The Joint
Commission Journal on Quality and Patient Safety, 35(1), 21-28.
November 2016
SAFER Self-Assessment | Computerized Provider Order Entry with Decision Support
45 of 45