Sentinel Events Initiative Demonstration Project
The Bureau of Justice Assistance's Sentinel Events Demonstration Project project provides technical assistance to jurisdictions seeking to conduct one or more sentinel event reviews. The goal of this project is to empower jurisdictions to build capacity and ultimately conduct their own reviews, which will mitigate future risk and reduce costs.
The Sentinel Events Initiative (SEI) is a joint project of the National Institute of Justice (NIJ) and the Bureau of Justice Assistance (BJA).
On this page find:
- What Is a 'Sentinel Event?'
- Sentinel Event Reviews in the Criminal Justice System
- Strategic Research and Implementation Plan
- Testing Sentinel Event Reviews in Three Jurisdictions
- Ongoing Research
- National Demonstration Collaboration
- Learn More About the Sentinel Event Reviews
What is a "Sentinel Event?"
When bad things happen in a complex system, the cause is rarely a single act, event or slip-up. More often, bad outcomes are "sentinel events."
A sentinel event is a significant negative outcome that:
- Signals underlying weaknesses in the system or process.
- Is likely the result of compound errors.
- May provide, if properly analyzed and addressed, important keys to strengthening the system and preventing future adverse events or outcomes.
In criminal justice, a sentinel event might be a police shooting, the wrongful conviction of an innocent person, the release from prison of a dangerous person or even a “near miss” that could have led to a bad outcome had it not been caught.
Learn more about sentinel events by reviewing articles in our compiled sentinel events bibliography.
Sentinel Event Reviews in the Criminal Justice System
Since 2011, we have been investigating the feasibility of using a sentinel event review approach to learn from errors in the criminal justice system. Sentinel event review has successfully been used in medicine, aviation and other high-risk enterprises. The overarching goal of sentinel event review is a routine, culture-changing practice that can lead to increased system reliability and, hence, greater public confidence in a system’s legitimacy. Read an article about NIJ's development of the Sentinel Events Initiative.
Although most criminal justice agencies already have error-detecting procedures in place — police internal affairs reviews, for example, or prosecutors’ professional ethics boards — these often become “gotcha” processes that focus on assigning individual blame. This can drive the reporting of errors underground, making future errors even harder to detect and correct.
Sentinel event review is based on three underlying principles:
- It is nonblaming.
- All stakeholders — system-wide — are involved in the review.
- It is an ongoing, routine practice.
Our Sentinel Events Initiative seeks to answer three empirical questions about using sentinel event reviews in the justice system:
- Can it be done?
- Does it have a positive impact, such as fewer errors and other public safety dividends, and increased public confidence in the nation’s justice system?
- Can it be sustained over time and incorporated into the routine activities of state and local justice processes?
In 2014, we published Mending Justice: Sentinel Event Reviews, which discusses sentinel event reviews in depth. The special report includes an introduction from former Attorney General Eric Holder and a number of commentaries from experts and other “early adopters” regarding the implementation of sentinel event review in the criminal justice system.
Strategic Research and Implementation Plan
NIJ developed the Sentinel Events Initiative Strategic Research and Implementation Plan, 2017-2021 to describe its current and projected efforts to explore, develop, and evaluate a mechanism for learning from error in criminal justice.
This document will be of interest to researchers (academic, governmental, and industry); federal, state, and local government partners; as well as justice policymakers, and its progress to date, and offers a roadmap for NIJ’s plans for expansion. As with all federal programs, this expansion is dependent on funding availability. Findings from the activities that fall within this strategic research plan will be disseminated among constituents and partners in ways designed to achieve the greatest impact.
Read the NIJ Strategic Research and Implementation Plan Sentinel Events Initiative. Note that the timespan covered by the plan has passed; NIJ has not plans to publish an update.
Testing Sentinel Event Reviews in Three Jurisdictions
In 2014, we asked jurisdictions from around the country to volunteer for an experiment — or beta test — of the sentinel event review process. Through a competitive process, three cities were selected: Milwaukee, Philadelphia and Baltimore.
The three sites designed and conducted their own review of a justice error (a sentinel event) that had occurred in their jurisdiction. By successfully completing a sentinel event review, the three sites provided the first empirical evidence of the feasibility of adopting sentinel event reviews in the justice system.
Lessons learned from the sites’ experiences are summarized in Paving the Way: Lessons Learned in Sentinel Event Reviews. This publication covers topics such as:
- Where does a jurisdiction start when thinking about performing a sentinel event review?
- What kind of an event should be reviewed, including some of the benefits and challenges of selecting an older event?
- Who should be on the sentinel event review team — and who should lead or facilitate the review process?
- How can the important ‘nonblaming’ component of sentinel event review be achieved?
Ongoing Research on Sentinel Event Reviews
Scientific research is key to developing evidence of how sentinel event reviews might be used to improve the functioning of the criminal justice system.
In 2014, we made two research awards:
- Texas State University will use concept mapping and social network analysis to examine criminal investigative failures in wrongful convictions and unsolved cases. Learn more about this project from an article in the NIJ Journal or see details on this award to Texas State University.
- Vera Institute of Justice will develop, implement and evaluate a Self-Harm Analysis and Review Protocol (SHARP) for responding to cases of serious self-harm in the New York City jail with the aim of designing a nationally replicable sentinel event review model. Read a report resulting from this work Creating a Culture of Safety: Sentinel Event Reviews for Suicide and Self-Harm in Correctional Facilities, published by the Vera Institute of Justice. See also details on this award to the Vera Institute of Justice.
In 2015, we made two research awards:
- Researchers from Michigan State University — working with researchers from Indiana University and the director of the Milwaukee Homicide Review Commission — are delving deeper into the ongoing gun homicide and non-fatal shooting review processes in Milwaukee, Detroit and Indianapolis, establishing multiagency teams to study issues such as privacy, resources needed, and the role of the facilitator. Learn more about this project from an article in the NIJ Journal or see details on this award.
- Researchers at the University of Pennsylvania’s Quattrone Center for the Administration of Fair Justice — in collaboration with the Philadelphia Police Department, District Attorney’s Office, Defender Association, and Court of Common Pleas — are evaluating the effectiveness of multidisciplinary review teams and includes creation of a database of errors and near-misses — similar to the Aviation Safety and Reporting System used in aviation industry — to help prioritize negative outcomes for sentinel event review. Learn more about this project from an article in the NIJ Journal or see details on this award.
National Demonstration Collaboration
The National Institute of Justice has partnered with the Bureau of Justice Assistance and the Quattrone Center for the Fair Administration of Justice to empower local communities to conduct collaborative reviews of justice system failings, with the goal of understanding system causes, mitigating risk, and preventing reoccurrence of negative outcomes at the local level. Learn more about this collaboration.
Learn More About Sentinel Events Reviews
- "NIJ’s Sentinel Events Initiative: Looking Back to Look Forward," James Doyle, NIJ Journal, 273, March 2014.
- Listen to James Doyle discuss the basics of Sentinel Event Reviews, January 2014.
- Proceedings from the NIJ Roundtable on Sentinel Events, May 21-22, 2013.
- "Learning From Error," James Doyle, in Police Foundation’s Ideas in Policing, No. 14, May 2012.
- "The Wrong Patient," Mark Chassin and Elise Becher, Annals of Internal Medicine, Volume 136, Number 11, June 2002 .
- Learning from Error in Policing: A Case Study in Organizational Accident Theory, Jon Shane, 2013. Available for purchase from booksellers.
- "Learning from error in American criminal justice (pdf, 40 pages)," James M. Doyle, Journal of Criminal Law and Criminology, Volume 100, No. 1, 2010.