U.S. flag

An official website of the United States government, Department of Justice.

Examining the Relative Utility of PBIS Implementation Fidelity Scores in Relation to Student Outcomes

NCJ Number
254727
Date Published
2019
Length
10 pages
Author(s)
Elise T. Pas; Stacy R. Johnson; Katrina J. Debnam; Chris S. Hulleman; Catherine P. Bradshaw
Agencies
NIJ-Sponsored
Publication Type
Research (Applied/Empirical), Report (Study/Research), Report (Grant Sponsored), Program/Project Evaluation, Program/Project Description
Grant Number(s)
2014-CK-BX-0005
Annotation
This study examined various Schoolwide Evaluation Tool (SET) cut points in reference to school-level outcomes across 180 elementary, middle, and high schools participating in randomized trials of the Positive Behavioral Interventions and Supports (PBIS) implementation.
Abstract
There are several widely used Positive Behavioral Interventions and Supports (PBIS) implementation fidelity measures, including the Schoolwide Evaluation Tool (SET), but there is limited empirical investigation substantiating the association between specific fidelity cut point scores and student outcomes. The current study examined the implementation fidelity achieved in the study sample, as well as within each school level (i.e., elementary, middle, and high schools). Using the binary complier index, the study examined the association of each of three SET cut points with behavioral and academic outcomes, using t tests and receiver operating characteristic (ROC) curve analyses. Although the t tests did not provide confirmation of one specific cut point, post hoc analyses suggested that the cut point may need to be tailored to school levels. There was moderate convergence between implementation on one scale (i.e., responses to behavioral violations) and academic achievement, based on ROC curve analyses for the 70 percent and 80 percent cut points. Implications for research and practice are discussed. 3 tables and 33 references (publisher abstract modified)
Date Created: July 20, 2021