U.S. flag

An official website of the United States government, Department of Justice.

Validating a novel tool for coding body worn camera footage of police-community member interactions

NCJ Number
308020
Journal
Criminology & Public Policy Volume: 22 Issue: 2 Dated: 2023 Pages: 347-384
Date Published
2023
Length
38 pages
Annotation

In this article, the authors propose and describe their validation of a tool for measuring the content of body-worn camera footage that is grounded in research on both measurement validation and the dynamics of police-community encounters; their goal was to provide researchers and practitioners with a flexible set of procedures for coding a random sample of police-community interactions that is relatively straightforward to implement while still capturing much of the richness and nuance of data contained within BWC footage.

Abstract

This article reports on a study that aimed to validate a tool for coding police body-worn camera (BWC) footage to measure the dynamics of police-community encounters, including items related to community members, officer performance, and situational outcomes. Over 1,000 BWC videos were scored by five coders who participated in an iterative interrater reliability exercise to improve the agreement. Krippendorf's alphas and a multilevel simultaneous component analysis were used to assess interrater reliability and the component structure of ratings, respectively. Bootstrapped and multilevel exploratory and confirmatory factor analyses were conducted to ascertain any underlying dimensions supporting officer and community member behavior, and cluster analyses were performed to examine whether interactions could be grouped into coherent categories. The lower bound of unweighted means of bootstrapped alphas ranged from 0.67 to 0.96 depending upon item type, and 21.60 percent of the total variance in raters was between-subjects. Factor analyses revealed only a single factor (“defensiveness”) underlying four items related to hostility directed toward officers by community members. Cluster analyses described seven categories that were highly overlapping but conceptually plausible with cluster silhouette means ranging from −0.06 to 0.13. The authors validated a collection of interval-level coding metrics on a random sample of over 1,000 interactions between police officers and community members recorded through BWCs. In doing so, they provide a roadmap for researchers and practitioners to effectively measure the dynamics of police-community encounters and officer performance within those encounters and a framework for addressing the validity and reliability of items in future studies involving the measurement of BWC footage. Publisher Abstract Provided

Date Published: January 1, 2023