U.S. flag

An official website of the United States government, Department of Justice.

Dot gov

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Https

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

NIJ Face Algorithm Assessment – Phases I, II, and III, Version 1.0

NCJ Number
252825
Date Published
Author(s)
The National Criminal Justice Technology Research, Test, and Evaluation Center
Agencies
NIJ-Sponsored
Annotation
Findings and methodology are presented for an assessment of the facial image processing software developed by Carnegie Mellon University (CMU).
Abstract
The assessment was divided into three phases, one for each of the three algorithms (Face Detection, Face Recognition, and Periocular Face Reconstruction). Results were computed with a software framework to maximize the consistency of the assessments. The process was designed to provide a one-to-one comparison between algorithms by processing both the benchmarks and the algorithm being assessed, using the same dataset and metrics. Summary results for the assessment are provided for each phase. In each case, the metric values are broken out by algorithm and dataset. The CMU-generated, CNN-based software generally out-performed the benchmark comparisons, although there were a few exceptions that are noted. The assessment found the CMU Ultron performance to be comparable to tinyFace. PittPatt performance is inferior to the Ultron/tinyFace, and YOLO has the lowest performance. In the recognition domain, the CMU-developed Native CMU outperformed across three datasets without any tuning. 28 references and extensive tables and figures
Date Created: April 14, 2019