U.S. flag

An official website of the United States government, Department of Justice.

Visualizing Deep Similarity Networks

NCJ Number
254594
Date Published
2019
Length
9 pages
Author(s)
Abby Stylianou; Richard Souvenir; Robert Pless
Agencies
NIJ-Sponsored
Publication Type
Research (Applied/Empirical), Report (Study/Research), Report (Grant Sponsored), Program/Project Description
Grant Number(s)
2018-75-CX-0038
Annotation
For convolutional neural network models that optimize an image embedding, this article proposes a method to highlight the regions of images that contribute most to pairwise similarity.
Abstract
This work is a corollary to the visualization tools developed for classification networks, but applicable to the problem domains better suited to similarity learning. The visualization shows how similarity networks that are fine-tuned learn to focus on different features. This approach is generalized to embedding networks that use different pooling strategies and provides a simple mechanism to support image similarity searches on objects or sub-regions in the query image. (publisher abstract modified)
Date Created: July 20, 2021