Person re-identification using local relation-aware graph convolutional network

Lian, Yu and Huang, Wenmin and Liu, Shuang and Guo, Peng and Zhang, Zhong and Durrani, Tariq S. (2023) Person re-identification using local relation-aware graph convolutional network. Sensors, 23 (19). 8138. ISSN 1424-8220 (https://doi.org/10.3390/s23198138)

[thumbnail of Lian-etal-Sensors-2023-Person-re-identification-using-local-relation-aware-graph-convolutional-network]
Preview
Text. Filename: Lian_etal_Sensors_2023_Person_re_identification_using_local_relation_aware_graph_convolutional_network.pdf
Final Published Version
License: Creative Commons Attribution 4.0 logo

Download (781kB)| Preview

Abstract

Local feature extractions have been verified to be effective for person re-identification (re-ID) in recent literature. However, existing methods usually rely on extracting local features from single part of a pedestrian while neglecting the relationship of local features among different pedestrian images. As a result, local features contain limited information from one pedestrian image, and cannot benefit from other pedestrian images. In this paper, we propose a novel approach named Local Relation-Aware Graph Convolutional Network (LRGCN) to learn the relationship of local features among different pedestrian images. In order to completely describe the relationship of local features among different pedestrian images, we propose overlap graph and similarity graph. The overlap graph formulates the edge weight as the overlap node number in the node’s neighborhoods so as to learn robust local features, and the similarity graph defines the edge weight as the similarity between the nodes to learn discriminative local features. To propagate the information for different kinds of nodes effectively, we propose the Structural Graph Convolution (SGConv) operation. Different from traditional graph convolution operations where all nodes share the same parameter matrix, SGConv learns different parameter matrices for the node itself and its neighbor nodes to improve the expressive power. We conduct comprehensive experiments to verify our method on four large-scale person re-ID databases, and the overall results show LRGCN exceeds the state-of-the-art methods.