Skip to main content
placeholder image

A mask based deep ranking neural network for person retrieval

Conference Paper


Abstract


  • Person retrieval faces many challenges including cluttered background, appearance variations (e.g., illumination, pose, occlusion) among different camera views and the similarity among different person's images. To address these issues, we put forward a novel mask based deep ranking neural network with a skipped fusing layer. Firstly, to alleviate the problem of cluttered background, masked images with only the foreground regions are incorporated as input in the proposed neural network. Secondly, to reduce the impact of the appearance variations, the multi-layer fusion scheme is developed to obtain more discriminative fine-grained information. Lastly, considering person retrieval is a special image retrieval task, we propose a novel ranking loss to optimize the whole network. The proposed ranking loss can further mitigate the interference problem of similar negative samples when producing ranking results. The extensive experiments validate the superiority of the proposed method compared with the state-of-the-art methods on many benchmark datasets.

Authors


  •   Qi, Lei (external author)
  •   Huo, Jing (external author)
  •   Wang, Lei
  •   Shi, Yinghuan (external author)
  •   Gao, Yang (external author)

Publication Date


  • 2019

Citation


  • Qi, L., Huo, J., Wang, L., Shi, Y. & Gao, Y. (2019). A mask based deep ranking neural network for person retrieval. IEEE International Conference on Multimedia and Expo (ICME) 2019 (pp. 496-501). United States: IEEE.

Scopus Eid


  • 2-s2.0-85070976724

Start Page


  • 496

End Page


  • 501

Place Of Publication


  • United States

Abstract


  • Person retrieval faces many challenges including cluttered background, appearance variations (e.g., illumination, pose, occlusion) among different camera views and the similarity among different person's images. To address these issues, we put forward a novel mask based deep ranking neural network with a skipped fusing layer. Firstly, to alleviate the problem of cluttered background, masked images with only the foreground regions are incorporated as input in the proposed neural network. Secondly, to reduce the impact of the appearance variations, the multi-layer fusion scheme is developed to obtain more discriminative fine-grained information. Lastly, considering person retrieval is a special image retrieval task, we propose a novel ranking loss to optimize the whole network. The proposed ranking loss can further mitigate the interference problem of similar negative samples when producing ranking results. The extensive experiments validate the superiority of the proposed method compared with the state-of-the-art methods on many benchmark datasets.

Authors


  •   Qi, Lei (external author)
  •   Huo, Jing (external author)
  •   Wang, Lei
  •   Shi, Yinghuan (external author)
  •   Gao, Yang (external author)

Publication Date


  • 2019

Citation


  • Qi, L., Huo, J., Wang, L., Shi, Y. & Gao, Y. (2019). A mask based deep ranking neural network for person retrieval. IEEE International Conference on Multimedia and Expo (ICME) 2019 (pp. 496-501). United States: IEEE.

Scopus Eid


  • 2-s2.0-85070976724

Start Page


  • 496

End Page


  • 501

Place Of Publication


  • United States