Roy, Soumava KumarHarandi, MehrtashNock, RichardHartley, RichardLee, Kyoung MuForsyth, DavidPollefeys, MarcTang, Xiaoou2023-07-11Oct 27-Nov9781728148038http://hdl.handle.net/1885/294119Siamese networks are non-linear deep models that have found their ways into a broad set of problems in learning theory, thanks to their embedding capabilities. In this paper, we study Siamese networks from a new perspective and question the validity of their training procedure. We show that in the majority of cases, the objective of a Siamese network is endowed with an invariance property. Neglecting the invariance property leads to a hindrance in training the Siamese networks. To alleviate this issue, we propose two Riemannian structures and generalize a well-established accelerated stochastic gradient descent method to take into account the proposed Riemannian structures. Our empirical evaluations suggest that by making use of the Riemannian geometry, we achieve state-of-the-art results against several algorithms for the challenging problem of fine-grained image classification.application/pdfen-AU© 2019 IEEESiamese networks: The tale of two manifolds201910.1109/ICCV.2019.003142022-05-08