Dense, scale-less descriptors

Tal Hassner, Viki Mayzels, Lihi Zelnik-Manor

Research output: Chapter in Book/Report/Conference proceedingChapterpeer-review


Establishing correspondences between two images requires matching similar image regions. To do this effectively, local representations must be designed to allow for meaningful comparisons. As we discuss in previous chapters, one such representation is the SIFT descriptor used by SIFT flow. The scale selection required to make SIFT scale invariant, however, is only known to be possible at sparse interest points, where local image information varies sufficiently. SIFT flow and similar methods consequently settle for descriptors extracted using manually determined scales, kept constant for all image pixels. In this chapter we discuss alternative representations designed to capture multiscale appearance, even in image regions where existing methods for scale selection are not effective. We show that (1) SIFTs extracted from different scales, even in low contrast areas, vary in their values and so single scale selection often results in poor matches when images show content at different scales. (2) We propose representing pixel appearances with sets of SIFTs extracted at multiple scales. Finally, (3) low-dimensional, linear subspaces are shown to accurately represent such SIFT sets. By mapping these subspaces to points we obtain a novel representation, the Scale-Less SIFT (SLS), which can be used in a dense manner, throughout the image, to represent multiscale image appearances. We demonstrate how the use of the SLS descriptor can act as an alternative to existing, single scale representations, allowing for accurate dense correspondences between images with scale-varying content.

Original languageEnglish
Title of host publicationDense Image Correspondences for Computer Vision
PublisherSpringer International Publishing
Number of pages20
ISBN (Electronic)9783319230481
ISBN (Print)9783319230474
StatePublished - 1 Jan 2015

Bibliographical note

Publisher Copyright:
© Springer International Publishing Switzerland 2015.


Dive into the research topics of 'Dense, scale-less descriptors'. Together they form a unique fingerprint.

Cite this