Dario Zanca (1,2), Marco Gori (2)
(1) DINFO, University of Florence
(2) DIISM, University of Siena
Part of: Advances in Neural Information Processing Systems 30 (NIPS 2017)
Abstract
Computational models of visual attention are at the crossroad of disciplines like cognitive science, computational neuroscience, and computer vision. In this project we propose a model of attentional scanpath that is based on the principle that there are foundational laws that drive the emergence of visual attention.
We devise variational laws of the eye-movement that rely on a generalized view of the Least Action Principle in physics. The potential energy captures details as well as peripheral visual features, while the kinetic energy corresponds with the classic interpretation in analytic mechanics. In addition, the Lagrangian contains a brightness invariance term, which characterizes significantly the scanpath trajectories.
We obtain differential equations of visual attention as the stationary point of the generalized action, and we propose an algorithm to estimate the model parameters. Finally, we report experimental results to validate the model in tasks of saliency detection.
Resources
– Paper
– Poster
Bibtex
@incollection{NIPS2017_6972,
title = {Variational Laws of Visual Attention for Dynamic Scenes},
author = {Zanca, Dario and Gori, Marco},
booktitle = {Advances in Neural Information Processing Systems 30},
editor = {I. Guyon and U. V. Luxburg and S. Bengio and H. Wallach and R. Fergus and S. Vishwanathan and R. Garnett},
pages = {3826–3835},
year = {2017},
publisher = {Curran Associates, Inc.},
url = {http://papers.nips.cc/paper/6972-variational-laws-of-visual-attention-for-dynamic-scenes.pdf}
}