Towards retrieving social events from spatio-temporal photo annotation

  • Davi Oliveira Serrano de Andrade University of Campina Grande
  • Anderson Almeida Firmino University of Campina Grande http://orcid.org/0000-0003-2199-8191
  • Cláudio de Souza Baptista University of Campina Grande
  • Hugo Feitosa de Figueirêdo Federal Institute of Paraíba
Keywords: Photo Retrieval, Event Retrieval, Information Retrieval, Photo collection, Event annotation, Multimedia systems.

Abstract

An event can be defined as a happening that gathers people with some common goal over a period of time and in a certain place. This paper presents a new method to retrieve social events through annotations in spatio-temporal photo collections, known as STEve-PR (Spatio-Temporal EVEnt Photo Retrieval). The proposed technique uses a clustering algorithm to gather similar photos by considering the location, date and time of the photos. The STEve-PR clustering approach clusters photos belonging to the same event. STEve-PR uses spatial clusters created to propagate event annotation between photos in the same cluster and employs TF-IDF similarity between tags to find the spatial cluster with the highest similarity for photos without a geographical location. We evaluated our approach on a public database.

Author Biographies

Davi Oliveira Serrano de Andrade, University of Campina Grande
Davi Oliveira Serrano de Andrade is a M.Sc.student in Computer Science at the University of Campina Grande, Brazil.
Anderson Almeida Firmino, University of Campina Grande
Anderson Almeida Firmino is a PhD candidate in Computer Science at the University of Campina Grande, Brazil.
Cláudio de Souza Baptista, University of Campina Grande
Cláudio de Souza Baptista is Full Professor and Coordinator of the Information Systems Laboratory at the University of Campina Grande, Brazil.
Hugo Feitosa de Figueirêdo, Federal Institute of Paraíba
Hugo Feitosa de Figueirêdo is Associate Professor at the Federal Institute of Paraíba, Brazil.
Published
2019-12-02
How to Cite
de Andrade, D. O. S., Firmino, A. A., Baptista, C. de S., & de Figueirêdo, H. F. (2019). Towards retrieving social events from spatio-temporal photo annotation. First Monday, 24(12). https://doi.org/10.5210/fm.v24i12.9778