Loading...
Loading...

Go to the content (press return)

Video object linguistic grounding

Author
Herrera-Palacio, A.; Ventura, C.; Giro, X.
Type of activity
Presentation of work at congresses
Name of edition
1st International Workshop on Multimodal Understanding and Learning for Embodied Applications
Date of publication
2019
Presentation's date
2019-10-25
Book of congress proceedings
MULEA '19 1st International Workshop on Multimodal Understanding and Learning for Embodied Applications Nice, France: October 25-25, 2019
First page
49
Last page
51
Publisher
Association for Computing Machinery (ACM)
DOI
https://doi.org/10.1145/3347450.3357662
Project funding
Multimodal Signal Processing and Machine Learning on Graphs
Repository
http://hdl.handle.net/2117/172234 Open in new window
https://imatge.upc.edu/web/publications/video-object-linguistic-grounding Open in new window
URL
https://dl.acm.org/citation.cfm?id=3357662 Open in new window
Abstract
The goal of this work is segmenting on a video sequence the objects which are mentioned in a linguistic description of the scene. We have adapted an existing deep neural network that achieves state of the art performance in semi-supervised video object segmentation, to add a linguistic branch that would generate an attention map over the video frames, making the segmentation of the objects temporally consistent along the sequence.
Citation
Herrera-Palacio, A.; Ventura, C.; Giro, X. Video object linguistic grounding. A: International Workshop on Multimodal Understanding and Learning for Embodied Applications. "MULEA '19 1st International Workshop on Multimodal Understanding and Learning for Embodied Applications Nice, France: October 25-25, 2019". New York: Association for Computing Machinery (ACM), 2019, p. 49-51.
Keywords
Linguistics, Neural networks, Video object gounding
Group of research
GPI - Image and Video Processing Group
IDEAI-UPC - Intelligent Data Science and Artificial Intelligence Research Center

Participants

  • Herrera-Palacio, Alba  (author and speaker )
  • Ventura Royo, Carles  (author and speaker )
  • Giro Nieto, Xavier  (author and speaker )