Beyond Caption To Narrative: Video Captioning With Multiple Sentences
2017-06-11 10:15
435 查看
Beyond Caption To Narrative: Video Captioning With Multiple Sentences
Andrew Shin, Katsunori Ohnishi, TatsuyaHarada
(Submitted on 18 May 2016)
Recent advances in image captioning task have led to increasing interests in video captioning task. However, most works on video captioning are focused on generating single input of aggregated features, which hardly deviates from image captioning process and
does not fully take advantage of dynamic contents present in videos. We attempt to generate video captions that convey richer contents by temporally segmenting the video with action localization, generating multiple captions from multiple frames, and connecting
them with natural language processing techniques, in order to generate a story-like caption. We show that our proposed method can generate captions that are richer in contents and can compete with state-of-the-art method without explicitly using video-level
features as input.
Comments: | accepted to ICIP 2016 |
Subjects: | Computer Vision and Pattern Recognition (cs.CV) |
Cite as: | arXiv:1605.05440 [cs.CV] |
(or arXiv:1605.05440v1 [cs.CV] for this version) |
Submission history
From: Andrew Shin [view email][v1] Wed, 18 May 2016 05:00:12 GMT (1186kb,D)
相关文章推荐
- Hierarchical Recurrent Neural Encoder for Video Representation with Application to Captioning
- Video Enhancement with Task-Oriented Flow(TOFlow)
- Video Captioning with Multi-Faceted Attention
- non-linear stationary subspace analysis with application to video classification
- Attaching Multiple Network Interfaces and Floating IPs to OpenStack Instances with Neutron
- How to deal with interlaced video
- Convert DateTime To Varchar with multiple Styles
- 解决报错 Page directive: illegal to have multiple occurrences of contentType with different values (old:
- Convert XAML Flow Document to XPS with Style (multiple page, page size, header, margin)
- Broadcasting video with Android - without writing to local files
- Mapping entities to multiple databases with NHibernate
- How to implement multiple constructor with different parameters in Scala
- JSP 解决illegal to have multiple occurrences of contentType with different values错误
- illegal to have multiple occurrences of contentType with different values (old: text/html; charset=
- Video Captioning with Transferred Semantic Attributes
- 解决illegal to have multiple occurrences of contentType with different values错误
- Send email to multiple users with sharepoint workflow
- How to effectively work with multiple files in Vim?
- Tracking The Untrackable: Learning to Track Multiple Cues with Long-Term Dependencies
- JSP 解决illegal to have multiple occurrences of contentType with different values错误