A Thousand Frames in Just a Few Words: Lingual Description of Videos through Latent Topics and Sparse Object Stitching

Keywords

Computer science, Image stitching, Artificial intelligence, Natural language processing, Natural language

References

• Efficiently Scaling up Crowdsourced Video AnnotationCarl Vondrick, Donald J. Patterson, Deva Ramanan — 2012
• Topic Models for Image Annotation and Text IllustrationYansong Feng, Mirella Lapata — 2010
• Comparing Automatic and Human Evaluation of NLG SystemsAnja Belz, Ehud Reiter — 2006
• Corpus-Guided Sentence Generation of Natural ImagesYezhou Yang, Ching L. Teo, Hal Daumé — 2011
• Topic regression multi-modal Latent Dirichlet Allocation for image annotationDuangmanee Putthividhy, Hagai Attias, Srikantan S. Nagarajan — 2010
• Modeling annotated dataDavid M. Blei, Michael I. Jordan — 2003
• A Spatio-Temporal Descriptor Based on 3D-GradientsAlexander Klaeser, Marcin Marszałek, C. Schmid — 2008
• Unbiased look at dataset biasAntonio Torralba, Alexei A. Efros — 2011
• The Pascal Visual Object Classes (VOC) ChallengeMark Everingham, Luc Van Gool, Christopher K. I. Williams — 2009
• Recognition using visual phrasesMohammad Amin Sadeghi, Ali Farhadi — 2011
• Towards coherent natural language description of video streamsMuhammad Usman Ghani Khan, Lei Zhang, Yoshihiko Gotoh — 2011
• Action bank: A high-level representation of activity in videoSiddharth Sadanand, Jason J. Corso — 2012
• Baby talk: Understanding and generating simple image descriptionsGirish Kulkarni, Visruth Premraj, Sagnik Dhar — 2011
• Translating related words to videos and back through latent topicsPradipto Das, Rohini K. Srihari, Jason J. Corso — 2013
• Bleu: a Method for Automatic Evaluation of Machine TranslationKishore Papineni, Salim Roukos, Todd J. Ward — 2002
• Rethinking LDA: Why Priors MatterHanna Wallach, David Mimno, Andrew McCallum — 2009
• Collecting Image Annotations Using Amazon’s Mechanical TurkCyrus Rashtchian, Peter Young, Micah Hodosh — 2010
• Graphical Models, Exponential Families, and Variational InferenceMartin J. Wainwright, Michael I. Jordan — 2008
• Spatially Coherent Latent Topic Model for Concurrent Segmentation and Classification of Objects and ScenesLiangliang Cao, Li Fei-Fei — 2007
• Automatic Evaluation of Summaries Using N-gram Co-occurrence StatisticsChin-Yew Lin, Eduard Hovy — 2003

Cited by

• Generalized Conditional Matching Algorithm for Ordered and Unordered SetsR. Krishnan — 2014
• Unsupervised Semantic Parsing of Video CollectionsOzan Şener, Amir Zamir, Silvio Savarese — 2015
• Jointly Modeling Deep Video and Compositional Text to Bridge Vision and Language in a Unified FrameworkRan Xu, Caiming Xiong, Wei Chen — 2015
• Interpretable video representationLukas Diem, Maia Zaharieva — 2015
• Combining visual recognition and computational linguistics : linguistic knowledge for visual recognition and natural language descriptions of visual contentMarcus Rohrbach — 2014
• Robot Learning Manipulation Action Plans by "Watching" Unconstrained Videos from the World Wide WebYezhou Yang, Yi Li, Cornelia Fermüller — 2015
• Generating Multi-Sentence Lingual Descriptions of Indoor ScenesDahua Lin, Chen Kong, Sanja Fidler — 2015
• Temporally coherent interpretations for long videos using pattern theoryFillipe D. M. de Souza, Sudeep Sarkar, Anuj Srivastava — 2015
• Book2Movie: Aligning video scenes with book chaptersMakarand Tapaswi, Martin Bäuml, Rainer Stiefelhagen — 2015
• Compositional Structure Learning for Action UnderstandingRan Xu, Gang Chen, Caiming Xiong — 2014
• Joint photo stream and blog post summarization and explorationGunhee Kim, Seungwhan Moon, Leonid Sigal — 2015
• Grasp type revisited: A modern perspective on a classical feature for visionYezhou Yang, Cornelia Fermüller, Yi Li — 2015
• Long-term recurrent convolutional networks for visual recognition and descriptionJeff Donahue, Lisa Anne Hendricks, Sergio Guadarrama — 2014
• Deep correlation for matching images and textFei Yan, Krystian Mikolajczyk — 2015
• Adopting Abstract Images for Semantic Scene UnderstandingC. Lawrence Zitnick, Ramakrishna Vedantam, Devi Parikh — 2016
• A framework for creating natural language descriptions of video streamsMuhammad Usman Ghani Khan, Nouf Al Harbi, Yoshihiko Gotoh — 2015
• DISCOVER: Discovering Important Segments for Classification of Video Events and RecountingChen Sun, Ram Nevatia — 2014
• Zero-Shot Event Detection Using Multi-modal Fusion of Weakly Supervised ConceptsShuang Wu, Sravanthi Bondugula, Florian Luisier — 2014
• Multimedia Topic Models Considering Burstiness of Local FeaturesYang Xie, Koji Eguchi — 2014
• A maximal figure-of-merit learning approach to maximizing mean average precision with deep neural network based classifiersKehuang Li, Zhen Huang, You-Chi Cheng — 2014

Related papers

• Evaluation in Natural Language Generation: Lessons from Referring Expression GenerationJette Viethen, Robert Dale — 2007
• Evaluation in the context of natural language generationChris Mellish, Robert Dale — 1998
• Affective Natural Language GenerationFiorella de Rosis, Floriana Grasso — 1999
• Context-aware Natural Language Generation for Spoken Dialogue SystemsHao Zhou, Minlie Huang, Xiaoyan Zhu — 2016
• Data mining via protoform based linguistic summaries: Some possible relations to natural language generationJanusz Kacprzyk, Sławomir Zadrożny — 2009
• Integrating natural language generation and model-based reasoning for explanation generationDonald Matheson, George M. Coghill, Somayajulu Sripada — 2012
• Intelligent Help Facilities: Generating Natural Language Descriptions with ExamplesVibhu O. Mittal, Cécile Paris — 1993
• Few-Shot Natural Language Generation by Rewriting TemplatesMihir Kale, Abhinav Rastogi — 2020