Generation and Comprehension of Unambiguous Object Descriptions

Keywords

Closed captioning, Toolbox, Computer science, Object (grammar), Artificial intelligence

References

• Natural Reference to Objects in a Visual DomainMargaret Mitchell, Kees van Deemter, Ehud Reiter — 2010
• Framing Image Description as a Ranking Task: Data, Models and Evaluation MetricsMicah Hodosh, Peter Young, Julia Hockenmaier — 2013
• Are You Talking to a Machine? Dataset and Methods for Multilingual Image QuestionHaoyuan Gao, Junhua Mao, Jie Zhou — 2015
• Show, Attend and Tell: Neural Image Caption Generation with Visual AttentionKelvin Xu, Jimmy Ba, Ryan Kiros — 2015
• Unifying Visual-Semantic Embeddings with Multimodal Neural Language ModelsRyan Kiros, Ruslan Salakhutdinov, Richard S. Zemel — 2014
• A Game-Theoretic Approach to Generating Spatial DescriptionsDave Golland, Percy Liang, Dan Klein — 2010
• Information sharing : reference and presupposition in language generation and interpretationKees van Deemter, Rodger Kibble — 2002
• Very Deep Convolutional Networks for Large-Scale Image RecognitionKaren Simonyan, Andrew Zisserman — 2014
• Composing Simple Image Descriptions using Web-scale N-gramsSiming Li, Girish Kulkarni, Tamara L. Berg — 2011
• LSTM: A Search Space OdysseyKlaus Greff, Rupesh K. Srivastava, Jan Koutník — 2015
• Exploring Nearest Neighbor Approaches for Image CaptioningJacob Devlin, Saurabh Gupta, Ross Girshick — 2015
• Corpus-Guided Sentence Generation of Natural ImagesYezhou Yang, Ching L. Teo, Hal Daumé — 2011
• Maximum mutual information estimation of hidden Markov model parameters for speech recognitionL.R. Bahl, Peter Brown, P. de Souza — 1986
• Show and tell: A neural image caption generatorOriol Vinyals, Alexander Toshev, Samy Bengio — 2014
• Mind's eye: A recurrent visual representation for image caption generationXinlei Chen, C. Lawrence Zitnick — 2015
• From captions to visual concepts and backHao Fang, Saurabh Gupta, Forrest Iandola — 2014
• Long-term recurrent convolutional networks for visual recognition and descriptionJeff Donahue, Lisa Anne Hendricks, Sergio Guadarrama — 2014
• CIDEr: Consensus-based image description evaluationRamakrishna Vedantam, C. Lawrence Zitnick, Devi Parikh — 2014
• BabyTalk: Understanding and Generating Simple Image DescriptionsGirish Kulkarni, Visruth Premraj, Vicente Ordóñez — 2013
• Understanding natural languageTerry Winograd — 1972

Cited by

• Learning to Compose and Reason with Language Tree Structures for Visual GroundingPedro Ruymán García Díaz — 2019
• Resolving References to Objects in Photographs using the Words-As-Classifiers ModelDavid Schlangen, Sina Zarrieß, Casey Kennington — 2015
• Reasoning about Pragmatics with Neural Listeners and SpeakersJacob Andreas, Dan Klein — 2016
• Ask Your Neurons: A Deep Learning Approach to Visual Question AnsweringMateusz Malinowski, Marcus Rohrbach, Mario Fritz — 2016
• Grounding, Justification, Adaptation: Towards Machines That Mean What They SayDavid Schlangen — 2016
• Modeling Context Between Objects for Referring Expression UnderstandingVarun Nagaraja, Vlad I. Morariu, Larry S. Davis — 2016
• Easy Things First: Installments Improve Referring Expression Generation for Objects in PhotographsSina Zarrieß, David Schlangen — 2016
• Utilizing Large Scale Vision and Text Datasets for Image Segmentation from Referring ExpressionsRonghang Hu, Marcus Rohrbach, Subhashini Venugopalan — 2016
• Dense Captioning with Joint Inference and Visual ContextLinjie Yang, Kevin Tang, Jianchao Yang — 2016
• Phrase Localization and Visual Relationship Detection with Comprehensive Linguistic CuesBryan A. Plummer, Arun Mallya, Christopher M. Cervantes — 2016
• Modeling Relationships in Referential Expressions with Compositional Modular NetworksRonghang Hu, Marcus Rohrbach, Jacob Andreas — 2016
• GuessWhat?! Visual Object Discovery through Multi-modal DialogueHarm de Vries, Florian Strub, Sarath Chandar — 2016
• ImageNet pre-trained models with batch normalizationMarcel Simon, Erik Rodner, Joachim Denzler — 2016
• Top-Down Visual Saliency Guided by CaptionsVasili Ramanishka, Abir Das, Jianming Zhang — 2016
• Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence ModelsBryan A. Plummer, Liwei Wang, Chris M. Cervantes — 2015
• A Joint Speaker-Listener-Reinforcer Model for Referring ExpressionsLicheng Yu, Hao Tan, Mohit Bansal — 2016
• Context-Aware Captions from Context-Agnostic SupervisionRamakrishna Vedantam, Samy Bengio, Kevin Murphy — 2017
• Comprehension-Guided Referring ExpressionsRuotian Luo, Gregory Shakhnarovich — 2017
• Unsupervised Visual-Linguistic Reference Resolution in Instructional VideosDe-An Huang, Joseph J. Lim, Li Fei-Fei — 2017
• Statistical models of learning and using semantic representationsJoshua T. Abbott — 2016

Related papers

• OSCAR and ActivityNet: an Image Captioning model can effectively learn a Video Captioning datasetEmmanuel Byrd, Miguel González-Mendoza — 2021
• Video Captioning via Hierarchical Reinforcement LearningXin Wang, Wenhu Chen, Jiawei Wu — 2017
• Image Captioning Methodologies Using Deep Learning: A ReviewVirendra Kumar Meghwal, Namita Mittal, Girdhari Singh — 2020
• Image Captioning using Neural NetworksDhruvil Shah, Vaquar Shaikh, Gaurav Verma — 2022
• Boosted Attention: Leveraging Human Attention for Image CaptioningShi Chen, Qi Zhao — 2018
• Evolution of Image Captioning Models: An OverviewAbdelkrim Saouabe, Said Tkatek, Merouane Mazar — 2023
• Image Captioning- Bangladesh’s Heritage Perspective Using Deep LearningSarowar Alam, K M Saiful Islam, Nishat Sharmila — 2022
• Poetic Experience and Poetic Expression ——On the characteristic of Intuitive ComprehensionDuan Zong — 2003
• Discussion on the Improvement of Comprehensive and Expression Ability of English TranslationJuan Xu — 2009