On Using Monolingual Corpora in Neural Machine Translation

Keywords

Machine translation, BLEU, Computer science, Leverage (statistics), Artificial intelligence

References

• ADADELTA: An Adaptive Learning Rate MethodMatthew D. Zeiler — 2012
• Theano: new features and speed improvementsFrédéric Bastien, Pascal Lamblin, Razvan Pascanu — 2012
• Recurrent Continuous Translation ModelsNal Kalchbrenner, Phil Blunsom — 2013
• On the difficulty of training recurrent neural networksRazvan Pascanu, Tomáš Mikolov, Yoshua Bengio — 2012
• Improving neural networks by preventing co-adaptation of feature detectorsGeoffrey E. Hinton, Nitish Srivastava, Alex Krizhevsky — 2012
• Continuous space language modelsHolger Schwenk — 2007
• Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber — 1997
• On Using Very Large Target Vocabulary for Neural Machine TranslationSébastien Jean, Kyunghyun Cho, Roland Memisevic — 2014
• Practical Variational Inference for Neural NetworksAlex Graves — 2011
• Addressing the Rare Word Problem in Neural Machine TranslationThang Luong, Ilya Sutskever, Quoc V. Le — 2014
• Moses: Open Source Toolkit for Statistical Machine TranslationPhilipp Koehn, Richard Zens, Chris Dyer — 2007
• Bidirectional recurrent neural networksMike Schuster, Kuldip K. Paliwal — 1997
• A Hierarchical Phrase-Based Model for Statistical Machine TranslationDavid Chiang — 2005
• Statistical Phrase-Based TranslationPhilipp Koehn, Franz Josef Och, Daniel Marcu — 2003
• Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine TranslationKyunghyun Cho, Bart van Merriënboer, Çağlar Gülçehre — 2014
• WIT3: Web Inventory of Transcribed and Translated TalksMauro Cettolo, Christian Girardi, Marcello Federico — 2012
• Continuous Space Translation Models for Phrase-Based Statistical Machine TranslationHolger Schwenk — 2012
• Fast and Robust Neural Network Joint Models for Statistical Machine TranslationJacob Devlin, Rabih Zbib, Zhongqiang Huang — 2014
• Maxout NetworksIan Goodfellow, David Warde-Farley, Mehdi Mirza — 2013
• RNNLM - Recurrent Neural Network Language Modeling ToolkitTomáš Mikolov, Stefan Kombrink, Anoop Deoras — 2011

Cited by

• Attention-Based Models for Speech RecognitionJan Chorowski, Dzmitry Bahdanau, Dmitriy Serdyuk — 2015
• Describing Multimedia Content Using Attention-Based Encoder-Decoder NetworksKyunghyun Cho, Aaron Courville, Yoshua Bengio — 2015
• A study of the recurrent neural network encoder-decoder for large vocabulary speech recognitionLiang Lu, Xingxing Zhang, Kyunghyun Cho — 2015
• End-to-end attention-based large vocabulary speech recognitionDzmitry Bahdanau, Jan Chorowski, Dmitriy Serdyuk — 2015
• Natural Language Video Description using Deep Recurrent Neural NetworksSubhashini Venugopalan — 2015
• Minimum Risk Training for Neural Machine TranslationShiqi Shen, Yong Cheng, Zhongjun He — 2015
• Mutual Information and Diverse Decoding Improve Neural Machine TranslationJiwei Li, Dan Jurafsky — 2016
• Multi-Way, Multilingual Neural Machine Translation with a Shared Attention MechanismOrhan Fırat, Kyunghyun Cho, Yoshua Bengio — 2016
• Montreal Neural Machine Translation Systems for WMT’15Sébastien Jean, Orhan Fırat, Kyunghyun Cho — 2015
• Improving Neural Machine Translation Models with Monolingual DataRico Sennrich, Barry Haddow, Alexandra Birch — 2015
• Neural Summarization by Extracting Sentences and WordsJianpeng Cheng, Mirella Lapata — 2016
• Adaptation of Language Models for SMT Using Neural Networks with Topic InformationYinggong Zhao, Shujian Huang, Xinyu Dai — 2016
• Improving LSTM-based Video Description with Linguistic Knowledge Mined from TextSubhashini Venugopalan, Lisa Anne Hendricks, Raymond J. Mooney — 2016
• Sentence-Level Grammatical Error Identification as Sequence-to-Sequence CorrectionAllen Schmaltz, Yoon Kim, Alexander M. Rush — 2016
• Variational Neural Machine TranslationBiao Zhang, Deyi Xiong, Jinsong Su — 2016
• Linguistic Input Features Improve Neural Machine TranslationRico Sennrich, Barry Haddow — 2016
• Generalizing and Hybridizing Count-based and Neural Language ModelsGraham Neubig, Chris Dyer — 2016
• Captioning Images with Diverse ObjectsSubhashini Venugopalan, Lisa Anne Hendricks, Marcus Rohrbach — 2016
• A Neural Knowledge Language ModelSungjin Ahn, Heeyoul Choi, Tanel Pärnamaa — 2016
• WMT 2016 Multimodal Translation System Description based on Bidirectional Recurrent Neural Networks with Double-EmbeddingsSergio Rodríguez Guasch, Marta R. Costa‐jussà — 2016

Related papers

• Better Evaluation Metrics Lead to Better Machine TranslationChang Liu, Daniel Dahlmeier, Hwee Tou Ng — 2011
• Statistical Machine Translation with Rule based Machine TranslationJin’ichi Murakami, Masato Tokuhisa — 2011
• Neural Machine Translation of Indian LanguagesKarthik Revanuru, Kaushik Turlapaty, Shrisha Rao — 2017
• Factored Statistical Machine Translation for German-EnglishDarryl Yunus Sulistyan — 2018
• Phrase-based Chinese Mongolian statistical machine translationSiriguleng Wang, Si Qintu, Nasun-urtu — 2010
• Improving English-to-Indian Language Neural Machine Translation SystemsAkshara Kandimalla, Pintu Lohar, Souvik Kumar Maji — 2022
• Very Deep Transformers for Neural Machine TranslationXiaodong Liu, Kevin Duh, Liyuan Liu — 2020
• A Novel Hybrid Approach to Improve Neural Machine Translation Decoding using Phrase-Based Statistical Machine TranslationEmre Şatır, Hasan Bulut — 2021