Mutual Information and Diverse Decoding Improve Neural Machine Translation

Keywords

Decoding methods, Machine translation, Computer science, Translation (biology), Neural decoding

References

• Trait-Based Hypothesis Selection For Machine TranslationJacob Devlin, Spyros Matsoukas — 2012
• Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network ModelsIulian Vlad Serban, Alessandro Sordoni, Yoshua Bengio — 2015
• Show, Attend and Tell: Neural Image Caption Generation with Visual AttentionKelvin Xu, Jimmy Ba, Ryan Kiros — 2015
• A Neural Network Approach to Context-Sensitive Generation of Conversational ResponsesAlessandro Sordoni, Michel Galley, Michael Auli — 2015
• A Neural Conversational ModelOriol Vinyals, Quoc V. Le — 2015
• Recurrent Continuous Translation ModelsNal Kalchbrenner, Phil Blunsom — 2013
• Neural Machine Translation of Rare Words with Subword UnitsRico Sennrich, Barry Haddow, Alexandra Birch — 2015
• Maximum mutual information estimation of hidden Markov model parameters for speech recognitionL.R. Bahl, Peter Brown, P. de Souza — 1986
• Effective Approaches to Attention-based Neural Machine TranslationThang Luong, Hieu Pham, Christopher D. Manning — 2015
• On Using Monolingual Corpora in Neural Machine TranslationÇağlar Gülçehre, Orhan Fırat, Kelvin Xu — 2015
• Bagging and Boosting statistical machine translation systemsTong Xiao, Jingbo Zhu, Tongran Liu — 2013
• Large scale discriminative training of hidden Markov models for speech recognitionPhilip C. Woodland, Daniel Povey — 2002
• String-to-Dependency Statistical Machine TranslationLibin Shen, Jinxi Xu, Ralph Weischedel — 2010
• Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber — 1997
• Solving the Problem of Cascading Errors: Approximate Bayesian Inference for Linguistic Annotation PipelinesJenny Rose Finkel, Christopher D. Manning, Andrew Y. Ng — 2006
• Lattice Minimum Bayes-Risk Decoding for Statistical Machine TranslationRoy W. Tromble, Shankar Kumar, Franz Josef Och — 2008
• On Using Very Large Target Vocabulary for Neural Machine TranslationSébastien Jean, Kyunghyun Cho, Roland Memisevic — 2014
• Bleu: a Method for Automatic Evaluation of Machine TranslationKishore Papineni, Salim Roukos, Todd J. Ward — 2002
• Lattice-based Minimum Error Rate Training for Statistical Machine TranslationWolfgang Macherey, Franz Josef Och, Ignacio Thayer — 2008
• A Hierarchical Neural Autoencoder for Paragraphs and DocumentsJiwei Li, Thang Luong, Dan Jurafsky — 2015

Cited by

• Noisy Parallel Approximate Decoding for Conditional Recurrent Language ModelKyunghyun Cho — 2016
• Review of state-of-the-arts in artificial intelligence with application to AI safety problemVladimir Shakirov — 2016
• MetaMind Neural Machine Translation System for WMT 2016James Bradbury, Richard Socher — 2016
• Diverse Beam Search: Decoding Diverse Solutions from Neural Sequence ModelsAshwin K. Vijayakumar, Michael Cogswell, Selvaraju, Ramprasath R. — 2016
• Neural Machine Translation by Minimising the Bayes-risk with Respect to Syntactic Translation LatticesFelix Stahlberg, Adrià de Gispert, Eva Hasler — 2016
• Decoding as Continuous Optimization in Neural Machine TranslationCong Duy Vu Hoang, Gholamreza Haffari, Trevor Cohn — 2017
• Grammatical error correction in non-native EnglishZheng Yuan — 2017
• Making 360° Video Watchable in 2D: Learning Videography for Click Free ViewingYu-Chuan Su, Kristen Grauman — 2017
• Natural Language Generation for Spoken Dialogue System using RNN Encoder-Decoder NetworksVan-Khanh Tran, Le-Minh Nguyen — 2017
• Data Augmentation with Seq2Seq ModelsJason Granstedt — 2017
• Single-Queue Decoding for Neural Machine TranslationRaphael Shu, Hideki Nakayama — 2017
• Towards Decoding as Continuous Optimisation in Neural Machine TranslationCong Duy Vu Hoang, Gholamreza Haffari, Trevor Cohn — 2017
• Maximum Expected Likelihood Estimation for Zero-resource Neural Machine TranslationHao Zheng, Yong Cheng, Yang Liu — 2017
• Detecting Untranslated Content for Neural Machine TranslationIsao Goto, Hideki Tanaka — 2017
• Neural Machine TranslationPhilipp Koehn — 2020
• Towards domain adaptation for Neural Network Language Generation in DialogueVan-Khanh Tran, Van-Tao Nguyen, Kiyoaki Shirai — 2017
• Diversifying Neural Conversation Model with Maximal Marginal RelevanceYiping Song, Zhiliang Tian, Dongyan Zhao — 2017
• Neural Machine TranslationThang Luong, Kyunghyun Cho, Christopher D. Manning — 2016
• Towards a Neural Conversation Model With Diversity Net Using Determinantal Point ProcessesYiping Song, Rui Yan, Yansong Feng — 2018
• Diverse Beam Search for Improved Description of Complex ScenesAshwin Vijayakumar, Michael Cogswell, Ramprasaath R. Selvaraju — 2018

Related papers

• Recurrent Stacking of Layers for Compact Neural Machine Translation ModelsRaj Dabre, Atsushi Fujita — 2018
• Model-based neural decoding of reaching movements: a maximum likelihood approachCaleb Kemere, Krishna V. Shenoy, T.H. Meng — 2004
• Comparing decoding performance between functionally defined neural populationsMatthew Best, Kazutaka Takahashi, Nicholas G. Hatsopoulos — 2015
• Trainable Greedy Decoding for Neural Machine TranslationJiatao Gu, Kyunghyun Cho, Victor O. K. Li — 2017
• Neural Decoding for Location of Macaque’s Moving Finger Using Generative Adversarial NetworksJingyi Feng, Haifeng Wu, Yu Zeng — 2018
• Stacked recurrent neural network for decoding of reaching movement using local field potentials and single-unit spikesYaser Fathi, Abbas Erfanian — 2017
• Improving the accuracy of decoding monkey brain-machine interface data by estimating the state of unobserved cell assemblies.Takahiro Asahina, Kenta Shimba, Kiyoshi Kotani — 2022
• Firing rate estimation using infinite mixture models and its application to neural decoding.Ryohei Shibue, Fumiyasu Komaki — 2017