Discriminative Training Methods for Hidden Markov Models: Theory and Experiments with Perceptron Algorithms

Keywords

Maximum-entropy Markov model, Computer science, Discriminative model, Hidden Markov model, Conditional random field

References

• Building a Large Annotated Corpus of English: The Penn TreebankMitchell P. Marcus — 1993
• A Maximum Entropy Model for Part-Of-Speech TaggingAdwait Ratnaparkhi — 1996
• Maximum Entropy Markov Models for Information Extraction and SegmentationAndrew McCallum, Dayne Freitag, Fernando C. N. Pereira — 2000
• On Weak LearningDavid P. Helmbold, Manfred K. Warmuth — 1995
• Large Margin Classification Using the Perceptron AlgorithmYoav Freund, Robert E. Schapire — 1998
• Enriching the Knowledge Sources Used in a Maximum Entropy Part-of-Speech TaggerKristina Toutanova, Christopher D. Manning — 2000
• The perceptron: a probabilistic model for information storage and organization in the brain.Frank F. Rosenblatt — 1958
• Transformation-Based Error-Driven Learning and Natural Language Processing: A Case Study in Part-of-Speech TaggingEric Brill — 1995
• New Ranking Algorithms for Parsing and Tagging: Kernels over Discrete Structures, and the Voted PerceptronMichael Collins, Nigel Duffy — 2002
• Ranking Algorithms for Named Entity Extraction: Boosting and the VotedPerceptronMichael Collins — 2002
• Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence DataJohn Lafferty, Andrew McCallum, Fernando C. N. Pereira — 2001
• Text Chunking using Transformation-Based LearningLance Ramshaw, Mitchell P. Marcus — 1995
• Convolution Kernels for Natural LanguageM. Collins, Nigel P. Duffy — 2001

Cited by

• UNT: A Supervised Synergistic Approach to Semantic Text SimilarityCarmen Banea, Samer Hassan, Michael Mohler — 2012
• Global vs. Local: Component Based Learning for Classification and Image UnderstandingYi Hong — 2013
• Counting-MLNs: Learning Relational Structure for Decision MakingAniruddh Nath, Matthew Richardson — 2012
• Loss Functions for Discriminative Training of Energy-Based ModelsYann LeCun, Fu Jie Huang — 2005
• Tree Revision Learning for Dependency ParsingGiuseppe Attardi, Massimiliano Ciaramita — 2007
• Structured Sparsity in Structured PredictionAndré F. T. Martins, Noah A. Smith, Pedro M. Q. Aguiar — 2011
• Semi-Markov Models for Sequence SegmentationQinfeng Shi, Yasemin Altün, Alex Smola — 2007
• Online Learning of Structured Predictors with Multiple KernelsAndré F. T. Martins, Noah A. Smith, Eric P. Xing — 2011
• A universal multilingual weightless neural network tagger via quantitative linguisticsHugo Carneiro, Carlos E. Pedreira, Felipe M. G. França — 2017
• Ensemble Methods for Structured PredictionCorinna Cortes, Vitaly Kuznetsov, Mehryar Mohri — 2014
• Large Margin Boltzmann MachinesMiao Xu, Rajesh P. N. Rao — 2009
• Robust Information Extraction with PerceptronsMihai Surdeanu, Massimiliano Ciaramita — 2007
• Learning to Rank Documents for Ad-Hoc Retrieval with Regularized ModelsGuihong Cao, Jian‐Yun Nie, Luo Si — 2007
• Universal Schema for Knowledge Representation from Text and Structured DataLimin Yao — 2015
• Intégration de l’alignement de mots dans le concordancier bilingue TransSearchStéphane Huet, Julien Bourdaillet, Philippe Langlais — 2009
• Microsoft Research Treelet Translation System: NIST MT Evaluation 06Xiaodong He, Arul Menezes, Chris Quirk — 2006
• Learning via Inference over Structurally Constrained OutputVasin Punyakanok, Dan Roth, Wen-tau Yih — 2004
• A Resource and Tool for Super-sense Tagging of Italian TextsGiuseppe Attardi, Stefano Dei Rossi, Giulia Di Pietro — 2010
• A Multilingual Dependency Analysis System Using Online Passive-Aggressive LearningLe-Minh Nguyen, Akira Shimazu, Phuong-Thai Nguyen — 2007
• Towards a machine-learning architecture for lexical functional grammar parsingGrzegorz Chrupała — 2008

Related papers

• Upgrading CRFS to JRFS and its Benefits to Sequence Modeling and LabelingYunfu Song, Zhijian Ou, Zitao Liu — 2020
• Hybrid semi-Markov CRF for Neural Sequence LabelingZhi-Xiu Ye, Zhen-Hua Ling — 2018
• Semi-Supervised Conditional Random Fields for Improved Sequence Segmentation and LabelingFeng Jiao, Shaojun Wang, Chi‐Hoon Lee — 2006
• Research on Applications of Conditional Random Fields and Its ImprovementLi Fei — 2011
• Early results for Chinese named entity recognition using conditional random fields model, HMM and maximum entropyYuanyong Feng, Le Sun, Julin Zhang — 2005
• A Hybrid Markov/Semi-Markov Conditional Random Field for Sequence SegmentationGalen Andrew — 2006
• Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence DataJohn Lafferty, Andrew McCallum, Fernando C. N. Pereira — 2001
• Conditional Random Fields Feature Subset Selection Based on Genetic Algorithms for Phosphorylation Site PredictionThanh Hai Dang, Kristof Engelen, Pieter Meysman — 2009