Duplicate Record Detection: A Survey

Keywords

Computer science, Data mining, Scalability, Information retrieval, Task (project management)

References

• The Data Warehouse ETL Toolkit: Practical Techniques for Extracting, Cleaning, Conforming, and Delivering DataRalph Kimball, Joe Caserta — 2004
• The State of Record Linkage and Current Research ProblemsWilliam E. Winkler — 1999
• Using q-grams in a DBMS for Approximate String Processing.Luis Gravano, Panagiotis G. Ipeirotis, H. V. Jagadish — 2001
• Methods for Linking and Mining Massive Heterogeneous DatabasesJosé C. Pinheiro, Don X. Sun — 1998
• Learning String-Edit DistanceEric Sven Ristad, P.N. Yianilos — 1996
• The double metaphone search algorithmLawrence Philips — 2000
• Bayesian Classification (AutoClass): Theory and ResultsPeter Cheeseman, John Stutz — 1996
• Learning to Understand Information on the Internet: An Example-Based ApproachMike Perkowitz, Robert B. Doorenbos, Oren Etzioni — 1997
• An Efficient Domain-Independent Algorithm for Detecting Approximately Duplicate Database RecordsAlvaro Monge, Charles Elkan — 1997
• Making large scale SVM learning practicalThorsten Joachims — 1998
• Advances in kernel methods: support vector learningBernhard Schölkopf, Christopher J. C. Burges, Alexander J. Smola — 1999
• Real-world Data is Dirty: Data Cleansing and The Merge/Purge ProblemMauricio A. Hernández, Salvatore J. Stolfo — 1998
• Entity matching in heterogeneous databases: a distance-based decision modelDebabrata Dey, Sumit Sarkar, Prabuddha De — 1998
• Hierarchically Classifying Documents Using Very Few WordsDaphne Koller, Mehran Sahami — 1997
• A Hierarchical Graphical Model for Record LinkagePradeep Ravikumar, William W. Cohen — 2004
• The inter-database instance identification problem in integrating autonomous systemsJ.R. Wang, Stuart Madnick — 1989
• Maximum Entropy Markov Models for Information Extraction and SegmentationAndrew McCallum, Dayne Freitag, Fernando C. N. Pereira — 2000
• Record linking: the design of efficient systems for linking records into individual and family histories.Howard B. Newcombe — 1967
• Network Flows: Theory, Algorithms, and ApplicationsDavid K. Smith, Ravindra K. Ahuja, Thomas L. Magnanti — 1993
• Automating the approximate record-matching processVassilios S. Verykios, Ahmed K. Elmagarmid, Elias N. Houstis — 2000

Cited by

• Data Integration over Distributed and Heterogeneous Data EndpointsSamur Araújo — 2014
• Toward an adaptive String Similarity Measure for Matching Product OffersAndreas Thor — 2010
• Learning-based fusion for data deduplication: A robust and automated solutionJ. Dinerstein — 2010
• A Framework for Identity Resolution and Merging for Multi-source Information ExtractionMilena Yankova, Horacio Saggion, Hamish Cunningham — 2008
• A Supervised Learning and Group Linking Method for Historical Census Household LinkageZhichun Fu, Peter Christen, Mac Boot — 2011
• CONE: Metrics for Automatic Evaluation of Named Entity Co-Reference ResolutionBo Lin, Rushin Shah, Robert Frederking — 2010
• Enterprise Data Analysis and Visualization: An Interview StudyDavid S. Miall — 2012
• A Comparison and Generalization of Blocking and Windowing Algorithms for Duplicate DetectionUwe Draisbach, Felix Naumann — 2009
• Data Quality support to on-the-fly data integration using Adaptive Query ProcessingPaolo Missier, Alvaro A. A. Fernandes, Roald Lengu — 2009
• Automatic key discovery for Data Linking. (Découverte des clés pour le Liage de Données)Danai Symeonidou — 2014
• Fusing automatically extracted annotations for the Semantic WebAndriy Nikolov — 2010
• Web-based Affiliation MatchingDavid Aumüller, Erhard Rahm — 2009
• Visualization and Detection of Multiple Aliases in Social MediaAmendra Shrestha — 2013
• A Novel Framework and Model for Data Warehouse CleansingGupta Daya, Payal Pahwa, Rajiv Arora — 2011
• Training selection for tuning entity matchingHanna Köpcke, Erhard Rahm — 2008
• Supporting Decision-making in Fraud Sensitive Environments: Including Personal Data from Public Sources in Risk AnalysesYorick Bouma — 2014
• Finding Ontological Correspondences for a Domain-Independent Natural Language Dialog AgentHamid Haidarian Shahri, Donald Perlis — 2008
• EARL: an Evolutionary Algorithm for Record LinkageFrancesco Cusmai, Carola Aiello, Monica Scannapieco — 2008
• Multi-source entity resolutionChristiaan M. Punter — 2010
• Mining the Digital Information NetworksNiklas Lavesson, Peter Linde, Panayiota Polydoratou — 2013

Related papers

• Duplicate Record DetectionK ElmagarmidAhmed, G IpeirotisPanagiotis, S VerykiosVassilios — 2007
• A Survey: Detection of Duplicate RecordDewendra Bharambe, Susheel Jain, Anurag Jain — 2012
• A survey on duplicate record detection in real world dataG V Dhivyabharathi, Siva Kumar Kumaresan . — 2016
• Duplicate Detection Of Records in Queries using ClusteringM Anitha, Azmeera Srinivas, T.P. Shekhar — 2012
• An Introduction to Duplicate DetectionFelix Naumann, Melanie Herschel — 2010
• Detection of Duplicate records by using Progressive Windowing TechniqueMs.Pooja Appasahab Tippanna, K.S. Kadam — 2017
• Efficient partial-duplicate detection based on sequence matchingQi Zhang, Yue Zhang, Haomin Yu — 2010
• Duplicate Record Detection for Database CleansingMariam Rehman, Vatcharapon Esichaikul — 2009