An Analysis of Single-Layer Networks in Unsupervised Feature Learning

Keywords

Computer science, Hyperparameter, Cluster analysis, Artificial intelligence, Feature (linguistics)

References

• The "independent components" of natural scenes are edge filters.Anthony J. Bell, Terrence J. Sejnowski — 1997
• Deep Boltzmann MachinesRuslan Salakhutdinov, Geoffrey E. Hinton — 2009
• Modeling pixel means and covariances using factorized third-order boltzmann machinesMarc’Aurelio Ranzato, Geoffrey E. Hinton — 2010
• Extracting and composing robust features with denoising autoencodersPascal Vincent, Hugo Larochelle, Yoshua Bengio — 2008
• Learning mid-level features for recognitionY-Lan Boureau, Francis Bach, Yann LeCun — 2010
• Linear spatial pyramid matching using sparse coding for image classificationJianchao Yang, Kai Yu, Yihong Gong — 2009
• Measuring Invariances in Deep NetworksIan Goodfellow, Honglak Lee, Quoc V. Le — 2009
• Large-scale object recognition with CUDA-accelerated hierarchical neural networksRafael Uetz, Sven Behnke — 2009
• A Bayesian hierarchical model for learning natural scene categoriesLi Fei-Fei, Pietro Perona — 2005
• Sparse Feature Learning for Deep Belief NetworksMarc’Aurelio Ranzato, Y-Lan Boureau, Y. Le Cun — 2007
• Improved Local Coordinate Coding using Local TangentsKai Yu, Tong Zhang — 2010
• Training Products of Experts by Minimizing Contrastive DivergenceGeoffrey E. Hinton — 2002
• Independent component analysis: algorithms and applicationsAapo Hyvärinen, Erkki Oja — 2000
• Convolutional deep belief networks for scalable unsupervised learning of hierarchical representationsHonglak Lee, Roger Grosse, Rajesh Ranganath — 2009
• Sparse deep belief net model for visual area V2Honglak Lee, Chaitanya Ekanadham, Andrew Y. Ng — 2007
• Learning methods for generic object recognition with invariance to pose and lightingYann LeCun, Fu Jie Huang, Léon Bottou — 2004
• Nonlinear Learning using Local Coordinate CodingKai Yu, Tong Zhang, Yihong Gong — 2009
• A Fast Learning Algorithm for Deep Belief NetsGeoffrey E. Hinton, Simon Osindero, Yee‐Whye Teh — 2006
• Object categorization by learned universal visual dictionaryJohn Winn, Antonio Criminisi, Thomas P. Minka — 2005
• Emergence of simple-cell receptive field properties by learning a sparse code for natural imagesBruno A. Olshausen, David J. Field — 1996

Cited by

• Fast and scalable distributed deep convolutional autoencoder for fMRI big data analyticsAlba Àgueda, Elsa Pastor, Eulàlia Planas — 2017
• Compute Less to Get More: Using ORC to Improve Sparse FilteringJohannes Lederer, Sergio Guadarrama — 2014
• Towards adaptive learning and inference : applications to hyperparameter tuning and astroparticle physicsRémi Bardenet — 2012
• Learning to see like children: proof of conceptMarco Gori, Marco Lippi, Marco Maggini — 2014
• Segmentation of brain MRI structures with deep machine learningAlberto Martínez González — 2012
• Collaborative hyperparameter tuningRémi Bardenet, Mátyás Brendel, Bal zs K gl — 2013
• On Random Weights and Unsupervised Feature LearningAndrew Saxe, Pang Wei Koh, Zhenghao Chen — 2011
• Learning by Stretching Deep NetworksGaurav Pandey, Ambedkar Dukkipati — 2014
• When Multivariate Forecasting Meets Unsupervised Feature Learning - Towards a Novel Anomaly Detection Framework for Decision SupportJiawei Wang, Jimmy Ren, Wei Wang — 2012
• Parallelized Deep Neural Networks for Distributed Intelligent SystemsLance Legel, Herd, Seth, Brown, Timothy — 2013
• Learning Invariant Color Features for Person ReidentificationRahul Rama Varior, Gang Wang, Jiwen Lu — 2014
• Inference Machines: Parsing Scenes via Iterated PredictionsMunoz, Daniel — 2013
• Deep Unsupervised Feature Learning for Natural Language ProcessingStephan Gouws — 2012
• Online Multi-Stage Deep Architectures for Feature Extraction and Object RecognitionDerek C. Rose — 2013
• Discovery of Deep Structure from Unlabeled DataAndrew Y. Ng, Christopher D. Manning — 2014
• Anytime Prediction: Efficient Ensemble Methods for Any Computational BudgetAlexander Grubb — 2014
• Development of a Response Planner using the UCT Algorithm for Cyber DefenseMichael P. Knight — 2013
• Unsupervised Learning of Object Descriptors and CompositionsXingyao Ye — 2012
• When are Overcomplete Representations Identifiable? Uniqueness of Tensor Decompositions Under Expansion ConstraintsAnimashree Anandkumar, Daniel Hsu, Majid Janzamin — 2013
• Learning Hierarchical Feature Extractors For Image RecognitionBoureau, Y-Lan — 2012

Related papers

• Learning Multiple Layers of Features from Tiny ImagesAlex Krizhevsky — 2024
• Reading Digits in Natural Images with Unsupervised Feature LearningYuval Netzer — 2011
• Deep Residual Learning for Image RecognitionKaiming He, Xiangyu Zhang, Shaoqing Ren — 2015
• Representation Learning: A Review and New PerspectivesYoshua Bengio, Aaron Courville, P. M. Durai Raj Vincent — 2012
• ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton — 2012
• Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising CriterionPascal Vincent, Hugo Larochelle, Isabelle Lajoie — 2010
• A Fast Learning Algorithm for Deep Belief NetsGeoffrey E. Hinton, Simon Osindero, Yee‐Whye Teh — 2006
• Convolutional deep belief networks for scalable unsupervised learning of hierarchical representationsHonglak Lee, Roger Grosse, Rajesh Ranganath — 2009
• ImageNet Large Scale Visual Recognition ChallengeOlga Russakovsky, Jia Deng, Hao Su — 2014