Function space analysis of deep learning representation layers

Keywords

Smoothness, Gradient boosting, Representation (politics), Computer science, Artificial intelligence

References

• Building decision tree classifier on private dataWenliang Du, Zhijun Zhan — 2002
• Feature-Budgeted Random ForestNan, Feng, Joseph Wang, Venkatesh Saligrama — 2015
• Adaptive Multivariate Approximation Using Binary Space Partitions and Geometric WaveletsShai Dekel, D. Leviatan — 2005
• Classification and regression treesWei‐Yin Loh — 2011
• Sparse spatial autoregressionsR. Kelley Pace, Ronald P. Barry — 1997
• Ten Lectures on WaveletsIngrid Daubechies, Christopher Heil — 1992
• Nonlinear piecewise polynomial approximation beyond Besov spacesBorislav Karaivanov, Pencho Petrushev — 2003
• The Elements of Statistical LearningEric R. Ziegel — 2003
• Two-Level-Split Decomposition of Anisotropic Besov SpacesWolfgang Dahmen, Shai Dekel, Pencho Petrushev — 2010
• An Analysis of Ensemble Pruning Techniques Based on Ordered AggregationGonzalo Martínez-Muñoz, Daniel Hernández-Lobato, Alberto Suárez — 2009
• Pruning of Random Forest classifiers: A survey and future directionsVrushali Kulkarni, Pradeep K. Sinha — 2012
• A wavelet tour of signal processingStéphane Mallat — 1998
• Theoretical Comparison between the Gini Index and Information Gain CriteriaLaura Elena Raileanu, Kilian Stoffel — 2004
• L1-based compression of random forest modelsArnaud Joly, François Schnitzler, Pierre Geurts — 2012
• Binary partition tree as an efficient representation for image processing, segmentation, and information retrievalPhilippe Salembier, Luís Garrido — 2000
• Predictive Ensemble Pruning by Expectation PropagationHuanhuan Chen, Peter Tiňo, Xin Yao — 2009
• Representation Learning: A Review and New PerspectivesYoshua Bengio, Aaron Courville, P. M. Durai Raj Vincent — 2012
• Image compression through wavelet transform codingRonald DeVore, Björn Jawerth, Bradley J. Lucier — 1992
• Understanding variable importances in forests of randomized treesGilles Louppe, Louis Wehenkel, Antonio Sutera — 2013
• A random forest guided tourGérard Biau, Erwan Scornet — 2015

Cited by

• USING FUNCTION SPACE THEORY FOR UNDERSTANDING INTERMEDIATE LAYERSOren Elisha, Shai Dekel — 2018
• Combined feature compression encoding in image retrievalLu Huo, Leijie Zhang — 2019
• Wavelet Regularization Benefits Adversarial TrainingJun Yan, Huilin Yin, Xiaoyang Deng — 2022
• Smooth Sailing: Improving Active Learning for Pre-trained Language Models with Representation Smoothness AnalysisJosip Jukić, Jan Šnajder — 2022

Related papers

• Nonlinear Cross-Domain Feature Representation Learning Method Based on Dual ConstraintsHan Ding, Yuhong Zhang, Shuai Yang — 2019
• Deep Clustering and Representation Learning that Preserves Geometric StructuresLirong Wu, Zicheng Liu, Zelin Zang — 2020
• Learning a Deep Part-based Representation by Preserving Data DistributionAnyong Qin, Zhaowei Shang, Zhuolin Tan — 2020
• Generalization bottleneck in deep metric learningZhanxuan Hu, Danyang Wu, Feiping Nie — 2021
• Multi-Level Representation Learning for Deep Subspace ClusteringMohsen Kheirandishfard, Fariba Zohrizadeh, Farhad Kamangar — 2020
• SAMPLING OF SURFACES AND LEARNING FUNCTIONS IN HIGH DIMENSIONSQing Zou, Mathews Jacob — 2020
• Beyond Vector Spaces: Compact Data Representationas Differentiable Weighted GraphsDenis Mazur, Vage Egiazarian, Stanislav Morozov — 2019
• Multiscale Wavelets on Trees, Graphs and High Dimensional Data: Theory and Applications to Semi Supervised LearningMatan Gavish, Boaz Nadler, Ronald R. Coifman — 2010
• Multiview Metric Learning with Global Consistency and Local SmoothnessDeming Zhai, Hong Chang, Shiguang Shan — 2012