Relational Knowledge Distillation
Explore this paper's citation graph
- Type
- preprint
- Published
- 2019-04-10
- Cited by
- 2,034
- References
- 50
- Access
- Open access
- OpenAlex
- https://openalex.org/W2939524044
- Semantic Scholar
- https://api.semanticscholar.org/CorpusID:131765296
Keywords
Margin (machine learning), Distillation, Benchmark (surveying), Metric (unit), Computer science
References
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- The Caltech-UCSD Birds-200-2011 Dataset
- Distilling the Knowledge in a Neural Network
- Human behaviour: Environmental stress seen since antiquity
- FaceNet: A unified embedding for face recognition and clustering
- Going deeper with convolutions
- ImageNet Large Scale Visual Recognition Challenge
- 3D Object Representations for Fine-Grained Categorization
- Learning using privileged information: similarity control and knowledge transfer
- Deep Metric Learning via Lifted Structured Feature Embedding
- Human-level concept learning through probabilistic program induction
- Deep Residual Learning for Image Recognition
- Model compression
- Course in General Linguistics
- Picking Deep Filter Responses for Fine-Grained Image Recognition
- Deep Model Compression: Distilling Knowledge from Noisy Teachers
- Face Model Compression by Distilling Knowledge from Neurons
- Improved Deep Metric Learning with Multi-class N-pair Loss Objective
- Prototypical Networks for Few-shot Learning
- Sampling Matters in Deep Embedding Learning
Cited by
- Adversarial-Based Knowledge Distillation for Multi-Model Ensemble and Noisy Data Refinement
- Empirical Analysis of Knowledge Distillation Technique for Optimization of Quantized Deep Neural Networks
- Knowledge Transfer Graph for Deep Collaborative Learning
- Distilled Camera-Aware Self Training for Semi-Supervised Person Re-Identification
- Training Quantized Neural Networks With a Full-Precision Auxiliary Module
- Towards Oracle Knowledge Distillation with Neural Architecture Search
- The Group Loss for Deep Metric Learning
- QUEST: Quantized embedding space for transferring knowledge
- Dreaming to Distill: Data-Free Knowledge Transfer via DeepInversion
- The State of Knowledge Distillation for Classification
- Distilling Knowledge from Well-Informed Soft Labels for Neural Relation Extraction
- Role-Wise Data Augmentation for Knowledge Distillation
- Look One and More: Distilling Hybrid Order Relational Knowledge for Cross-Resolution Image Recognition
- Modeling Teacher-Student Techniques in Deep Neural Networks for Knowledge Distillation
- Structured Pruning for Efficient Convolutional Neural Networks via Incremental Regularization
- Learning an Evolutionary Embedding via Massive Knowledge Distillation
- Freeze the Discriminator: a Simple Baseline for Fine-Tuning GANs
- MarginDistillation: distillation for margin-based softmax
- Knowledge distillation via adaptive instance normalization
- Unifying Specialist Image Embedding into Universal Image Embedding
Related papers
- Symmetric Metric Learning with Adaptive Margin for Recommendation
- Local decision maximum margin metric learning for hyperspectral target detection
- Triplet Loss for Knowledge Distillation
- Multi-relational Weighted Tensor Decomposition
- Pattern-Based Transformation Approach to Relational Domain Learning Using Dynamic Aggregation for Relational Attributes
- FactorBase: SQL for Learning A Multi-Relational Graphical Model
- FactorBase : Multi-relational model learning with SQL all the way
- FACTORBASE: multi-relational structure learning with SQL all the way
- Inductive logic programming for knowedge discovery in databases