Deep Learning with Differential Privacy
Explore this paper's citation graph
Summary
This work develops new algorithmic techniques for learning and a refined analysis of privacy costs within the framework of differential privacy, and demonstrates that deep neural networks can be trained with non-convex objectives, under a modest privacy budget, and at a manageable cost in software complexity, training efficiency, and model quality.
- Type
- article
- Published
- 2016-07-01
- Cited by
- 8,269
- References
- 63
- Access
- Open access
- OpenAlex
- https://openalex.org/W2473418344
- Semantic Scholar
- https://api.semanticscholar.org/CorpusID:207241585
Keywords
Differential privacy, Computer science, Variety (cybernetics), Machine learning, Deep learning
References
- On Random Weights and Unsupervised Feature Learning
- Torch7: A Matlab-like Environment for Machine Learning
- Learning representations by back-propagating errors
- On k-Anonymity and the Curse of Dimensionality
- Efficient Estimation of Word Representations in Vector Space
- Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
- The Composition Theorem for Differential Privacy
- Differentially Private Empirical Risk Minimization: Efficient Algorithms and Tight Error Bounds
- Lua—An Extensible Extension Language
- Bounds on the sample complexity for private learning and private data release
- The cost of privacy: destruction of data-mining utility in anonymized data publishing
- Stochastic gradient descent with differentially private updates
- Private Empirical Risk Minimization: Efficient Algorithms and Tight Error Bounds
- Analyze gauss: optimal bounds for privacy-preserving principal component analysis
- Differentially private recommender systems: building privacy into the net
- The Algorithmic Foundations of Differential Privacy
- Model Inversion Attacks that Exploit Confidence Information and Basic Countermeasures
- Privacy-preserving deep learning
- A firm foundation for private data analysis
- Privacy integrated queries: an extensible platform for privacy-preserving data analysis
Cited by
- Realizing private and practical pharmacological collaboration
- Transitive Transfer Learning
- Differentially Private Stochastic Gradient Descent for in-RDBMS Analytics
- Concrete Problems in AI Safety
- Model-based Differentially Private Data Synthesis and Statistical Inference in Multiple Synthetic Datasets
- Web Information Systems Engineering: WISE 2019 Workshop, Demo, and Tutorial, Hong Kong and Macau, China, January 19–22, 2020, Revised Selected Papers
- Distributed Optimization for Client-Server Architecture with Negative Gradient Weights
- Federated Optimization: Distributed Machine Learning for On-Device Intelligence
- Membership Inference Attacks Against Machine Learning Models
- Communication-Efficient Learning of Deep Networks from Decentralized Data
- Variational Bayes In Private Settings (VIPS)
- Differential Privacy in the Wild: A Tutorial on Current Practices & Open Challenges
- Differential Private Noise Adding Mechanism: Fundamental Theory and its Application
- Simple Black-Box Adversarial Perturbations for Deep Networks
- Differentially private publication of location entropy
- SoK: Security and Privacy in Machine Learning
- Practical Secure Aggregation for Federated Learning on User-Held Data
- Privacy Preservation for Cloud-Based Data Sharing and Data Analytics
- Deep Reinforcement Learning: An Overview
- Private Learning on Networks
Related papers
- Differential Private Noise Adding Mechanism and Its Application on Consensus Algorithm
- Differential Private Noise Adding Mechanism and Its Application on Consensus
- Interpretable Mesomorphic Networks for Tabular Data
- Adversarial Robustness of Deep Learning: Theory, Algorithms, and Applications
- Deep learning: Evolution and expansion
- Multi-Condition Training on Deep Convolutional Neural Networks for Robust Plant Diseases Detection
- Unveiling Privacy Setting Breaches in Online Social Networks