research
∙
07/28/2023
Mean Estimation with User-level Privacy under Data Heterogeneity
A key challenge in many modern data analysis tasks is that user data are...
share
research
∙
07/27/2023
Samplable Anonymous Aggregation for Private Federated Data Analysis
We revisit the problem of designing scalable protocols for private stati...
research
∙
07/21/2023
Differentially Private Heavy Hitter Detection using Federated Analytics
In this work, we study practical heuristics to improve the performance o...
research
∙
06/07/2023
Fast Optimal Locally Private Mean Estimation via Random Projections
We study the problem of locally private mean estimation of high-dimensio...
research
∙
02/27/2023
Near-Optimal Algorithms for Private Online Optimization in the Realizable Regime
We consider online learning problems in the realizable setting, where th...
research
∙
12/24/2022
Concentration of the Langevin Algorithm's Stationary Distribution
A canonical algorithm for log-concave sampling is the Langevin Algorithm...
research
∙
11/18/2022
Private Federated Statistics in an Interactive Setting
Privately learning statistics of events on devices can enable improved u...
research
∙
10/24/2022
Private Online Prediction from Experts: Separations and Faster Rates
Online prediction from experts is a fundamental problem in machine learn...
research
∙
10/24/2022
Subspace Recovery from Heterogeneous Data with Non-isotropic Noise
Recovering linear subspaces from data is a fundamental and important tas...
research
∙
10/16/2022
Resolving the Mixing Time of the Langevin Algorithm to its Stationary Distribution for Log-Concave Sampling
Sampling from a high-dimensional distribution is a fundamental task in s...
research
∙
08/09/2022
Stronger Privacy Amplification by Shuffling for Rényi and Approximate Differential Privacy
The shuffle model of differential privacy has gained significant interes...
research
∙
07/18/2022
FLAIR: Federated Learning Annotated Image Repository
Cross-device federated learning is an emerging machine learning (ML) par...
research
∙
05/27/2022
Privacy of Noisy Stochastic Gradient Descent: More Iterations without More Privacy Loss
A central issue in machine learning is how to train models on sensitive ...
research
∙
05/05/2022
Optimal Algorithms for Mean Estimation under Local Differential Privacy
We study the problem of mean estimation of ℓ_2-bounded vectors under the...
research
∙
03/01/2022
Private Frequency Estimation via Projective Geometry
In this work, we propose a new algorithm ProjectiveGeometryResponse (PGR...
research
∙
02/22/2022
Differential Secrecy for Distributed Data and Applications to Robust Differentially Secure Vector Summation
Computing the noisy sum of real-valued vectors is an important primitive...
research
∙
06/25/2021
Private Adaptive Gradient Methods for Convex Optimization
We study adaptive methods for differentially private convex optimization...
research
∙
03/02/2021
Private Stochastic Convex Optimization: Optimal Rates in ℓ_1 Geometry
Stochastic convex optimization over an ℓ_1-bounded domain is ubiquitous ...
research
∙
02/24/2021
Lossless Compression of Efficient Private Local Randomizers
Locally Differentially Private (LDP) Reports are commonly used for colle...
research
∙
12/23/2020
Hiding Among the Clones: A Simple and Nearly Optimal Analysis of Privacy Amplification by Shuffling
Recent work of Erlingsson, Feldman, Mironov, Raghunathan, Talwar, and Th...
research
∙
12/11/2020
When is Memorization of Irrelevant Training Data Necessary for High-Accuracy Learning?
Modern machine learning models are complex and frequently encode surpris...
research
∙
12/02/2020
On the Error Resistance of Hinge Loss Minimization
Commonly used classification algorithms in machine learning, such as sup...
research
∙
10/27/2020
Faster Differentially Private Samplers via Rényi Divergence Analysis of Discretized Langevin MCMC
Various differentially private algorithms instantiate the exponential me...
research
∙
10/26/2020
Stochastic Optimization with Laggard Data Pipelines
State-of-the-art optimization is steadily shifting towards massively par...
research
∙
06/12/2020
Stability of Stochastic Gradient Descent on Nonsmooth Convex Losses
Uniform stability is a notion of algorithmic stability that bounds the w...
research
∙
05/10/2020
Private Stochastic Convex Optimization: Optimal Rates in Linear Time
We study differentially private (DP) algorithms for stochastic convex op...
research
∙
02/08/2020
Exploring the Memorization-Generalization Continuum in Deep Learning
Human learners appreciate that some facts demand memorization whereas ot...
research
∙
11/05/2019
Computational Separations between Sampling and Optimization
Two commonly arising computational tasks in Bayesian learning are Optimi...
research
∙
08/28/2019
Rényi Differential Privacy of the Sampled Gaussian Mechanism
The Sampled Gaussian Mechanism (SGM)---a composition of subsampling and ...
research
∙
08/27/2019
Private Stochastic Convex Optimization with Optimal Rates
We study differentially private (DP) algorithms for stochastic convex op...
research
∙
04/23/2019
Semi-Cyclic Stochastic Gradient Descent
We consider convex SGD updates with a block-cyclic structure, i.e. where...
research
∙
02/22/2019
Better Algorithms for Stochastic Bandits with Adversarial Corruptions
We study the stochastic multi-armed bandits problem in the presence of a...
research
∙
11/29/2018
Amplification by Shuffling: From Local to Central Differential Privacy via Anonymity
Sensitive statistics are often collected across sets of users, with repe...
research
∙
11/19/2018
Private Selection from Private Candidates
Differentially Private algorithms often need to select the best amongst ...
research
∙
08/20/2018
Privacy Amplification by Iteration
Many commonly used learning algorithms work by iteratively updating an i...
research
∙
06/19/2018
Online Linear Quadratic Control
We study the problem of controlling linear time-invariant systems with k...
research
∙
04/30/2018
Adversarially Robust Generalization Requires More Data
Machine learning models are often susceptible to adversarial perturbatio...
research
∙
03/05/2018
Online learning over a finite action set with limited switching
This paper studies the value of switching actions in the Prediction From...
research
∙
02/24/2018
Scalable Private Learning with PATE
The rapid adoption of machine learning has increased concerns about the ...
research
∙
08/26/2017
On the Protection of Private Information in Machine Learning Systems: Two Recent Approaches
The recent, remarkable growth of machine learning has led to intense int...
research
∙
10/18/2016
Semi-supervised Knowledge Transfer for Deep Learning from Private Training Data
Some machine learning applications involve training data that is sensiti...
research
∙
07/01/2016
Deep Learning with Differential Privacy
Machine learning techniques based on neural networks are achieving remar...
research
∙
03/14/2016
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
TensorFlow is an interface for expressing machine learning algorithms, a...
research
∙
11/20/2014