Computational Optimal Transport: Complexity by Accelerated Gradient Descent Is Better Than by Sinkhorn's Algorithm
We analyze two algorithms for approximating the general optimal transport (OT) distance between two discrete distributions of size n, up to accuracy ε. For the first algorithm, which is based on the celebrated Sinkhorn's algorithm, we prove the complexity bound O(n^2/ε^2) arithmetic operations. For the second one, which is based on our novel Adaptive Primal-Dual Accelerated Gradient Descent (APDAGD) algorithm, we prove the complexity bound O({n^9/4/ε, n^2/ε^2 }) arithmetic operations. Both bounds have better dependence on ε than the state-of-the-art result given by O(n^2/ε^3). Our second algorithm not only has better dependence on ε in the complexity bound, but also is not specific to entropic regularization and can solve the OT problem with different regularizers.
READ FULL TEXT