The Power of Convex Relaxation: Near-Optimal Matrix Completion
Emmanuel J. Candès, Terence Tao
Abstract
Emmanuel J. Candès, Terence Tao
Abstract
This paper is concerned with the problem of recovering an unknown matrix from a small fraction of its entries. This is known as thematrix completionproblem, and comes up in a great number of applications, including the famousNetflix Prizeand other similar questions in collaborative filtering. In general, accurate recovery of a matrix from a small number of entries is impossible, but the knowledge that the unknown matrix has low rank radically changes this premise, making the search for solutions meaningful. This paper presents optimality results quantifying the minimum number of entries needed to recover a matrix of rankrexactly by any method whatsoever (the information theoretic limit). More importantly, the paper shows that, under certain incoherence assumptions on the singular vectors of the matrix, recovery is possible by solving a convenient convex program as soon as the number of entries is on the order of the information theoretic limit (up to logarithmic factors). This convex program simply finds, among all matrices consistent with the observed entries, that with minimum nuclear norm. As an example, we show that on the order ofnrlog(n) samples are needed to recover a randomnxnmatrix of rankrby any method, and to be sure, nuclear norm minimization succeeds as soon as the number of entries is of the formnrpolylog(n).
OpenAlex reports 2163 citations for this work. Citation counts describe recorded attention and do not establish research quality.
A contribution statement is not available in the OpenAlex record.
Method details are not available in the OpenAlex metadata.
Findings are not separately available in the OpenAlex metadata.
Limitations are not available in the OpenAlex metadata.
Application details are not available in the OpenAlex metadata.
This paper is concerned with the problem of recovering an unknown matrix from a small fraction of its entries. This is known as thematrix completionproblem, and comes up in a great number of applications, including the famousNetflix Prizeand other similar questions in collaborative filtering. In general, accurate recovery of a matrix from a small number of entries is impossible, but the knowledge that the unknown matrix has low rank radically changes this premise, making the search for solutions meaningful. This paper presents optimality results quantifying the minimum number of entries needed to recover a matrix of rankrexactly by any method whatsoever (the information theoretic limit). More importantly, the paper shows that, under certain incoherence assumptions on the singular vectors of the matrix, recovery is possible by solving a convenient convex program as soon as the number of entries is on the order of the information theoretic limit (up to logarithmic factors). This convex program simply finds, among all matrices consistent with the observed entries, that with minimum nuclear norm. As an example, we show that on the order ofnrlog(n) samples are needed to recover a randomnxnmatrix of rankrby any method, and to be sure, nuclear norm minimization succeeds as soon as the number of entries is of the formnrpolylog(n).
Key concepts: Matrix norm, Matrix completion, Matrix (chemical analysis), Rank (graph theory), Logarithm, Computer science, Combinatorics, Regular polygon