Exact Matrix Completion via Convex Optimization — TEI-tagged view

Emmanuel J. Candès, Benjamin Recht · 2009 · mathematics · doi:10.1007/s10208-009-9045-5 · full text at the source · TEI xml · tagged edition · index · concepts · authors
Where this record's text came from. faceted 2026-08 by reading the locally held text (pdftext); every evidence string verified as an exact substring of that text before merging. The method vocabulary offered (behavioural-experiment, fmri, simulation, review, ...) has no slot for a theorem-proving mathematics paper, so I used 'mathematical-proof'; the paper does also report simulations (Sect. 7, 50 runs per (n,m,r) triple with SDPT3), which would justify 'simulation' as a secondary method tag. The paper also differentiates itself sharply from [29] (Gaussian-measurement nuclear-norm results) and from the SVD-based procedure of [3], but those passages state that the prior methods do not address this problem rather than contradicting a claim, so I did not force them into a claim relations type. Discipline could equally be 'signal-processing' or 'optimization'. 2026-08-14 and 2026-08-16 schema-0.3 passes: every quote verified as an exact substring of the staged text and anchored at merge time; concept terms verified present; every edge endpoint an existing node. Update, 15 September 2026: EXCEPTION, measured with the merge gate's own predicate (Paper.locate): 3 quote(s) on this record are not found as one exact string in the current staged text - content_tags.findings[0].evidence, content_tags.findings[1].evidence, content_tags.statistics[3].evidence. The sentence above does not hold for them as written. Where a row records why - the quote is grounded in another copy of the paper, joins two passages with an ellipsis, or differs from the staged text by extraction noise - that note stays on the row. Update, 16 September 2026: EXCEPTION TO THE DATED PASS ABOVE, on this record only: this record carries 2 composite quote fields - a quote assembled from two or more passages joined by an ellipsis. A COMPOSITE IS NOT AN EXACT CONTIGUOUS SUBSTRING of the staged text and is deliberately not anchored: each of its parts is verified separately at the offsets in evidence composite spans, and a part occurring more than once carries span null rather than a guessed offset. So the 'every quote verified as an exact substring' clause of the dated pass above DOES NOT HOLD for those fields, and never did - the parts were verified, the whole was not. Nothing is deleted, re-grounded or withdrawn: this writes down an exception that was always true of composites and had not been recorded, so a reader was told more than the pass had checked.
The quality of the text these quotes were cut from. symbol-font-not-extractable: mathematical notation is lost to '(cid:NN)' markers - 2453 of them, 14.4% of an internal file by character, but only 5.5% sit isolated in running prose (the rest cluster inside formulae). Omega, the norms and the inequality operators render as markers. 29 distinct codes with the top two accounting for 38% - ONE SYMBOL FONT WITH NO ToUnicode MAP, not a general extraction failure; a broken text font needs hundreds of codes. THE ARGUMENT OF THE PAPER IS READABLE AND TAGGABLE; THE EQUATIONS ARE NOT. 42 live quotes, 1 carrying a marker. The web page we fetched carries 1742 markers of its own and is not a repair.
Some quotes on this page contain (cid:NN). The PDF this text was extracted from encodes 6 characters in a way that names no letter, so the extractor could not say what they were. The quotes keep them because a quote is reproduced exactly or it proves nothing — the marks are the source’s, not the tagging’s.
3 quotes on this page were cut from a different copy of this article. This project holds two extractions of this paper: the plain text every other quote here is anchored in, and the publisher’s own HTML edition, which we are not licensed to republish. They are verbatim in the second and cannot be found in the first — not because the tagging is wrong, but because the extraction damaged the passage: a page number dropped into the middle of a number, a formula moved out of its sentence, a ligature where two letters belong. The record names the copy for each one. The quote is the paper’s; the extraction is not.
Other fields define these differently the same word, defined another way in another discipline
recovery 5 fields · sample-size 5 fields · statistical-significance 2 fields
Tags on this paper every tag the record carries, whether or not the words occur in the text below — a number is how many papers in the corpus carry that tag; a tag with no number is unique to this paper
matrix completion convex optimization2 low-rank matrix nuclear norm compressed sensing3 incoherent standard basis rank minimization sampling operator mathematical-proof27

Our tag layer for this paper

Cross-disciplinary analysis
content-tags & facets: phenomenon · claim-type · cross-domain-transfer · mechanism · claim-relation · replication-status · limitation — grounded in the full text
phenomenonlow-rank matrix completion— “Our main result (Theorem 1.3) extends to a variety of other low-rank matrix completion problems beyond the sampling of entries.”
claim-typemethod— “In this paper, we consider an alternative which minimizes the sum of the singular values over the constraint set.”
method — evidence— “To prove Theorem 1.3, we first establish sufficient conditions which guarantee that the true low-rank matrix M is the unique solution to (1.5) in Sect. 3.”
transferfrom compressive sampling in signal acquisition: the compressed-sensing result that an object can be recovered exactly from far fewer measurements than its dimension, carried over from signal acquisition to the recovery of a low-rank matrix from a sample of its entries— “Our work is inspired by results in the emerging field of compressive sampling or compressed sensing, a new paradigm for acquiring information about objects of interest from what appears to be a highly incomplete set of measurements [10, 12, 16].”transfers[0]
mechanismthe quantity actually wanted - the rank - is replaced by the sum of the singular values, because minimising rank is NP-hard and every known exact algorithm takes time doubly exponential in the dimension, while the substitute is convex— “This is unfortunately of little practical use because this optimization problem is not only NP-hard, but all known algorithms which provide exact solutions require time doubly exponential in the dimension n of the matrix in both theory and practice [13]. If a matrix has rank r, then it has exactly r nonzero singular values so that the rank…mechanisms[0]
mechanismthe substitution is licensed by an analogy the authors state rather than assume: the nuclear norm stands to the rank function as the convex l1 norm stands to the counting l0 norm in sparse signal recovery - one counts nonvanishing singular values, the other sums their amplitude— “Whereas the rank function counts the number of nonvanishing singular values, the nuclear norm sums their amplitude and in some sense, is to the rank functional what the convex (cid:4)1 norm is to the counting (cid:4)0 norm in the area of sparse signal recovery.”mechanisms[1]
mechanismthe informal requirement that the singular vectors be spread out is converted into a MEASURED quantity - the coherence of a subspace against the standard basis - whose smallest value is one, attained when the spanning vectors' entries all share a magnitude, and whose largest is attained by any subspace containing a standard basis element— “Note that for any subspace, the smallest μ(U ) can be is 1, achieved, for example, if U is spanned by vectors whose entries all have magnitude 1/ n. The largest possible value for μ(U ) is n/r which would correspond to any subspace that contains a standard basis element.”mechanisms[2]
mechanismnecessity is established by exhibiting a matrix rather than by argument: this one cannot be recovered from a sample of its entries unless nearly all are seen, because for most sampling sets one would see only zeros and would have no way to guess the matrix is not zero— “Clearly, this matrix cannot be recovered from a sampling of its entries unless we pretty much see all the entries. The reason is that for most sampling sets, we would only get to see zeros so that we would have no way of guessing that the matrix is not zero.”mechanisms[3]
mechanisma second necessary condition is derived the same way, from an adversarial sampling set rather than a random one: with no sample in some row, one component is unobserved and no method whatsoever can recover it, so at least one observation per row and per column is required— “Then if we do not have samples from the first row, for example, one could never guess the value of the first component of x1 by any method whatsoever; no information about x1 is observed. There is of course nothing special about the first row and this argument extends to any row or column. To have any hope of recovering an unknown matrix, one…mechanisms[4]
mechanismthe impossibility is side-stepped by changing the question from ALL sampling sets to MOST - adversarial sampling defeats even rank one, so what is asked instead is whether recovery succeeds for almost all sampling sets of a given size— “We have just seen that if the sampling is adversarial, e.g., one observes all of the entries of M but those in the first row, then one would not even be able to recover matrices of rank 1. But what happens for most sampling sets? Can one recover a low-rank matrix from almost all sampling sets of cardinality m?”mechanisms[5]
mechanismthe class of matrices the theorem covers is fixed by an explicitly stated assumption rather than left to the reader: both coherences must be bounded above by a single positive constant, which is what turns 'the singular vectors are spread out' into a checkable premise— “A0 The coherences obey max(μ(U ), μ(V )) ≤ μ0 for some positive μ0.”mechanisms[6]
mechanismthe convex program is put into a form existing software already solves: for a positive semidefinite unknown the nuclear norm IS the trace of the matrix, so the heuristic collapses into minimising the trace over the constraint set— “Indeed, when the matrix variable is symmetric and positive semidefinite, the nuclear norm of X is the sum of the (nonnegative) eigenvalues and thus equal to the trace of X. Hence, for positive semidefinite unknowns, (1.5) would simply minimize the trace over the constraint set:”mechanisms[7]
builds-on convex optimization (nuclear-norm minimization)— “finds the matrix with minimum nuclear norm that fits the data”claim_relations[0]
extends the theory of compressed sensing— “From this viewpoint, the results in this paper greatly extend the theory of compressed sensing by showing that other types of interesting objects or structures, beyond sparse signals and images, can be recovered from a limited set of measurements.”claim_relations[1]
builds-on the nuclear norm heuristic introduced by Fazel [19]— “Nuclear norm minimization is a recent heuristic introduced by Fazel in [19], and is an extension of the trace heuristic often used by the control community; see, e.g., [4, 28].”claim_relations[2]
extends the notion of incoherence of a unitary transformation introduced in [9]— “This paper generalizes the notion of incoherence to problems beyond the setting of sparse signal recovery.”claim_relations[3]
sense'exact' recovery - EXACT UNDER CONDITIONS, NOT IN GENERAL: recovery of the true matrix is proved for matrices incoherent with the standard basis and from a random sample, after the paper has stated that recovering ALL low-rank matrices is impossible, so the word describes the outcome when the hypotheses hold rather than the reach of the method— “It is therefore impossible to recover all low-rank matrices from a set of sampled entries but can one recover most of them”senses[0]
sensethe nuclear norm - A HEURISTIC STANDING IN FOR RANK: the problem actually wanted is combinatorially hard, the nuclear norm is introduced as a heuristic optimisation, and the theorem is that the two coincide for most problems - so the method solves a different problem that usually has the same answer— “In other words, for most problems, the nuclear norm relaxation is formally equivalent to the combinatorially hard rank minimization problem”senses[1]
senseincoherence - THE HYPOTHESIS THE HEADLINE DEPENDS ON: the recoverable matrices are those whose row and column spaces are incoherent with the standard basis, a property nothing in an application guarantees and which the result cannot be quoted without— “if a matrix has row and column spaces that are incoherent with the standard basis, then nuclear norm minimization can recover this matrix from a random sampling of a small number of entries”senses[2]
controlthe whole recovery procedure repeated 50 times for every (n, m, r) triple — held — rules out a single lucky or unlucky draw of the sampled entries - 50 repetitions per parameter setting turn one outcome into a rate— “For each (n, m, r) triple, we repeated the following procedure 50 times.”controls[0]
holds whennuclear norm —same-as→ rank minimization — for most problems, not for all— “In other words, for most problems, the nuclear norm relaxation is formally equivalent to the combinatorially hard rank minimization problem”— “for most problems”concept_edges[0]
weightnuclear norm —same-as→ rank minimization — 0.9— “In other words, for most problems, the nuclear norm relaxation is formally equivalent to the combinatorially hard rank minimization problem”concept_edges[0]
outcome (stated by the tagger, no quotation)control — heldcontrols[0]
for which uselimitation — the exact-recovery guarantee: IT WOULD BE OF INTEREST TO EXTEND OUR RESULTS TO THE CASE WHERE THE UNKNOWN MATRIX IS APPROXIMATELY LOW-RANK - only exactly low-rank is covered— “It would be of interest to extend our results to the case where the unknown matrix is approximately low-rank.”limitations[0]
for which uselimitation — the sampling bound as a practical requirement: THE EXPERIMENTS REVEAL VERY SIMILAR PLOTS FOR DIFFERENT n, SUGGESTING THAT OUR ASYMPTOTIC CONDITIONS FOR RECOVERY MAY BE RATHER CONSERVATIVE— “Interestingly, the experiments reveal very similar plots for different n, suggesting that our asymptotic conditions for recovery may be rather conservative.”limitations[1]
for which uselimitation — any large-scale application of the method as specified: STANDARD INTERIOR POINT METHODS WILL BE IMPRACTICAL FOR PROBLEMS WHERE THE UNKNOWN MATRIX HAS HUNDREDS OF ROWS OR COLUMNS— “Standard interior point methods will be impractical for problems where the unknown matrix has hundreds of rows or columns.”limitations[2]
for which uselimitation — the general recovery problem: WE LEAVE THIS GENERAL LOW-RANK RECOVERY PROBLEM FOR FUTURE WORK— “To avoid unnecessary confusion and notational clutter, we leave this general low-rank recovery problem for future work.”limitations[3]
for which uselimitation — the exact-recovery result reported here: the authors state it is impossible to recover all low-rank matrices from sampled entries, and pose the answerable question as whether most can be recovered— “It is therefore impossible to recover all low-rank matrices from a set of sampled entries but can one recover most of them”limitations[4]
for which uselimitation — the use of nuclear norm minimisation as a stand-in for rank minimisation: the paper states the relaxation is formally equivalent to the combinatorially hard rank minimization problem for most problems— “In other words, for most problems, the nuclear norm relaxation is formally equivalent to the combinatorially hard rank minimization problem”limitations[5]
for which uselimitation — any application of this recovery result: it applies to matrices whose row and column spaces are incoherent with the standard basis, a property of the matrix that must hold for the guarantee to bind— “if a matrix has row and column spaces that are incoherent with the standard basis, then nuclear norm minimization can recover this matrix from a random sampling of a small number of entries”limitations[6]
for which uselimitation — the claim that this method makes the problem tractable: the exact formulation is NP-hard and all known exact algorithms require time doubly exponential in the matrix dimension— “this optimization problem is not only NP-hard, but all known algorithms which provide exact solutions require time doubly exponential in the dimension”limitations[7]
evidence status notemechanism — 2026-08-16: TWO FAILED GLYPHS INSIDE THIS QUOTE. The staged text reads "what the convex (cid:4)1 norm is to the counting (cid:4)0 norm" - the extraction could not map the script-l character and left the raw PDF font code "(cid:4)" in its place, twice. Read as l-1 and l-0, the standard sparse-recovery notation. The quote is an exact substring of the staged file. It is kept rather than dropped because this sentence IS the licence for the paper's central substitution - the nuclear norm stands to rank as the convex norm stands to the counting norm - and a mechanisms layer that silently omitted it would be tidier and less true.— “Whereas the rank function counts the number of nonvanishing singular values, the nuclear norm sums their amplitude and in some sense, is to the rank functional what the convex (cid:4)1 norm is to the counting (cid:4)0 norm in the area of sparse signal recovery.”mechanisms[1]
evidence status notemechanism — 2026-08-16: THE SUBJECT OF THIS QUOTE IS ANAPHORIC AND ITS REFERENT IS NOT QUOTABLE. "this matrix" is the rank-one matrix with a single nonzero entry in the top-right corner, defined in the preceding sentence as M = e1 e_n^*. The span was NOT widened to reach that definition because the intervening text is the flattened matrix display, which the extraction renders as stray zeros and box-drawing characters - 'M = e1e* n = [ 0 0 ... 0 0 . . . 0 . . . ] , 0 1 0 0 ...' - so a wider span would quote rubble to fix a pronoun. Recorded here instead.— “Clearly, this matrix cannot be recovered from a sampling of its entries unless we pretty much see all the entries. The reason is that for most sampling sets, we would only get to see zeros so that we would have no way of guessing that the matrix is not zero.”mechanisms[3]
replicationuntested
limitationThe guarantee covers exactly low-rank matrices; extension to approximately low-rank matrices is left open.— “It would be of interest to extend our results to the case where the unknown matrix is approximately low-rank.”limitations[0]
limitationThe sampling bounds proved may be far more demanding than what is needed in practice.— “Interestingly, the experiments reveal very similar plots for different n, suggesting that our asymptotic conditions for recovery may be rather conservative.”limitations[1]
limitationThe semidefinite program the theory relies on does not scale with off-the-shelf solvers.— “Standard interior point methods will be impractical for problems where the unknown matrix has hundreds of rows or columns.”limitations[2]
limitationThe general problem of recovery from arbitrary linear functionals is not treated.— “To avoid unnecessary confusion and notational clutter, we leave this general low-rank recovery problem for future work.”limitations[3]
limitationThe paper states that the general problem is impossible and narrows the question before answering it.— “It is therefore impossible to recover all low-rank matrices from a set of sampled entries but can one recover most of them”limitations[4]
limitationThe tractable method is a relaxation whose equivalence to the real problem holds for most instances, not all.— “In other words, for most problems, the nuclear norm relaxation is formally equivalent to the combinatorially hard rank minimization problem”limitations[5]
limitationThe recovery guarantee holds only for matrices whose row and column spaces satisfy an incoherence condition.— “if a matrix has row and column spaces that are incoherent with the standard basis, then nuclear norm minimization can recover this matrix from a random sampling of a small number of entries”limitations[6]
limitationThe exact-solution alternative is not merely slow but doubly exponential in the dimension.— “this optimization problem is not only NP-hard, but all known algorithms which provide exact solutions require time doubly exponential in the dimension”limitations[7]
Content tags
content-observations: finding · quantity · variable · definition · key-term — grounded in the full text
findingMost low-rank matrices can be perfectly recovered from an apparently incomplete set of entries by a simple convex program that finds the matrix of minimum nuclear norm fitting the data.— “We show that one can perfectly recover most low-rank matrices from what appears to be an incomplete set of entries... most n × n matrices of rank r can be perfectly recovered by solving a simple convex optimization program. This program finds the matrix with minimum nuclear norm that fits the data.” [checked against the archived source, not this rendering]content_tags.findings[0]
not machine-vouchedfinding — declared-ellipsis - An elided quote: its 2 pieces ('We show that one can perfectly recover m' ... 'minimum nuclear norm that fits the data.') are each in our copy of the paper, and the quote marks the cut with an ellipsis, so the joined string is in no copy. Located mechanically, piece by piece.content_tags.findings[0]
findingThe paper's notion of incoherence generalizes the compressive-sampling concept of the same name; the Netflix recommender problem is a motivating case.— “Our notion of incoherence generalizes the concept of the same name in compressive sampling... The Netflix problem. In the area of recommender systems, users submit ratings on a subset of entries” [checked against the archived source, not this rendering]content_tags.findings[1]
not machine-vouchedfinding — declared-ellipsis - An elided quote: its 2 pieces ('Our notion of incoherence generalizes th' ... 'rs submit ratings on a subset of entries') are each in our copy of the paper, and the quote marks the cut with an ellipsis, so the joined string is in no copy. Located mechanically, piece by piece.content_tags.findings[1]
quantitym ≥ C·n^1.2·r·log n — sample complexity: entries sufficient to recover most rank-r n×n matrices— “if the number m of sampled entries obeys m ≥ C n1.2r log n for some positive numerical constant C, then with very high probability, most n × n matrices of rank r can be perfectly recovered”content_tags.quantities[0]
quantity1.25 exponent — replacing 1.2 with 1.25 makes the result hold for all ranks— “if one replaces the 1.2 exponent with 1.25, then the result holds for all values of the rank”content_tags.quantities[1]
definitionmatrix completion— “the recovery of a data matrix from a sampling of its entries”content_tags.definitions[0]
definitionnuclear norm minimization— “This program finds the matrix with minimum nuclear norm that fits the data”content_tags.definitions[1]
key-termsmatrix, completion, low-rank, nuclear norm, convex, recovery, entries, incoherence, rank
Concepts
terms this paper carries, each with the sentence it was cut from — the layer that joins one paper to another. Terms with no quote yet are on CONCEPTS.html.
conceptnuclear norm— “In other words, for most problems, the nuclear norm relaxation is formally equivalent to the combinatorially hard rank minimization problem”concepts[3]
conceptincoherent— “if a matrix has row and column spaces that are incoherent with the standard basis”concepts[5]
conceptstandard basis— “row and column spaces that are incoherent with the standard basis”concepts[6]
conceptrank minimization— “In other words, for most problems, the nuclear norm relaxation is formally equivalent to the combinatorially hard rank minimization problem”concepts[7]
conceptsampling operator— “this matrix cannot be in the null space of the “sampling operator” that provides the values of a subset of the entries”concepts[8]
Statistics — cross-field join keys
field-invariant statistical terms, used in their statistical sense (gated on a number / symbol / test). A p-value or a standard deviation means the SAME thing in physics, biology, psychology and sociology — so these are the strongest cross-field join keys. Grounded verbatim.
chi-square χ² as written: chi-squared— “Lemma 2.3 Let Yd be distributed as a chi-squared random variable with d degrees of freedom.”content_tags.statistics[0]
degrees-of-freedom df— “Lemma 2.3 Let Yd be distributed as a chi-squared random variable with d degrees of freedom.”content_tags.statistics[1]
sample-size n/N— “matrices from on the order of nr— up to logarithmic multiplicative factors—randomly selected entries? Can the sample size be merely proportional to the true complexity of the low-rank object we wish to recover? In this direction, we”content_tags.statistics[2]
evidence status notesample-size — QUOTE RECOVERED FROM THE PAPER'S OWN CHARACTERS. The recorded quote was LETTERS-ONLY IDENTICAL to this stretch of the staged text but not an exact substring of it - spaces, hyphens, ligature glyphs or mathematical operators differed, so it could never anchor. This is the file's own text between the same two letters: not produced by a rule about the damage, copied out of the file. Round-trip checked (the recovered span is letters-only equal to the original) and length-checked. The text as originally recorded is kept in evidence as extracted.content_tags.statistics[2]
statistical-significance as written: significantly— “A common hypothesis in the multitask setting is that the wk corresponding to each of the classes together span a very low dimensional subspace with dimension significantly smaller than K [1,3,5].” [checked against the archived source, not this rendering]content_tags.statistics[3]
not machine-vouchedstatistical-significance — not-in-our-copy - The quote is in the original web page we fetched for this paper, but not in the text we tag against, which was extracted differently. Checked with ligatures, hyphens, spacing and punctuation set aside.content_tags.statistics[3]

When we have changed our mind. Some entries in the table begin with a word in capitals and the reason for it. EVIDENCE CORRECTED — the finding still stands, but we had quoted the wrong sentence from the paper, and the quotation has been replaced with the right one. RETRACTED — the entry itself was wrong; it stays on the page, marked, with the reason, rather than being deleted. WITHDRAWN AND REPLACED — the entry was wrong, and a corrected version of it appears in the entries below. Each mark carries its own reason, in brackets, because the reasons differ from one entry to the next. An entry we have WITHDRAWN is removed from this page and kept in the record, with its reason. A line reading Audit and a date is a later re-reading of the entry against its whole sentence: DOUBTFUL means it was kept, and the reason says what is loose about it. Quotation marks inside the tagger's sentence. Where a tag is the tagger's own sentence, a phrase in quotation marks inside it is borrowed from the paper — the tagger's wording around it is not. The paper's own sentence is the evidence quote for that row; on this page it is withheld with the article, and the article is at its publisher. Nothing inside quotation marks anywhere on this page is ours: if it is quoted, it is the paper's. Whose words a concept carries. A concept entry records a term the paper itself uses, so the term, the sense given for it, and its evidence are the paper's own words, quoted where the paper fixes them. This is the opposite of a sense entry in the tag table, which is the tagger's sentence about how the paper uses a term. Where a concept entry could not be grounded in the paper's words, the entry says so on its own row.

Tag layer © the Meta-Tagging Project, CC BY 4.0. The paper text is © its authors/publisher and is linked, not reproduced. Excerpts shown are short quotations for identification and verification. · back to index · concepts · authors · עברית
© 2026 Shir Sivroni · ORCID 0009-0000-2597-2824