A Style-Based Generator Architecture for Generative Adversarial Networks — TEI-tagged view

Tero Karras, Samuli Laine, Timo Aila · 2019 · art-history · arXiv:1812.04948 · full text at the source · TEI xml · tagged edition · index · concepts · authors
Where this record's text came from. faceted 2026-08 by reading the locally held text (pdftext); every evidence string verified as an exact substring of that text before merging. Replication_status left 'untested': the paper reports that parallel work corroborates the general superiority of style-based design ("corroborating the large-scale ImageNet measurements made in parallel work"), but no one has re-run this paper's own measurements. The third limitation quote is a fragment because the PDF extraction interleaved a figure caption mid-sentence; it is reproduced exactly as it appears in the article text. The paper also declines to add an encoder network for existing disentanglement metrics, which is a scope decision rather than a stated limitation, so it is not listed. 2026-08-14, 2026-08-16 and 2026-08-25 schema-0.3 passes: every quote verified as an exact substring of the staged text and anchored at merge time; concept terms verified present; every edge endpoint an existing node. Update, 15 September 2026: EXCEPTION, measured with the merge gate's own predicate (Paper.locate): 1 quote(s) on this record are not found as one exact string in the current staged text - content_tags.statistics[0].evidence. The sentence above does not hold for them as written. Where a row records why - the quote is grounded in another copy of the paper, joins two passages with an ellipsis, or differs from the staged text by extraction noise - that note stays on the row.
Some words in these quotes contain the wrong character. The PDF this text was extracted from substituted 2 characters inside a word — a currency sign or a stray accent where a letter pair belongs, as in signi¢cantly for significantly, or a single ligature glyph, as in confidence. They are valid characters in the wrong place, so they survive every encoding check. The quotes keep them for the same reason as above, and a search of this page will not find the affected words.
1 quote on this page was cut from a different copy of this article. This project holds two extractions of this paper: the plain text every other quote here is anchored in, and the publisher’s own HTML edition, which we are not licensed to republish. It is verbatim in the second and cannot be found in the first — not because the tagging is wrong, but because the extraction damaged the passage: a page number dropped into the middle of a number, a formula moved out of its sentence, a ligature where two letters belong. The record names the copy for each one. The quote is the paper’s; the extraction is not.
Other fields define these differently the same word, defined another way in another discipline
deep learning 11 fields · standard-deviation 3 fields
Tags on this paper every tag the record carries, whether or not the words occur in the text below — a number is how many papers in the corpus carry that tag; a tag with no number is unique to this paper
generative adversarial network2 image synthesis style transfer deep learning42 style3 spatially invariant statistics disentanglement perceptual path length linear separability coarse spatial resolutions system-or-tool-building173

Our tag layer for this paper

Cross-disciplinary analysis
content-tags & facets: phenomenon · claim-type · cross-domain-transfer · mechanism · claim-relation · replication-status · limitation — grounded in the full text
phenomenonlatent-space disentanglement in GAN image synthesis— “There are various definitions for disentanglement [54, 50, 2, 7, 19], but a common goal is a latent space that consists of linear subspaces, each of which controls one factor of variation.”
claim-typemethod— “We propose an alternative generator architecture for generative adversarial networks, borrowing from style transfer literature.”
method — evidence— “Motivated by style transfer literature [27], we re-design the generator architecture in a way that exposes novel ways to control the image synthesis process.”
transferfrom neural style transfer: the style-transfer idea of separating content from style, taken from that literature and built into the generator architecture so that style is injected at each convolution layer - the network is named after it— “Motivated by style transfer literature [27], we re-design the generator architecture in a way that exposes novel ways to control the image synthesis process.”transfers[0]
mechanismeach style controls exactly one convolution: AdaIN normalises the channel to zero mean and unit variance first, so the incoming style's scale and bias do not depend on the previous statistics and are overridden by the next AdaIN— “To see the reason for this localization, let us consider how the AdaIN operation (Eq. 1) first normalizes each channel to zero mean and unit variance, and only then applies scales and biases based on the style. The new per-channel statistics, as dictated by the style, modify the relative importance of features for the subsequent convolution…mechanisms[0]
mechanismstyle localisation is trained for, not only architected: a percentage of images are generated from two latent codes with a crossover point, which stops the network assuming adjacent styles are correlated— “To further encourage the styles to localize, we employ mixing regularization, where a given percentage of images are generated using two random latent codes instead of one during training. When generating such an image, we simply switch from one latent code to another — an operation we refer to as style mixing — at a randomly selected point…mechanisms[1]
mechanismstochastic detail is supplied by the architecture: per-pixel noise is added after each convolution the paper's reason - that a traditional generator must otherwise invent spatially-varying pseudorandom numbers from earlier activations - is the preceding paragraph, not this span— “Our architecture sidesteps these issues altogether by adding per-pixel noise after each convolution.”mechanisms[2]
mechanismthe division of labour between style and noise is enforced by the discriminator rather than by design: using noise for a global property would produce spatially inconsistent decisions and be penalised— “If the network tried to control, e.g., pose using the noise, that would lead to spatially inconsistent decisions that would then be penalized by the discriminator. Thus the network learns to use the global and local channels appropriately, without explicit guidance.”mechanisms[3]
mechanismthe intermediate latent space is defined by what it is NOT required to do - it need not follow the training data's density, which is the constraint the paper blames for entanglement in the input space— “The input latent space must follow the probability density of the training data, and we argue that this leads to some degree of unavoidable entanglement. Our intermediate latent space is free from that restriction and is therefore allowed to be disentangled.”mechanisms[4]
mechanismthe path length is defined as a limit under infinitely fine subdivision and computed as an approximation with a small finite epsilon instead the second adjustment - dividing by epsilon squared because the perceptual distance is quadratic - is a separate sentence far down the section; a span reaching it crosses a footnote, Table 3 and a figure caption— “A natural definition for the perceptual path length would be the limit of this sum under infinitely fine subdivision, but in practice we approximate it using a small subdivision epsilon”mechanisms[5]
mechanismseparability is measured without an encoder: auxiliary attribute classifiers label generated images, the least confident half is discarded, and a linear SVM is fitted per attribute on the latent-space points the conditional entropy and its exponentiation into the final score are described in the sentences after this span— “To measure the separability of one attribute, we generate 200,000 images with z ∼ P (z) and classify them using the auxiliary classification network. We then sort the samples according to classifier confidence and remove the least confident half, yielding 100,000 labeled latent-space vectors. For each attribute, we fit a linear SVM to predict…mechanisms[6]
builds-on style transfer literature— “Motivated by style transfer literature [27], we re-design the generator architecture in a way that exposes novel ways to control the image synthesis process.”claim_relations[0]
builds-on Progressive GAN (Karras et al.)— “Our baseline configuration (A) is the Progressive GAN setup of Karras et al.”claim_relations[1]
builds-on the Progressive GAN setup of Karras et al. [30]— “Our baseline configuration (A) is the Progressive GAN setup of Karras et al. [30], from which we inherit the networks and all hyperparameters except where stated otherwise.”claim_relations[2]
extends the parallel self-modulation work of Chen et al. [6]— “In parallel work, Chen et al. [6] “self modulate” the generator using AdaINs, similarly to our work, but do not consider an intermediate latent space or noise inputs.”claim_relations[3]
sense'style' - REUSED BY THE AUTHORS' OWN DECISION, FOR ARCHITECTURAL RESEMBLANCE: they say plainly that they choose to reuse the word for the vector y because similar network architectures are already used in feedforward style transfer and image-to-image translation, so the word marks a family of architectures rather than a property of a picture— “We choose to reuse the word “style” for y because similar network architectures are already used for feedforward style transfer [27], unsupervised image-toimage translation [28], and domain mixtures”senses[0]
sensestyle, once more removed - AS SPATIALLY INVARIANT STATISTICS: the paper's warrant is the style transfer literature's finding that spatially invariant statistics encode style while spatially varying features encode the instance, which is the same move gatys2015 made with a Gram matrix— “This observation is in line with style transfer literature, where it has been established that spatially invariant statistics (Gram matrix, channel-wise mean, variance, etc.) reliably encode the style of an image [20, 39] while spatially varying features encode a specific instance”senses[1]
sensedisentanglement - A GOAL STANDING IN FOR A DEFINITION: the paper records that the literature holds various definitions and adopts the shared aim of a latent space of linear subspaces, then measures that aim with two metrics of its own devising— “There are various definitions for disentanglement [54, 50, 2, 7, 19], but a common goal is a latent space that consists…senses[2]
sensestyle AT COARSE RESOLUTION - POSE, FACE SHAPE AND EYEGLASSES: the styles copied from the coarse spatial resolutions carry high-level aspects of the subject itself, so at this level the word ranges over what the picture is OF and not only how it lookssenses[3]
sensestyle ON NON-FACE DATASETS - CAMERA VIEWPOINT AND CHOICE OF FURNITURE: in bedrooms the coarse styles control where the camera is and the middle styles select which furniture appears, which an art historian would call composition and subject matter rather than style
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
senses[4]
controlan ablation table beginning from a Progressive GAN baseline, with each row adding one change to the row above — held — rules out attributing the improvement to the architecture as a whole - a table where every row differs from the previous one by a single change is what makes any single change attributable
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
controls[0]
edgestyle —operationalised-as→ spatially invariant statistics
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
concept_edges[0]
outcome (stated by the tagger, no quotation)control — heldcontrols[0]
for which uselimitation — any disentanglement claim about the input latent space: THE INPUT LATENT SPACE MUST FOLLOW THE PROBABILITY DENSITY OF THE TRAINING DATA, AND WE ARGUE THAT THIS LEADS TO SOME DEGREE OF UNAVOIDABLE ENTANGLEMENT
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
limitations[0]
for which uselimitation — the perceptual path length comparison, biased against the paper's own conclusion: THIS MEASUREMENT IS IN FACT SLIGHTLY BIASED IN FAVOR OF THE INPUT LATENT SPACE Z
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
limitations[1]
for which uselimitation — any use of FID as the training objective: THE SLOWLY RISING PATH LENGTHS INDICATE THAT THE IMPROVEMENTS IN FID COME AT THE COST OF A MORE ENTANGLED REPRESENTATION
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
limitations[2]
for which uselimitation — every result and every model trained on FFHQ: the images were crawled from Flickr, THUS INHERITING ALL THE BIASES OF THAT WEBSITE, then automatically aligned and cropped
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
limitations[3]
for which uselimitation — any disentanglement claim made here: the paper states there are various definitions of disentanglement and adopts a common goal - a latent space of linear subspaces each controlling one factor of variation - rather than one of them
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
limitations[4]
for which uselimitation — the disentanglement figures given here: the authors state the previously proposed metrics require an encoder network mapping images to latent codes, which this architecture does not have, so the two metrics used are new ones of their own
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
limitations[5]
for which uselimitation — the perceptual path length reported here: it is built on a pairwise image distance computed as a weighted difference between two VGG16 embeddings, with the weights fitted so the metric agrees with human perceptual similarity judgments
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
limitations[6]
for which uselimitation — the explanation offered for why this generator disentangles: the authors posit that there is pressure on the generator because generating realistic images should be easier from a disentangled representation than from an entangled one
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
limitations[7]
for which uselimitation — any reading of this model's 'style' as a manner of depiction: copying the coarse-resolution styles transfers pose, general hair style, face shape and eyeglasses, which are properties of the subject rather than of the manner
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
limitations[8]
replicationuntested
limitationthe input latent space, constrained to follow the training-data density, has some unavoidable entanglement
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
limitations[0]
limitationThe perceptual path length measurement is admitted to be biased in favour of the input latent space Z.
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
limitations[1]
limitationContinued FID improvement during training comes at the cost of a more entangled representation (rising path lengths).
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
limitations[2]
limitationThe new FFHQ face dataset was crawled from Flickr and therefore inherits that site's biases.
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
limitations[3]
limitationThe central term has no agreed definition and the paper proceeds on a shared goal instead.
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
limitations[4]
limitationThe two metrics reported are new because the existing ones cannot be run here, so the numbers compare to nobody.
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
limitations[5]
limitationThe perceptual distance the headline metric is built on is another network's embedding, fitted to human ratings.
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
limitations[6]
limitationThe mechanism claimed for the improvement is posited rather than shown.
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
limitations[7]
limitationWhat the paper controls under the name 'style' includes the pose and the shape of the face.
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
limitations[8]
Content tags
content-observations: finding · quantity · variable · definition · key-term — grounded in the full text
findingThe generator learns, without supervision, to separate high-level attributes such as pose and identity from stochastic variation such as freckles and hair, and allows intuitive, scale-specific control of synthesis.
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
content_tags.findings[0]
evidence status notefinding — QUOTE REPAIRED: the extractor split a hyphen-space and the quote was recorded faithfully with the damage in it, which made it unanchorable. The repaired string is an EXACT SUBSTRING of the staged text - that is why it was accepted, not because a rule produced it. The text as originally recorded is kept in evidence as extracted.content_tags.findings[0]
findingThe new generator improves on the state of the art in traditional distribution-quality metrics, interpolates demonstrably better, and better disentangles the latent factors of variation.
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
content_tags.findings[1]
evidence status notefinding — QUOTE REPAIRED: the extractor split a hyphen-space and the quote was recorded faithfully with the damage in it, which made it unanchorable. The repaired string is an EXACT SUBSTRING of the staged text - that is why it was accepted, not because a rule produced it. The text as originally recorded is kept in evidence as extracted.content_tags.findings[1]
quantity50,000 images — images used to compute the FID metric
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
content_tags.quantities[0]
quantity1024×1024 pixels — output resolution (progressive from 4x4 to 1024x1024)
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
content_tags.quantities[1]
variableFID (dependent)
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
content_tags.variables[1]
evidence status notevariable — QUOTE RECOVERED FROM THE PAPER'S OWN CHARACTERS. The recorded quote was LETTERS-ONLY IDENTICAL to this stretch of the staged text but not an exact substring of it - spaces, hyphens, ligature glyphs or mathematical operators differed, so it could never anchor. This is the file's own text between the same two letters: not produced by a rule about the damage, copied out of the file. Round-trip checked (the recovered span is letters-only equal to the original) and length-checked. The text as originally recorded is kept in evidence as extracted.content_tags.variables[1]
definitionadaptive instance normalization (AdaIN)
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
content_tags.definitions[0]
evidence status notedefinition — QUOTE REPAIRED: the extractor split a hyphen-space and the quote was recorded faithfully with the damage in it, which made it unanchorable. The repaired string is an EXACT SUBSTRING of the staged text - that is why it was accepted, not because a rule produced it. The text as originally recorded is kept in evidence as extracted.content_tags.definitions[0]
definitionEVIDENCE CORRECTED (RE-GROUNDED) · FFHQ
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
content_tags.definitions[1]
retracteddefinition — RE-GROUNDED. The published string was not verbatim in EITHER copy of the paper. A quote field promises the author's words; this held 'a new, highly…' - which welds the abstract's phrasing 2,456 characters earlier to the introduction's parenthetical. The introduction states both in one sentence and that is what is quoted now.content_tags.definitions[1]
key-termsgenerator, latent, style, disentangle, images, synthesis, interpolation, network, AdaIN
Concepts
terms this paper carries, each with the sentence it was cut from — the layer that joins one paper to another. Terms with no quote yet are on CONCEPTS.html.
conceptstyle
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
concepts[4]
conceptspatially invariant statistics
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
concepts[5]
conceptdisentanglement
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
concepts[6]
conceptperceptual path length
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
concepts[7]
conceptlinear separability
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
concepts[8]
conceptcoarse spatial resolutions
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
concepts[9]
Statistics — cross-field join keys
field-invariant statistical terms, used in their statistical sense (gated on a number / symbol / test). A p-value or a standard deviation means the SAME thing in physics, biology, psychology and sociology — so these are the strongest cross-field join keys. Grounded verbatim.
mean μ as written: average of
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
content_tags.statistics[1]
evidence status notemean — QUOTE REPAIRED: the extractor split a hyphen-space and the quote was recorded faithfully with the damage in it, which made it unanchorable. The repaired string is an EXACT SUBSTRING of the staged text - that is why it was accepted, not because a rule produced it. The text as originally recorded is kept in evidence as extracted.content_tags.statistics[1]
standard-deviation SD/σ
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
content_tags.statistics[2]

When we have changed our mind. Some entries in the table begin with a word in capitals and the reason for it. EVIDENCE CORRECTED — the finding still stands, but we had quoted the wrong sentence from the paper, and the quotation has been replaced with the right one. RETRACTED — the entry itself was wrong; it stays on the page, marked, with the reason, rather than being deleted. WITHDRAWN AND REPLACED — the entry was wrong, and a corrected version of it appears in the entries below. Each mark carries its own reason, in brackets, because the reasons differ from one entry to the next. An entry we have WITHDRAWN is removed from this page and kept in the record, with its reason. A line reading Audit and a date is a later re-reading of the entry against its whole sentence: DOUBTFUL means it was kept, and the reason says what is loose about it. Quotation marks inside the tagger's sentence. Where a tag is the tagger's own sentence, a phrase in quotation marks inside it is borrowed from the paper — the tagger's wording around it is not. The paper's own sentence is the evidence quote for that row; on this page it is withheld with the article, and the article is at its publisher. Nothing inside quotation marks anywhere on this page is ours: if it is quoted, it is the paper's. Whose words a concept carries. A concept entry records a term the paper itself uses, so the term, the sense given for it, and its evidence are the paper's own words, quoted where the paper fixes them. This is the opposite of a sense entry in the tag table, which is the tagger's sentence about how the paper uses a term. Where a concept entry could not be grounded in the paper's words, the entry says so on its own row.

Tag layer © the Meta-Tagging Project, CC BY 4.0. The paper text is © its authors/publisher and is linked, not reproduced. Excerpts shown are short quotations for identification and verification. · back to index · concepts · authors · עברית
© 2026 Shir Sivroni · ORCID 0009-0000-2597-2824