Accurate structure prediction of biomolecular interactions with AlphaFold 3 — TEI-tagged view

Josh Abramson, Jonas Adler, Jack Dunger, Richard Evans, Tim Green, Alexander Pritzel, Olaf Ronneberger, Lindsay Willmore, Andrew J. Ballard, Joshua Bambrick, Sebastian W. Bodenstein, David A. Evans, Chia-Chun Hung, Michael O’Neill, David Reiman, Kathryn Tunyasuvunakool, Zachary Wu, Akvilė Žemgulytė, Eirini Arvaniti, Charles Beattie, Ottavia Bertolli, Alex Bridgland, Alexey Cherepanov, Miles Congreve, Alexander I. Cowen-Rivers, Andrew Cowie, Michael Figurnov, Fabian B. Fuchs, Hannah Gladman, Rishub Jain, Yousuf A. Khan, Caroline M. R. Low, Kuba Perlin, Anna Potapenko, Pascal Savy, Sukhdeep Singh, Adrian Stecula, Ashok Thillaisundaram, Catherine Tong, Sergei Yakneen, Ellen D. Zhong, Michal Zielinski, Augustin Žídek, Victor Bapst, Pushmeet Kohli, Max Jaderberg, Demis Hassabis, John M. Jumper · 2024 · structural-biology · doi:10.1038/s41586-024-07487-w · TEI xml · tagged edition · index · concepts · authors
Where this record's text came from. 2026-09-11 schema-0.3 pass: every quote verified as an exact substring of the staged text and anchored at merge time; concept terms verified present; every edge endpoint an existing node.
26 quotations on this page contain a reference number where the paper printed a superscript. This journal style prints citations as raised numerals — parameters12,13 — and the extraction flattened them into the line, so the sentence reads parameters 12 , 13 . The digits are citation markers and not part of what the author wrote. The quotes keep them for the same reason they keep every other extraction fault: a quote is reproduced exactly or it proves nothing.
Other fields define these differently the same word, defined another way in another discipline
overfitting 6 fields · Protein Data Bank 2 fields · early stopping 2 fields · protein structure prediction 2 fields
Tags on this paper every tag the record carries, whether or not the words occur in the text below — a number is how many papers in the corpus carry that tag; a tag with no number is unique to this paper
AlphaFold 3 Protein Data Bank3 modified residues pairformer evoformer2 structure module2 multiple-sequence alignment2 diffusion module hallucination cross-distillation AlphaFold-Multimer2 pLDDT3 predicted aligned error2 distance error matrix PoseBusters docking RoseTTAFold2NA CASP15 DockQ LDDT2 ipTM chirality5 model seeds diffusion samples MSA depth2 conformational state static structures solution ensemble protein structure prediction2 ligand docking early stopping3 overfitting16 system-or-tool-building173
Method, as described: train a diffusion model to take noised atomic coordinates and predict the true ones, so that small-noise denoising teaches local stereochemistry and large-noise denoising teaches global structure; at inference, sample random noise and denoise it recurrently, then rank samples from several random seeds by predicted confidence

Colour legend

Nature<title level="j">A work — the journal / venue title.
2024<date>A year or date.

Josh AbramsonpersName, Jonas AdlerpersName, Jack DungerpersName, Richard EvanspersName, Tim GreenpersName, Alexander PritzelpersName, Olaf RonnebergerpersName, Lindsay WillmorepersName, Andrew J. BallardpersName, Joshua BambrickpersName, Sebastian W. BodensteinpersName, David A. EvanspersName, Chia-Chun HungpersName, Michael O’NeillpersName, David ReimanpersName, Kathryn TunyasuvunakoolpersName, Zachary WupersName, Akvilė ŽemgulytėpersName, Eirini ArvanitipersName, Charles BeattiepersName, Ottavia BertollipersName, Alex BridglandpersName, Alexey CherepanovpersName, Miles CongrevepersName, Alexander I. Cowen-RiverspersName, Andrew CowiepersName, Michael FigurnovpersName, Fabian B. FuchspersName, Hannah GladmanpersName, Rishub JainpersName, Yousuf A. KhanpersName, Caroline M. R. LowpersName, Kuba PerlinpersName, Anna PotapenkopersName, Pascal SavypersName, Sukhdeep SinghpersName, Adrian SteculapersName, Ashok ThillaisundarampersName, Catherine TongpersName, Sergei YakneenpersName, Ellen D. ZhongpersName, Michal ZielinskipersName, Augustin ŽídekpersName, Victor BapstpersName, Pushmeet KohlipersName, Max JaderbergpersName, Demis HassabispersName, John M. JumperpersName (2024date). “Accurate structure prediction of biomolecular interactions with AlphaFold 3.” Naturetitle·j.

Object of study — joint structure prediction of biomolecular complexes containing proteins, nucleic acids, small-molecule ligands, ions and modified residuesterm, within one deep-learning model

Research question — whether the structure of complexes spanning a much wider range of biomolecules than proteins can be predicted accurately within a single deep-learning framework, rather than by interaction-specific tools that often trail physics-inspired methods

Contribution — AlphaFold 3term: a pairformerterm that replaces the evoformerterm and de-emphasises MSA processing, a diffusion moduleterm that predicts raw atom coordinates in place of the AF2 structure moduleterm, cross-distillationterm against hallucinationterm, and a confidence head trained by diffusion rollout, together outperforming specialised tools across ligands, nucleic acids, modifications and protein complexes

Cross-disciplinary analysis
content-tags & facets: phenomenon · claim-type · cross-domain-transfer · mechanism · claim-relation · replication-status · limitation — grounded in the full text
phenomenonduring training the network learns local structure far faster than the global arrangement of a complex: intrachain metrics reach 97 percent of their maximum within the first 20,000 steps, while protein-protein interface accuracy passes that bar only after 60,000 steps — “Figure 2d shows that, during initial training, the model learns quickly to predict the local structures (all intrachain metrics go up quickly and reach 97% of the maximum performance within the first 20,000 training steps), while the model needs considerably longer to learn the global constellation (the interface metrics go up slowly and protein–protein interface LDDT passes the 97% bar only after 60,000 steps). During AF3 development, we observed that some model abilities topped out relatively early and started to decline (most likely due to overfitting to the limited number of training samples for this capability), while other abilities were still undertrained. We addressed this by increasing or decreasing the sampling probability for the corresponding training sets (Supplementary Methods 2.5.1 ) and by performing early stopping using a weighted average of all of the above metrics and some additional metrics to select the best model checkpoint (Supplementary Table 7 ). The fine-tuning stages with the larger crop sizes improve the model on all metrics with an especially high uplift on protein–protein interfaces (Extended Data Fig. 2 ).”
claim-typeexistence — “The core challenge of molecular biology is to understand and ultimately regulate the complex atomic interactions of biological systems. The AF3 model takes a large step in this direction, demonstrating that it is possible to accurately predict the structure of a wide range of biomolecular systems in a unified framework. Although there are still substantial challenges to achieve highly accurate predictions across all interaction types, we demonstrate that it is possible to build a deep-learning system that shows strong coverage and generalization for all of these interactions. We also demonstrate that the lack of cross-entity evolutionary information is not a substantial blocker to progress in predicting these interactions and, moreover, substantial improvement in antibody results suggests AlphaFold-derived methods are able to model the chemistry and physics of classes of molecular interactions without dependence on MSAs. Finally, the large improvement in protein–ligand structure prediction shows that it is possible to handle the wide diversity of chemical space within a general deep-learning framework and without resorting to an artificial separation between protein structure prediction and ligand docking.”
method — evidence — “The diffusion module (Fig. 2b and Supplementary Methods 3.7 ) operates directly on raw atom coordinates, and on a coarse abstract token representation, without rotational frames or any equivariant processing. We had observed in AF2 that removing most of the complexity of the structure module had only a modest effect on the prediction accuracy, and maintaining the backbone frame and side-chain torsion representation add quite a bit of complexity for general molecular graphs. Similarly AF2 required carefully tuned stereochemical violation penalties during training to enforce chemical plausibility of the resulting structures. We use a relatively standard diffusion approach 33 in which the diffusion model is trained to receive ‘noised’ atomic coordinates and then predict the true coordinates. This task requires the network to learn protein structure at a variety of length scales, whereby the denoising task at small noise emphasizes understanding very local stereochemistry and the denoising task at high noise emphasizes the large-scale structure of the system. At the inference time, random noise is sampled and then recurrently denoised to produce a final structure. Importantly, this is a generative training procedure that produces a distribution of answers. This means that, for each answer, the local structure will be sharply defined (for example, side-chain bond geometry) even when the network is uncertain about the positions. For this reason, we are able to avoid both torsion-based parametrizations of the residues and violation losses on the structure, while handling the full complexity of general ligands. Similarly to some recent work 34 , we find that no invariance or equivariance with respect to global rotations and translation of the molecule are required in the architecture and we therefore omit them to simplify the machine learning architecture.”
object of study — evidence — “Here we present AlphaFold 3 (AF3)—a model that is capable of high-accuracy prediction of complexes containing nearly all molecular types present in the Protein Data Bank 32 (PDB) (Fig. 1a,b ). In all but one category, it achieves a substantially higher performance than strong methods that specialize in just the given task (Fig. 1c and Extended Data Table 1 ), including higher accuracy at protein structure and the structure of protein–protein interactions.”
research question — evidence — “These successes lead to the question of whether it is possible to accurately predict the structure of complexes containing a much wider range of biomolecules, including ligands, ions, nucleic acids and modified residues, within a deep-learning framework. A wide range of predictors for various specific interaction types has been developed 16 – 28 , as well as one generalist method developed concurrently with the present work 29 , but the accuracy of such deep-learning attempts has been mixed and often below that of physics-inspired methods 30 , 31 . Almost all of these methods are also highly specialized to particular interaction types and cannot predict the structure of general biomolecular complexes containing many types of entities.”
contribution — evidence — “This is achieved by a substantial evolution of the AF2 architecture and training procedure (Fig. 1d ) both to accommodate more general chemical structures and to improve the data efficiency of learning. The system reduces the amount of multiple-sequence alignment (MSA) processing by replacing the AF2 evoformer with the simpler pairformer module (Fig. 2a ). Furthermore it directly predicts the raw atom coordinates with a diffusion module, replacing the AF2 structure module that operated on amino-acid-specific frames and side-chain torsion angles (Fig. 2b ). The multiscale nature of the diffusion process (low noise levels induce the network to improve local structure) also enable us to eliminate stereochemical losses and most special handling of bonding patterns in the network, easily accommodating arbitrary chemical components.”
mechanismmultiscale denoising Denoising at small noise levels emphasises very local stereochemistry and at high noise levels the large-scale structure, so one training objective covers every length scale. — “The diffusion module (Fig. 2b and Supplementary Methods 3.7 ) operates directly on raw atom coordinates, and on a coarse abstract token representation, without rotational frames or any equivariant processing. We had observed in AF2 that removing most of the complexity of the structure module had only a modest effect on the prediction accuracy, and maintaining the backbone frame and side-chain torsion representation add quite a bit of complexity for general molecular graphs. Similarly AF2 required carefully tuned stereochemical violation penalties during training to enforce chemical plausibility of the resulting structures. We use a relatively standard diffusion approach 33 in which the diffusion model is trained to receive ‘noised’ atomic coordinates and then predict the true coordinates. This task requires the network to learn protein structure at a variety of length scales, whereby the denoising task at small noise emphasizes understanding very local stereochemistry and the denoising task at high noise emphasizes the large-scale structure of the system. At the inference time, random noise is sampled and then recurrently denoised to produce a final structure. Importantly, this is a generative training procedure that produces a distribution of answers. This means that, for each answer, the local structure will be sharply defined (for example, side-chain bond geometry) even when the network is uncertain about the positions. For this reason, we are able to avoid both torsion-based parametrizations of the residues and violation losses on the structure, while handling the full complexity of general ligands. Similarly to some recent work 34 , we find that no invariance or equivariance with respect to global rotations and translation of the molecule are required in the architecture and we therefore omit them to simplify the machine learning architecture.”mechanisms[0]
mechanismgenerative sharpness Because training is generative and yields a distribution of answers, each sample keeps sharply defined local geometry even where positions are uncertain, which removes the need for torsion parametrisations and violation losses. — “The diffusion module (Fig. 2b and Supplementary Methods 3.7 ) operates directly on raw atom coordinates, and on a coarse abstract token representation, without rotational frames or any equivariant processing. We had observed in AF2 that removing most of the complexity of the structure module had only a modest effect on the prediction accuracy, and maintaining the backbone frame and side-chain torsion representation add quite a bit of complexity for general molecular graphs. Similarly AF2 required carefully tuned stereochemical violation penalties during training to enforce chemical plausibility of the resulting structures. We use a relatively standard diffusion approach 33 in which the diffusion model is trained to receive ‘noised’ atomic coordinates and then predict the true coordinates. This task requires the network to learn protein structure at a variety of length scales, whereby the denoising task at small noise emphasizes understanding very local stereochemistry and the denoising task at high noise emphasizes the large-scale structure of the system. At the inference time, random noise is sampled and then recurrently denoised to produce a final structure. Importantly, this is a generative training procedure that produces a distribution of answers. This means that, for each answer, the local structure will be sharply defined (for example, side-chain bond geometry) even when the network is uncertain about the positions. For this reason, we are able to avoid both torsion-based parametrizations of the residues and violation losses on the structure, while handling the full complexity of general ligands. Similarly to some recent work 34 , we find that no invariance or equivariance with respect to global rotations and translation of the molecule are required in the architecture and we therefore omit them to simplify the machine learning architecture.”mechanisms[1]
mechanismcross-distillation from AlphaFold-Multimer Training structures predicted by AlphaFold-Multimer represent unstructured regions as long extended loops, and training on them teaches AF3 to reproduce that instead of inventing compact structure. — “The use of a generative diffusion approach comes with some technical challenges that we needed to address. The biggest issue is that generative models are prone to hallucination 35 , whereby the model may invent plausible-looking structure even in unstructured regions. To counteract this effect, we use a cross-distillation method in which we enrich the training data with structures predicted by AlphaFold-Multimer (v.2.3) 7 , 8 . In these structures, unstructured regions are typically represented by long extended loops instead of compact structures, and training on them ‘teaches’ AF3 to mimic this behaviour. This cross-distillation greatly reduced the hallucination behaviour of AF3 (Extended Data Fig. 1 for disorder prediction results on the CAID 2 36 benchmark set).”mechanisms[2]
mechanismdiffusion rollout for the confidence head Since diffusion trains only single denoising steps, a larger-step rollout generates a full structure during training; it is used to permute symmetric chains and ligands and to compute the metrics the confidence head learns to predict. — “We also developed confidence measures that predict the atom-level and pairwise errors in our final structures. In AF2, this was done directly by regressing the error in the output of the structure module during training. However, this procedure is not applicable to diffusion training, as only a single step of the diffusion is trained instead of a full-structure generation (Fig. 2c ). To remedy this, we developed a diffusion ‘rollout’ procedure for the full-structure prediction generation during training (using a larger step size than normal; Fig. 2c (mini-rollout)). This predicted structure is then used to permute the symmetric ground-truth chains and ligands, and to compute the performance metrics to train the confidence head. The confidence head uses the pairwise representation to predict a modified local distance difference test (pLDDT) and a predicted aligned error (PAE) matrix as in AF2, as well as a distance error matrix (PDE), which is the error in the distance matrix of the predicted structure as compared to the true structure (details are provided in Supplementary Methods 4.3 ).”mechanisms[3]
mechanismcapability rebalancing Abilities that saturated early and began to decline were given lower sampling probability while undertrained ones were given more, with early stopping on a weighted average of metrics selecting the checkpoint. — “Figure 2d shows that, during initial training, the model learns quickly to predict the local structures (all intrachain metrics go up quickly and reach 97% of the maximum performance within the first 20,000 training steps), while the model needs considerably longer to learn the global constellation (the interface metrics go up slowly and protein–protein interface LDDT passes the 97% bar only after 60,000 steps). During AF3 development, we observed that some model abilities topped out relatively early and started to decline (most likely due to overfitting to the limited number of training samples for this capability), while other abilities were still undertrained. We addressed this by increasing or decreasing the sampling probability for the corresponding training sets (Supplementary Methods 2.5.1 ) and by performing early stopping using a weighted average of all of the above metrics and some additional metrics to select the best model checkpoint (Supplementary Table 7 ). The fine-tuning stages with the larger crop sizes improve the model on all metrics with an especially high uplift on protein–protein interfaces (Extended Data Fig. 2 ).”mechanisms[4]
mechanismpenalised seed ranking Predictions from several seeds are ranked by an ipTM-based score divided by 100 when a ligand shows chirality errors or clashes, so plausible samples outrank physically invalid ones. — “Inference was performed on the asymmetric unit from specified PDBs, with the following minor modifications. In several PDB files, chains clashing with the ligand of interest were removed ( 7O1T , 7PUV , 7SCW , 7WJB , 7ZXV , 8AIE ). Another PDB entry ( 8F4J ) was too large to inference the entire system (over 5,120 tokens), so we included only protein chains within 20 Å of the ligand of interest. Five model seeds, each with five diffusion samples, were produced per target, resulting in 25 predictions, which were ranked by quality and predicted accuracy: the ranking score was calculated from an ipTM aggregate (Supplementary Methods 5.9.3 (point 3)), then further divided by 100 if the ligand had chirality errors or had clashes with the protein.”mechanisms[5]
builds-on AlphaFold 2 (Jumper et al. 2021), whose trunk-then-structure-generator design AF3 keeps while replacing the evoformer and the structure module — “The overall structure of AF3 (Fig. 1d and Supplementary Methods 3 ) echoes that of AF2, with a large trunk evolving a pairwise representation of the chemical complex followed by a structure module that uses the pairwise representation to generate explicit atomic positions, but there are large differences in each major component. These modifications were driven both by the need to accommodate a wide range of chemical entities without excessive special casing and by observations of AF2 performance with different modifications. Within the trunk, MSA processing is substantially de-emphasized, with a much smaller and simpler MSA embedding block (Supplementary Methods 3.3 ). Compared with the original evoformer from AF2, the number of blocks is reduced to four, the processing of the MSA representation uses an inexpensive pair-weighted averaging and only the pair representation is used for later processing steps. The ‘pairformer’ (Fig. 2a and Supplementary Methods 3.6 ) replaces the evoformer of AF2 as the dominant processing block. It operates only on the pair representation and the single representation; the MSA representation is not retained and all information passes through the pair representation. The pair processing and the number of blocks (48) is largely unchanged from AF2. The resulting pair and single representation together with the input representation are passed to the new diffusion module (Fig. 2b ) that replaces the structure module of AF2.”claim_relations[0]
builds-on AlphaFold-Multimer v2.3, whose predicted structures supply the cross-distillation training data and serve as the protein-complex baseline — “The use of a generative diffusion approach comes with some technical challenges that we needed to address. The biggest issue is that generative models are prone to hallucination 35 , whereby the model may invent plausible-looking structure even in unstructured regions. To counteract this effect, we use a cross-distillation method in which we enrich the training data with structures predicted by AlphaFold-Multimer (v.2.3) 7 , 8 . In these structures, unstructured regions are typically represented by long extended loops instead of compact structures, and training on them ‘teaches’ AF3 to mimic this behaviour. This cross-distillation greatly reduced the hallucination behaviour of AF3 (Extended Data Fig. 1 for disorder prediction results on the CAID 2 36 benchmark set).”claim_relations[1]
builds-on standard denoising diffusion models from generative machine learning — “The diffusion module (Fig. 2b and Supplementary Methods 3.7 ) operates directly on raw atom coordinates, and on a coarse abstract token representation, without rotational frames or any equivariant processing. We had observed in AF2 that removing most of the complexity of the structure module had only a modest effect on the prediction accuracy, and maintaining the backbone frame and side-chain torsion representation add quite a bit of complexity for general molecular graphs. Similarly AF2 required carefully tuned stereochemical violation penalties during training to enforce chemical plausibility of the resulting structures. We use a relatively standard diffusion approach 33 in which the diffusion model is trained to receive ‘noised’ atomic coordinates and then predict the true coordinates. This task requires the network to learn protein structure at a variety of length scales, whereby the denoising task at small noise emphasizes understanding very local stereochemistry and the denoising task at high noise emphasizes the large-scale structure of the system. At the inference time, random noise is sampled and then recurrently denoised to produce a final structure. Importantly, this is a generative training procedure that produces a distribution of answers. This means that, for each answer, the local structure will be sharply defined (for example, side-chain bond geometry) even when the network is uncertain about the positions. For this reason, we are able to avoid both torsion-based parametrizations of the residues and violation losses on the structure, while handling the full complexity of general ligands. Similarly to some recent work 34 , we find that no invariance or equivariance with respect to global rotations and translation of the molecule are required in the architecture and we therefore omit them to simplify the machine learning architecture.”claim_relations[2]
builds-on recent work showing that no rotational or translational invariance or equivariance is needed in the architecture — “The diffusion module (Fig. 2b and Supplementary Methods 3.7 ) operates directly on raw atom coordinates, and on a coarse abstract token representation, without rotational frames or any equivariant processing. We had observed in AF2 that removing most of the complexity of the structure module had only a modest effect on the prediction accuracy, and maintaining the backbone frame and side-chain torsion representation add quite a bit of complexity for general molecular graphs. Similarly AF2 required carefully tuned stereochemical violation penalties during training to enforce chemical plausibility of the resulting structures. We use a relatively standard diffusion approach 33 in which the diffusion model is trained to receive ‘noised’ atomic coordinates and then predict the true coordinates. This task requires the network to learn protein structure at a variety of length scales, whereby the denoising task at small noise emphasizes understanding very local stereochemistry and the denoising task at high noise emphasizes the large-scale structure of the system. At the inference time, random noise is sampled and then recurrently denoised to produce a final structure. Importantly, this is a generative training procedure that produces a distribution of answers. This means that, for each answer, the local structure will be sharply defined (for example, side-chain bond geometry) even when the network is uncertain about the positions. For this reason, we are able to avoid both torsion-based parametrizations of the residues and violation losses on the structure, while handling the full complexity of general ligands. Similarly to some recent work 34 , we find that no invariance or equivariance with respect to global rotations and translation of the molecule are required in the architecture and we therefore omit them to simplify the machine learning architecture.”claim_relations[3]
builds-on the PoseBusters benchmark and its validity-checking Python package — “For pocket-aligned r.m.s.d., first alignment between the predicted and ground-truth structures was conducted by aligning to the ground-truth pocket backbone atoms (CA, C or N atoms within 10 Å of the ligand of interest) from the primary protein chain (the chain with the greatest number of contacts within 10 Å of the ligand). The PoseBusters Python package v.0.2.7 51 was used to score r.m.s.d. and violations from the pocket-aligned predictions.”claim_relations[4]
sensehallucination - a word from perception and from language models, used here for a structural failure: a diffusion model inventing spurious order (compact structure) in regions that are in fact disordered — “We note that the switch from the non-generative AF2 model to the diffusion-based AF3 model introduces the challenge of spurious structural order (hallucinations) in disordered regions (Fig. 5d and Extended Data Fig. 1 ). Although hallucinated regions are typically marked as very low confidence, they can lack the distinctive ribbon-like appearance that AF2 produces in disordered regions. To encourage ribbon-like predictions in AF3, we use distillation training from AF2 predictions, and we add a ranking term to encourage results with more solvent accessible surface area 36 .”senses[0]
sensediffusion - the machine-learning sense (a learned denoising process across noise scales) in a paper about molecules, where the physical sense of molecular diffusion in solution is equally live; the diffusion module has nothing to do with molecules diffusing — “This is achieved by a substantial evolution of the AF2 architecture and training procedure (Fig. 1d ) both to accommodate more general chemical structures and to improve the data efficiency of learning. The system reduces the amount of multiple-sequence alignment (MSA) processing by replacing the AF2 evoformer with the simpler pairformer module (Fig. 2a ). Furthermore it directly predicts the raw atom coordinates with a diffusion module, replacing the AF2 structure module that operated on amino-acid-specific frames and side-chain torsion angles (Fig. 2b ). The multiscale nature of the diffusion process (low noise levels induce the network to improve local structure) also enable us to eliminate stereochemical losses and most special handling of bonding patterns in the network, easily accommodating arbitrary chemical components.”senses[1]
senseseed - a model seed (a separately seeded run of the whole network) against a diffusion sample drawn inside one seed; for antibodies more seeds help and more samples per seed do not, so the two senses of 'another random try' are not interchangeable — “Despite the large advance in modelling accuracy in AF3, there are still many targets for which accurate modelling can be challenging. To obtain the highest accuracy, it may be necessary to generate a large number of predictions and rank them, which incurs an extra computational cost. A class of targets in which we observe this effect strongly is antibody–antigen complexes, similar to other recent work 46 . Figure 5a shows that, for AF3, top-ranked predictions keep improving with more model seeds, even at as many as 1,000 (Wilcoxon signed-rank test between 5 and 1,000 seeds, P = 2.0 × 10 −5 for percentage correct and P = 0.009 for percentage very high accuracy; ranking by protein–protein interface ipTM). This large improvement with many seeds is not observed in general for other classes of molecules (Extended Data Fig. 7b ). Using only one diffusion sample per model seed for the AF3 predictions rather than five (not illustrated) does not change the results significantly, indicating that running more model seeds is necessary for antibody score improvements, rather than just more diffusion samples.”senses[2]
senseblind - AlphaFold is 'blind' to the binding pocket, while docking is usually given pocket residues; 'true blind docking' names the rarer case with no pocket information, so 'blind' marks the absence of privileged structural input — “While AlphaFold models are ‘blind’ to the protein pocket, docking is often performed with knowledge of the protein pocket residues. For example, Uni-Mol specifies the pocket as any residue within 6 Å of the heavy atoms in the ligand of interest 26 . To evaluate the ability of AF3 to dock ligands accurately when given pocket information, we fine-tuned a 30 September 2019 cut-off AF3 model with an additional token feature specifying pocket–ligand pairs (Supplementary Methods 2.8 ). Specifically, an additional token feature was introduced, set to true for a ligand entity of interest and any pocket residues with heavy atoms within 6 Å of the ligand entity. At training time, a single random ligand entity is chosen to use in this feature. Note that multiple ligand chains with the same entity (CCD code) may be selected. At inference time, the ligand entity was chosen based on the ligand of interest’s CCD code, so again multiple ligand chains were occasionally chosen. The results of this analysis are shown in Extended Data Fig. 4 .”senses[3]
noteAlphaFold 2 (Jumper et al. 2021), whose trunk-then-structure-generator design AF3 keeps while replacing the evoformer and the structure module — Joins the already-tagged jumper2021 AlphaFold record. — “The overall structure of AF3 (Fig. 1d and Supplementary Methods 3 ) echoes that of AF2, with a large trunk evolving a pairwise representation of the chemical complex followed by a structure module that uses the pairwise representation to generate explicit atomic positions, but there are large differences in each major component. These modifications were driven both by the need to accommodate a wide range of chemical entities without excessive special casing and by observations of AF2 performance with different modifications. Within the trunk, MSA processing is substantially de-emphasized, with a much smaller and simpler MSA embedding block (Supplementary Methods 3.3 ). Compared with the original evoformer from AF2, the number of blocks is reduced to four, the processing of the MSA representation uses an inexpensive pair-weighted averaging and only the pair representation is used for later processing steps. The ‘pairformer’ (Fig. 2a and Supplementary Methods 3.6 ) replaces the evoformer of AF2 as the dominant processing block. It operates only on the pair representation and the single representation; the MSA representation is not retained and all information passes through the pair representation. The pair processing and the number of blocks (48) is largely unchanged from AF2. The resulting pair and single representation together with the input representation are passed to the new diffusion module (Fig. 2b ) that replaces the structure module of AF2.”claim_relations[0]
weightAlphaFold 2 (Jumper et al. 2021), whose trunk-then-structure-generator design AF3 keeps while replacing the evoformer and the structure module — 0.96 — “The overall structure of AF3 (Fig. 1d and Supplementary Methods 3 ) echoes that of AF2, with a large trunk evolving a pairwise representation of the chemical complex followed by a structure module that uses the pairwise representation to generate explicit atomic positions, but there are large differences in each major component. These modifications were driven both by the need to accommodate a wide range of chemical entities without excessive special casing and by observations of AF2 performance with different modifications. Within the trunk, MSA processing is substantially de-emphasized, with a much smaller and simpler MSA embedding block (Supplementary Methods 3.3 ). Compared with the original evoformer from AF2, the number of blocks is reduced to four, the processing of the MSA representation uses an inexpensive pair-weighted averaging and only the pair representation is used for later processing steps. The ‘pairformer’ (Fig. 2a and Supplementary Methods 3.6 ) replaces the evoformer of AF2 as the dominant processing block. It operates only on the pair representation and the single representation; the MSA representation is not retained and all information passes through the pair representation. The pair processing and the number of blocks (48) is largely unchanged from AF2. The resulting pair and single representation together with the input representation are passed to the new diffusion module (Fig. 2b ) that replaces the structure module of AF2.”claim_relations[0]
noteAlphaFold-Multimer v2.3, whose predicted structures supply the cross-distillation training data and serve as the protein-complex baseline — Used both as teacher for disordered regions and as comparator. — “The use of a generative diffusion approach comes with some technical challenges that we needed to address. The biggest issue is that generative models are prone to hallucination 35 , whereby the model may invent plausible-looking structure even in unstructured regions. To counteract this effect, we use a cross-distillation method in which we enrich the training data with structures predicted by AlphaFold-Multimer (v.2.3) 7 , 8 . In these structures, unstructured regions are typically represented by long extended loops instead of compact structures, and training on them ‘teaches’ AF3 to mimic this behaviour. This cross-distillation greatly reduced the hallucination behaviour of AF3 (Extended Data Fig. 1 for disorder prediction results on the CAID 2 36 benchmark set).”claim_relations[1]
weightAlphaFold-Multimer v2.3, whose predicted structures supply the cross-distillation training data and serve as the protein-complex baseline — 0.93 — “The use of a generative diffusion approach comes with some technical challenges that we needed to address. The biggest issue is that generative models are prone to hallucination 35 , whereby the model may invent plausible-looking structure even in unstructured regions. To counteract this effect, we use a cross-distillation method in which we enrich the training data with structures predicted by AlphaFold-Multimer (v.2.3) 7 , 8 . In these structures, unstructured regions are typically represented by long extended loops instead of compact structures, and training on them ‘teaches’ AF3 to mimic this behaviour. This cross-distillation greatly reduced the hallucination behaviour of AF3 (Extended Data Fig. 1 for disorder prediction results on the CAID 2 36 benchmark set).”claim_relations[1]
notestandard denoising diffusion models from generative machine learning — The generative method is imported, not invented here. — “The diffusion module (Fig. 2b and Supplementary Methods 3.7 ) operates directly on raw atom coordinates, and on a coarse abstract token representation, without rotational frames or any equivariant processing. We had observed in AF2 that removing most of the complexity of the structure module had only a modest effect on the prediction accuracy, and maintaining the backbone frame and side-chain torsion representation add quite a bit of complexity for general molecular graphs. Similarly AF2 required carefully tuned stereochemical violation penalties during training to enforce chemical plausibility of the resulting structures. We use a relatively standard diffusion approach 33 in which the diffusion model is trained to receive ‘noised’ atomic coordinates and then predict the true coordinates. This task requires the network to learn protein structure at a variety of length scales, whereby the denoising task at small noise emphasizes understanding very local stereochemistry and the denoising task at high noise emphasizes the large-scale structure of the system. At the inference time, random noise is sampled and then recurrently denoised to produce a final structure. Importantly, this is a generative training procedure that produces a distribution of answers. This means that, for each answer, the local structure will be sharply defined (for example, side-chain bond geometry) even when the network is uncertain about the positions. For this reason, we are able to avoid both torsion-based parametrizations of the residues and violation losses on the structure, while handling the full complexity of general ligands. Similarly to some recent work 34 , we find that no invariance or equivariance with respect to global rotations and translation of the molecule are required in the architecture and we therefore omit them to simplify the machine learning architecture.”claim_relations[2]
weightstandard denoising diffusion models from generative machine learning — 0.92 — “The diffusion module (Fig. 2b and Supplementary Methods 3.7 ) operates directly on raw atom coordinates, and on a coarse abstract token representation, without rotational frames or any equivariant processing. We had observed in AF2 that removing most of the complexity of the structure module had only a modest effect on the prediction accuracy, and maintaining the backbone frame and side-chain torsion representation add quite a bit of complexity for general molecular graphs. Similarly AF2 required carefully tuned stereochemical violation penalties during training to enforce chemical plausibility of the resulting structures. We use a relatively standard diffusion approach 33 in which the diffusion model is trained to receive ‘noised’ atomic coordinates and then predict the true coordinates. This task requires the network to learn protein structure at a variety of length scales, whereby the denoising task at small noise emphasizes understanding very local stereochemistry and the denoising task at high noise emphasizes the large-scale structure of the system. At the inference time, random noise is sampled and then recurrently denoised to produce a final structure. Importantly, this is a generative training procedure that produces a distribution of answers. This means that, for each answer, the local structure will be sharply defined (for example, side-chain bond geometry) even when the network is uncertain about the positions. For this reason, we are able to avoid both torsion-based parametrizations of the residues and violation losses on the structure, while handling the full complexity of general ligands. Similarly to some recent work 34 , we find that no invariance or equivariance with respect to global rotations and translation of the molecule are required in the architecture and we therefore omit them to simplify the machine learning architecture.”claim_relations[2]
noterecent work showing that no rotational or translational invariance or equivariance is needed in the architecture — Justifies dropping equivariant processing. — “The diffusion module (Fig. 2b and Supplementary Methods 3.7 ) operates directly on raw atom coordinates, and on a coarse abstract token representation, without rotational frames or any equivariant processing. We had observed in AF2 that removing most of the complexity of the structure module had only a modest effect on the prediction accuracy, and maintaining the backbone frame and side-chain torsion representation add quite a bit of complexity for general molecular graphs. Similarly AF2 required carefully tuned stereochemical violation penalties during training to enforce chemical plausibility of the resulting structures. We use a relatively standard diffusion approach 33 in which the diffusion model is trained to receive ‘noised’ atomic coordinates and then predict the true coordinates. This task requires the network to learn protein structure at a variety of length scales, whereby the denoising task at small noise emphasizes understanding very local stereochemistry and the denoising task at high noise emphasizes the large-scale structure of the system. At the inference time, random noise is sampled and then recurrently denoised to produce a final structure. Importantly, this is a generative training procedure that produces a distribution of answers. This means that, for each answer, the local structure will be sharply defined (for example, side-chain bond geometry) even when the network is uncertain about the positions. For this reason, we are able to avoid both torsion-based parametrizations of the residues and violation losses on the structure, while handling the full complexity of general ligands. Similarly to some recent work 34 , we find that no invariance or equivariance with respect to global rotations and translation of the molecule are required in the architecture and we therefore omit them to simplify the machine learning architecture.”claim_relations[3]
weightrecent work showing that no rotational or translational invariance or equivariance is needed in the architecture — 0.88 — “The diffusion module (Fig. 2b and Supplementary Methods 3.7 ) operates directly on raw atom coordinates, and on a coarse abstract token representation, without rotational frames or any equivariant processing. We had observed in AF2 that removing most of the complexity of the structure module had only a modest effect on the prediction accuracy, and maintaining the backbone frame and side-chain torsion representation add quite a bit of complexity for general molecular graphs. Similarly AF2 required carefully tuned stereochemical violation penalties during training to enforce chemical plausibility of the resulting structures. We use a relatively standard diffusion approach 33 in which the diffusion model is trained to receive ‘noised’ atomic coordinates and then predict the true coordinates. This task requires the network to learn protein structure at a variety of length scales, whereby the denoising task at small noise emphasizes understanding very local stereochemistry and the denoising task at high noise emphasizes the large-scale structure of the system. At the inference time, random noise is sampled and then recurrently denoised to produce a final structure. Importantly, this is a generative training procedure that produces a distribution of answers. This means that, for each answer, the local structure will be sharply defined (for example, side-chain bond geometry) even when the network is uncertain about the positions. For this reason, we are able to avoid both torsion-based parametrizations of the residues and violation losses on the structure, while handling the full complexity of general ligands. Similarly to some recent work 34 , we find that no invariance or equivariance with respect to global rotations and translation of the molecule are required in the architecture and we therefore omit them to simplify the machine learning architecture.”claim_relations[3]
notethe PoseBusters benchmark and its validity-checking Python package — Ligand accuracy and physical validity are scored with PoseBusters. — “For pocket-aligned r.m.s.d., first alignment between the predicted and ground-truth structures was conducted by aligning to the ground-truth pocket backbone atoms (CA, C or N atoms within 10 Å of the ligand of interest) from the primary protein chain (the chain with the greatest number of contacts within 10 Å of the ligand). The PoseBusters Python package v.0.2.7 51 was used to score r.m.s.d. and violations from the pocket-aligned predictions.”claim_relations[4]
weightthe PoseBusters benchmark and its validity-checking Python package — 0.88 — “For pocket-aligned r.m.s.d., first alignment between the predicted and ground-truth structures was conducted by aligning to the ground-truth pocket backbone atoms (CA, C or N atoms within 10 Å of the ligand of interest) from the primary protein chain (the chain with the greatest number of contacts within 10 Å of the ligand). The PoseBusters Python package v.0.2.7 51 was used to score r.m.s.d. and violations from the pocket-aligned predictions.”claim_relations[4]
notemodel seeds —contrasted-with→ diffusion samples — Contrast cue 'rather than' with a measured difference in effect. — “Despite the large advance in modelling accuracy in AF3, there are still many targets for which accurate modelling can be challenging. To obtain the highest accuracy, it may be necessary to generate a large number of predictions and rank them, which incurs an extra computational cost. A class of targets in which we observe this effect strongly is antibody–antigen complexes, similar to other recent work 46 . Figure 5a shows that, for AF3, top-ranked predictions keep improving with more model seeds, even at as many as 1,000 (Wilcoxon signed-rank test between 5 and 1,000 seeds, P = 2.0 × 10 −5 for percentage correct and P = 0.009 for percentage very high accuracy; ranking by protein–protein interface ipTM). This large improvement with many seeds is not observed in general for other classes of molecules (Extended Data Fig. 7b ). Using only one diffusion sample per model seed for the AF3 predictions rather than five (not illustrated) does not change the results significantly, indicating that running more model seeds is necessary for antibody score improvements, rather than just more diffusion samples.”concept_edges[0]
relationmodel seeds —contrasted-with→ diffusion samples — Running more model seeds, rather than just more diffusion samples, is what improves antibody predictions. — “Despite the large advance in modelling accuracy in AF3, there are still many targets for which accurate modelling can be challenging. To obtain the highest accuracy, it may be necessary to generate a large number of predictions and rank them, which incurs an extra computational cost. A class of targets in which we observe this effect strongly is antibody–antigen complexes, similar to other recent work 46 . Figure 5a shows that, for AF3, top-ranked predictions keep improving with more model seeds, even at as many as 1,000 (Wilcoxon signed-rank test between 5 and 1,000 seeds, P = 2.0 × 10 −5 for percentage correct and P = 0.009 for percentage very high accuracy; ranking by protein–protein interface ipTM). This large improvement with many seeds is not observed in general for other classes of molecules (Extended Data Fig. 7b ). Using only one diffusion sample per model seed for the AF3 predictions rather than five (not illustrated) does not change the results significantly, indicating that running more model seeds is necessary for antibody score improvements, rather than just more diffusion samples.”concept_edges[0]
weightmodel seeds —contrasted-with→ diffusion samples — 0.9 — “Despite the large advance in modelling accuracy in AF3, there are still many targets for which accurate modelling can be challenging. To obtain the highest accuracy, it may be necessary to generate a large number of predictions and rank them, which incurs an extra computational cost. A class of targets in which we observe this effect strongly is antibody–antigen complexes, similar to other recent work 46 . Figure 5a shows that, for AF3, top-ranked predictions keep improving with more model seeds, even at as many as 1,000 (Wilcoxon signed-rank test between 5 and 1,000 seeds, P = 2.0 × 10 −5 for percentage correct and P = 0.009 for percentage very high accuracy; ranking by protein–protein interface ipTM). This large improvement with many seeds is not observed in general for other classes of molecules (Extended Data Fig. 7b ). Using only one diffusion sample per model seed for the AF3 predictions rather than five (not illustrated) does not change the results significantly, indicating that running more model seeds is necessary for antibody score improvements, rather than just more diffusion samples.”concept_edges[0]
relationpairformer → evoformer — The pairformer replaces the evoformer of AF2 as the dominant processing block. — “The overall structure of AF3 (Fig. 1d and Supplementary Methods 3 ) echoes that of AF2, with a large trunk evolving a pairwise representation of the chemical complex followed by a structure module that uses the pairwise representation to generate explicit atomic positions, but there are large differences in each major component. These modifications were driven both by the need to accommodate a wide range of chemical entities without excessive special casing and by observations of AF2 performance with different modifications. Within the trunk, MSA processing is substantially de-emphasized, with a much smaller and simpler MSA embedding block (Supplementary Methods 3.3 ). Compared with the original evoformer from AF2, the number of blocks is reduced to four, the processing of the MSA representation uses an inexpensive pair-weighted averaging and only the pair representation is used for later processing steps. The ‘pairformer’ (Fig. 2a and Supplementary Methods 3.6 ) replaces the evoformer of AF2 as the dominant processing block. It operates only on the pair representation and the single representation; the MSA representation is not retained and all information passes through the pair representation. The pair processing and the number of blocks (48) is largely unchanged from AF2. The resulting pair and single representation together with the input representation are passed to the new diffusion module (Fig. 2b ) that replaces the structure module of AF2.”unhoused_relations[0]
weightpairformer → evoformer — 0.95 — “The overall structure of AF3 (Fig. 1d and Supplementary Methods 3 ) echoes that of AF2, with a large trunk evolving a pairwise representation of the chemical complex followed by a structure module that uses the pairwise representation to generate explicit atomic positions, but there are large differences in each major component. These modifications were driven both by the need to accommodate a wide range of chemical entities without excessive special casing and by observations of AF2 performance with different modifications. Within the trunk, MSA processing is substantially de-emphasized, with a much smaller and simpler MSA embedding block (Supplementary Methods 3.3 ). Compared with the original evoformer from AF2, the number of blocks is reduced to four, the processing of the MSA representation uses an inexpensive pair-weighted averaging and only the pair representation is used for later processing steps. The ‘pairformer’ (Fig. 2a and Supplementary Methods 3.6 ) replaces the evoformer of AF2 as the dominant processing block. It operates only on the pair representation and the single representation; the MSA representation is not retained and all information passes through the pair representation. The pair processing and the number of blocks (48) is largely unchanged from AF2. The resulting pair and single representation together with the input representation are passed to the new diffusion module (Fig. 2b ) that replaces the structure module of AF2.”unhoused_relations[0]
relationdiffusion module → structure module — The new diffusion module replaces the structure module of AF2. — “The overall structure of AF3 (Fig. 1d and Supplementary Methods 3 ) echoes that of AF2, with a large trunk evolving a pairwise representation of the chemical complex followed by a structure module that uses the pairwise representation to generate explicit atomic positions, but there are large differences in each major component. These modifications were driven both by the need to accommodate a wide range of chemical entities without excessive special casing and by observations of AF2 performance with different modifications. Within the trunk, MSA processing is substantially de-emphasized, with a much smaller and simpler MSA embedding block (Supplementary Methods 3.3 ). Compared with the original evoformer from AF2, the number of blocks is reduced to four, the processing of the MSA representation uses an inexpensive pair-weighted averaging and only the pair representation is used for later processing steps. The ‘pairformer’ (Fig. 2a and Supplementary Methods 3.6 ) replaces the evoformer of AF2 as the dominant processing block. It operates only on the pair representation and the single representation; the MSA representation is not retained and all information passes through the pair representation. The pair processing and the number of blocks (48) is largely unchanged from AF2. The resulting pair and single representation together with the input representation are passed to the new diffusion module (Fig. 2b ) that replaces the structure module of AF2.”unhoused_relations[1]
weightdiffusion module → structure module — 0.95 — “The overall structure of AF3 (Fig. 1d and Supplementary Methods 3 ) echoes that of AF2, with a large trunk evolving a pairwise representation of the chemical complex followed by a structure module that uses the pairwise representation to generate explicit atomic positions, but there are large differences in each major component. These modifications were driven both by the need to accommodate a wide range of chemical entities without excessive special casing and by observations of AF2 performance with different modifications. Within the trunk, MSA processing is substantially de-emphasized, with a much smaller and simpler MSA embedding block (Supplementary Methods 3.3 ). Compared with the original evoformer from AF2, the number of blocks is reduced to four, the processing of the MSA representation uses an inexpensive pair-weighted averaging and only the pair representation is used for later processing steps. The ‘pairformer’ (Fig. 2a and Supplementary Methods 3.6 ) replaces the evoformer of AF2 as the dominant processing block. It operates only on the pair representation and the single representation; the MSA representation is not retained and all information passes through the pair representation. The pair processing and the number of blocks (48) is largely unchanged from AF2. The resulting pair and single representation together with the input representation are passed to the new diffusion module (Fig. 2b ) that replaces the structure module of AF2.”unhoused_relations[1]
relationprotein structure prediction → ligand docking — Protein-ligand structure prediction is handled without resorting to an artificial separation between protein structure prediction and ligand docking. — “The core challenge of molecular biology is to understand and ultimately regulate the complex atomic interactions of biological systems. The AF3 model takes a large step in this direction, demonstrating that it is possible to accurately predict the structure of a wide range of biomolecular systems in a unified framework. Although there are still substantial challenges to achieve highly accurate predictions across all interaction types, we demonstrate that it is possible to build a deep-learning system that shows strong coverage and generalization for all of these interactions. We also demonstrate that the lack of cross-entity evolutionary information is not a substantial blocker to progress in predicting these interactions and, moreover, substantial improvement in antibody results suggests AlphaFold-derived methods are able to model the chemistry and physics of classes of molecular interactions without dependence on MSAs. Finally, the large improvement in protein–ligand structure prediction shows that it is possible to handle the wide diversity of chemical space within a general deep-learning framework and without resorting to an artificial separation between protein structure prediction and ligand docking.”unhoused_relations[2]
weightprotein structure prediction → ligand docking — 0.85 — “The core challenge of molecular biology is to understand and ultimately regulate the complex atomic interactions of biological systems. The AF3 model takes a large step in this direction, demonstrating that it is possible to accurately predict the structure of a wide range of biomolecular systems in a unified framework. Although there are still substantial challenges to achieve highly accurate predictions across all interaction types, we demonstrate that it is possible to build a deep-learning system that shows strong coverage and generalization for all of these interactions. We also demonstrate that the lack of cross-entity evolutionary information is not a substantial blocker to progress in predicting these interactions and, moreover, substantial improvement in antibody results suggests AlphaFold-derived methods are able to model the chemistry and physics of classes of molecular interactions without dependence on MSAs. Finally, the large improvement in protein–ligand structure prediction shows that it is possible to handle the wide diversity of chemical space within a general deep-learning framework and without resorting to an artificial separation between protein structure prediction and ligand docking.”unhoused_relations[2]
relationcross-distillation → hallucination — This cross-distillation greatly reduced the hallucination behaviour of AF3. — “The use of a generative diffusion approach comes with some technical challenges that we needed to address. The biggest issue is that generative models are prone to hallucination 35 , whereby the model may invent plausible-looking structure even in unstructured regions. To counteract this effect, we use a cross-distillation method in which we enrich the training data with structures predicted by AlphaFold-Multimer (v.2.3) 7 , 8 . In these structures, unstructured regions are typically represented by long extended loops instead of compact structures, and training on them ‘teaches’ AF3 to mimic this behaviour. This cross-distillation greatly reduced the hallucination behaviour of AF3 (Extended Data Fig. 1 for disorder prediction results on the CAID 2 36 benchmark set).”unhoused_relations[3]
weightcross-distillation → hallucination — 0.88 — “The use of a generative diffusion approach comes with some technical challenges that we needed to address. The biggest issue is that generative models are prone to hallucination 35 , whereby the model may invent plausible-looking structure even in unstructured regions. To counteract this effect, we use a cross-distillation method in which we enrich the training data with structures predicted by AlphaFold-Multimer (v.2.3) 7 , 8 . In these structures, unstructured regions are typically represented by long extended loops instead of compact structures, and training on them ‘teaches’ AF3 to mimic this behaviour. This cross-distillation greatly reduced the hallucination behaviour of AF3 (Extended Data Fig. 1 for disorder prediction results on the CAID 2 36 benchmark set).”unhoused_relations[3]
relationDockQ → LDDT — DockQ and iLDDT are highly correlated. — “We measure the quality of the predictions with DockQ, LDDT or pocket-aligned r.m.s.d. For nucleic–protein interfaces, we measure interface accuracy through iLDDT, which is calculated from distances between atoms across different chains in the interface. DockQ and iLDDT are highly correlated (Extended Data Fig. 9 ), so the standard cut-offs for DockQ can be translated to equivalent iLDDT cut-offs. Nucleic acid LDDTs (intrachains and interface) were calculated with an inclusion radius of 30 Å compared with the usual 15 Å used for proteins, owing to their larger scale. For confidence calibration assessment, we use a bespoke LDDT (LDDT_to_polymer) metric that considers differences from each atom of a given entity to any C α or C1′ polymer atom within its inclusion radius. This is closely related to how the confidence prediction is trained (Supplementary Methods 4.3.1 ).”unhoused_relations[4]
weightDockQ → LDDT — 0.88 — “We measure the quality of the predictions with DockQ, LDDT or pocket-aligned r.m.s.d. For nucleic–protein interfaces, we measure interface accuracy through iLDDT, which is calculated from distances between atoms across different chains in the interface. DockQ and iLDDT are highly correlated (Extended Data Fig. 9 ), so the standard cut-offs for DockQ can be translated to equivalent iLDDT cut-offs. Nucleic acid LDDTs (intrachains and interface) were calculated with an inclusion radius of 30 Å compared with the usual 15 Å used for proteins, owing to their larger scale. For confidence calibration assessment, we use a bespoke LDDT (LDDT_to_polymer) metric that considers differences from each atom of a given entity to any C α or C1′ polymer atom within its inclusion radius. This is closely related to how the confidence prediction is trained (Supplementary Methods 4.3.1 ).”unhoused_relations[4]
relationmultiple-sequence alignment → AlphaFold 3 — The lack of cross-entity evolutionary information is not a substantial blocker to progress in predicting these interactions. — “The core challenge of molecular biology is to understand and ultimately regulate the complex atomic interactions of biological systems. The AF3 model takes a large step in this direction, demonstrating that it is possible to accurately predict the structure of a wide range of biomolecular systems in a unified framework. Although there are still substantial challenges to achieve highly accurate predictions across all interaction types, we demonstrate that it is possible to build a deep-learning system that shows strong coverage and generalization for all of these interactions. We also demonstrate that the lack of cross-entity evolutionary information is not a substantial blocker to progress in predicting these interactions and, moreover, substantial improvement in antibody results suggests AlphaFold-derived methods are able to model the chemistry and physics of classes of molecular interactions without dependence on MSAs. Finally, the large improvement in protein–ligand structure prediction shows that it is possible to handle the wide diversity of chemical space within a general deep-learning framework and without resorting to an artificial separation between protein structure prediction and ligand docking.”unhoused_relations[5]
weightmultiple-sequence alignment → AlphaFold 3 — 0.8 — “The core challenge of molecular biology is to understand and ultimately regulate the complex atomic interactions of biological systems. The AF3 model takes a large step in this direction, demonstrating that it is possible to accurately predict the structure of a wide range of biomolecular systems in a unified framework. Although there are still substantial challenges to achieve highly accurate predictions across all interaction types, we demonstrate that it is possible to build a deep-learning system that shows strong coverage and generalization for all of these interactions. We also demonstrate that the lack of cross-entity evolutionary information is not a substantial blocker to progress in predicting these interactions and, moreover, substantial improvement in antibody results suggests AlphaFold-derived methods are able to model the chemistry and physics of classes of molecular interactions without dependence on MSAs. Finally, the large improvement in protein–ligand structure prediction shows that it is possible to handle the wide diversity of chemical space within a general deep-learning framework and without resorting to an artificial separation between protein structure prediction and ligand docking.”unhoused_relations[5]
no type for thispairformer → evoformer — The pairformer takes over the evoformer's role as the dominant trunk block while dropping the retained MSA representation. — “The overall structure of AF3 (Fig. 1d and Supplementary Methods 3 ) echoes that of AF2, with a large trunk evolving a pairwise representation of the chemical complex followed by a structure module that uses the pairwise representation to generate explicit atomic positions, but there are large differences in each major component. These modifications were driven both by the need to accommodate a wide range of chemical entities without excessive special casing and by observations of AF2 performance with different modifications. Within the trunk, MSA processing is substantially de-emphasized, with a much smaller and simpler MSA embedding block (Supplementary Methods 3.3 ). Compared with the original evoformer from AF2, the number of blocks is reduced to four, the processing of the MSA representation uses an inexpensive pair-weighted averaging and only the pair representation is used for later processing steps. The ‘pairformer’ (Fig. 2a and Supplementary Methods 3.6 ) replaces the evoformer of AF2 as the dominant processing block. It operates only on the pair representation and the single representation; the MSA representation is not retained and all information passes through the pair representation. The pair processing and the number of blocks (48) is largely unchanged from AF2. The resulting pair and single representation together with the input representation are passed to the new diffusion module (Fig. 2b ) that replaces the structure module of AF2.”unhoused_relations[0]
no type for thisdiffusion module → structure module — The diffusion module takes over the structure module's job of producing atomic positions, but generatively and on raw coordinates. — “The overall structure of AF3 (Fig. 1d and Supplementary Methods 3 ) echoes that of AF2, with a large trunk evolving a pairwise representation of the chemical complex followed by a structure module that uses the pairwise representation to generate explicit atomic positions, but there are large differences in each major component. These modifications were driven both by the need to accommodate a wide range of chemical entities without excessive special casing and by observations of AF2 performance with different modifications. Within the trunk, MSA processing is substantially de-emphasized, with a much smaller and simpler MSA embedding block (Supplementary Methods 3.3 ). Compared with the original evoformer from AF2, the number of blocks is reduced to four, the processing of the MSA representation uses an inexpensive pair-weighted averaging and only the pair representation is used for later processing steps. The ‘pairformer’ (Fig. 2a and Supplementary Methods 3.6 ) replaces the evoformer of AF2 as the dominant processing block. It operates only on the pair representation and the single representation; the MSA representation is not retained and all information passes through the pair representation. The pair processing and the number of blocks (48) is largely unchanged from AF2. The resulting pair and single representation together with the input representation are passed to the new diffusion module (Fig. 2b ) that replaces the structure module of AF2.”unhoused_relations[1]
no type for thisprotein structure prediction → ligand docking — The paper treats the boundary between protein structure prediction and ligand docking as artificial: one framework does both. — “The core challenge of molecular biology is to understand and ultimately regulate the complex atomic interactions of biological systems. The AF3 model takes a large step in this direction, demonstrating that it is possible to accurately predict the structure of a wide range of biomolecular systems in a unified framework. Although there are still substantial challenges to achieve highly accurate predictions across all interaction types, we demonstrate that it is possible to build a deep-learning system that shows strong coverage and generalization for all of these interactions. We also demonstrate that the lack of cross-entity evolutionary information is not a substantial blocker to progress in predicting these interactions and, moreover, substantial improvement in antibody results suggests AlphaFold-derived methods are able to model the chemistry and physics of classes of molecular interactions without dependence on MSAs. Finally, the large improvement in protein–ligand structure prediction shows that it is possible to handle the wide diversity of chemical space within a general deep-learning framework and without resorting to an artificial separation between protein structure prediction and ligand docking.”unhoused_relations[2]
no type for thiscross-distillation → hallucination — Cross-distillation reduces hallucination. — “The use of a generative diffusion approach comes with some technical challenges that we needed to address. The biggest issue is that generative models are prone to hallucination 35 , whereby the model may invent plausible-looking structure even in unstructured regions. To counteract this effect, we use a cross-distillation method in which we enrich the training data with structures predicted by AlphaFold-Multimer (v.2.3) 7 , 8 . In these structures, unstructured regions are typically represented by long extended loops instead of compact structures, and training on them ‘teaches’ AF3 to mimic this behaviour. This cross-distillation greatly reduced the hallucination behaviour of AF3 (Extended Data Fig. 1 for disorder prediction results on the CAID 2 36 benchmark set).”unhoused_relations[3]
no type for thisDockQ → LDDT — DockQ and interface LDDT are highly correlated, so thresholds on one translate into thresholds on the other. — “We measure the quality of the predictions with DockQ, LDDT or pocket-aligned r.m.s.d. For nucleic–protein interfaces, we measure interface accuracy through iLDDT, which is calculated from distances between atoms across different chains in the interface. DockQ and iLDDT are highly correlated (Extended Data Fig. 9 ), so the standard cut-offs for DockQ can be translated to equivalent iLDDT cut-offs. Nucleic acid LDDTs (intrachains and interface) were calculated with an inclusion radius of 30 Å compared with the usual 15 Å used for proteins, owing to their larger scale. For confidence calibration assessment, we use a bespoke LDDT (LDDT_to_polymer) metric that considers differences from each atom of a given entity to any C α or C1′ polymer atom within its inclusion radius. This is closely related to how the confidence prediction is trained (Supplementary Methods 4.3.1 ).”unhoused_relations[4]
no type for thismultiple-sequence alignment → AlphaFold 3 — Missing cross-entity evolutionary information is not a substantial blocker, and antibody gains suggest AlphaFold-derived methods can model interaction chemistry without depending on MSAs, although single-chain accuracy still falls with shallow MSAs. — “The core challenge of molecular biology is to understand and ultimately regulate the complex atomic interactions of biological systems. The AF3 model takes a large step in this direction, demonstrating that it is possible to accurately predict the structure of a wide range of biomolecular systems in a unified framework. Although there are still substantial challenges to achieve highly accurate predictions across all interaction types, we demonstrate that it is possible to build a deep-learning system that shows strong coverage and generalization for all of these interactions. We also demonstrate that the lack of cross-entity evolutionary information is not a substantial blocker to progress in predicting these interactions and, moreover, substantial improvement in antibody results suggests AlphaFold-derived methods are able to model the chemistry and physics of classes of molecular interactions without dependence on MSAs. Finally, the large improvement in protein–ligand structure prediction shows that it is possible to handle the wide diversity of chemical space within a general deep-learning framework and without resorting to an artificial separation between protein structure prediction and ligand docking.”unhoused_relations[5]
limitationPredictions do not always respect chirality even though reference structures with correct chirality are given as input; with a ranking penalty the violation rate on PoseBusters is still 4.4 percent. — “On stereochemistry, we note two main classes of violations. The first is that the model outputs do not always respect chirality (Fig. 5b ), despite the model receiving reference structures with correct chirality as input features. To address this in the PoseBusters benchmark, we included a penalty for chirality violation in our ranking formula for model predictions. Despite this, we still observe a chirality violation rate of 4.4% in the benchmark. The second class of stereochemical violations is a tendency of the model to occasionally produce overlapping (clashing) atoms in the predictions. This sometimes manifests as extreme violations in homomers in which entire chains have been observed to overlap (Fig. 5e ). Penalizing clashes during ranking (Supplementary Methods 5.9.3 ) reduces the occurrence of this failure mode but does not eliminate them. Almost all remaining clashes occur for protein–nucleic complexes with both greater than 100 nucleotides and greater than 2,000 residues in total.”limitations[0]
limitationThe model sometimes produces clashing atoms, up to whole overlapping chains in homomers; penalising clashes in ranking reduces but does not eliminate them. — “On stereochemistry, we note two main classes of violations. The first is that the model outputs do not always respect chirality (Fig. 5b ), despite the model receiving reference structures with correct chirality as input features. To address this in the PoseBusters benchmark, we included a penalty for chirality violation in our ranking formula for model predictions. Despite this, we still observe a chirality violation rate of 4.4% in the benchmark. The second class of stereochemical violations is a tendency of the model to occasionally produce overlapping (clashing) atoms in the predictions. This sometimes manifests as extreme violations in homomers in which entire chains have been observed to overlap (Fig. 5e ). Penalizing clashes during ranking (Supplementary Methods 5.9.3 ) reduces the occurrence of this failure mode but does not eliminate them. Almost all remaining clashes occur for protein–nucleic complexes with both greater than 100 nucleotides and greater than 2,000 residues in total.”limitations[1]
limitationMoving from a non-generative to a diffusion model introduced hallucinated order in disordered regions, which can lack the ribbon-like appearance AF2 gives such regions. — “We note that the switch from the non-generative AF2 model to the diffusion-based AF3 model introduces the challenge of spurious structural order (hallucinations) in disordered regions (Fig. 5d and Extended Data Fig. 1 ). Although hallucinated regions are typically marked as very low confidence, they can lack the distinctive ribbon-like appearance that AF2 produces in disordered regions. To encourage ribbon-like predictions in AF3, we use distillation training from AF2 predictions, and we add a ranking term to encourage results with more solvent accessible surface area 36 .”limitations[2]
limitationThe model predicts static structures as seen in the PDB, not the dynamics of molecules in solution; multiple seeds do not approximate the solution ensemble. — “A key limitation of protein structure prediction models is that they typically predict static structures as seen in the PDB, not the dynamical behaviour of biomolecular systems in solution. This limitation persists for AF3, in which multiple random seeds for either the diffusion head or the overall network do not produce an approximation of the solution ensemble.”limitations[3]
limitationThe modelled conformational state can be wrong: E3 ubiquitin ligases open in the apo state are predicted closed for both apo and holo inputs. — “In some cases, the modelled conformational state may not be correct or comprehensive given the specified ligands and other inputs. For example, E3 ubiquitin ligases natively adopt an open conformation in an apo state and have been observed only in a closed state when bound to ligands, but AF3 exclusively predicts the closed state for both holo and apo systems 42 (Fig. 5c ). Many methods have been developed, particularly around MSA resampling, that assist in generating diversity from previous AlphaFold models 43 – 45 and may also assist in multistate prediction with AF3.”limitations[4]
limitationFor hard targets such as antibody-antigen complexes, top accuracy needs many predictions ranked, at extra computational cost. — “Despite the large advance in modelling accuracy in AF3, there are still many targets for which accurate modelling can be challenging. To obtain the highest accuracy, it may be necessary to generate a large number of predictions and rank them, which incurs an extra computational cost. A class of targets in which we observe this effect strongly is antibody–antigen complexes, similar to other recent work 46 . Figure 5a shows that, for AF3, top-ranked predictions keep improving with more model seeds, even at as many as 1,000 (Wilcoxon signed-rank test between 5 and 1,000 seeds, P = 2.0 × 10 −5 for percentage correct and P = 0.009 for percentage very high accuracy; ranking by protein–protein interface ipTM). This large improvement with many seeds is not observed in general for other classes of molecules (Extended Data Fig. 7b ). Using only one diffusion sample per model seed for the AF3 predictions rather than five (not illustrated) does not change the results significantly, indicating that running more model seeds is necessary for antibody score improvements, rather than just more diffusion samples.”limitations[5]
limitationProteins with shallow MSAs are still predicted with lower accuracy. — “While expanding in modelling abilities, AF3 has also improved in protein complex accuracy relative to AlphaFold-Multimer (v.2.3) 7 , 8 . Generally, protein–protein prediction success (DockQ > 0.23) 40 has increased (paired Wilcoxon signed-rank test, P = 1.8 × 10 −18 ), with antibody–protein interaction prediction in particular showing a marked improvement (Fig. 1c (right); paired Wilcoxon signed-rank test, P = 6.5 × 10 −5 , predictions top-ranked from 1,000 rather than the typical 5 seeds; further details are provided in Fig. 5a ). Protein monomer LDDT improvement is also significant (paired Wilcoxon signed-rank test, P = 1.7 × 10 −34 ). AF3 has a very similar dependence on MSA depth to AlphaFold-Multimer v.2.3; proteins with shallow MSAs are predicted with lower accuracy (a comparison of the dependence of single-chain LDDT on MSA depth is shown in Extended Data Fig. 7a ).”limitations[6]
limitationOn CASP15 RNA targets no significance statistics are reported because the dataset is too small, and the best human-expert-aided submission was not matched. — “We also evaluated AF3 performance on the ten publicly available Critical Assessment of Structure Prediction 15 (CASP15) RNA targets: we achieve a higher average performance than RoseTTAFold2NA and AIchemy_RNA 27 (the best AI-based submission in CASP15 18 , 31 ) on the respective common subsets of our and their predictions (detailed results are shown in Extended Data Fig. 5a ). We did not reach the performance of the best human-expert-aided CASP15 submission AIchemy_RNA2 39 (Fig. 1c (centre left)). Owing to limited dataset sizes, we do not report significance test statistics here. Further analysis of the accuracy of predicting nucleic acids alone (without proteins) is shown in Extended Data Fig. 5b .”limitations[7]
limitationNearly all authors have commercial interests in the work, and patent applications on the method have been filed. — “Author-affiliated entities have filed US provisional patent applications including 63/611,674, 63/611,638 and 63/546,444 relating to predicting 3D structures of molecule complexes using embedding neural networks and generative models. All of the authors other than A.B., Y.A.K. and E.D.Z. have commercial interests in the work described.”limitations[8]
Content tags
content-observations: finding · quantity · variable · definition · key-term — grounded in the full text
findingWithout any structural input, AF3 greatly outperforms classical docking such as Vina (Fisher's exact test, P = 2.27e-13) and true blind docking such as RoseTTAFold All-Atom (P = 4.45e-25) on PoseBusters, even though traditional docking uses privileged information from the solved structure. — “We evaluated the performance of the system on recent interface-specific benchmarks for each complex type (Fig. 1c and Extended Data Table 1 ). Performance on protein–ligand interfaces was evaluated on the PoseBusters benchmark set, which is composed of 428 protein–ligand structures released to the PDB in 2021 or later. As our standard training cut-off date is in 2021, we trained a separate AF3 model with an earlier training-set cutoff ( Methods ). Accuracy on the PoseBusters set is reported as the percentage of protein–ligand pairs with pocket-aligned ligand root mean squared deviation (r.m.s.d.) of less than 2 Å. The baseline models come in two categories: those that use only protein sequence and ligand SMILES as an input and those that additionally leak information from the solved protein–ligand test structure. Traditional docking methods use the latter privileged information, even though that information would not be available in real-world use cases. Even so, AF3 greatly outperforms classical docking tools such as Vina 37 , 38 even while not using any structural inputs (Fisher’s exact test, P = 2.27 × 10 −13 ) and greatly outperforms all other true blind docking like RoseTTAFold All-Atom ( P = 4.45 × 10 −25 ). Extended Data Fig. 3 shows three examples in which AF3 achieves accurate predictions but docking tools Vina and Gold do not 37 . PoseBusters analysis was performed using a training cut-off of 30 September 2019 for AF3 to ensure that the model was not trained on any PoseBusters structures. To compare with the RoseTTAFold All-Atom results, we used PoseBusters version 1. Version 2 (crystal contacts removed from the benchmark set) results including quality metrics are shown in Extended Data Fig. 4b–f and Extended Data Table 1 . We use multiple seeds to ensure correct chirality and avoid slight protein–ligand clashing (as opposed to a method like diffusion guidance to enforce) but we are typically able to produce high-quality stereochemistry. Separately, we also train a version of AF3 that receives the ‘pocket information’ as used in some recent deep-learning work 24 , 26 (the results are shown in Extended Data Fig. 4a ).”content_tags.findings[0]
findingAF3 predicts protein-nucleic acid complexes and RNA structures more accurately than RoseTTAFold2NA, compared on structures below 1,000 residues. — “AF3 predicts protein–nucleic complexes and RNA structures with higher accuracy than RoseTTAFold2NA 15 (Fig. 1c (second plot)). As RoseTTAFold2NA is validated only on structures below 1,000 residues, we use only structures below 1,000 residues from our recent PDB evaluation set for this comparison ( Methods ). AF3 is able to predict protein–nucleic structures with thousands of residues, an example of which is shown in Fig. 3a . Note that we do not compare directly to RoseTTAFold All-Atom, but benchmarks indicate that RoseTTAFold All-Atom is slightly less accurate than RoseTTAFold2NA for nucleic acid predictions 29 .”content_tags.findings[1]
findingOn CASP15 RNA targets AF3 beats RoseTTAFold2NA and the best AI-based submission but does not reach the best human-expert-aided submission. — “We also evaluated AF3 performance on the ten publicly available Critical Assessment of Structure Prediction 15 (CASP15) RNA targets: we achieve a higher average performance than RoseTTAFold2NA and AIchemy_RNA 27 (the best AI-based submission in CASP15 18 , 31 ) on the respective common subsets of our and their predictions (detailed results are shown in Extended Data Fig. 5a ). We did not reach the performance of the best human-expert-aided CASP15 submission AIchemy_RNA2 39 (Fig. 1c (centre left)). Owing to limited dataset sizes, we do not report significance test statistics here. Further analysis of the accuracy of predicting nucleic acids alone (without proteins) is shown in Extended Data Fig. 5b .”content_tags.findings[2]
findingMulti-residue glycans are predicted successfully 42.1 percent of the time (n = 131 clusters), slightly below single-residue glycans at 46.1 percent (n = 167). — “Covalent modifications (bonded ligands, glycosylation, and modified protein residues and nucleic acid bases) are also accurately predicted by AF3 (Fig. 1c (centre right)). Modifications include those to any polymer residue (protein, RNA or DNA). We report accuracy as the percentage of successful predictions (pocket r.m.s.d. < 2 Å). We apply quality filters to the bonded ligands and glycosylation dataset (as does PoseBusters): we include only ligands with high-quality experimental data (ranking_model_fit > 0.5, according to the RCSB structure validation report, that is, X-ray structures with a model quality above the median). As with the PoseBusters set, the bonded ligands and glycosylation datasets are not filtered by homology to the training dataset. Filtering on the basis of the bound polymer chain homology (using polymer template similarity < 40) yielded only five clusters for bonded ligands and seven clusters for glycosylation. We exclude multi-residue glycans here because the RCSB validation report does not provide a ranking_model_fit value for them. The percentage of successful predictions (pocket r.m.s.d. < 2 Å) for multi-residue glycans on all-quality experimental data is 42.1% ( n = 131 clusters), which is slightly lower than the success rate for single-residue glycans on all-quality experimental data of 46.1% ( n = 167). The modified residues dataset is filtered similarly to our other polymer test sets: it contains only modified residues in polymer chains with low homology to the training set ( Methods ). See Extended Data Table 1 for detailed results, and Extended Data Fig. 6 for examples of predicted protein, DNA and RNA structures with covalent modifications, including analysis of the impact of phosphorylation on predictions.”content_tags.findings[3]
findingAgainst AlphaFold-Multimer v2.3, protein-protein success rises (P = 1.8e-18), antibody-protein interfaces improve markedly (P = 6.5e-5) and protein monomer LDDT improves (P = 1.7e-34). — “While expanding in modelling abilities, AF3 has also improved in protein complex accuracy relative to AlphaFold-Multimer (v.2.3) 7 , 8 . Generally, protein–protein prediction success (DockQ > 0.23) 40 has increased (paired Wilcoxon signed-rank test, P = 1.8 × 10 −18 ), with antibody–protein interaction prediction in particular showing a marked improvement (Fig. 1c (right); paired Wilcoxon signed-rank test, P = 6.5 × 10 −5 , predictions top-ranked from 1,000 rather than the typical 5 seeds; further details are provided in Fig. 5a ). Protein monomer LDDT improvement is also significant (paired Wilcoxon signed-rank test, P = 1.7 × 10 −34 ). AF3 has a very similar dependence on MSA depth to AlphaFold-Multimer v.2.3; proteins with shallow MSAs are predicted with lower accuracy (a comparison of the dependence of single-chain LDDT on MSA depth is shown in Extended Data Fig. 7a ).”content_tags.findings[4]
findingIntrachain metrics reach 97 percent of maximum performance within the first 20,000 training steps; protein-protein interface LDDT passes 97 percent only after 60,000 steps. — “Figure 2d shows that, during initial training, the model learns quickly to predict the local structures (all intrachain metrics go up quickly and reach 97% of the maximum performance within the first 20,000 training steps), while the model needs considerably longer to learn the global constellation (the interface metrics go up slowly and protein–protein interface LDDT passes the 97% bar only after 60,000 steps). During AF3 development, we observed that some model abilities topped out relatively early and started to decline (most likely due to overfitting to the limited number of training samples for this capability), while other abilities were still undertrained. We addressed this by increasing or decreasing the sampling probability for the corresponding training sets (Supplementary Methods 2.5.1 ) and by performing early stopping using a weighted average of all of the above metrics and some additional metrics to select the best model checkpoint (Supplementary Table 7 ). The fine-tuning stages with the larger crop sizes improve the model on all metrics with an especially high uplift on protein–protein interfaces (Extended Data Fig. 2 ).”content_tags.findings[5]
findingCross-distillation greatly reduced the hallucination behaviour of AF3. — “The use of a generative diffusion approach comes with some technical challenges that we needed to address. The biggest issue is that generative models are prone to hallucination 35 , whereby the model may invent plausible-looking structure even in unstructured regions. To counteract this effect, we use a cross-distillation method in which we enrich the training data with structures predicted by AlphaFold-Multimer (v.2.3) 7 , 8 . In these structures, unstructured regions are typically represented by long extended loops instead of compact structures, and training on them ‘teaches’ AF3 to mimic this behaviour. This cross-distillation greatly reduced the hallucination behaviour of AF3 (Extended Data Fig. 1 for disorder prediction results on the CAID 2 36 benchmark set).”content_tags.findings[6]
findingAntibody-antigen top-ranked predictions keep improving with more model seeds up to 1,000 (P = 2.0e-5 for percentage correct; P = 0.009 for very high accuracy), an effect not seen generally for other molecule classes. — “Despite the large advance in modelling accuracy in AF3, there are still many targets for which accurate modelling can be challenging. To obtain the highest accuracy, it may be necessary to generate a large number of predictions and rank them, which incurs an extra computational cost. A class of targets in which we observe this effect strongly is antibody–antigen complexes, similar to other recent work 46 . Figure 5a shows that, for AF3, top-ranked predictions keep improving with more model seeds, even at as many as 1,000 (Wilcoxon signed-rank test between 5 and 1,000 seeds, P = 2.0 × 10 −5 for percentage correct and P = 0.009 for percentage very high accuracy; ranking by protein–protein interface ipTM). This large improvement with many seeds is not observed in general for other classes of molecules (Extended Data Fig. 7b ). Using only one diffusion sample per model seed for the AF3 predictions rather than five (not illustrated) does not change the results significantly, indicating that running more model seeds is necessary for antibody score improvements, rather than just more diffusion samples.”content_tags.findings[7]
findingAF3 confidence measures are well calibrated with accuracy. — “As with AF2, AF3 confidence measures are well calibrated with accuracy. Our confidence analysis is performed on the recent PDB evaluation set, with no homology filtering and including peptides. The ligands category is filtered to high-quality experimental structures as described above, and considers standard non-bonded ligands only. See Extended Data Fig. 8 for a similar assessment on bonded ligand and other interfaces. All statistics are cluster-weighted ( Methods ) and consider the top-ranked prediction only (ranking details are provided in Supplementary Methods 5.9.3 ).”content_tags.findings[8]
findingAlmost all remaining clashes occur in protein-nucleic acid complexes with more than 100 nucleotides and more than 2,000 residues in total. — “On stereochemistry, we note two main classes of violations. The first is that the model outputs do not always respect chirality (Fig. 5b ), despite the model receiving reference structures with correct chirality as input features. To address this in the PoseBusters benchmark, we included a penalty for chirality violation in our ranking formula for model predictions. Despite this, we still observe a chirality violation rate of 4.4% in the benchmark. The second class of stereochemical violations is a tendency of the model to occasionally produce overlapping (clashing) atoms in the predictions. This sometimes manifests as extreme violations in homomers in which entire chains have been observed to overlap (Fig. 5e ). Penalizing clashes during ranking (Supplementary Methods 5.9.3 ) reduces the occurrence of this failure mode but does not eliminate them. Almost all remaining clashes occur for protein–nucleic complexes with both greater than 100 nucleotides and greater than 2,000 residues in total.”content_tags.findings[9]
findingDockQ and iLDDT are highly correlated, so standard DockQ cut-offs translate into equivalent iLDDT cut-offs. — “We measure the quality of the predictions with DockQ, LDDT or pocket-aligned r.m.s.d. For nucleic–protein interfaces, we measure interface accuracy through iLDDT, which is calculated from distances between atoms across different chains in the interface. DockQ and iLDDT are highly correlated (Extended Data Fig. 9 ), so the standard cut-offs for DockQ can be translated to equivalent iLDDT cut-offs. Nucleic acid LDDTs (intrachains and interface) were calculated with an inclusion radius of 30 Å compared with the usual 15 Å used for proteins, owing to their larger scale. For confidence calibration assessment, we use a bespoke LDDT (LDDT_to_polymer) metric that considers differences from each atom of a given entity to any C α or C1′ polymer atom within its inclusion radius. This is closely related to how the confidence prediction is trained (Supplementary Methods 4.3.1 ).”content_tags.findings[10]
quantity428 protein-ligand structures released to the PDB in 2021 or later — “We evaluated the performance of the system on recent interface-specific benchmarks for each complex type (Fig. 1c and Extended Data Table 1 ). Performance on protein–ligand interfaces was evaluated on the PoseBusters benchmark set, which is composed of 428 protein–ligand structures released to the PDB in 2021 or later. As our standard training cut-off date is in 2021, we trained a separate AF3 model with an earlier training-set cutoff ( Methods ). Accuracy on the PoseBusters set is reported as the percentage of protein–ligand pairs with pocket-aligned ligand root mean squared deviation (r.m.s.d.) of less than 2 Å. The baseline models come in two categories: those that use only protein sequence and ligand SMILES as an input and those that additionally leak information from the solved protein–ligand test structure. Traditional docking methods use the latter privileged information, even though that information would not be available in real-world use cases. Even so, AF3 greatly outperforms classical docking tools such as Vina 37 , 38 even while not using any structural inputs (Fisher’s exact test, P = 2.27 × 10 −13 ) and greatly outperforms all other true blind docking like RoseTTAFold All-Atom ( P = 4.45 × 10 −25 ). Extended Data Fig. 3 shows three examples in which AF3 achieves accurate predictions but docking tools Vina and Gold do not 37 . PoseBusters analysis was performed using a training cut-off of 30 September 2019 for AF3 to ensure that the model was not trained on any PoseBusters structures. To compare with the RoseTTAFold All-Atom results, we used PoseBusters version 1. Version 2 (crystal contacts removed from the benchmark set) results including quality metrics are shown in Extended Data Fig. 4b–f and Extended Data Table 1 . We use multiple seeds to ensure correct chirality and avoid slight protein–ligand clashing (as opposed to a method like diffusion guidance to enforce) but we are typically able to produce high-quality stereochemistry. Separately, we also train a version of AF3 that receives the ‘pocket information’ as used in some recent deep-learning work 24 , 26 (the results are shown in Extended Data Fig. 4a ).”content_tags.quantities[0]
quantity4.4 percent on the PoseBusters benchmark despite a chirality penalty — “On stereochemistry, we note two main classes of violations. The first is that the model outputs do not always respect chirality (Fig. 5b ), despite the model receiving reference structures with correct chirality as input features. To address this in the PoseBusters benchmark, we included a penalty for chirality violation in our ranking formula for model predictions. Despite this, we still observe a chirality violation rate of 4.4% in the benchmark. The second class of stereochemical violations is a tendency of the model to occasionally produce overlapping (clashing) atoms in the predictions. This sometimes manifests as extreme violations in homomers in which entire chains have been observed to overlap (Fig. 5e ). Penalizing clashes during ranking (Supplementary Methods 5.9.3 ) reduces the occurrence of this failure mode but does not eliminate them. Almost all remaining clashes occur for protein–nucleic complexes with both greater than 100 nucleotides and greater than 2,000 residues in total.”content_tags.quantities[1]
quantity42.1 percent for multi-residue glycans (n = 131 clusters) against 46.1 percent for single-residue glycans (n = 167) — “Covalent modifications (bonded ligands, glycosylation, and modified protein residues and nucleic acid bases) are also accurately predicted by AF3 (Fig. 1c (centre right)). Modifications include those to any polymer residue (protein, RNA or DNA). We report accuracy as the percentage of successful predictions (pocket r.m.s.d. < 2 Å). We apply quality filters to the bonded ligands and glycosylation dataset (as does PoseBusters): we include only ligands with high-quality experimental data (ranking_model_fit > 0.5, according to the RCSB structure validation report, that is, X-ray structures with a model quality above the median). As with the PoseBusters set, the bonded ligands and glycosylation datasets are not filtered by homology to the training dataset. Filtering on the basis of the bound polymer chain homology (using polymer template similarity < 40) yielded only five clusters for bonded ligands and seven clusters for glycosylation. We exclude multi-residue glycans here because the RCSB validation report does not provide a ranking_model_fit value for them. The percentage of successful predictions (pocket r.m.s.d. < 2 Å) for multi-residue glycans on all-quality experimental data is 42.1% ( n = 131 clusters), which is slightly lower than the success rate for single-residue glycans on all-quality experimental data of 46.1% ( n = 167). The modified residues dataset is filtered similarly to our other polymer test sets: it contains only modified residues in polymer chains with low homology to the training set ( Methods ). See Extended Data Table 1 for detailed results, and Extended Data Fig. 6 for examples of predicted protein, DNA and RNA structures with covalent modifications, including analysis of the impact of phosphorylation on predictions.”content_tags.quantities[2]
quantity5 model seeds with 5 diffusion samples each, 25 samples to choose from — “No inference time templates or reference ligand position features were released after 30 September 2021, and in the case of PoseBusters evaluation, an earlier cut-off date of 30 September 2019 was used. The model can be run with different random seeds to generate alternative results, with a batch of diffusion samples per seed. Unless otherwise stated, all results are generated by selecting the top confidence sample from running 5 seeds of the same trained model, with 5 diffusion samples per model seed, for a total of 25 samples to choose from. Standard crystallization aids are excluded from predictions (Supplementary Table 8 ).”content_tags.quantities[3]
quantitymini batch of 256; 12,288 diffusion samples in initial training and 8,192 in fine-tuning; crop sizes 384, 640 and 768 tokens across three stages — “No structural data used during training were released after 30 September 2021 and, for the model used in PoseBusters evaluations, we filtered out PDB 32 structures released after 30 September 2021. One optimizer step uses a mini batch of 256 input data samples and during initial training 256 × 48 = 12,288 diffusion samples. For fine-tuning, the number of diffusion samples is reduced to 256 × 32 = 8,192. The model is trained in three stages—the initial training with a crop size of 384 tokens and two sequential fine tuning stages with crop sizes of 640 and 768 tokens. Further details are provided in Supplementary Methods 5.2 .”content_tags.quantities[4]
quantity30 September 2021 for the main model and 30 September 2019 for the PoseBusters model — “While other analyses used an AlphaFold model trained on PDB data released before a cut-off of 30 September 2021, our PoseBusters analysis was conducted on a model (with identical architecture and similar training schedule) differing only in the use of an earlier 30 September 2019 cut-off. This analysis therefore did not include training data, inference time templates or ‘ref_pos’ features released after this date.”content_tags.quantities[5]
quantity30 angstroms for nucleic acids against the usual 15 angstroms for proteins — “We measure the quality of the predictions with DockQ, LDDT or pocket-aligned r.m.s.d. For nucleic–protein interfaces, we measure interface accuracy through iLDDT, which is calculated from distances between atoms across different chains in the interface. DockQ and iLDDT are highly correlated (Extended Data Fig. 9 ), so the standard cut-offs for DockQ can be translated to equivalent iLDDT cut-offs. Nucleic acid LDDTs (intrachains and interface) were calculated with an inclusion radius of 30 Å compared with the usual 15 Å used for proteins, owing to their larger scale. For confidence calibration assessment, we use a bespoke LDDT (LDDT_to_polymer) metric that considers differences from each atom of a given entity to any C α or C1′ polymer atom within its inclusion radius. This is closely related to how the confidence prediction is trained (Supplementary Methods 4.3.1 ).”content_tags.quantities[6]
quantitychains above 40 percent sequence identity to training chains removed; peptide chains under 16 residues always removed — “The recent PDB set is filtered to a low homology subset (Supplementary Methods 6.1 ) for some results where stated. Homology is defined as sequence identity to sequences in the training set and is measured by template search (Supplementary Methods 2.4 ). Individual polymer chains in evaluation complexes are filtered out if the maximum sequence identity to chains in the training set is greater than 40%, where sequence identity is the percentage of residues in the evaluation set chain that are identical to the training set chain. Individual peptide chains (protein chains with less than 16 residues) are always filtered out. For polymer–polymer interfaces, if both polymers have greater than 40% sequence identity to two chains in the same complex in the training set, then the interface is filtered out. For interfaces to a peptide, the interface is filtered out if the non-peptide entity has greater than 40% sequence identity to any chain in the training set.”content_tags.quantities[7]
quantity71 antibody-antigen complexes with 166 interfaces spanning 65 interface clusters — “To study antibody-antigen interface prediction, we filter the low homology recent PDB set to complexes that contain at least one protein–protein interface where one of the protein chains is in one of the two largest PDB chain clusters (these clusters are representative of antibodies). We further filter to complexes with at most 2,560 tokens and with no unknown amino acids in the PDB to allow extensive comparison against relaxed predictions of AlphaFold-Multimer v2.3. That leaves 71 antibody–antigen complexes, containing 166 antibody–antigen interfaces spanning 65 interface clusters.”content_tags.quantities[8]
quantitythe MSA processing block is reduced to four blocks, while the pairformer keeps 48 — “The overall structure of AF3 (Fig. 1d and Supplementary Methods 3 ) echoes that of AF2, with a large trunk evolving a pairwise representation of the chemical complex followed by a structure module that uses the pairwise representation to generate explicit atomic positions, but there are large differences in each major component. These modifications were driven both by the need to accommodate a wide range of chemical entities without excessive special casing and by observations of AF2 performance with different modifications. Within the trunk, MSA processing is substantially de-emphasized, with a much smaller and simpler MSA embedding block (Supplementary Methods 3.3 ). Compared with the original evoformer from AF2, the number of blocks is reduced to four, the processing of the MSA representation uses an inexpensive pair-weighted averaging and only the pair representation is used for later processing steps. The ‘pairformer’ (Fig. 2a and Supplementary Methods 3.6 ) replaces the evoformer of AF2 as the dominant processing block. It operates only on the pair representation and the single representation; the MSA representation is not retained and all information passes through the pair representation. The pair processing and the number of blocks (48) is largely unchanged from AF2. The resulting pair and single representation together with the input representation are passed to the new diffusion module (Fig. 2b ) that replaces the structure module of AF2.”content_tags.quantities[9]
variablepLDDT — “We also developed confidence measures that predict the atom-level and pairwise errors in our final structures. In AF2, this was done directly by regressing the error in the output of the structure module during training. However, this procedure is not applicable to diffusion training, as only a single step of the diffusion is trained instead of a full-structure generation (Fig. 2c ). To remedy this, we developed a diffusion ‘rollout’ procedure for the full-structure prediction generation during training (using a larger step size than normal; Fig. 2c (mini-rollout)). This predicted structure is then used to permute the symmetric ground-truth chains and ligands, and to compute the performance metrics to train the confidence head. The confidence head uses the pairwise representation to predict a modified local distance difference test (pLDDT) and a predicted aligned error (PAE) matrix as in AF2, as well as a distance error matrix (PDE), which is the error in the distance matrix of the predicted structure as compared to the true structure (details are provided in Supplementary Methods 4.3 ).”content_tags.variables[0]
variableipTM — “In Fig. 4a (top row), we plot the chain pair interface-predicted TM (ipTM) score 41 (Supplementary Methods 5.9.1 ) against interface accuracy measures: protein–protein DockQ, protein–nucleic interface LDDT (iLDDT) and protein–ligand success, with success defined as the percentage of examples under thresholded pocket-aligned r.m.s.d. values. In Fig. 4a (bottom row), we plot the average pLDDT per protein, nucleotide or ligand entity against our bespoke LDDT_to_polymer metric (metrics details are provided in the Methods ), which is closely related to the training target of the pLDDT predictor.”content_tags.variables[1]
variableDockQ — “We measure the quality of the predictions with DockQ, LDDT or pocket-aligned r.m.s.d. For nucleic–protein interfaces, we measure interface accuracy through iLDDT, which is calculated from distances between atoms across different chains in the interface. DockQ and iLDDT are highly correlated (Extended Data Fig. 9 ), so the standard cut-offs for DockQ can be translated to equivalent iLDDT cut-offs. Nucleic acid LDDTs (intrachains and interface) were calculated with an inclusion radius of 30 Å compared with the usual 15 Å used for proteins, owing to their larger scale. For confidence calibration assessment, we use a bespoke LDDT (LDDT_to_polymer) metric that considers differences from each atom of a given entity to any C α or C1′ polymer atom within its inclusion radius. This is closely related to how the confidence prediction is trained (Supplementary Methods 4.3.1 ).”content_tags.variables[2]
variablepocket-aligned r.m.s.d. — “Pocket-aligned r.m.s.d. is computed as follows: the pocket is defined as all heavy atoms within 10 Å of any heavy atom of the ligand, restricted to the primary polymer chain for the ligand or modified residue being scored, and further restricted to only backbone atoms for proteins. The primary polymer chain is defined variously: for PoseBusters, it is the protein chain with the most atoms within 10 Å of the ligand; for bonded ligand scores, it is the bonded polymer chain; and for modified residues, it is the chain in which the residue is contained (minus that residue). The pocket is used to align the predicted structure to the ground-truth structure with least-squares rigid alignment and then the r.m.s.d. is computed on all heavy atoms of the ligand.”content_tags.variables[3]
variablenumber of effective sequences — “MSA depth analysis (Extended Data Fig. 7a ) was based on computing the normalized number of effective sequences ( N eff ) for each position of a query sequence. Per-residue N eff values were obtained by counting the number of non-gap residues in the MSA for this position and weighting the sequences using the N eff scheme 49 with a threshold of 80% sequence identity measured on the region that is non-gap in either sequence.”content_tags.variables[4]
definitionhallucination — “The use of a generative diffusion approach comes with some technical challenges that we needed to address. The biggest issue is that generative models are prone to hallucination 35 , whereby the model may invent plausible-looking structure even in unstructured regions. To counteract this effect, we use a cross-distillation method in which we enrich the training data with structures predicted by AlphaFold-Multimer (v.2.3) 7 , 8 . In these structures, unstructured regions are typically represented by long extended loops instead of compact structures, and training on them ‘teaches’ AF3 to mimic this behaviour. This cross-distillation greatly reduced the hallucination behaviour of AF3 (Extended Data Fig. 1 for disorder prediction results on the CAID 2 36 benchmark set).”content_tags.definitions[0]
definitioncross-distillation — “The use of a generative diffusion approach comes with some technical challenges that we needed to address. The biggest issue is that generative models are prone to hallucination 35 , whereby the model may invent plausible-looking structure even in unstructured regions. To counteract this effect, we use a cross-distillation method in which we enrich the training data with structures predicted by AlphaFold-Multimer (v.2.3) 7 , 8 . In these structures, unstructured regions are typically represented by long extended loops instead of compact structures, and training on them ‘teaches’ AF3 to mimic this behaviour. This cross-distillation greatly reduced the hallucination behaviour of AF3 (Extended Data Fig. 1 for disorder prediction results on the CAID 2 36 benchmark set).”content_tags.definitions[1]
definitionpairformer — “The overall structure of AF3 (Fig. 1d and Supplementary Methods 3 ) echoes that of AF2, with a large trunk evolving a pairwise representation of the chemical complex followed by a structure module that uses the pairwise representation to generate explicit atomic positions, but there are large differences in each major component. These modifications were driven both by the need to accommodate a wide range of chemical entities without excessive special casing and by observations of AF2 performance with different modifications. Within the trunk, MSA processing is substantially de-emphasized, with a much smaller and simpler MSA embedding block (Supplementary Methods 3.3 ). Compared with the original evoformer from AF2, the number of blocks is reduced to four, the processing of the MSA representation uses an inexpensive pair-weighted averaging and only the pair representation is used for later processing steps. The ‘pairformer’ (Fig. 2a and Supplementary Methods 3.6 ) replaces the evoformer of AF2 as the dominant processing block. It operates only on the pair representation and the single representation; the MSA representation is not retained and all information passes through the pair representation. The pair processing and the number of blocks (48) is largely unchanged from AF2. The resulting pair and single representation together with the input representation are passed to the new diffusion module (Fig. 2b ) that replaces the structure module of AF2.”content_tags.definitions[2]
definitiondiffusion module — “The diffusion module (Fig. 2b and Supplementary Methods 3.7 ) operates directly on raw atom coordinates, and on a coarse abstract token representation, without rotational frames or any equivariant processing. We had observed in AF2 that removing most of the complexity of the structure module had only a modest effect on the prediction accuracy, and maintaining the backbone frame and side-chain torsion representation add quite a bit of complexity for general molecular graphs. Similarly AF2 required carefully tuned stereochemical violation penalties during training to enforce chemical plausibility of the resulting structures. We use a relatively standard diffusion approach 33 in which the diffusion model is trained to receive ‘noised’ atomic coordinates and then predict the true coordinates. This task requires the network to learn protein structure at a variety of length scales, whereby the denoising task at small noise emphasizes understanding very local stereochemistry and the denoising task at high noise emphasizes the large-scale structure of the system. At the inference time, random noise is sampled and then recurrently denoised to produce a final structure. Importantly, this is a generative training procedure that produces a distribution of answers. This means that, for each answer, the local structure will be sharply defined (for example, side-chain bond geometry) even when the network is uncertain about the positions. For this reason, we are able to avoid both torsion-based parametrizations of the residues and violation losses on the structure, while handling the full complexity of general ligands. Similarly to some recent work 34 , we find that no invariance or equivariance with respect to global rotations and translation of the molecule are required in the architecture and we therefore omit them to simplify the machine learning architecture.”content_tags.definitions[3]
definitiondistance error matrix — “We also developed confidence measures that predict the atom-level and pairwise errors in our final structures. In AF2, this was done directly by regressing the error in the output of the structure module during training. However, this procedure is not applicable to diffusion training, as only a single step of the diffusion is trained instead of a full-structure generation (Fig. 2c ). To remedy this, we developed a diffusion ‘rollout’ procedure for the full-structure prediction generation during training (using a larger step size than normal; Fig. 2c (mini-rollout)). This predicted structure is then used to permute the symmetric ground-truth chains and ligands, and to compute the performance metrics to train the confidence head. The confidence head uses the pairwise representation to predict a modified local distance difference test (pLDDT) and a predicted aligned error (PAE) matrix as in AF2, as well as a distance error matrix (PDE), which is the error in the distance matrix of the predicted structure as compared to the true structure (details are provided in Supplementary Methods 4.3 ).”content_tags.definitions[4]
definitionipTM — “In Fig. 4a (top row), we plot the chain pair interface-predicted TM (ipTM) score 41 (Supplementary Methods 5.9.1 ) against interface accuracy measures: protein–protein DockQ, protein–nucleic interface LDDT (iLDDT) and protein–ligand success, with success defined as the percentage of examples under thresholded pocket-aligned r.m.s.d. values. In Fig. 4a (bottom row), we plot the average pLDDT per protein, nucleotide or ligand entity against our bespoke LDDT_to_polymer metric (metrics details are provided in the Methods ), which is closely related to the training target of the pLDDT predictor.”content_tags.definitions[5]
definitionpocket-aligned r.m.s.d. — “Pocket-aligned r.m.s.d. is computed as follows: the pocket is defined as all heavy atoms within 10 Å of any heavy atom of the ligand, restricted to the primary polymer chain for the ligand or modified residue being scored, and further restricted to only backbone atoms for proteins. The primary polymer chain is defined variously: for PoseBusters, it is the protein chain with the most atoms within 10 Å of the ligand; for bonded ligand scores, it is the bonded polymer chain; and for modified residues, it is the chain in which the residue is contained (minus that residue). The pocket is used to align the predicted structure to the ground-truth structure with least-squares rigid alignment and then the r.m.s.d. is computed on all heavy atoms of the ligand.”content_tags.definitions[6]
definitionrecent PDB set — “General model evaluation was performed on our recent PDB set consisting of 8,856 PDB complexes released between 1 May 2022 and 12 January 2023. The set contains almost all PDB complexes released during that period that are less than 5,120 model tokens in size (Supplementary Methods 6.1 ). Single chains and interfaces within each structure were scored separately rather than only looking at full complex scores, and clustering was then applied to chains and interfaces so that scores could be aggregated first within clusters and then across clusters for mean scores, or using a weighting of inverse cluster size for distributional statistics (Supplementary Methods 6.2 and 6.4 ).”content_tags.definitions[7]
definitionhomology — “The recent PDB set is filtered to a low homology subset (Supplementary Methods 6.1 ) for some results where stated. Homology is defined as sequence identity to sequences in the training set and is measured by template search (Supplementary Methods 2.4 ). Individual polymer chains in evaluation complexes are filtered out if the maximum sequence identity to chains in the training set is greater than 40%, where sequence identity is the percentage of residues in the evaluation set chain that are identical to the training set chain. Individual peptide chains (protein chains with less than 16 residues) are always filtered out. For polymer–polymer interfaces, if both polymers have greater than 40% sequence identity to two chains in the same complex in the training set, then the interface is filtered out. For interfaces to a peptide, the interface is filtered out if the non-peptide entity has greater than 40% sequence identity to any chain in the training set.”content_tags.definitions[8]
definitionLDDT_to_polymer — “We measure the quality of the predictions with DockQ, LDDT or pocket-aligned r.m.s.d. For nucleic–protein interfaces, we measure interface accuracy through iLDDT, which is calculated from distances between atoms across different chains in the interface. DockQ and iLDDT are highly correlated (Extended Data Fig. 9 ), so the standard cut-offs for DockQ can be translated to equivalent iLDDT cut-offs. Nucleic acid LDDTs (intrachains and interface) were calculated with an inclusion radius of 30 Å compared with the usual 15 Å used for proteins, owing to their larger scale. For confidence calibration assessment, we use a bespoke LDDT (LDDT_to_polymer) metric that considers differences from each atom of a given entity to any C α or C1′ polymer atom within its inclusion radius. This is closely related to how the confidence prediction is trained (Supplementary Methods 4.3.1 ).”content_tags.definitions[9]
definitioniLDDT — “We measure the quality of the predictions with DockQ, LDDT or pocket-aligned r.m.s.d. For nucleic–protein interfaces, we measure interface accuracy through iLDDT, which is calculated from distances between atoms across different chains in the interface. DockQ and iLDDT are highly correlated (Extended Data Fig. 9 ), so the standard cut-offs for DockQ can be translated to equivalent iLDDT cut-offs. Nucleic acid LDDTs (intrachains and interface) were calculated with an inclusion radius of 30 Å compared with the usual 15 Å used for proteins, owing to their larger scale. For confidence calibration assessment, we use a bespoke LDDT (LDDT_to_polymer) metric that considers differences from each atom of a given entity to any C α or C1′ polymer atom within its inclusion radius. This is closely related to how the confidence prediction is trained (Supplementary Methods 4.3.1 ).”content_tags.definitions[10]
Concepts
terms this paper carries, each with the sentence it was cut from — the layer that joins one paper to another. Terms with no quote yet are on CONCEPTS.html.
conceptAlphaFold 3 — not defined in this paper's own words; the diffusion-based model predicting structures of general biomolecular complexes — “Here we present AlphaFold 3 (AF3)—a model that is capable of high-accuracy prediction of complexes containing nearly all molecular types present in the Protein Data Bank 32 (PDB) (Fig. 1a,b ). In all but one category, it achieves a substantially higher performance than strong methods that specialize in just the given task (Fig. 1c and Extended Data Table 1 ), including higher accuracy at protein structure and the structure of protein–protein interactions.”concepts[0]
conceptProtein Data Bank — not defined in this paper's own words; the archive whose molecular types AF3 aims to cover and on which it trains — “Here we present AlphaFold 3 (AF3)—a model that is capable of high-accuracy prediction of complexes containing nearly all molecular types present in the Protein Data Bank 32 (PDB) (Fig. 1a,b ). In all but one category, it achieves a substantially higher performance than strong methods that specialize in just the given task (Fig. 1c and Extended Data Table 1 ), including higher accuracy at protein structure and the structure of protein–protein interactions.”concepts[1]
conceptmodified residues — not defined in this paper's own words; chemically modified polymer residues, one of the entity classes AF3 predicts — “These successes lead to the question of whether it is possible to accurately predict the structure of complexes containing a much wider range of biomolecules, including ligands, ions, nucleic acids and modified residues, within a deep-learning framework. A wide range of predictors for various specific interaction types has been developed 16 – 28 , as well as one generalist method developed concurrently with the present work 29 , but the accuracy of such deep-learning attempts has been mixed and often below that of physics-inspired methods 30 , 31 . Almost all of these methods are also highly specialized to particular interaction types and cannot predict the structure of general biomolecular complexes containing many types of entities.”concepts[2]
conceptpairformer — not defined in this paper's own words; AF3's main trunk block on pair and single representations — “This is achieved by a substantial evolution of the AF2 architecture and training procedure (Fig. 1d ) both to accommodate more general chemical structures and to improve the data efficiency of learning. The system reduces the amount of multiple-sequence alignment (MSA) processing by replacing the AF2 evoformer with the simpler pairformer module (Fig. 2a ). Furthermore it directly predicts the raw atom coordinates with a diffusion module, replacing the AF2 structure module that operated on amino-acid-specific frames and side-chain torsion angles (Fig. 2b ). The multiscale nature of the diffusion process (low noise levels induce the network to improve local structure) also enable us to eliminate stereochemical losses and most special handling of bonding patterns in the network, easily accommodating arbitrary chemical components.”concepts[3]
conceptevoformer — not defined in this paper's own words; the MSA-heavy AF2 block that AF3 replaces — “This is achieved by a substantial evolution of the AF2 architecture and training procedure (Fig. 1d ) both to accommodate more general chemical structures and to improve the data efficiency of learning. The system reduces the amount of multiple-sequence alignment (MSA) processing by replacing the AF2 evoformer with the simpler pairformer module (Fig. 2a ). Furthermore it directly predicts the raw atom coordinates with a diffusion module, replacing the AF2 structure module that operated on amino-acid-specific frames and side-chain torsion angles (Fig. 2b ). The multiscale nature of the diffusion process (low noise levels induce the network to improve local structure) also enable us to eliminate stereochemical losses and most special handling of bonding patterns in the network, easily accommodating arbitrary chemical components.”concepts[4]
conceptstructure module — not defined in this paper's own words; the frame- and torsion-based AF2 module replaced by diffusion — “This is achieved by a substantial evolution of the AF2 architecture and training procedure (Fig. 1d ) both to accommodate more general chemical structures and to improve the data efficiency of learning. The system reduces the amount of multiple-sequence alignment (MSA) processing by replacing the AF2 evoformer with the simpler pairformer module (Fig. 2a ). Furthermore it directly predicts the raw atom coordinates with a diffusion module, replacing the AF2 structure module that operated on amino-acid-specific frames and side-chain torsion angles (Fig. 2b ). The multiscale nature of the diffusion process (low noise levels induce the network to improve local structure) also enable us to eliminate stereochemical losses and most special handling of bonding patterns in the network, easily accommodating arbitrary chemical components.”concepts[5]
conceptmultiple-sequence alignment — not defined in this paper's own words; the evolutionary input whose processing AF3 de-emphasises — “This is achieved by a substantial evolution of the AF2 architecture and training procedure (Fig. 1d ) both to accommodate more general chemical structures and to improve the data efficiency of learning. The system reduces the amount of multiple-sequence alignment (MSA) processing by replacing the AF2 evoformer with the simpler pairformer module (Fig. 2a ). Furthermore it directly predicts the raw atom coordinates with a diffusion module, replacing the AF2 structure module that operated on amino-acid-specific frames and side-chain torsion angles (Fig. 2b ). The multiscale nature of the diffusion process (low noise levels induce the network to improve local structure) also enable us to eliminate stereochemical losses and most special handling of bonding patterns in the network, easily accommodating arbitrary chemical components.”concepts[6]
conceptdiffusion module — not defined in this paper's own words; the generative module predicting raw atom coordinates — “The diffusion module (Fig. 2b and Supplementary Methods 3.7 ) operates directly on raw atom coordinates, and on a coarse abstract token representation, without rotational frames or any equivariant processing. We had observed in AF2 that removing most of the complexity of the structure module had only a modest effect on the prediction accuracy, and maintaining the backbone frame and side-chain torsion representation add quite a bit of complexity for general molecular graphs. Similarly AF2 required carefully tuned stereochemical violation penalties during training to enforce chemical plausibility of the resulting structures. We use a relatively standard diffusion approach 33 in which the diffusion model is trained to receive ‘noised’ atomic coordinates and then predict the true coordinates. This task requires the network to learn protein structure at a variety of length scales, whereby the denoising task at small noise emphasizes understanding very local stereochemistry and the denoising task at high noise emphasizes the large-scale structure of the system. At the inference time, random noise is sampled and then recurrently denoised to produce a final structure. Importantly, this is a generative training procedure that produces a distribution of answers. This means that, for each answer, the local structure will be sharply defined (for example, side-chain bond geometry) even when the network is uncertain about the positions. For this reason, we are able to avoid both torsion-based parametrizations of the residues and violation losses on the structure, while handling the full complexity of general ligands. Similarly to some recent work 34 , we find that no invariance or equivariance with respect to global rotations and translation of the molecule are required in the architecture and we therefore omit them to simplify the machine learning architecture.”concepts[7]
concepthallucination — not defined in this paper's own words; invented structure in unstructured regions — “The use of a generative diffusion approach comes with some technical challenges that we needed to address. The biggest issue is that generative models are prone to hallucination 35 , whereby the model may invent plausible-looking structure even in unstructured regions. To counteract this effect, we use a cross-distillation method in which we enrich the training data with structures predicted by AlphaFold-Multimer (v.2.3) 7 , 8 . In these structures, unstructured regions are typically represented by long extended loops instead of compact structures, and training on them ‘teaches’ AF3 to mimic this behaviour. This cross-distillation greatly reduced the hallucination behaviour of AF3 (Extended Data Fig. 1 for disorder prediction results on the CAID 2 36 benchmark set).”concepts[8]
conceptcross-distillation — not defined in this paper's own words; training on another model's predicted structures — “The use of a generative diffusion approach comes with some technical challenges that we needed to address. The biggest issue is that generative models are prone to hallucination 35 , whereby the model may invent plausible-looking structure even in unstructured regions. To counteract this effect, we use a cross-distillation method in which we enrich the training data with structures predicted by AlphaFold-Multimer (v.2.3) 7 , 8 . In these structures, unstructured regions are typically represented by long extended loops instead of compact structures, and training on them ‘teaches’ AF3 to mimic this behaviour. This cross-distillation greatly reduced the hallucination behaviour of AF3 (Extended Data Fig. 1 for disorder prediction results on the CAID 2 36 benchmark set).”concepts[9]
conceptAlphaFold-Multimer — not defined in this paper's own words; the AF2 variant for protein complexes, teacher and baseline — “While expanding in modelling abilities, AF3 has also improved in protein complex accuracy relative to AlphaFold-Multimer (v.2.3) 7 , 8 . Generally, protein–protein prediction success (DockQ > 0.23) 40 has increased (paired Wilcoxon signed-rank test, P = 1.8 × 10 −18 ), with antibody–protein interaction prediction in particular showing a marked improvement (Fig. 1c (right); paired Wilcoxon signed-rank test, P = 6.5 × 10 −5 , predictions top-ranked from 1,000 rather than the typical 5 seeds; further details are provided in Fig. 5a ). Protein monomer LDDT improvement is also significant (paired Wilcoxon signed-rank test, P = 1.7 × 10 −34 ). AF3 has a very similar dependence on MSA depth to AlphaFold-Multimer v.2.3; proteins with shallow MSAs are predicted with lower accuracy (a comparison of the dependence of single-chain LDDT on MSA depth is shown in Extended Data Fig. 7a ).”concepts[10]
conceptpLDDT — not defined in this paper's own words; predicted per-atom local accuracy — “We also developed confidence measures that predict the atom-level and pairwise errors in our final structures. In AF2, this was done directly by regressing the error in the output of the structure module during training. However, this procedure is not applicable to diffusion training, as only a single step of the diffusion is trained instead of a full-structure generation (Fig. 2c ). To remedy this, we developed a diffusion ‘rollout’ procedure for the full-structure prediction generation during training (using a larger step size than normal; Fig. 2c (mini-rollout)). This predicted structure is then used to permute the symmetric ground-truth chains and ligands, and to compute the performance metrics to train the confidence head. The confidence head uses the pairwise representation to predict a modified local distance difference test (pLDDT) and a predicted aligned error (PAE) matrix as in AF2, as well as a distance error matrix (PDE), which is the error in the distance matrix of the predicted structure as compared to the true structure (details are provided in Supplementary Methods 4.3 ).”concepts[11]
conceptpredicted aligned error — not defined in this paper's own words; the pairwise positional error matrix from the confidence head — “We also developed confidence measures that predict the atom-level and pairwise errors in our final structures. In AF2, this was done directly by regressing the error in the output of the structure module during training. However, this procedure is not applicable to diffusion training, as only a single step of the diffusion is trained instead of a full-structure generation (Fig. 2c ). To remedy this, we developed a diffusion ‘rollout’ procedure for the full-structure prediction generation during training (using a larger step size than normal; Fig. 2c (mini-rollout)). This predicted structure is then used to permute the symmetric ground-truth chains and ligands, and to compute the performance metrics to train the confidence head. The confidence head uses the pairwise representation to predict a modified local distance difference test (pLDDT) and a predicted aligned error (PAE) matrix as in AF2, as well as a distance error matrix (PDE), which is the error in the distance matrix of the predicted structure as compared to the true structure (details are provided in Supplementary Methods 4.3 ).”concepts[12]
conceptdistance error matrix — not defined in this paper's own words; predicted error of the distance matrix — “We also developed confidence measures that predict the atom-level and pairwise errors in our final structures. In AF2, this was done directly by regressing the error in the output of the structure module during training. However, this procedure is not applicable to diffusion training, as only a single step of the diffusion is trained instead of a full-structure generation (Fig. 2c ). To remedy this, we developed a diffusion ‘rollout’ procedure for the full-structure prediction generation during training (using a larger step size than normal; Fig. 2c (mini-rollout)). This predicted structure is then used to permute the symmetric ground-truth chains and ligands, and to compute the performance metrics to train the confidence head. The confidence head uses the pairwise representation to predict a modified local distance difference test (pLDDT) and a predicted aligned error (PAE) matrix as in AF2, as well as a distance error matrix (PDE), which is the error in the distance matrix of the predicted structure as compared to the true structure (details are provided in Supplementary Methods 4.3 ).”concepts[13]
conceptPoseBusters — not defined in this paper's own words; the protein-ligand benchmark and validity checker — “We evaluated the performance of the system on recent interface-specific benchmarks for each complex type (Fig. 1c and Extended Data Table 1 ). Performance on protein–ligand interfaces was evaluated on the PoseBusters benchmark set, which is composed of 428 protein–ligand structures released to the PDB in 2021 or later. As our standard training cut-off date is in 2021, we trained a separate AF3 model with an earlier training-set cutoff ( Methods ). Accuracy on the PoseBusters set is reported as the percentage of protein–ligand pairs with pocket-aligned ligand root mean squared deviation (r.m.s.d.) of less than 2 Å. The baseline models come in two categories: those that use only protein sequence and ligand SMILES as an input and those that additionally leak information from the solved protein–ligand test structure. Traditional docking methods use the latter privileged information, even though that information would not be available in real-world use cases. Even so, AF3 greatly outperforms classical docking tools such as Vina 37 , 38 even while not using any structural inputs (Fisher’s exact test, P = 2.27 × 10 −13 ) and greatly outperforms all other true blind docking like RoseTTAFold All-Atom ( P = 4.45 × 10 −25 ). Extended Data Fig. 3 shows three examples in which AF3 achieves accurate predictions but docking tools Vina and Gold do not 37 . PoseBusters analysis was performed using a training cut-off of 30 September 2019 for AF3 to ensure that the model was not trained on any PoseBusters structures. To compare with the RoseTTAFold All-Atom results, we used PoseBusters version 1. Version 2 (crystal contacts removed from the benchmark set) results including quality metrics are shown in Extended Data Fig. 4b–f and Extended Data Table 1 . We use multiple seeds to ensure correct chirality and avoid slight protein–ligand clashing (as opposed to a method like diffusion guidance to enforce) but we are typically able to produce high-quality stereochemistry. Separately, we also train a version of AF3 that receives the ‘pocket information’ as used in some recent deep-learning work 24 , 26 (the results are shown in Extended Data Fig. 4a ).”concepts[14]
conceptdocking — not defined in this paper's own words; placing a ligand into a known protein structure, the task AF3 absorbs — “We evaluated the performance of the system on recent interface-specific benchmarks for each complex type (Fig. 1c and Extended Data Table 1 ). Performance on protein–ligand interfaces was evaluated on the PoseBusters benchmark set, which is composed of 428 protein–ligand structures released to the PDB in 2021 or later. As our standard training cut-off date is in 2021, we trained a separate AF3 model with an earlier training-set cutoff ( Methods ). Accuracy on the PoseBusters set is reported as the percentage of protein–ligand pairs with pocket-aligned ligand root mean squared deviation (r.m.s.d.) of less than 2 Å. The baseline models come in two categories: those that use only protein sequence and ligand SMILES as an input and those that additionally leak information from the solved protein–ligand test structure. Traditional docking methods use the latter privileged information, even though that information would not be available in real-world use cases. Even so, AF3 greatly outperforms classical docking tools such as Vina 37 , 38 even while not using any structural inputs (Fisher’s exact test, P = 2.27 × 10 −13 ) and greatly outperforms all other true blind docking like RoseTTAFold All-Atom ( P = 4.45 × 10 −25 ). Extended Data Fig. 3 shows three examples in which AF3 achieves accurate predictions but docking tools Vina and Gold do not 37 . PoseBusters analysis was performed using a training cut-off of 30 September 2019 for AF3 to ensure that the model was not trained on any PoseBusters structures. To compare with the RoseTTAFold All-Atom results, we used PoseBusters version 1. Version 2 (crystal contacts removed from the benchmark set) results including quality metrics are shown in Extended Data Fig. 4b–f and Extended Data Table 1 . We use multiple seeds to ensure correct chirality and avoid slight protein–ligand clashing (as opposed to a method like diffusion guidance to enforce) but we are typically able to produce high-quality stereochemistry. Separately, we also train a version of AF3 that receives the ‘pocket information’ as used in some recent deep-learning work 24 , 26 (the results are shown in Extended Data Fig. 4a ).”concepts[15]
conceptRoseTTAFold2NA — not defined in this paper's own words; the nucleic acid-specific baseline predictor — “AF3 predicts protein–nucleic complexes and RNA structures with higher accuracy than RoseTTAFold2NA 15 (Fig. 1c (second plot)). As RoseTTAFold2NA is validated only on structures below 1,000 residues, we use only structures below 1,000 residues from our recent PDB evaluation set for this comparison ( Methods ). AF3 is able to predict protein–nucleic structures with thousands of residues, an example of which is shown in Fig. 3a . Note that we do not compare directly to RoseTTAFold All-Atom, but benchmarks indicate that RoseTTAFold All-Atom is slightly less accurate than RoseTTAFold2NA for nucleic acid predictions 29 .”concepts[16]
conceptCASP15 — not defined in this paper's own words; the round-15 community assessment used for RNA targets — “We also evaluated AF3 performance on the ten publicly available Critical Assessment of Structure Prediction 15 (CASP15) RNA targets: we achieve a higher average performance than RoseTTAFold2NA and AIchemy_RNA 27 (the best AI-based submission in CASP15 18 , 31 ) on the respective common subsets of our and their predictions (detailed results are shown in Extended Data Fig. 5a ). We did not reach the performance of the best human-expert-aided CASP15 submission AIchemy_RNA2 39 (Fig. 1c (centre left)). Owing to limited dataset sizes, we do not report significance test statistics here. Further analysis of the accuracy of predicting nucleic acids alone (without proteins) is shown in Extended Data Fig. 5b .”concepts[17]
conceptDockQ — not defined in this paper's own words; protein-protein docking model quality score — “We measure the quality of the predictions with DockQ, LDDT or pocket-aligned r.m.s.d. For nucleic–protein interfaces, we measure interface accuracy through iLDDT, which is calculated from distances between atoms across different chains in the interface. DockQ and iLDDT are highly correlated (Extended Data Fig. 9 ), so the standard cut-offs for DockQ can be translated to equivalent iLDDT cut-offs. Nucleic acid LDDTs (intrachains and interface) were calculated with an inclusion radius of 30 Å compared with the usual 15 Å used for proteins, owing to their larger scale. For confidence calibration assessment, we use a bespoke LDDT (LDDT_to_polymer) metric that considers differences from each atom of a given entity to any C α or C1′ polymer atom within its inclusion radius. This is closely related to how the confidence prediction is trained (Supplementary Methods 4.3.1 ).”concepts[18]
conceptLDDT — not defined in this paper's own words; local distance difference test accuracy — “We measure the quality of the predictions with DockQ, LDDT or pocket-aligned r.m.s.d. For nucleic–protein interfaces, we measure interface accuracy through iLDDT, which is calculated from distances between atoms across different chains in the interface. DockQ and iLDDT are highly correlated (Extended Data Fig. 9 ), so the standard cut-offs for DockQ can be translated to equivalent iLDDT cut-offs. Nucleic acid LDDTs (intrachains and interface) were calculated with an inclusion radius of 30 Å compared with the usual 15 Å used for proteins, owing to their larger scale. For confidence calibration assessment, we use a bespoke LDDT (LDDT_to_polymer) metric that considers differences from each atom of a given entity to any C α or C1′ polymer atom within its inclusion radius. This is closely related to how the confidence prediction is trained (Supplementary Methods 4.3.1 ).”concepts[19]
conceptipTM — not defined in this paper's own words; interface-predicted TM score — “In Fig. 4a (top row), we plot the chain pair interface-predicted TM (ipTM) score 41 (Supplementary Methods 5.9.1 ) against interface accuracy measures: protein–protein DockQ, protein–nucleic interface LDDT (iLDDT) and protein–ligand success, with success defined as the percentage of examples under thresholded pocket-aligned r.m.s.d. values. In Fig. 4a (bottom row), we plot the average pLDDT per protein, nucleotide or ligand entity against our bespoke LDDT_to_polymer metric (metrics details are provided in the Methods ), which is closely related to the training target of the pLDDT predictor.”concepts[20]
conceptchirality — not defined in this paper's own words; handedness of stereocentres, not always respected by predictions — “On stereochemistry, we note two main classes of violations. The first is that the model outputs do not always respect chirality (Fig. 5b ), despite the model receiving reference structures with correct chirality as input features. To address this in the PoseBusters benchmark, we included a penalty for chirality violation in our ranking formula for model predictions. Despite this, we still observe a chirality violation rate of 4.4% in the benchmark. The second class of stereochemical violations is a tendency of the model to occasionally produce overlapping (clashing) atoms in the predictions. This sometimes manifests as extreme violations in homomers in which entire chains have been observed to overlap (Fig. 5e ). Penalizing clashes during ranking (Supplementary Methods 5.9.3 ) reduces the occurrence of this failure mode but does not eliminate them. Almost all remaining clashes occur for protein–nucleic complexes with both greater than 100 nucleotides and greater than 2,000 residues in total.”concepts[21]
conceptmodel seeds — not defined in this paper's own words; separate randomly seeded runs of the whole network — “Despite the large advance in modelling accuracy in AF3, there are still many targets for which accurate modelling can be challenging. To obtain the highest accuracy, it may be necessary to generate a large number of predictions and rank them, which incurs an extra computational cost. A class of targets in which we observe this effect strongly is antibody–antigen complexes, similar to other recent work 46 . Figure 5a shows that, for AF3, top-ranked predictions keep improving with more model seeds, even at as many as 1,000 (Wilcoxon signed-rank test between 5 and 1,000 seeds, P = 2.0 × 10 −5 for percentage correct and P = 0.009 for percentage very high accuracy; ranking by protein–protein interface ipTM). This large improvement with many seeds is not observed in general for other classes of molecules (Extended Data Fig. 7b ). Using only one diffusion sample per model seed for the AF3 predictions rather than five (not illustrated) does not change the results significantly, indicating that running more model seeds is necessary for antibody score improvements, rather than just more diffusion samples.”concepts[22]
conceptdiffusion samples — not defined in this paper's own words; denoising samples drawn within one seed — “Despite the large advance in modelling accuracy in AF3, there are still many targets for which accurate modelling can be challenging. To obtain the highest accuracy, it may be necessary to generate a large number of predictions and rank them, which incurs an extra computational cost. A class of targets in which we observe this effect strongly is antibody–antigen complexes, similar to other recent work 46 . Figure 5a shows that, for AF3, top-ranked predictions keep improving with more model seeds, even at as many as 1,000 (Wilcoxon signed-rank test between 5 and 1,000 seeds, P = 2.0 × 10 −5 for percentage correct and P = 0.009 for percentage very high accuracy; ranking by protein–protein interface ipTM). This large improvement with many seeds is not observed in general for other classes of molecules (Extended Data Fig. 7b ). Using only one diffusion sample per model seed for the AF3 predictions rather than five (not illustrated) does not change the results significantly, indicating that running more model seeds is necessary for antibody score improvements, rather than just more diffusion samples.”concepts[23]
conceptMSA depth — not defined in this paper's own words; how many effective sequences the alignment holds — “While expanding in modelling abilities, AF3 has also improved in protein complex accuracy relative to AlphaFold-Multimer (v.2.3) 7 , 8 . Generally, protein–protein prediction success (DockQ > 0.23) 40 has increased (paired Wilcoxon signed-rank test, P = 1.8 × 10 −18 ), with antibody–protein interaction prediction in particular showing a marked improvement (Fig. 1c (right); paired Wilcoxon signed-rank test, P = 6.5 × 10 −5 , predictions top-ranked from 1,000 rather than the typical 5 seeds; further details are provided in Fig. 5a ). Protein monomer LDDT improvement is also significant (paired Wilcoxon signed-rank test, P = 1.7 × 10 −34 ). AF3 has a very similar dependence on MSA depth to AlphaFold-Multimer v.2.3; proteins with shallow MSAs are predicted with lower accuracy (a comparison of the dependence of single-chain LDDT on MSA depth is shown in Extended Data Fig. 7a ).”concepts[24]
conceptconformational state — not defined in this paper's own words; the particular conformation, such as open or closed, a structure adopts — “In some cases, the modelled conformational state may not be correct or comprehensive given the specified ligands and other inputs. For example, E3 ubiquitin ligases natively adopt an open conformation in an apo state and have been observed only in a closed state when bound to ligands, but AF3 exclusively predicts the closed state for both holo and apo systems 42 (Fig. 5c ). Many methods have been developed, particularly around MSA resampling, that assist in generating diversity from previous AlphaFold models 43 – 45 and may also assist in multistate prediction with AF3.”concepts[25]
conceptstatic structures — not defined in this paper's own words; single fixed structures as deposited in the PDB — “A key limitation of protein structure prediction models is that they typically predict static structures as seen in the PDB, not the dynamical behaviour of biomolecular systems in solution. This limitation persists for AF3, in which multiple random seeds for either the diffusion head or the overall network do not produce an approximation of the solution ensemble.”concepts[26]
conceptsolution ensemble — not defined in this paper's own words; the distribution of conformations a molecule samples in solution — “A key limitation of protein structure prediction models is that they typically predict static structures as seen in the PDB, not the dynamical behaviour of biomolecular systems in solution. This limitation persists for AF3, in which multiple random seeds for either the diffusion head or the overall network do not produce an approximation of the solution ensemble.”concepts[27]
conceptprotein structure prediction — not defined in this paper's own words; computing a protein's 3D structure from sequence — “The core challenge of molecular biology is to understand and ultimately regulate the complex atomic interactions of biological systems. The AF3 model takes a large step in this direction, demonstrating that it is possible to accurately predict the structure of a wide range of biomolecular systems in a unified framework. Although there are still substantial challenges to achieve highly accurate predictions across all interaction types, we demonstrate that it is possible to build a deep-learning system that shows strong coverage and generalization for all of these interactions. We also demonstrate that the lack of cross-entity evolutionary information is not a substantial blocker to progress in predicting these interactions and, moreover, substantial improvement in antibody results suggests AlphaFold-derived methods are able to model the chemistry and physics of classes of molecular interactions without dependence on MSAs. Finally, the large improvement in protein–ligand structure prediction shows that it is possible to handle the wide diversity of chemical space within a general deep-learning framework and without resorting to an artificial separation between protein structure prediction and ligand docking.”concepts[28]
conceptligand docking — not defined in this paper's own words; placing small molecules into protein structures — “The core challenge of molecular biology is to understand and ultimately regulate the complex atomic interactions of biological systems. The AF3 model takes a large step in this direction, demonstrating that it is possible to accurately predict the structure of a wide range of biomolecular systems in a unified framework. Although there are still substantial challenges to achieve highly accurate predictions across all interaction types, we demonstrate that it is possible to build a deep-learning system that shows strong coverage and generalization for all of these interactions. We also demonstrate that the lack of cross-entity evolutionary information is not a substantial blocker to progress in predicting these interactions and, moreover, substantial improvement in antibody results suggests AlphaFold-derived methods are able to model the chemistry and physics of classes of molecular interactions without dependence on MSAs. Finally, the large improvement in protein–ligand structure prediction shows that it is possible to handle the wide diversity of chemical space within a general deep-learning framework and without resorting to an artificial separation between protein structure prediction and ligand docking.”concepts[29]
conceptearly stopping — not defined in this paper's own words; checkpoint selection on a weighted average of metrics — “Figure 2d shows that, during initial training, the model learns quickly to predict the local structures (all intrachain metrics go up quickly and reach 97% of the maximum performance within the first 20,000 training steps), while the model needs considerably longer to learn the global constellation (the interface metrics go up slowly and protein–protein interface LDDT passes the 97% bar only after 60,000 steps). During AF3 development, we observed that some model abilities topped out relatively early and started to decline (most likely due to overfitting to the limited number of training samples for this capability), while other abilities were still undertrained. We addressed this by increasing or decreasing the sampling probability for the corresponding training sets (Supplementary Methods 2.5.1 ) and by performing early stopping using a weighted average of all of the above metrics and some additional metrics to select the best model checkpoint (Supplementary Table 7 ). The fine-tuning stages with the larger crop sizes improve the model on all metrics with an especially high uplift on protein–protein interfaces (Extended Data Fig. 2 ).”concepts[30]
conceptoverfitting — not defined in this paper's own words; capabilities declining after early saturation on few training samples — “Figure 2d shows that, during initial training, the model learns quickly to predict the local structures (all intrachain metrics go up quickly and reach 97% of the maximum performance within the first 20,000 training steps), while the model needs considerably longer to learn the global constellation (the interface metrics go up slowly and protein–protein interface LDDT passes the 97% bar only after 60,000 steps). During AF3 development, we observed that some model abilities topped out relatively early and started to decline (most likely due to overfitting to the limited number of training samples for this capability), while other abilities were still undertrained. We addressed this by increasing or decreasing the sampling probability for the corresponding training sets (Supplementary Methods 2.5.1 ) and by performing early stopping using a weighted average of all of the above metrics and some additional metrics to select the best model checkpoint (Supplementary Table 7 ). The fine-tuning stages with the larger crop sizes improve the model on all metrics with an especially high uplift on protein–protein interfaces (Extended Data Fig. 2 ).”concepts[31]

Full text — tagged

Accurate structure prediction of biomolecular interactions with AlphaFold 3term Abstract The introduction of AlphaFold 2 1 has spurred a revolution in modelling the structure of proteins and their interactions, enabling a huge range of applications in protein modelling and design 2 – 6 . Here we describe our AlphaFold 3term model with a substantially updated diffusion-based architecture that is capable of predicting the joint structure of complexes including proteins, nucleic acids, small molecules, ions and modified residuesterm. The new AlphaFold model demonstrates substantially improved accuracy over many previous specialized tools: far greater accuracy for protein–ligand interactions compared with state-of-the-art dockingterm tools, much higher accuracy for protein–nucleic acid interactions compared with nucleic-acid-specific predictors and substantially higher antibody–antigen prediction accuracy compared with AlphaFold-Multimerterm v.2.3 7 , 8 . Together, these results show that high-accuracy modelling across biomolecular space is possible within a single unified deep-learning framework.

Subject terms: Protein structure predictionsterm, Structural biology, Machine learning, Drug discovery Main Accurate models of biological complexes are critical to our understanding of cellular functions and for the rational design of therapeutics 2 – 4 , 9 . Enormous progress has been achieved in protein structure predictionterm with the development of AlphaFold 1 , and the field has grown tremendously with a number of later methods that build on the ideas and techniques of AlphaFold 2 (AF2) 10 – 12 . Almost immediately after AlphaFold became available, it was shown that simple input modifications would enable surprisingly accurate protein interaction predictions 13 – 15 and that training AF2 specifically for protein interaction prediction yielded a highly accurate system 7 .

These successes lead to the question of whether it is possible to accurately predict the structure of complexes containing a much wider range of biomolecules, including ligands, ions, nucleic acids and modified residuesterm, within a deep-learning framework. A wide range of predictors for various specific interaction types has been developed 16 – 28 , as well as one generalist method developed concurrently with the present work 29 , but the accuracy of such deep-learning attempts has been mixed and often below that of physics-inspired methods 30 , 31 . Almost all of these methods are also highly specialized to particular interaction types and cannot predict the structure of general biomolecular complexes containing many types of entities.

Here we present AlphaFold 3term (AF3)—a model that is capable of high-accuracy prediction of complexes containing nearly all molecular types present in the Protein Data Bankterm 32 (PDB) (Fig. 1a,b ). In all but one category, it achieves a substantially higher performance than strong methods that specialize in just the given task (Fig. 1c and Extended Data Table 1 ), including higher accuracy at protein structure and the structure of protein–protein interactions.

AF3 accurately predicts structures across biomolecular complexes. a , b , Example structures predicted using AF3. a , Bacterial CRP/FNR family transcriptional regulator protein bound to DNA and cGMP (PDB 7PZB ; full-complex LDDTterm 47 , 82.8; global distance test (GDT) 48 , 90.1). b , Human coronavirus OC43 spike protein, 4,665 residues, heavily glycosylated and bound by neutralizing antibodies (PDB 7PNM ; full-complex LDDTterm, 83.0; GDT, 83.1). c , AF3 performance on PoseBustersterm (v.1, August 2023 release), our recent PDB evaluation set and CASP15term RNA. Metrics are as follows: percentage of pocket-aligned ligand r.m.s.d. < 2 Å for ligands and covalent modifications; interface LDDTterm for protein–nucleic acid complexes; LDDTterm for nucleic acid and protein monomers; and percentage DockQterm > 0.23 for protein–protein and protein–antibody interfaces. All scores are reported from the top confidence-ranked sample out of five model seedsterm (each with five diffusion samplesterm), except for protein–antibody scores, which were ranked across 1,000 model seedsterm for both models (each AF3 seed with five diffusion samplesterm). Sampling and ranking details are provided in the Methods . For ligands, n indicates the number of targets; for nucleic acids, n indicates the number of structures; for modifications, n indicates the number of clusters; and for proteins, n indicates the number of clusters. The bar height indicates the mean; error bars indicate exact binomial distribution 95% confidence intervals for PoseBustersterm and by 10,000 bootstrap resamples for all others. Significance levels were calculated using two-sided Fisher’s exact tests for PoseBustersterm and using two-sided Wilcoxon signed-rank tests for all others; *** P < 0.001, ** P < 0.01. Exact P values (from left to right) are as follows: 2.27 × 10 −13 , 2.57 × 10 −3 , 2.78 × 10 −3 , 7.28 × 10 −12 , 1.81 × 10 −18 , 6.54 × 10 −5 and 1.74 × 10 −34 . AF-M 2.3, AlphaFold-Multimerterm v.2.3; dsDNA, double-stranded DNA. d , AF3 architecture for inference. The rectangles represent processing modules and the arrows show the data flow. Yellow, input data; blue, abstract network activations; greenpersName, output data. The coloured balls represent physical atom coordinates.

Prediction accuracy across biomolecular complexes This is achieved by a substantial evolution of the AF2 architecture and training procedure (Fig. 1d ) both to accommodate more general chemical structures and to improve the data efficiency of learning. The system reduces the amount of multiple-sequence alignmentterm (MSA) processing by replacing the AF2 evoformerterm with the simpler pairformerterm module (Fig. 2a ). Furthermore it directly predicts the raw atom coordinates with a diffusion moduleterm, replacing the AF2 structure moduleterm that operated on amino-acid-specific frames and side-chain torsion angles (Fig. 2b ). The multiscale nature of the diffusion process (lowpersName noise levels induce the network to improve local structure) also enable us to eliminate stereochemical losses and most special handling of bonding patterns in the network, easily accommodating arbitrary chemical components.

Architectural and training details. a , The pairformerterm module. Input and output: pair representation with dimension ( n , n , c ) and single representation with dimension ( n , c ). n is the number of tokens (polymer residues and atoms); c is the number of channels (128 for the pair representation, 384 for the single representation). Each of the 48 blocks has an independent set of trainable parameters. b , The diffusion moduleterm. Input: coarse arrays depict per-token representations (greenpersName, inputs; blue, pair; red, single). Fine arrays depict per-atom representations. The coloured balls represent physical atom coordinates. Cond., conditioning; rand. rot. trans., random rotation and translation; seq., sequence. c , The training set-up (distogram head omitted) starting from the end of the network trunk. The coloured arrays show activations from the network trunk (greenpersName, inputs; blue, pair; red, single). The blue arrows show abstract activation arrays. The yellow arrows show ground-truth data. The greenpersName arrows show predicted data. The stop sign represents stopping of the gradient. Both depicted diffusion modulesterm share weights. d , Training curves for initial training and fine-tuning stages, showing the LDDTterm on our evaluation set as a function of optimizer steps. The scatter plot shows the raw datapoints and the lines show the smoothed performance using a median filter with a kernel width of nine datapoints. The crosses mark the point at which the smoothed performance reaches 97% of its initial training maximum.

Network architecture and training The overall structure of AF3 (Fig. 1d and Supplementary Methods 3 ) echoes that of AF2, with a large trunk evolving a pairwise representation of the chemical complex followed by a structure moduleterm that uses the pairwise representation to generate explicit atomic positions, but there are large differences in each major component. These modifications were driven both by the need to accommodate a wide range of chemical entities without excessive special casing and by observations of AF2 performance with different modifications. Within the trunk, MSA processing is substantially de-emphasized, with a much smaller and simpler MSA embedding block (Supplementary Methods 3.3 ). Compared with the original evoformerterm from AF2, the number of blocks is reduced to four, the processing of the MSA representation uses an inexpensive pair-weighted averaging and only the pair representation is used for later processing steps. The ‘pairformerterm’ (Fig. 2a and Supplementary Methods 3.6 ) replaces the evoformerterm of AF2 as the dominant processing block. It operates only on the pair representation and the single representation; the MSA representation is not retained and all information passes through the pair representation. The pair processing and the number of blocks (48) is largely unchanged from AF2. The resulting pair and single representation together with the input representation are passed to the new diffusion moduleterm (Fig. 2b ) that replaces the structure moduleterm of AF2.

The diffusion moduleterm (Fig. 2b and Supplementary Methods 3.7 ) operates directly on raw atom coordinates, and on a coarse abstract token representation, without rotational frames or any equivariant processing. We had observed in AF2 that removing most of the complexity of the structure moduleterm had only a modest effect on the prediction accuracy, and maintaining the backbone frame and side-chain torsion representation add quite a bit of complexity for general molecular graphs. Similarly AF2 required carefully tuned stereochemical violation penalties during training to enforce chemical plausibility of the resulting structures. We use a relatively standard diffusion approach 33 in which the diffusion model is trained to receive ‘noised’ atomic coordinates and then predict the true coordinates. This task requires the network to learn protein structure at a variety of length scales, whereby the denoising task at small noise emphasizes understanding very local stereochemistry and the denoising task at high noise emphasizes the large-scale structure of the system. At the inference time, random noise is sampled and then recurrently denoised to produce a final structure. Importantly, this is a generative training procedure that produces a distribution of answers. This means that, for each answer, the local structure will be sharply defined (for example, side-chain bond geometry) even when the network is uncertain about the positions. For this reason, we are able to avoid both torsion-based parametrizations of the residues and violation losses on the structure, while handling the full complexity of general ligands. Similarly to some recent work 34 , we find that no invariance or equivariance with respect to global rotations and translation of the molecule are required in the architecture and we therefore omit them to simplify the machine learning architecture.

The use of a generative diffusion approach comes with some technical challenges that we needed to address. The biggest issue is that generative models are prone to hallucinationterm 35 , whereby the model may invent plausible-looking structure even in unstructured regions. To counteract this effect, we use a cross-distillationterm method in which we enrich the training data with structures predicted by AlphaFold-Multimerterm (v.2.3) 7 , 8 . In these structures, unstructured regions are typically represented by long extended loops instead of compact structures, and training on them ‘teaches’ AF3 to mimic this behaviour. This cross-distillationterm greatly reduced the hallucinationterm behaviour of AF3 (Extended Data Fig. 1 for disorder prediction results on the CAID 2 36 benchmark set).

Disordered region prediction. a , Example prediction for a disordered protein from AlphaFoldMultimerterm v2.3, AlphaFold 3term, and AlphaFold 3term trained without the disordered protein PDB cross distillationterm set. Protein is DP02376 from the CAID 2 (Critical Assessment of protein Intrinsic Disorder prediction) set. Predictions coloured by pLDDTterm (orange: pLDDTterm <= 50, yellow: 50 < pLDDTterm <= 70, light blue: 70 < pLDDTterm <= 90, and dark blue: 90 <= pLDDTterm < 100). b , Predictions of disorder across residues in proteins in the CAID 2 set, which are also lowpersName homologyterm·def to the AF3 training set. Prediction methods include RASA (relative accessible surface area) and pLDDTterm (N = 151 proteins; 46,093 residues).

We also developed confidence measures that predict the atom-level and pairwise errors in our final structures. In AF2, this was done directly by regressing the error in the output of the structure moduleterm during training. However, this procedure is not applicable to diffusion training, as only a single step of the diffusion is trained instead of a full-structure generation (Fig. 2c ). To remedy this, we developed a diffusion ‘rollout’ procedure for the full-structure prediction generation during training (using a larger step size than normal; Fig. 2c (mini-rollout)). This predicted structure is then used to permute the symmetric ground-truth chains and ligands, and to compute the performance metrics to train the confidence head. The confidence head uses the pairwise representation to predict a modified local distance difference test (pLDDTterm) and a predicted aligned errorterm (PAE) matrix as in AF2, as well as a distance error matrixterm (PDE), which is the error in the distance matrix of the predicted structure as compared to the true structure (details are provided in Supplementary Methods 4.3 ).

Figure 2d shows that, during initial training, the model learns quickly to predict the local structures (all intrachain metrics go up quickly and reach 97% of the maximum performance within the first 20,000 training steps), while the model needs considerably longer to learn the global constellation (the interface metrics go up slowly and protein–protein interface LDDTterm passes the 97% bar only after 60,000 steps). During AF3 development, we observed that some model abilities topped out relatively early and started to decline (most likely due to overfittingterm to the limited number of training samples for this capability), while other abilities were still undertrained. We addressed this by increasing or decreasing the sampling probability for the corresponding training sets (Supplementary Methods 2.5.1 ) and by performing early stoppingterm using a weighted average of all of the above metrics and some additional metrics to select the best model checkpoint (Supplementary Table 7 ). The fine-tuning stages with the larger crop sizes improve the model on all metrics with an especially high uplift on protein–protein interfaces (Extended Data Fig. 2 ).

Accuracy across training. Training curves for initial training and fine tuning showing LDDTterm (local distance difference test) on our evaluation set as a function of optimizer steps. One optimizer step uses a mini batch of 256 trunk samples and during initial training 256 * 48 = 12,288 diffusion samplesterm. For fine tuning the number of diffusion samplesterm is reduced to 256 * 32 = 8,192. The scatter plot shows the raw data points and the lines show the smoothed performance using a median filter with a kernel width of 9 data points. The dashed lines mark the points where the smoothed performance passes 90% and 97% of the initial training maximum for the first time.

Accuracy across complex types AF3 can predict structures from input polymer sequences, residue modifications and ligand SMILES (simplified molecular-input line-entry system). In Fig. 3 we show a selection of examples highlighting the ability of the model to generalize to a number of biologically important and therapeutically relevant modalities. In selecting these examples, we considered novelty in terms of the similarity of individual chains and interfaces to the training set (additional information is provided in Supplementary Methods 8.1 ).

Examples of predicted complexes. Selected structure predictions from AF3. Predicted protein chains are shown in blue (predicted antibody in greenpersName), predicted ligands and glycans in orange, predicted RNA in purple and the ground truth is shown in grey. a , Human 40S small ribosomal subunit (7,663 residues) including 18S ribosomal RNA and Met-tRNA i Met (opaque purple) in a complex with translation initiation factors eIF1A and eIF5B (opaque blue; PDB 7TQL ; full-complex LDDTterm, 87.7; GDT, 86.9). b , The glycosylated globular portion of an EXTL3 homodimer (PDB 7AU2 ; mean pocket-aligned r.m.s.d.term·var, 1.10 Å). c , Mesothelin C-terminal peptide bound to the monoclonal antibody 15B6 (PDB 7U8C ; DockQterm, 0.85). d , LGK974, a clinical-stage inhibitor, bound to PORCN in a complex with the WNT3A peptide (PDB 7URD ; ligand r.m.s.d., 1.00 Å). e , (5S,6S)-O7-sulfo DADH bound to the AziU3/U2 complex with a novel fold (PDB 7WUX ; ligand r.m.s.d., 1.92 Å). f , Analogue of NIH-12848 bound to an allosteric site of PI5P4Kγ (PDB 7QIE ; ligand r.m.s.d., 0.37 Å).

We evaluated the performance of the system on recent interface-specific benchmarks for each complex type (Fig. 1c and Extended Data Table 1 ). Performance on protein–ligand interfaces was evaluated on the PoseBustersterm benchmark set, which is composed of 428 protein–ligand structures released to the PDB in 2021 or later. As our standard training cut-off date is in 2021, we trained a separate AF3 model with an earlier training-set cutoff ( Methods ). Accuracy on the PoseBustersterm set is reported as the percentage of protein–ligand pairs with pocket-aligned ligand root mean squared deviation (r.m.s.d.) of less than 2 Å. The baseline models come in two categories: those that use only protein sequence and ligand SMILES as an input and those that additionally leak information from the solved protein–ligand test structure. Traditional dockingterm methods use the latter privileged information, even though that information would not be available in real-world use cases. Even so, AF3 greatly outperforms classical dockingterm tools such as Vina 37 , 38 even while not using any structural inputs (Fisher’s exact test, P = 2.27 × 10 −13 ) and greatly outperforms all other true blind dockingterm like RoseTTAFold All-Atom ( P = 4.45 × 10 −25 ). Extended Data Fig. 3 shows three examples in which AF3 achieves accurate predictions but dockingterm tools Vina and Gold do not 37 . PoseBustersterm analysis was performed using a training cut-off of 30 September 2019 for AF3 to ensure that the model was not trained on any PoseBustersterm structures. To compare with the RoseTTAFold All-Atom results, we used PoseBustersterm version 1. Version 2 (crystal contacts removed from the benchmark set) results including quality metrics are shown in Extended Data Fig. 4b–f and Extended Data Table 1 . We use multiple seeds to ensure correct chiralityterm and avoid slight protein–ligand clashing (as opposed to a method like diffusion guidance to enforce) but we are typically able to produce high-quality stereochemistry. Separately, we also train a version of AF3 that receives the ‘pocket information’ as used in some recent deep-learning work 24 , 26 (the results are shown in Extended Data Fig. 4a ).

AlphaFold 3term predictions of PoseBustersterm examples for which Vina and Gold were inaccurate. Predicted protein chains are shown in blue, predicted ligands in orange, and ground truth in grey. a , Human Notum bound to inhibitor ARUK3004556 (PDB ID 8BTI, ligand RMSD: 0.65 Å). b , Pseudomonas sp. PDC86 Aapf bound to HEHEAA (PDB ID 7KZ9, ligand RMSD: 1.3 Å). c , Human Galectin-3 carbohydrate-recognition domain in complex with compound 22 (PDB ID 7XFA, ligand RMSD: 0.44 Å).

PoseBustersterm analysis. a , Comparison of AlphaFold 3term and baseline method protein-ligand binding success on the PoseBustersterm Version 1 benchmark set (V1, August 2023 release). Methods classified by the extent of ground truth information used to make predictions. Note all methods that use pocket residue information except for UMol and AF3 also use ground truth holo protein structures. b , PoseBustersterm Version 2 (V2, November 2023 release) comparison between the leading dockingterm method Vina and AF3 2019 (two-sided Fisher exact test, N = 308 targets, p = 2.3 * 10 −8 ). c , PoseBustersterm V2 results of AF3 2019 on targets with lowpersName, moderate, and high protein sequence homologyterm·def (integer ranges indicate maximum sequence identity with proteins in the training set). d , PoseBustersterm V2 results of AF3 2019 with ligands split by those characterized as “common natural” ligands and others. “Common natural” ligands are defined as those which occur greater than 100 times in the PDB and which are not non-natural (by visual inspection). A full list may be found in Supplementary Table 15 . Dark bar indicates RMSD < 2 Å and passing PoseBustersterm validity checks (PB-valid). e , PoseBustersterm V2 structural accuracy and validity. Dark bar indicates RMSD < 2 Å and passing PoseBustersterm validity checks (PB-valid). Light hashed bar indicates RMSD < 2 Å but not PB valid. f , PoseBustersterm V2 detailed validity check comparison. Error bars indicate exact binomial distribution 95% confidence intervals. N = 427 targets for RoseTTAFold All-Atom and 428 targets for all others in Version 1; 308 targets in Version 2.

AF3 predicts protein–nucleic complexes and RNA structures with higher accuracy than RoseTTAFold2NAterm 15 (Fig. 1c (second plot)). As RoseTTAFold2NAterm is validated only on structures below 1,000 residues, we use only structures below 1,000 residues from our recent PDB evaluation set for this comparison ( Methods ). AF3 is able to predict protein–nucleic structures with thousands of residues, an example of which is shown in Fig. 3a . Note that we do not compare directly to RoseTTAFold All-Atom, but benchmarks indicate that RoseTTAFold All-Atom is slightly less accurate than RoseTTAFold2NAterm for nucleic acid predictions 29 .

We also evaluated AF3 performance on the ten publicly available Critical Assessment of Structure Prediction 15 (CASP15term) RNA targets: we achieve a higher average performance than RoseTTAFold2NAterm and AIchemy_RNA 27 (the best AI-based submission in CASP15term 18 , 31 ) on the respective common subsets of our and their predictions (detailed results are shown in Extended Data Fig. 5a ). We did not reach the performance of the best human-expert-aided CASP15term submission AIchemy_RNA2 39 (Fig. 1c (centre left)). Owing to limited dataset sizes, we do not report significance test statistics here. Further analysis of the accuracy of predicting nucleic acids alone (without proteins) is shown in Extended Data Fig. 5b .

Nucleic acid prediction accuracy and confidences. a , CASP15term RNA prediction accuracy from AIChemy_RNA (the top AI-based submission), RoseTTAFold2NAterm (the AI-based method capable of predicting proteinRNA complexes), and AlphaFold 3term. Ten of the 13 targets are available in the PDB or via the CASP15term website for evaluation. Predictions are downloaded from the CASP website for external models. b , Accuracy on structures containing lowpersName homologyterm·def RNA-only or DNA-only complexes from the recent PDB evaluation set. Comparison between AlphaFold 3term and RoseTTAFold2NAterm (RF2NA) (RNA: N = 29 structures, paired Wilcoxon signed-rank test, p = 1.6 * 10 −7 ; DNA: N = 63 structures, paired two-sided Wilcoxon signed-rank test, p = 5.2 * 10 −12 ). Note RF2NA was only trained and evaluated on duplexes (chains forming at least 10 hydrogen bonds), but some DNA structures in this set may not be duplexes. Box, centerline, and whiskers boundaries are at (25%, 75%) intervals, median, and (5%, 95%) intervals. c Predicted structure of a mycobacteriophage immunity repressor protein bound to double stranded DNA (PDB ID 7R6R), coloured by pLDDTterm (left; orange: 0–50, yellow: 50–70, cyan 70–90, and blue 90–100) and chain id (right). Note the disordered N-terminus not entirely shown. d , Predicted aligned errorterm (PAE) per token-pair for the prediction in c with rows and columns labelled by chain id and greenpersName gradient indicating PAE.

Covalent modifications (bonded ligands, glycosylation, and modified protein residues and nucleic acid bases) are also accurately predicted by AF3 (Fig. 1c (centre right)). Modifications include those to any polymer residue (protein, RNA or DNA). We report accuracy as the percentage of successful predictions (pocket r.m.s.d. < 2 Å). We apply quality filters to the bonded ligands and glycosylation dataset (as does PoseBustersterm): we include only ligands with high-quality experimental data (ranking_model_fit > 0.5, according to the RCSB structure validation report, that is, X-ray structures with a model quality above the median). As with the PoseBustersterm set, the bonded ligands and glycosylation datasets are not filtered by homologyterm·def to the training dataset. Filtering on the basis of the bound polymer chain homologyterm·def (using polymer template similarity < 40) yielded only five clusters for bonded ligands and seven clusters for glycosylation. We exclude multi-residue glycans here because the RCSB validation report does not provide a ranking_model_fit value for them. The percentage of successful predictions (pocket r.m.s.d. < 2 Å) for multi-residue glycans on all-quality experimental data is 42.1% ( n = 131 clusters), which is slightly lower than the success rate for single-residue glycans on all-quality experimental data of 46.1% ( n = 167). The modified residuesterm dataset is filtered similarly to our other polymer test sets: it contains only modified residuesterm in polymer chains with lowpersName homologyterm·def to the training set ( Methods ). See Extended Data Table 1 for detailed results, and Extended Data Fig. 6 for examples of predicted protein, DNA and RNA structures with covalent modifications, including analysis of the impact of phosphorylation on predictions.

Analysis and examples for modified proteins and nucleic acids. a , Accuracy on structures. containing common phosphorylation residues (SEP, TPO, PTR, NEP, HIP) from the recent PDB evaluation set. Comparison between AlphaFold 3term with phosphorylation modelled, and AlphaFold 3term without modelling phosphorylation (N = 76 clusters, paired two-sided Wilcoxon signed-rank test, p = 1.6 * 10 −4 ). Note, to predict a structure without modelling phosphorylation, we predict the parent (standard) residue in place of the modification. AlphaFold 3term generally achieves better backbone accuracy when modelling phosphorylation. Error bars indicate exact binomial distribution 95% confidence intervals. b , SPOC domain of human SHARP in complex with phosphorylated RNA polymerase II C-terminal domain (PDB ID 7Z1K), predictions coloured by pLDDTterm (orange: 0–50, yellow: 50–70, cyan 70–90, and blue 90–100). Left: Phosphorylation modelled (mean pocket-aligned RMSD Cα 2.104 Å). Right: Without modelling phosphorylation (mean pocketaligned RMSD Cα 10.261 Å). When excluding phosphorylation, AlphaFold 3term provides lower pLDDTterm confidence on the phosphopeptide. c , Structure of parkin bound to two phospho-ubiquitin molecules (PDB ID 7US1), predictions similarly coloured by pLDDTterm. Left: Phosphorylation modelled (mean pocket-aligned RMSD Cα 0.424 Å). Right: Without modelling phosphorylation (mean pocket-aligned RMSD Cα 9.706 Å). When excluding phosphorylation, AlphaFold 3term provides lower pLDDTterm confidence on the interface residues of the incorrectly predicted ubiquitin. d , Example structures with modified nucleic acids. Left: Guanosine monophosphate in RNA (PDB ID 7TNZ, mean pocket-aligned modified residueterm RMSD 0.840 Å). Right: Methylated DNA cytosines (PDB ID 7SDW, mean pocket-aligned modified residueterm RMSD 0.502 Å). Welabel residues of the predicted structure for reference. Ground truth structure in grey; predicted protein in blue, predicted RNA in purple, predicted DNA in magenta, predicted ions in orange, with predicted modifications highlighted via spheres.

While expanding in modelling abilities, AF3 has also improved in protein complex accuracy relative to AlphaFold-Multimerterm (v.2.3) 7 , 8 . Generally, protein–protein prediction success (DockQterm > 0.23) 40 has increased (paired Wilcoxon signed-rank test, P = 1.8 × 10 −18 ), with antibody–protein interaction prediction in particular showing a marked improvement (Fig. 1c (right); paired Wilcoxon signed-rank test, P = 6.5 × 10 −5 , predictions top-ranked from 1,000 rather than the typical 5 seeds; further details are provided in Fig. 5a ). Protein monomer LDDTterm improvement is also significant (paired Wilcoxon signed-rank test, P = 1.7 × 10 −34 ). AF3 has a very similar dependence on MSA depthterm to AlphaFold-Multimerterm v.2.3; proteins with shallow MSAs are predicted with lower accuracy (a comparison of the dependence of single-chain LDDTterm on MSA depthterm is shown in Extended Data Fig. 7a ).

Model limitations. a , Antibody prediction quality increases with the number of model seedsterm. The quality of top-ranked, low-homology antibody–antigen interface predictions as a function of the number of seeds. Each datapoint shows the mean over 1,000 random samples (with replacement) of seeds to rank over, out of 1,200 seeds. Confidence intervals are 95% bootstraps over 10,000 resamples of cluster scores at each datapoint. Samples per interface are ranked by protein–protein ipTMterm. Significance tests were performed using by two-sided Wilcoxon signed-rank tests. n = 65 clusters. Exact P values were as follows: 2.0 × 10 −5 (percentage correct) and P = 0.009 (percentage very high accuracy). b , Prediction (coloured) and ground-truth (grey) structures of Thermotoga maritima α-glucuronidase and beta- d -glucuronic acid—a target from the PoseBustersterm set (PDB: 7CTM ). AF3 predicts alpha- d -glucuronic acid; the differing chiral centre is indicated by an asterisk. The prediction shown is top-ranked by ligand–protein ipTMterm and with a chiralityterm and clash penalty. c , Conformation coverage is limited. Ground-truth structures (grey) of cereblon in open (apo, PDB: 8CVP ; left) and closed (holo mezigdomide-bound, PDB: 8D7U ; right) conformations. Predictions (blue) of both apo (with 10 overlaid samples) and holo structures are in the closed conformation. The dashed lines indicate the distance between the N-terminal Lon protease-like and C-terminal thalidomide-binding domain. d , A nuclear pore complex with 1,854 unresolved residues (PDB: 7F60 ). The ground truth (left) and predictions from AlphaFold-Multimerterm v.2.3 (middle) and AF3 (right) are shown. e , Prediction of a trinucleosome with overlapping DNA (pink) and protein (blue) chains (PDB: 7PEU ); highlighted are overlapping protein chains B and J and self-overlapping DNA chain AA. Unless otherwise stated, predictions are top-ranked by our global complex ranking metric with chiral mismatch and steric clash penalties (Supplementary Methods 5.9.1 ).

Model accuracy with MSA size and number of seeds. a , Effect of MSA depthterm on protein prediction accuracy. Accuracy is given as single chain LDDTterm score and MSA depthterm is computed by counting the number of non-gap residues for each position in the MSA using the N eff weighting scheme and taking the median across residues (see Methods for details on N eff ). MSA used for AF-M 2.3 differs slightly from AF3; the data uses the AF3 MSA depthterm for both to make the comparison clearer. The analysis uses every protein chain in the lowpersName homologyterm·def Recent PDB setterm·def, restricted to chains in complexes with fewer than 20 protein chains and fewer than 2,560 tokens (see Methods for details on Recent PDB setterm·def and comparisons to AF-M 2.3). The curves are obtained through Gaussian kernel average smoothing (window size is 0.2 units in log10( N eff )); the shaded area is the 95% confidence interval estimated using bootstrap of 10,000 samples. b , Increase in ranked accuracy with number of seeds for different molecule types. Predictions are ranked by confidence, and only the most confident per interface is scored. Evaluated on the lowpersName homologyterm·def recent PDB setterm·def, filtered to less than 1,536 tokens. Number of clusters evaluated: dna-intra = 386, protein-intra = 875, rnaintra = 78, protein-dna = 307, protein-rna = 102, protein-protein (antibody = False) = 697, protein-protein (antibody = True) = 58. Confidence intervals are 95% bootstraps over 1,000 samples.

Predicted confidences track accuracy As with AF2, AF3 confidence measures are well calibrated with accuracy. Our confidence analysis is performed on the recent PDB evaluation set, with no homologyterm·def filtering and including peptides. The ligands category is filtered to high-quality experimental structures as described above, and considers standard non-bonded ligands only. See Extended Data Fig. 8 for a similar assessment on bonded ligand and other interfaces. All statistics are cluster-weighted ( Methods ) and consider the top-ranked prediction only (ranking details are provided in Supplementary Methods 5.9.3 ).

Relationship between confidence and accuracy for protein interactions with ions, bonded ligands and bonded glycans. Accuracy is given as the percentage of interface clusters under various pocket-aligned RMSD thresholds, as a function of the chain pair ipTMterm of the interface. The ions group includes both metals and nonmetals. N values report the number of clusters in each band. For a similar analysis on general ligand-protein interfaces, see Fig. 4 of main text.

In Fig. 4a (top row), we plot the chain pair interface-predicted TM (ipTMterm) score 41 (Supplementary Methods 5.9.1 ) against interface accuracy measures: protein–protein DockQterm, protein–nucleic interface LDDTterm (iLDDTterm·def) and protein–ligand success, with success defined as the percentage of examples under thresholded pocket-aligned r.m.s.d.term·var values. In Fig. 4a (bottom row), we plot the average pLDDTterm per protein, nucleotide or ligand entity against our bespoke LDDT_to_polymerterm·def metric (metrics details are provided in the Methods ), which is closely related to the training target of the pLDDTterm predictor.

AF3 confidences track accuracy. a , The accuracy of protein-containing interfaces as a function of chain pair ipTMterm (top). Bottom, the LDDT-to-polymer accuracy was evaluated for various chain types as a function of chain-averaged pLDDTterm. The box plots show the 25–75% confidence intervals (box limits), the median (centre line) and the 5–95% confidence intervals (whiskers). n values report the number of clusters in each band. b , The predicted structure of PDB 7T82 coloured by pLDDTterm (orange, 0–50; yellow, 50–70; cyan, 70–90; and blue, 90–100). c , The same prediction coloured by chain. d , DockQterm scores for protein–protein interfaces. e , PAE matrix of same prediction (darker is more confident), with chain colouring of c on the side bars. The dashed black lines indicate the chain boundaries.

In Fig. 4b–e , we highlight a single example prediction of 7T82 , in which per-atom pLDDTterm colouring identifies unconfident chain tails, somewhat confident interfaces and otherwise confident secondary structure. In Fig. 4c , the same prediction is coloured by chain, along with DockQterm interface scores in Fig. 4d and per-chain colouring displayed on the axes for reference. We see from Fig. 4e that PAE confidence is high for pink–grey and blue–orange residue pairs for which DockQterm > 0.7, and least confident about pink–orange and pink–blue residue pairs that have DockQterm ≈ 0. A similar PAE analysis of an example with protein and nucleic acid chains is shown in Extended Data Fig. 5c,d .

Model limitations We note model limitations of AF3 with respect to stereochemistry, hallucinationsterm, dynamics and accuracy for certain targets.

On stereochemistry, we note two main classes of violations. The first is that the model outputs do not always respect chiralityterm (Fig. 5b ), despite the model receiving reference structures with correct chiralityterm as input features. To address this in the PoseBustersterm benchmark, we included a penalty for chiralityterm violation in our ranking formula for model predictions. Despite this, we still observe a chiralityterm violation rate of 4.4% in the benchmark. The second class of stereochemical violations is a tendency of the model to occasionally produce overlapping (clashing) atoms in the predictions. This sometimes manifests as extreme violations in homomers in which entire chains have been observed to overlap (Fig. 5e ). Penalizing clashes during ranking (Supplementary Methods 5.9.3 ) reduces the occurrence of this failure mode but does not eliminate them. Almost all remaining clashes occur for protein–nucleic complexes with both greater than 100 nucleotides and greater than 2,000 residues in total.

We note that the switch from the non-generative AF2 model to the diffusion-based AF3 model introduces the challenge of spurious structural order (hallucinationsterm) in disordered regions (Fig. 5d and Extended Data Fig. 1 ). Although hallucinated regions are typically marked as very lowpersName confidence, they can lack the distinctive ribbon-like appearance that AF2 produces in disordered regions. To encourage ribbon-like predictions in AF3, we use distillation training from AF2 predictions, and we add a ranking term to encourage results with more solvent accessible surface area 36 .

A key limitation of protein structure predictionterm models is that they typically predict static structuresterm as seen in the PDB, not the dynamical behaviour of biomolecular systems in solution. This limitation persists for AF3, in which multiple random seeds for either the diffusion head or the overall network do not produce an approximation of the solution ensembleterm.

In some cases, the modelled conformational stateterm may not be correct or comprehensive given the specified ligands and other inputs. For example, E3 ubiquitin ligases natively adopt an open conformation in an apo state and have been observed only in a closed state when bound to ligands, but AF3 exclusively predicts the closed state for both holo and apo systems 42 (Fig. 5c ). Many methods have been developed, particularly around MSA resampling, that assist in generating diversity from previous AlphaFold models 43 – 45 and may also assist in multistate prediction with AF3.

Despite the large advance in modelling accuracy in AF3, there are still many targets for which accurate modelling can be challenging. To obtain the highest accuracy, it may be necessary to generate a large number of predictions and rank them, which incurs an extra computational cost. A class of targets in which we observe this effect strongly is antibody–antigen complexes, similar to other recent work 46 . Figure 5a shows that, for AF3, top-ranked predictions keep improving with more model seedsterm, even at as many as 1,000 (Wilcoxon signed-rank test between 5 and 1,000 seeds, P = 2.0 × 10 −5 for percentage correct and P = 0.009 for percentage very high accuracy; ranking by protein–protein interface ipTMterm). This large improvement with many seeds is not observed in general for other classes of molecules (Extended Data Fig. 7b ). Using only one diffusion sampleterm per model seedterm for the AF3 predictions rather than five (not illustrated) does not change the results significantly, indicating that running more model seedsterm is necessary for antibody score improvements, rather than just more diffusion samplesterm.

Discussion The core challenge of molecular biology is to understand and ultimately regulate the complex atomic interactions of biological systems. The AF3 model takes a large step in this direction, demonstrating that it is possible to accurately predict the structure of a wide range of biomolecular systems in a unified framework. Although there are still substantial challenges to achieve highly accurate predictions across all interaction types, we demonstrate that it is possible to build a deep-learning system that shows strong coverage and generalization for all of these interactions. We also demonstrate that the lack of cross-entity evolutionary information is not a substantial blocker to progress in predicting these interactions and, moreover, substantial improvement in antibody results suggests AlphaFold-derived methods are able to model the chemistry and physics of classes of molecular interactions without dependence on MSAs. Finally, the large improvement in protein–ligand structure prediction shows that it is possible to handle the wide diversity of chemical space within a general deep-learning framework and without resorting to an artificial separation between protein structure predictionterm and ligand dockingterm.

The development of bottom-up modelling of cellular components is a key step in unravelling the complexity of molecular regulation within the cell, and the performance of AF3 shows that developing the right deep-learning frameworks can massively reduce the amount of data required to obtain biologically relevant performance on these tasks and amplify the impact of the data already collected. We expect that structural modelling will continue to improve not only due to advances in deep learning but also because continuing methodological advances in experimental structure determination, such as the substantial improvements in cryo-electron microscopy and tomography, will provide a wealth of new training data to further the improve the generalization ability of such models. The parallel developments of experimental and computational methods promise to propel us further into an era of structurally informed biological understanding and therapeutic development.

Methods Full algorithm details Extensive explanations of the components are available in Supplementary Methods 2 – 5 . Moreover, pseudocode is available in Supplementary Algorithms 1 – 31 , network diagrams in Figs. 1d and 2a–c and Supplementary Fig. 2 , input features in Supplementary Table 5 and additional hyperparameters for training in Supplementary Tables 3 , 4 and 7 .

Training regime No structural data used during training were released after 30 September 2021 and, for the model used in PoseBustersterm evaluations, we filtered out PDB 32 structures released after 30 September 2021. One optimizer step uses a mini batch of 256 input data samples and during initial training 256 × 48 = 12,288 diffusion samplesterm. For fine-tuning, the number of diffusion samplesterm is reduced to 256 × 32 = 8,192. The model is trained in three stages—the initial training with a crop size of 384 tokens and two sequential fine tuning stages with crop sizes of 640 and 768 tokens. Further details are provided in Supplementary Methods 5.2 .

Inference regime No inference time templates or reference ligand position features were released after 30 September 2021, and in the case of PoseBustersterm evaluation, an earlier cut-off date of 30 September 2019 was used. The model can be run with different random seeds to generate alternative results, with a batch of diffusion samplesterm per seed. Unless otherwise stated, all results are generated by selecting the top confidence sample from running 5 seeds of the same trained model, with 5 diffusion samplesterm per model seedterm, for a total of 25 samples to choose from. Standard crystallization aids are excluded from predictions (Supplementary Table 8 ).

Results are shown for the top-ranked sample and sample ranking depends on whether trying to select the overall best output globally, or the best output for some chain, interface or modified residueterm. Global ranking uses a mix of pTM and ipTMterm along with terms to reduce cases with large numbers of clashes and increase rates of disorder; individual chain ranking uses a chain specific pTM measure; interface ranking uses a bespoke ipTMterm measure for the relevant chain pair; and modified residueterm ranking uses average pLDDTterm over the residue of interest (Supplementary Methods 5.9.3 ).

Metrics Evaluation compares a predicted structure to the corresponding ground-truth structure. If the complex contains multiple identical entities, assignment of the predicted units to the ground-truth units is found by maximizing LDDTterm. Assignment in local symmetry groups of atoms in ligands is solved by exhaustive search over the first 1,000 per-residue symmetries as given by RDKit.

We measure the quality of the predictions with DockQterm, LDDTterm or pocket-aligned r.m.s.d.term·var For nucleic–protein interfaces, we measure interface accuracy through iLDDTterm·def, which is calculated from distances between atoms across different chains in the interface. DockQterm and iLDDTterm·def are highly correlated (Extended Data Fig. 9 ), so the standard cut-offs for DockQterm can be translated to equivalent iLDDTterm·def cut-offs. Nucleic acid LDDTsterm (intrachains and interface) were calculated with an inclusion radius of 30 Å compared with the usual 15 Å used for proteins, owing to their larger scale. For confidence calibration assessment, we use a bespoke LDDTterm (LDDT_to_polymerterm·def) metric that considers differences from each atom of a given entity to any C α or C1′ polymer atom within its inclusion radius. This is closely related to how the confidence prediction is trained (Supplementary Methods 4.3.1 ).

Correlation of DockQterm and iLDDTterm·def for protein-protein interfaces. One data point per cluster, 4,182 clusters shown. Line of best fit with a Huber regressor with epsilon 1. DockQterm categories correct (>0.23), and very high accuracy (>0.8) correspond to iLDDTsterm·def of 23.6 and 77.6 respectively.

Pocket-aligned r.m.s.d.term·var is computed as follows: the pocket is defined as all heavy atoms within 10 Å of any heavy atom of the ligand, restricted to the primary polymer chain for the ligand or modified residueterm being scored, and further restricted to only backbone atoms for proteins. The primary polymer chain is defined variously: for PoseBustersterm, it is the protein chain with the most atoms within 10 Å of the ligand; for bonded ligand scores, it is the bonded polymer chain; and for modified residuesterm, it is the chain in which the residue is contained (minus that residue). The pocket is used to align the predicted structure to the ground-truth structure with least-squares rigid alignment and then the r.m.s.d. is computed on all heavy atoms of the ligand.

Recent PDB evaluation set General model evaluation was performed on our recent PDB setterm·def consisting of 8,856 PDB complexes released between 1 May 2022 and 12 January 2023. The set contains almost all PDB complexes released during that period that are less than 5,120 model tokens in size (Supplementary Methods 6.1 ). Single chains and interfaces within each structure were scored separately rather than only looking at full complex scores, and clustering was then applied to chains and interfaces so that scores could be aggregated first within clusters and then across clusters for mean scores, or using a weighting of inverse cluster size for distributional statistics (Supplementary Methods 6.2 and 6.4 ).

Evaluation on ligands excludes standard crystallization aids (Supplementary Table 8 ), our ligand exclusion list (Supplementary Table 9 ) and glycans (Supplementary Table 10 ). Bonded and non-bonded ligands are evaluated separately. Ions are only included when specifically mentioned (Supplementary Table 11 ).

The recent PDB setterm·def is filtered to a lowpersName homologyterm·def subset (Supplementary Methods 6.1 ) for some results where stated. Homologyterm·def is defined as sequence identity to sequences in the training set and is measured by template search (Supplementary Methods 2.4 ). Individual polymer chains in evaluation complexes are filtered out if the maximum sequence identity to chains in the training set is greater than 40%, where sequence identity is the percentage of residues in the evaluation set chain that are identical to the training set chain. Individual peptide chains (protein chains with less than 16 residues) are always filtered out. For polymer–polymer interfaces, if both polymers have greater than 40% sequence identity to two chains in the same complex in the training set, then the interface is filtered out. For interfaces to a peptide, the interface is filtered out if the non-peptide entity has greater than 40% sequence identity to any chain in the training set.

To compare the quality of prediction of protein–protein interfaces and protein monomers against that of AlphaFold-Multimerterm (v.2.3) 8 , and to compare the dependence of single-protein-chain prediction quality on MSA depthterm, we restrict the low-homology recent PDB setterm·def to complexes with fewer than 20 protein chains and fewer than 2,560 tokens. We compare against unrelaxed AlphaFold-Multimerterm v.2.3 predictions.

To study antibody-antigen interface prediction, we filter the lowpersName homologyterm·def recent PDB setterm·def to complexes that contain at least one protein–protein interface where one of the protein chains is in one of the two largest PDB chain clusters (these clusters are representative of antibodies). We further filter to complexes with at most 2,560 tokens and with no unknown amino acids in the PDB to allow extensive comparison against relaxed predictions of AlphaFold-Multimerterm v2.3. That leaves 71 antibody–antigen complexes, containing 166 antibody–antigen interfaces spanning 65 interface clusters.

MSA depthterm analysis (Extended Data Fig. 7a ) was based on computing the normalized number of effective sequencesterm·var ( N eff ) for each position of a query sequence. Per-residue N eff values were obtained by counting the number of non-gap residues in the MSA for this position and weighting the sequences using the N eff scheme 49 with a threshold of 80% sequence identity measured on the region that is non-gap in either sequence.

Nucleic acid prediction baseline For benchmarking performance on nucleic acid structure prediction, we report baseline comparisons to an existing machine learning system for protein–nucleic acid and RNA tertiary structure prediction, RoseTTAFold2NAterm 18 . We run the open source RF2NA 50 with the same MSAs as those that were used for AF3 predictions. For comparison between AF3 and RF2NA, a subset of our recent PDB setterm·def was chosen to meet the RF2NA criteria (<1,000 total residues and nucleotides). As RF2NA was not trained to predict systems with DNA and RNA, analysis is limited to targets with only one nucleic acid type. No system was publicly available at time of writing for baseline comparisons on data with arbitrary combinations of biomolecular types in PDB.

As an additional baseline for RNA tertiary structure prediction, we evaluate AF3 performance on CASP15term RNA targets that were publicly available as of 1 December 2023 (R1116/8S95, R1117/8FZA, R1126 (downloaded from the CASP15term website https://predictioncenter.org/casp15term/TARGETS_PDB/R1126.pdb ), R1128/8BTZ, R1136/7ZJ4, R1138/[7PTK/7PTL], R1189/7YR7 and R1190/7YR6). We compare the top-1 ranked predictions and, where multiple ground-truth structures exist (R1136), the prediction is scored against the closest state. We display comparisons to RF2NA as a representative machine learning system; AIchemy_RNA2 as the top performing entrant with human intervention; and AIchemy_RNA as the top performing machine learning system. All entrants’ predictions were downloaded from the CASP website and scored internally.

PoseBustersterm While other analyses used an AlphaFold model trained on PDB data released before a cut-off of 30 September 2021, our PoseBustersterm analysis was conducted on a model (with identical architecture and similar training schedule) differing only in the use of an earlier 30 September 2019 cut-off. This analysis therefore did not include training data, inference time templates or ‘ref_pos’ features released after this date.

Inference was performed on the asymmetric unit from specified PDBs, with the following minor modifications. In several PDB files, chains clashing with the ligand of interest were removed ( 7O1T , 7PUV , 7SCW , 7WJB , 7ZXV , 8AIE ). Another PDB entry ( 8F4J ) was too large to inference the entire system (over 5,120 tokens), so we included only protein chains within 20 Å of the ligand of interest. Five model seedsterm, each with five diffusion samplesterm, were produced per target, resulting in 25 predictions, which were ranked by quality and predicted accuracy: the ranking score was calculated from an ipTMterm aggregate (Supplementary Methods 5.9.3 (point 3)), then further divided by 100 if the ligand had chiralityterm errors or had clashes with the protein.

For pocket-aligned r.m.s.d.term·var, first alignment between the predicted and ground-truth structures was conducted by aligning to the ground-truth pocket backbone atoms (CA, C or N atoms within 10 Å of the ligand of interest) from the primary protein chain (the chain with the greatest number of contacts within 10 Å of the ligand). The PoseBustersterm Python package v.0.2.7 51 was used to score r.m.s.d. and violations from the pocket-aligned predictions.

While AlphaFold models are ‘blind’ to the protein pocket, dockingterm is often performed with knowledge of the protein pocket residues. For example, Uni-Mol specifies the pocket as any residue within 6 Å of the heavy atoms in the ligand of interest 26 . To evaluate the ability of AF3 to dock ligands accurately when given pocket information, we fine-tuned a 30 September 2019 cut-off AF3 model with an additional token feature specifying pocket–ligand pairs (Supplementary Methods 2.8 ). Specifically, an additional token feature was introduced, set to true for a ligand entity of interest and any pocket residues with heavy atoms within 6 Å of the ligand entity. At training time, a single random ligand entity is chosen to use in this feature. Note that multiple ligand chains with the same entity (CCD code) may be selected. At inference time, the ligand entity was chosen based on the ligand of interest’s CCD code, so again multiple ligand chains were occasionally chosen. The results of this analysis are shown in Extended Data Fig. 4 .

Model performance analysis and visualization Data analysis used Python v.3.11.7 ( https://www.python.org/ ), NumPy v.1.26.3 ( https://github.com/numpy/numpy ), SciPy v.1.9.3 ( https://www.scipy.org/ ), seaborn v.0.12.2 ( https://github.com/mwaskom/seaborn ), Matplotlib v.3.6.1 ( https://github.com/matplotlib/matplotlib ), pandas v.2.0.3 ( https://github.com/pandas-dev/pandas ), statsmodels v.0.12.2 ( https://github.com/statsmodels/statsmodels ), RDKit v.4.3.0 ( https://github.com/rdkit/rdkit ) and Colab ( https://research.google.com/colaboratory ). TM-align v.20190822 ( https://zhanglab.dcmb.med.umich.edu/TM-align/ ) was used for computing TM-scores. Structure visualizations were created in Pymol v.2.55.5 ( https://github.com/schrodinger/pymol-open-source ).

Reporting summary Further information on research design is available in the Nature Portfolio Reporting Summary linked to this article.

Online content Any methods, additional references, Nature Portfolio reporting summaries, source data, extended data, supplementary information, acknowledgements, peer review information; details of author contributions and competing interests; and statements of data and code availability are available at 10.1038/s41586-024-07487-w.

Supplementary information Supplementary Information 1 (notation), 2 (data pipeline), 3 (model architecture), 4 (auxiliary heads), 5 (training and inference), 6 (evaluation), 7 (differences to AlphaFold2 and AlphaFold-Multimerterm), 8 (Supplementary Results) and 9 (Appendix, including CCD Code and PDB ID tables).

Reporting Summary AF3 predictions for the Posebustersterm benchmark and outputs of the Posebustersterm checks for those predictions.

Acknowledgements We thank G. Arena, Ž. Avsec, A. Baryshnikov, R. Bates, M. Beck, A. Bond, N. Bradley-Schmieg, J. Cavojska, B. Coppin, E. Dupont, S. Eddy, M. Fiscato, R. GreenpersName, D. Hariharan, K. Holsheimer, N. Hurley, C. Jones, K. Kavukcuoglu, J. Kelly, E. Kim, A. Koivuniemi, O. Kovalevskiy, D. Lasecki, M. Last, A. Laydon, W. McCorkindale, S. Miller, A. Morris, L. Nicolaisen, E. Palmer, A. Paterson, S. Petersen, O. Purkiss, C. Shi, G. Thomas, G. Thornton and H. Tomlinson for their contributions.

Extended data figures and tables Author contributions The equally contributing authors are alphabetically ordered, as are the remaining core contributor authors (excluding jointly supervising authors) and similar for all remaining non-supervising authors. D.H., M.J. and J.M.J. led the research. M.J., J.M.J. and P.K. developed research strategy. J. AbramsonpersName, V.B., T.G. and C.-C.H. led key research pillars. T.G. and A. Židek led the technical framework for research. O.B., H.G. and S.S. coordinated and managed the research project. J. AbramsonpersName, J. AdlerpersName, E.A., A.J.B., J.B., V.B., A.I.C.-R., J.D., R.E., D.A.E., M.F., F.B.F., T.G., C.-C.H., M.J., J.M.J., Y.A.K., A. PotapenkopersName, A. PritzelpersName, D.R., O.R., A.T., C.T., K.T., L.W., Z.W. and E.D.Z. developed the neural network architecture and training procedure. J. AbramsonpersName, A.J.B., J.B., V.B., C.B., S.W.B., A.B., A. CherepanovpersName, A.I.C.-R., A. CowiepersName, J.D., T.G., R.J., M.O., K.P., D.R., O.R., M.Z., A. ŽemgulytėpersName and A. ŽídekpersName developed the training, inference, data and evaluation infrastructure. J. AbramsonpersName, J. AdlerpersName, A.J.B., V.B., A.I.C.-R., R.E., D.A.E., T.G., D.H., M.J., J.M.J., P.K., K.P., A. PritzelpersName, O.R., P.S., S.S., A.S., K.T. and L.W. contributed to the writing of the paper. M.C., C.M.R.L. and S.Y. advised on the project.

Peer review Peer review information Nature thanks Justas Dapkunas, Roland Dunbrack and Hashim Al-Hashimi for their contribution to the peer review of this work.

Data availability All scientific datasets used to create training and evaluation inputs are freely available from public sources. Structures from the PDB were used for training and as templates ( https://files.wwpdb.org/pub/pdb/data/assemblies/mmCIF/ ; sequence clusters are available at https://cdn.rcsb.org/resources/sequence/clusters/clusters-by-entity-40.txt ; sequence data are available at https://files.wwpdb.org/pub/pdb/derived_data/ ). Training used a version of the PDB downloaded 12 January 2023, while template search used a version downloaded 28 September 2022. We also used the Chemical Components Dictionary downloaded on 19 October 2023 ( https://www.wwpdb.org/data/ccd ). We show experimental structures from the PDB under accession numbers 7PZB (ref. 52 ), 7PNM (ref. 53 ), 7TQL (ref. 54 ), 7AU2 (ref. 55 ), 7U8C (ref. 56 ), 7URD (ref. 57 ), 7WUX (ref. 58 ), 7QIE (ref. 59 ), 7T82 (ref. 60 ), 7CTM (ref. 61 ), 8CVP (ref. 42 ), 8D7U (ref. 42 ), 7F60 (ref. 62 ), 8BTI (ref. 63 ), 7KZ9 (ref. 64 ), 7XFA (ref. 65 ), 7PEU (ref. 66 ), 7SDW (ref. 67 ), 7TNZ (ref. 68 ), 7R6R (ref. 69 ), 7USR (ref. 70 ) and 7Z1K (ref. 71 ). We also used the following publicly available databases for training or evaluation. Detailed usage is described in Supplementary Methods 2.2 and 2.5.2 . UniRef90 v.2020_01 ( https://ftp.ebi.ac.uk/pub/databases/uniprot/previous_releases/release-2020_01/uniref/ ), UniRef90 v.2020_03 ( https://ftp.ebi.ac.uk/pub/databases/uniprot/previous_releases/release-2020_03/uniref/ ), UniRef90 v.2022_05 ( https://ftp.ebi.ac.uk/pub/databases/uniprot/previous_releases/release-2022_05/uniref/ ), Uniclust30 v.2018_08 ( https://wwwuser.gwdg.de/~compbiol/uniclust/2018_08/ ), Uniclust30 v.2021_03 ( https://wwwuser.gwdg.de/~compbiol/uniclust/2021_03/ ), MGnify clusters v.2018_12 ( https://ftp.ebi.ac.uk/pub/databases/metagenomics/peptide_database/2018_12/ ), MGnify clusters v.2022_05 ( https://ftp.ebi.ac.uk/pub/databases/metagenomics/peptide_database/2022_05/ ), BFD ( https://bfd.mmseqs.com ), RFam v.14.9 ( https://ftp.ebi.ac.uk/pub/databases/Rfam/14.9/ ), RNAcentral v.21.0 ( https://ftp.ebi.ac.uk/pub/databases/RNAcentral/releases/21.0/ ), Nucleotide Database (as of 23 February 2023) ( https://ftp.ncbi.nlm.nih.gov/blast/db/FASTA/nt.gz ), JASPAR 2022 ( https://jaspar.elixir.no/downloads/ ; see https://jaspar.elixir.no/profile-versions for version information), SELEX protein sequences from the supplementary tables of ref. 72 and SELEX protein sequences from the supplementary tables of ref. 73 .

Code availability AlphaFold 3term will be available as a non-commercial usage only server at https://www.alphafoldserver.com , with restrictions on allowed ligands and covalent modifications. Pseudocode describing the algorithms is available in the Supplementary Information . Code is not provided.

Competing interests Author-affiliated entities have filed US provisional patent applications including 63/611,674, 63/611,638 and 63/546,444 relating to predicting 3D structures of molecule complexes using embedding neural networks and generative models. All of the authors other than A.B., Y.A.K. and E.D.Z. have commercial interests in the work described.

Footnotes Contributor Information Max JaderbergpersName, Email: jaderbergpersName@isomorphiclabs.com.

Demis HassabispersName, Email: dhcontact@google.com.

John M. JumperpersName, Email: jumperpersName@google.com Extended data is available for this paper at 10.1038/s41586-024-07487-w.

Supplementary information The online version contains supplementary material available at 10.1038/s41586-024-07487-w.

References Associated Data Supplementary Materials Supplementary Information 1 (notation), 2 (data pipeline), 3 (model architecture), 4 (auxiliary heads), 5 (training and inference), 6 (evaluation), 7 (differences to AlphaFold2 and AlphaFold-Multimerterm), 8 (Supplementary Results) and 9 (Appendix, including CCD Code and PDB ID tables).

Reporting Summary AF3 predictions for the Posebustersterm benchmark and outputs of the Posebustersterm checks for those predictions.

Data Availability Statement All scientific datasets used to create training and evaluation inputs are freely available from public sources. Structures from the PDB were used for training and as templates ( https://files.wwpdb.org/pub/pdb/data/assemblies/mmCIF/ ; sequence clusters are available at https://cdn.rcsb.org/resources/sequence/clusters/clusters-by-entity-40.txt ; sequence data are available at https://files.wwpdb.org/pub/pdb/derived_data/ ). Training used a version of the PDB downloaded 12 January 2023, while template search used a version downloaded 28 September 2022. We also used the Chemical Components Dictionary downloaded on 19 October 2023 ( https://www.wwpdb.org/data/ccd ). We show experimental structures from the PDB under accession numbers 7PZB (ref. 52 ), 7PNM (ref. 53 ), 7TQL (ref. 54 ), 7AU2 (ref. 55 ), 7U8C (ref. 56 ), 7URD (ref. 57 ), 7WUX (ref. 58 ), 7QIE (ref. 59 ), 7T82 (ref. 60 ), 7CTM (ref. 61 ), 8CVP (ref. 42 ), 8D7U (ref. 42 ), 7F60 (ref. 62 ), 8BTI (ref. 63 ), 7KZ9 (ref. 64 ), 7XFA (ref. 65 ), 7PEU (ref. 66 ), 7SDW (ref. 67 ), 7TNZ (ref. 68 ), 7R6R (ref. 69 ), 7USR (ref. 70 ) and 7Z1K (ref. 71 ). We also used the following publicly available databases for training or evaluation. Detailed usage is described in Supplementary Methods 2.2 and 2.5.2 . UniRef90 v.2020_01 ( https://ftp.ebi.ac.uk/pub/databases/uniprot/previous_releases/release-2020_01/uniref/ ), UniRef90 v.2020_03 ( https://ftp.ebi.ac.uk/pub/databases/uniprot/previous_releases/release-2020_03/uniref/ ), UniRef90 v.2022_05 ( https://ftp.ebi.ac.uk/pub/databases/uniprot/previous_releases/release-2022_05/uniref/ ), Uniclust30 v.2018_08 ( https://wwwuser.gwdg.de/~compbiol/uniclust/2018_08/ ), Uniclust30 v.2021_03 ( https://wwwuser.gwdg.de/~compbiol/uniclust/2021_03/ ), MGnify clusters v.2018_12 ( https://ftp.ebi.ac.uk/pub/databases/metagenomics/peptide_database/2018_12/ ), MGnify clusters v.2022_05 ( https://ftp.ebi.ac.uk/pub/databases/metagenomics/peptide_database/2022_05/ ), BFD ( https://bfd.mmseqs.com ), RFam v.14.9 ( https://ftp.ebi.ac.uk/pub/databases/Rfam/14.9/ ), RNAcentral v.21.0 ( https://ftp.ebi.ac.uk/pub/databases/RNAcentral/releases/21.0/ ), Nucleotide Database (as of 23 February 2023) ( https://ftp.ncbi.nlm.nih.gov/blast/db/FASTA/nt.gz ), JASPAR 2022 ( https://jaspar.elixir.no/downloads/ ; see https://jaspar.elixir.no/profile-versions for version information), SELEX protein sequences from the supplementary tables of ref. 72 and SELEX protein sequences from the supplementary tables of ref. 73 .

AlphaFold 3term will be available as a non-commercial usage only server at https://www.alphafoldserver.com , with restrictions on allowed ligands and covalent modifications. Pseudocode describing the algorithms is available in the Supplementary Information . Code is not provided.

Interpretive notes.
• Highlighted spans are tagged entities: persName (author), title (venue), placeName (place), date (year), and term (a key concept: domain / ai / method).
• Eponymous or retrospective terms (e.g. “Nash equilibrium”, “segregation”) do not appear in the original source and so are not highlighted — a deliberate choice (see Report 4).
• Some entries begin with a word in capitals. EVIDENCE CORRECTED means the finding still stands and it was our quotation that was wrong — it has been replaced. RETRACTED means the entry itself was wrong; it stays on the page, marked, with its reason, rather than being deleted. WITHDRAWN AND REPLACED means a corrected version of it appears in the entries below. Each mark carries its own reason, because the reasons differ from one entry to the next. An entry we have WITHDRAWN is removed from this page and kept in the record, with its reason. A line reading Audit and a date is a later re-reading of the entry against its whole sentence: DOUBTFUL means it was kept, and the reason says what is loose about it.
• Quotation marks inside the tagger's sentence. Where a tag is the tagger's own sentence, a phrase in quotation marks inside it is borrowed from the paper — the tagger's wording around it is not. The paper's own sentence is the evidence quote shown on the same row, so the borrowing can be checked against the thing borrowed from without leaving this page. Nothing inside quotation marks anywhere on this page is ours: if it is quoted, it is the paper's. Whose words a concept carries. A concept entry records a term the paper itself uses, so the term, the sense given for it, and its evidence are the paper's own words, quoted where the paper fixes them. This is the opposite of a sense entry in the tag table, which is the tagger's sentence about how the paper uses a term. Where a concept entry could not be grounded in the paper's words, the entry says so on its own row.
• Counts: 1 work · 1 date.
Meta-Tagging Project · record abramson2024-alphafold3.
© 2026 Shir Sivroni