An open source chemical structure curation pipeline using RDKit

A. Patrícia Bento, Anne Hersey, Eloy Félix, Greg Landrum, Anna Gaulton, Francis Atkinson, Louisa J. Bellis, Marleen De Veij, Andrew R. Leach · Journal of Cheminformatics · 2020 · computational chemistry · 10.1186/s13321-020-00456-1 · record bento2020-open-source-chemical-structure-curation
tag layer · index · concepts · authors · עברית
Where this record's text came from. 2026-08-30 schema-0.3 pass: every quote verified as an exact substring of the staged text and anchored at merge time; concept terms verified present; every edge endpoint an existing node.
34 quotations on this page contain a reference number where the paper printed a superscript. This journal style prints citations as raised numerals — parameters12,13 — and the extraction flattened them into the line, so the sentence reads parameters 12 , 13 . The digits are citation markers and not part of what the author wrote. The quotes keep them for the same reason they keep every other extraction fault: a quote is reproduced exactly or it proves nothing.
How to read this page. The article text below is reproduced exactly as it was staged; nothing in it has been rewritten. Coloured stretches are tagged. A solid underline means the tag records the paper's own words. A dotted underline means the tag text is the tagger's sentence about the paper — the quotation is the paper's, the wording of the tag is not. Every superscript label links to that tag's row in the table at the foot of the page. The machine-readable edition of the same thing is the TEI file beside this one, where the tags live in standOff. When we have changed our mind. Some entries in the table begin with a word in capitals and the reason for it. EVIDENCE CORRECTED — the finding still stands, but we had quoted the wrong sentence from the paper, and the quotation has been replaced with the right one. RETRACTED — the entry itself was wrong; it stays on the page, marked, with the reason, rather than being deleted. WITHDRAWN AND REPLACED — the entry was wrong, and a corrected version of it appears in the entries below. Each mark carries its own reason, in brackets, because the reasons differ from one entry to the next. An entry we have WITHDRAWN is removed from this page and kept in the record, with its reason. A line reading Audit and a date is a later re-reading of the entry against its whole sentence: DOUBTFUL means it was kept, and the reason says what is loose about it. Quotation marks inside the tagger's sentence. Where a tag is the tagger's own sentence, a phrase in quotation marks inside it is borrowed from the paper — the tagger's wording around it is not. The paper's own sentence is the evidence quote shown on the same row, so the borrowing can be checked against the thing borrowed from without leaving this page. Nothing inside quotation marks anywhere on this page is ours: if it is quoted, it is the paper's. Whose words a concept carries. A concept entry records a term the paper itself uses, so the term, the sense given for it, and its evidence are the paper's own words, quoted where the paper fixes them. This is the opposite of a sense entry in the tag table, which is the tagger's sentence about how the paper uses a term. Where a concept entry could not be grounded in the paper's words, the entry says so on its own row.
Other fields define these differently the same word, defined another way in another discipline
SMILES 2 fields · canonical SMILES 2 fields · RDKit 2 fields · chemical structures 2 fields

Tags on this paper

Every tag the record carries, each linking to every other paper in the corpus that carries it. A tag appears here whether or not its words occur in the article — the spans below are only the ones a sentence in this paper licenses. Of the 52 concept tags on this paper, all 52 are grounded in a quoted sentence. All carry the tagger's gloss of what the term means in this paper, which is not something the article can license.
ChEMBL database bioactivity data small molecule compounds chemical structures chemical curation pipeline RDKit Checker Standardizer GetParent manual curation automated procedure molfiles SMILES V2000 molfile Standard InChI identifier uniqueness for a chemical structure InChIKey ChEMBL identifier canonical SMILES canonical tautomer legacy pipeline MolVS penalty score severity of the perceived problem warning flag fatal error stereocentres stereo mismatch exclude flag coordination bonds explicit H atoms hypervalent nitro groups neutralised arbitrary choice salt form parent structure connected component isotopes solvents salts genuine mixtures parent aggregation process ChEMBL 26 ChEMBL literature set SureChEMBL PubChem PubChem standardiser changed InChIs different Standard InChIKeys multicomponent compounds business rules stereo mismatch checks structure normalization neutralisation canonical choice parent aggregation cross-source Checker evaluation cross-database Standardizer comparison parent molecule multicomponent compound stereocentre counts data source charge status stereochemistry system-or-tool-building
Method, as described: Checker penalty scoring, rule-based Standardizer transformations, GetParent salt-solvent-isotope processing, and cross-dataset comparison by Standard InChI

Legend

relation to other workclaim_relationshow this paper stands to another: agrees, contradicts, extends, qualifies
claim typeclaim_typethe shape of the claim: existence, mechanism, method, critique, prediction, null
concept edgeconcept_edgesan asserted relation between two concepts, with the sentence asserting it
conceptconceptsan idea the paper works with, quoted where the paper uses it
content tagcontent_tagsa finding, definition, quantity, statistic or variable named in the paper
contributioncontributionwhat the paper claims to add
controlcontrolsan experiment run to eliminate a rival explanation
limitationlimitationswhat the paper says its evidence cannot support
mechanismmechanismshow the reported effect is said to come about
methodmethodhow the paper produced its evidence
object of studyobject_of_studywhat the paper is about — the thing it investigates
phenomenonphenomenonthe effect or regularity under study
research questionresearch_questionthe question the paper sets itself
sensesensesa distinct use of a term, quoted where the paper fixes it
unrecordable relationunhoused_relationsa relation the paper asserts that this vocabulary cannot express, with the reason

The paper, tagged

An open source chemical structure curation pipeline using RDKit

Abstract

limitationsconcepts↗concepts↗concepts↗unhoused_relationsThe ChEMBL database is one of a number of public databases that contain bioactivity data on small molecule compounds curated from diverse sources. Incoming compounds are typically not standardised according to consistent rules. In order to maintain the quality of the final database and to easily compare and integrate data on the same compound from different sources it is necessary for the chemical structures in the database to be appropriately standardised.

object_of_studyclaim_typemethod↗concepts↗concepts↗concepts↗concepts↗concepts↗concept_edgesconcept_edgesconcept_edgescontent_tagsA chemical curation pipeline has been developed using the open source toolkit RDKit. It comprises three components: a Checker to test the validity of chemical structures and flag any serious errors; a Standardizer which formats compounds according to defined rules and conventions and a GetParent component that removes any salts and solvents from the compound to create its parent. This pipeline has been applied to the latest version of the ChEMBL database as well as uncurated datasets from other sources to test the robustness of the process and to identify common issues in database molecular structures.

concepts↗content_tagsAll the components of the structure pipeline have been made freely available for other researchers to use and adapt for their own use. The code is available in a GitHub repository and it can also be accessed via the ChEMBL Beaker webservices. It has been used successfully to standardise the nearly 2 million compounds in the ChEMBL database and the compound validity checker has been used to identify compounds with the most serious issues so that they can be prioritised for manual curation.

Keywords: Chemistry, Curation, ChEMBL, RDKit, Open source, Standardisation

Introduction

concepts↗content_tagscontent_tagsThe ChEMBL database is a freely available bioactivity database containing close to 2.5 million compound records on nearly 2 million unique chemical structures [ 1 ]. The compound structures and associated bioactivity data are extracted on a regular basis primarily from the medicinal chemistry literature. A growing number of researchers are also depositing experimental data directly in order to make these available in the public domain. Furthermore, ChEMBL contains a set of manually curated marketed drugs and clinical candidates as well as selected bioactivity data from other public databases such as BindingDB [ 2 ] and PubChem [ 3 ]. Bioactivity data on the same compound from all ChEMBL sources (scientific articles, deposited datasets and curated drug sources) are aggregated according to chemical structure. Compounds may be physically tested in bioassays as the so-called parent molecule or as one of a number of different salt forms. Scientists commonly wish to aggregate the data on these different forms on the basis of the common underlying parent structure, and so it is necessary to link these various forms of the “same” underlying parent molecule.

limitationsconcepts↗content_tagscontent_tagscontent_tagsIn order to facilitate the use of the database, a key objective of the ChEMBL compound curation process is to standardise the chemical structures stored in the database and to assign a unique identifier to each distinct chemical structure regardless of the source. It is worth noting that there are over 5000 unique compounds in the ChEMBL database with data from ten or more different sources, and four compounds (doxorubicin, ciprofloxacin, chloroquine and paclitaxel) each with data from over 1000 sources. For each ChEMBL release, more than 50,000 new structures are added to the database, which makes manual curation and standardisation of the chemical structures impracticable. Hence an automated procedure is required.

phenomenonlimitationsconcepts↗concepts↗unhoused_relationscontent_tagsThe chemical structures submitted to the ChEMBL database are generally received as molfiles [ 4 ] but can also be in SMILES format [ 5 ]. There is no universal standard for these formats and the challenges of converting between chemical structure formats is well documented [ 6 ]. Even the simple process of loading molecules into and out of different cheminformatics packages can subtly change the structure, particularly if it was not well drawn in the first place. Chemical structures from the primary scientific literature are mostly manually drawn from the structural information in the papers prior to loading into ChEMBL. These structures are often represented in the publication as Markush structures with different R-groups shown in SAR (structure–activity relationship) tables. Compounds may also be shown with charges on acidic or basic groups, to indicate the form in which they are likely to interact with amino acid residues in a binding pocket. In some articles the compounds synthesised and reported are isotopically labelled. The ChEMBL compound curation procedure therefore needs to process molecules represented in all these ways (and more) to determine which compounds are the same. Examples of these situations can be found in recent articles where data was extracted for the ChEMBL database [ 7 – 9 ].

mechanisms↗limitationsconcepts↗concepts↗concepts↗concepts↗concepts↗concepts↗concepts↗unhoused_relationssensessensessensesconcept_edgesconcept_edgescontent_tagscontent_tags↗content_tags↗content_tags↗A standardised V2000 molfile was chosen as the primary chemical structure representation in the database. The Standard InChI and the corresponding hashed InChIKey [ 10 , 11 ] are used in ChEMBL as the measure of uniqueness for a chemical structure and are calculated from the molfile using software provided by the InChI Trust, currently version 1.05 [ 12 ]. Thus, when compounds from different scientific articles have the same Standard InChI and InChIKey they are considered to be the same compound and are assigned the same ChEMBL identifier (CHEMBL_ID). The use of the Standard InChI has a number of advantages in the context of the ChEMBL database. It was developed as an IUPAC open standard to enable information exchange and interoperability between large databases. The simple format of Standard InChI is also used by many other database providers and hence it is an ideal choice for an open database such as ChEMBL. However, unlike molfiles and SMILES, it was designed as an identifier and not as a structure format suitable for cheminformatics applications. For example, the Standard InChI is independent of the tautomeric form of a compound and hence different tautomers of a compound will have the same standard InChI. As a consequence, they are considered in ChEMBL as being the same compound and hence have the same ChEMBL_ID. It should however be remembered that there are a few disadvantages to using Standard InChI as an identifier, including: its inability to recognise some 1,5 keto-enol tautomers as being the same compound; its inability to recognise cis/trans isomerism in organometallic compounds (e.g. cisplatin and transplatin) and it does not support the use of relative stereochemistry, only absolute or no stereochemistry. Despite these limitations, it is a good compromise for a structural identifier for a public database such as ChEMBL. To aid interoperability, a canonical SMILES is also generated from each primary molfile, but this is considered to be a secondary structure.

concepts↗The challenges of registering compounds in a database and determining chemical uniqueness are not specific to ChEMBL. PubChem, the open chemistry database of over 100 million compounds maintained by the National Institutes of Health (NIH) has developed an automated and publicly available standardisation process based on OpenEye toolkits [ 13 ]. They utilise an isomeric canonical SMILES to identify unique structures and show that their method generates more unique structures than when Standard InChI is used to determine uniqueness. They also generate a canonical tautomer for their compounds. The ChEMBL group decided against the use of a canonical tautomer, for a number of reasons. Firstly, it is anticipated that the authors of an article in the medicinal chemistry literature will have worked on their compound set for some considerable time, performed docking and molecular modelling studies and will be well placed to assign the most appropriate tautomeric form, for example based on specific interactions with the target protein. Secondly, it is possible for tautomers to interconvert under experimental conditions. Thirdly, changing the tautomeric form of a compound can alter its stereochemistry by removing, or introducing, a chiral centre from a molecule, requiring often difficult decisions to be made about how to “merge” compounds/data with different chirality or which stereo form to create. Thalidomide is a well-known example of the second phenomenon which interconverts between the therapeutic R-enantiomer and the teratogenic S-enantiomer via the enol tautomer [ 14 ].

The Royal Society of Chemistry (RSC) developed the Chemical Validation and Standardization Platform (CVSP) [ 15 ] to support compound deposition into their ChemSpider chemical database [ 16 ] and as a contribution to the Innovative Medicines Initiative (IMI) funded OpenPHACTS project [ 17 ] which aimed to standardise chemical structures from multiple databases. The CVSP methodology uses sets of SMARTS-based rules that can be tailored by the user. The code is available on GitHub [ 18 ] but currently has no obvious documentation and the interface is no longer available [ 19 ] although it is still possible for depositors to ChemSpider to use the rules to validate their structures.

The United States Environmental Protection Agency (EPA) also strive to have well curated structures in their DSSTox database [ 20 ]. They have described, in detail, the complexity of the task and have undertaken extensive curation of their chemical structures using a combination of manual and automated methods. Much of their focus has been on resolving the mismatches between names, identifiers and structures between their compound set and those in the US National Library of Medicine databases ChemID [ 21 ] and PubChem. Due to the inability of the V2000 molfiles to distinguish relative and absolute stereochemistry they have chosen to use V3000 molfiles as their preferred structure format. They also use an InChIKey calculated using the ChemAxon JChem toolkit to determine uniqueness, but this differs from the Standard InChIKey discussed above. SMILES are provided for users not wanting to use V3000 molfiles, but they make the point that this results in a less rich representation of the structures. Their methods are based on a combination of commercial toolkits and their own manual curation tool [ 22 ].

The Global Substance Registration System (GSRS), developed by the regulatory authorities in the USA and Europe, creates a Unique Ingredient Identifier (UNII) for components of medicinal products which includes small molecules but also more complex molecules such as proteins and polymers [ 23 ]. This is a particularly useful resource for identifying the structures of specific pharmaceutically relevant compounds, but it is less useful for the bulk curation of the larger set of bioactive molecules in the ChEMBL database.

Many commercial software providers also provide toolkits for standardising compound structures. These are widely used by large pharmaceutical and agrochemical companies where the precise annotation of a chemical structure is crucial for intellectual property protection. Those produced by ChemAxon and 3DS are examples of these toolkits [ 24 , 25 ].

research_questionlimitationsconcepts↗concepts↗unhoused_relationsclaim_relationsclaim_relationsclaim_relationscontent_tagsThe legacy pipeline for processing compound structures prior to deposition into ChEMBL was based on commercial software and had evolved over more than 10 years. During this time, more and more incorrect, unusual, and exceptional situations were identified and integrated into the pipeline. Unfortunately, these refinements were increasingly making the code difficult to maintain and modify. In reviewing options for a sustainable future solution that also removed the dependence on commercial software it became apparent that none of the existing toolkits fitted the ChEMBL group’s requirements. Therefore, the decision was made to build a curation pipeline around the widely used open-source RDKit toolkit and its implementation of the MolVS molecule validation and standardisation tool [ 26 , 27 ]. The resulting pipeline is now available as an open-source solution, freely available for the wider scientific community [ 28 ]. As part of this project the current rules used for curating ChEMBL structures have also been revised and rewritten to make them more sustainable. The resulting processes are designed and developed to suit the specific situation of ChEMBL, but the code can also be used by others “as is” or can be modified to suit other requirements.

unhoused_relationsIt is important to note that this curation pipeline is not intended as a replacement for a similarly named standardiser tool [ 29 ] which was previously developed by the ChEMBL group as a contribution to the IMI eTOX project [ 30 ] and was specifically designed to standardise molecules in preparation for molecular modelling applications.

The newly developed curation pipeline will now be described in more detail.

Methods

Three new components have been developed using the RDKit toolkit. Two of these components ( Standardizer and GetParent ) have been rewritten and adapted from rules originally implemented using a commercial software toolkit. In contrast, the Checker component was developed more recently in an attempt to identify problem structures before they were added to the ChEMBL database.

Hence the new ChEMBL curation pipeline comprises three processes:

Checker : identifies and validates structures and identifies problems before they are added to the database

mechanisms↗content_tags↗Standardizer : processes (standardises) chemical structures according to a set of predefined rules

content_tags↗GetParent : generates parent structures based on a set of rules and defined lists of salts and solvents

Checker component

mechanisms↗concepts↗concepts↗concepts↗sensescontent_tags↗content_tags↗The Checker component validates structures prior to the compounds being loaded into ChEMBL. If an error or problem is detected in the structure a score is reported for the molecule; the score increases with the severity of the perceived problem. In the majority of cases compounds are loaded into the database even if a warning flag is identified. The scores are recorded but at this point errors are not corrected. Instead, they are prioritised and subjected to subsequent manual curation, as time and degree of seriousness permits. A summary of the structure checks performed, and the resultant penalty scores assigned are shown in Table 1 .

Penalty scores and annotation that are output from the Checker module

mechanisms↗concepts↗unhoused_relationssensescontent_tagscontent_tags↗content_tagscontent_tagsIt is an individual user’s choice what they decide to do with molecules that return specific penalty scores. For ChEMBL, a penalty score of 7 is considered to be a fatal error and the molfile is not loaded into the database. Examples of illegal input are, for example, unknown elements in the molfile, or molfiles that cannot be read in RDKit due to the inability to process their aromatic bonds. Molecules with a penalty score of 6 are loaded into the ChEMBL database but without a molfile, as it is considered that these have a significant issue with the structure, and it is preferable to fix the problem than have a badly formed molecule in the database. Most of the issues that give rise to a penalty score of 6 are self-explanatory and are described in Table 1 . If the penalty score is 5 or 2 the molecule is loaded but the compounds are also prioritised for manual curation. Again, many of the 5 and 2 penalty scores are self-explanatory, but the stereo mismatch errors perhaps need further explanation. These are reported when the number of stereocentres perceived by the following calculation methods differ:

Mol: number of atoms where a wedged bond starts

InChI: number of tetrahedral stereocentres

RDKit: number of atomic stereocentres remaining after calling Chem.AssignStereochemistry()

mechanisms↗concepts↗concepts↗content_tags↗content_tags↗Hence the “InChi_RDKit/Mol stereo mismatch” warning message indicates that the InChI and RDKit algorithms perceive the number of stereocentres to be the same but different from the molfile. “Mol/Inchi/RDKit stereo mismatch” means that all three methods perceive different stereocentre counts. The majority of these issues occur in complex molecules such as bridged bicyclic molecules that are badly drawn. As Standard InChI is derived from the molfile, the errors where the molfile and InChI differ in their stereocentre counts are given a higher penalty score [ 5 ] than when they are the same but different from the RDKit stereo count [ 2 ].

sensesThe InChI software may give a number of warnings. These are also reported by the ChEMBL Checker module. Some of these are considered important, but others such as “InChI: Omitted undefined stereo”, “InChI: Charges were rearranged”, “InChI: Ambiguous stereo”, “InChI: Proton(s) added/removed” and “InChI: Not chiral” are generated for large numbers of molecules. These either reflect the reorganisation of atoms in order to generate the InChI or are related to stereochemical ambiguity arising, for example, from the fact that the compound is a racemate; these are not considered issues for a database such as ChEMBL. Therefore, these are given a low penalty score [ 2 ]. However, in other contexts they might be more relevant and so are reported in the Checker output.

Standardizer component

limitationssensesThe standardisation rules implemented in the ChEMBL database are based largely on the FDA/IUPAC guidelines [ 31 , 32 ]. Whilst the aim is to adhere to these rules as closely as possible, the practical reality is that submitted compounds are sometimes drawn imperfectly or the structures are ambiguously defined in the original publication or by the depositor. An automated standardiser can only safely correct some of the potential issues and the standardisation rules, currently encoded in the Standardizer component, are outlined here.

mechanisms↗limitationsconcepts↗concepts↗unhoused_relationssensescontent_tagscontent_tags↗For certain compound types, particularly organometallic and those with a large number of boron atoms, a flag is set (exclude flag) and no attempt is made to standardise them. This is largely due to the V2000 molfile format used by ChEMBL being unable to accurately represent coordination bonds. For this reason, although the bioactivity data on these compounds is available in ChEMBL, the chemical structures are not curated nor provided in the release version of the database.

content_tagsThe first step in the standardisation process is therefore to exclude molecules if they contain more than 7 boron atoms or any of the following atoms: [Sc], [Ti], [V], [Cr], [Mn], [Fe], [Co], [Ni], [Cu], [Ga], [Y], [Zr], [Nb], [Mo], [Tc], [Ru], [Rh], [Pd], [Cd], [In], [Sn], [La], [Hf], [Ta], [W], [Re], [Os], [Ir], [Pt], [Au], [Hg], [Tl], [Pb], [Bi], [Po], [Ac], [Ce], [Pr], [Nd], [Pm], [Sm], [Eu], [Gd], [Tb], [Dy], [Ho], [Er], [Tm], [Yb], [Lu], [Th], [Pa], [U], [Np], [Pu], [Am], [Cm], [Bk], [Cf], [Es], [Fm], [Md], [No], [Lr], [Ge], [Sb].

The following standardisations are then made to the molecule (where they occur):

Standardise unknown stereochemistry

Clear S Group data from the molfile

Generate a kekulé form of the structure

concepts↗Remove explicit H atoms except: Hs where an isotope of hydrogen has been specifically set Hs that have a wedged or dashed bond to them Hs bonded to atoms with tetrahedral stereochemistry set (“Chiral Hs”). This is an example: Hs bonded to atoms in a non-default valence state that are not simply protonated. An example is phosphinic acid:

mechanisms↗concepts↗Normalise structure: Fix hypervalent nitro groups Convert covalently drawn alkaline metals connected to O or N to ionic forms (e.g. NaO to Na+ O−) Fix incorrect amide tautomers, e.g. N=COH to HNC(=O) Standardise sulphoxides to charge-separated form Standardise diazonium N to N+ Ensure quaternary N is charged Ensure trivalent O is charged Ensure trivalent S is charged Ensure halogen not bonded to a neighbouring atom is charged

mechanisms↗concepts↗Ensure molecule is neutralised, if possible, by: Adding or removing Hs Moving Hs from one atom to another (including between components)

mechanisms↗limitationsconcepts↗Note that if the Hs could be added to more than one atom an arbitrary choice is made but this is done canonically so the result will always be the same for a given molecule

7. Normalise (straighten) triple bonds and allenes

In the context of the ChEMBL database, it is the molfiles standardised according to these rules that are stored in the database and which are in turn the structures made available to the database users.

GetParent component

concepts↗concepts↗concepts↗Many compound registration systems, including the ChEMBL database, identify compounds that are related by virtue of being a salt form of a common parent structure. Therefore, as part of the ChEMBL compound curation pipeline, molecules are identified where the molfile contains more than one connected component as well as molecules containing atoms with specified isotopes.

mechanisms↗limitationsconcepts↗concepts↗concepts↗concepts↗unhoused_relationsunhoused_relationssensescontent_tagscontent_tags↗The GetParent module is applied to just those compounds that match one or both of these criteria. All information about isotopes is removed, as are solvents and salts present in the molfile which match any of the components in the defined salt and solvent lists. Having removed all salts (e.g. Na+ that might be included to neutralise a carboxyl group), the resulting molecule is neutralised and a new molfile created as the “parent” molecule. Compounds containing more than one component that are genuine mixtures (i.e., all of the components are absent from the salt and solvent lists) has, in the context of the ChEMBL database, its parent registered as the identical mixture. For cases such as sodium chloride and sodium citrate, where both components are in the salt list, the GetParent module does not remove any component and the parent remains the same as the salt. Here again, the parent is registered as the multicomponent mixture. Compounds containing any of the excluded atoms described above have their isotopes and solvents removed and then parents created, so that bioactivity data can subsequently be aggregated. For example, the antimony-containing compound sodium stibogluconate has two versions in ChEMBL 26, both with bioactivity data: CHEMBL3754364 is a version with water of crystallisation and CHEMBL3764926 is a version without. These are annotated as related forms so that the bioactivity data can be seen aggregated in the database. Cyanocobalamin is a cobalt-containing compound which is recorded as a parent and three different isotopes in the database (CHEMBL2110563, CHEMBL2104118, CHEMBL2104381 and CHEMBL2096655). Again, the GetParent module enables their data aggregation. Organometallic compounds do not however have salts removed due to the complexity of how they are often represented in the deposited molfile. For example, this is often achieved by drawing them as disconnected components as is the case for transplatin (CHEMBL1386) which was deposited into the database as N.N.[Cl−].[Cl−].[Pt+2]. Removal of the chloride and ammonia components would incorrectly result in a platinum ion as the parent.

content_tagscontent_tagscontent_tagscontent_tags↗content_tags↗The list of salts used in ChEMBL is based on the USAN Council’s list of pharmacological salts [ 33 ]. Additional entities have been added to this list where a significant number of examples have been present in ChEMBL datasets. The GetParent module will remove salts regardless of: (i) the charge status (e.g. acetic acid or acetate, Cl− or HCl); (ii) whether or not stereochemistry is depicted (e.g. tartaric acid); (iii) cis/trans isomers (e.g. maleic and fumaric acid). The salts and solvents files are available in the GitHub repository [ 28 ]. Currently, these files contain 162 salts and 9 solvents respectively. This list will be maintained and extended if additional salts and solvents are identified.

mechanisms↗concepts↗unhoused_relationssensescontent_tagscontent_tags↗For the avoidance of any doubt, although parents, salts, solvents, isotopes and mixtures are all identified using the process just described, the bioactivity data recorded in ChEMBL is registered against the form it was measured on. The aggregation by parent structure is undertaken to make it easier to identify all the data for salts and isotopes of a common parent. For example, paroxetine (CHEMBL490) has bioactivity data determined for the parent molecule, two salts, one salt/solvent mixture and two different isotopes as well as there being an additional salt registered as an FDA approved drug. Another example is amphetamine (CHEMBL405), which has bioactivity data in ChEMBL for eight different salts in addition to the parent amphetamine and an additional two salts that are recorded in drug sources such as the FDA orange book [ 34 ]. The parent aggregation process makes this data easily identified and grouped. This is illustrated in Fig. 1 for these two compounds.

Examples of the multicomponent forms of paroxetine and amphetamine and how they have been aggregated by use of the GetParent component

Availability of structure curation pipeline

The code for the pipeline has all been developed using the RDKit toolkit (version 2019.09.2.0). It is open source and publicly available in GitHub [ 28 ], currently as version 1.0.0. A conda package is also available to facilitate installation [ 35 ]. The Standardizer , Checker and GetParent functions are also integrated in the ChEMBL Beaker webservices and can be used in this way via the ‘check’, ‘getParent’ and ‘standardize’ endpoints [ 36 ]. Any new features developed by the ChEMBL group will be added to the repository and comments and suggestions from others are welcomed.

Results and discussion

limitationscontrolsconcepts↗content_tagsOne of the objectives in developing the new curation pipeline was to improve the quality of the chemical structures in the ChEMBL database. As the rules implemented in the new Standardizer and GetParent modules were largely based on the original ChEMBL rules developed over the last 10 years it is difficult to unambiguously quantify this improvement. To provide a consistent starting point, therefore, the current 1.9 million compounds in the latest release of ChEMBL (ChEMBL 26) have been completely re-standardised and the parents regenerated for the whole database using the new pipeline.

Checker component

mechanisms↗controlscontrolsconcepts↗concepts↗content_tags↗To investigate the utility of the Checker module three very different compound sets were used. These were: a set of compounds recently extracted (by manual drawing) from the medicinal chemistry literature by the ChEMBL data extractors; a set of compounds from SureChEMBL, the patent database where the chemical structures are obtained by entity recognition followed by name or image to structure conversion [ 37 ] and a randomly selected compound set from PubChem (SIDs) as initially submitted by the depositors and prior to any compound standardisation. These three datasets are provided as structure data files (sd files) in the Supplementary Information S1, S2, S3. The results from these three sets are shown in Table 2 .

Checker total number of the different penalty scores output from subjecting the ChEMBL Literature set, the SureChEMBL set and the PubChem Set to the Checker process

concepts↗unhoused_relationscontent_tagsAs expected, the ChEMBL literature set, being derived via manual extraction and curation, generates the fewest serious penalty scores, although it is clear there are still thousands of molecules with an undesirable representation (e.g. stereo bonds in rings, atoms with multiple stereo bonds and molecules with stereo bonds to stereocentres). The PubChem deposited set includes a large number of empty molfiles and unknown elements (often represented as an asterix, “*”) in addition to molecules containing overlapping atoms. The SureChEMBL set has a large number of compounds with V3000 formatted molfiles, radical entities as well as bonds with illegal stereo flags (usually molfiles with a 4 in the bond stereo field of the bond block). The difference between these sets is not surprising given the differences in the data sources, confirming that the Checker is suitable for identifying a range of different issues of differing severity for datasets of diverse origin.

content_tagscontent_tagscontent_tagscontent_tagscontent_tagsA breakdown of the number of compounds from each set which returned penalty scores is shown in Table 3 . When more than one score is returned for a compound the highest score is reported. It is worth noting that 75% of the ChEMBL literature set compounds and 60% of both the SureChEMBL and PubChem compound sets showed no issues in the Checker tests. When structures with a penalty score of 2 associated with InChI Warnings such as “omitted undefined stereo” and “InChI: Charges were rearranged” are excluded (as described above) then the proportion of compounds with undesirable features that would benefit from correction falls to between 4 and 11%.

Percentages of the compounds in each of the SureChEMBL, ChEMBL and PubChem sets returning each value as their maximum penalty score

content_tagscontent_tagsFrom a ChEMBL perspective the compounds in the latest released version of the database (ChEMBL 26) have also been subjected to the Checker analysis and this has enabled the identification of small sets of compounds with particular problems that were not previously identified. This dataset is available as an sd file on the ChEMBL FTP site [ 38 ]. These have been prioritised for curation for a subsequent ChEMBL release. The numbers of compounds with penalty scores 5 and 6 are summarised in Table 4 . Those considered to be the highest priority for curation are compounds with a penalty score of 6 (69 compounds). In future the structures of molecules with penalty scores of 6 will not be added to the database until they have been manually checked and corrected.

Checker penalty scores on the current version of ChEMBL (ChEMBL 26)

content_tagsThe ~ 2500 compounds with penalty scores of 5 are placed in a group for second-tier curation with the following penalty annotations being prioritised:

molecule has a crossed bond in a ring (632 compounds). This set does however need to be further divided depending on the ring size. It is considered a more serious issue for small rings than large rings where it is not always clear whether cis, trans or either orientation is correct.

molecule has two (or more) atoms with exactly the same coordinates (273 compounds)

Those compounds with mismatches in the number of stereocentres will then be addressed.

Standardizer component

sensesExamples of applying the Standardizer to some “ChEMBL-like” molecules are shown in Fig. 2 . These examples show some of the specific standardisations described in the methods section for which the Standardizer component was designed to correct. Also, as described above, there will be differences between the last two versions of ChEMBL (versions 25 and 26) due to the re-standardisation as well as the manual curation that took place between the two releases. Comparing the structures in these two releases does not give any useful statistics on the effectiveness of the new Standardizer . Instead, to investigate this, the three sets of molecules previously described have been standardised by the new Standardizer module. The critical differences are where the new standardisation results in a different InChI from the one obtained prior to standardisation.

Examples of standardisations that have been applied to a set of compounds. The compound structure before and after standardisation is shown. a Fix hypervalent nitro groups, b remove explicit H atoms, c fix covalently drawn alkaline metals connected to O or N to ionic forms, d Standardise sulphoxides to charge separated form, e normalise (straighten) allene bonds

concepts↗unhoused_relationscontent_tagscontent_tagscontent_tags↗The percentage of molecules with changed InChIs are low for all datasets and always < 2% in each case. The majority of the changes occur where the Standardizer has neutralised a previously charged molecule, for example by removing a proton from a positively charged nitrogen or protonating a carboxyl group. A summary of these changes is shown in Table 5 . This also indicates which layer of the InChI has changed. Whilst initially it may appear that changes to the connectivity layer are unexpected for a standardisation process these examples are due to salts where the overall molfile is not neutral and where a proton has been removed to confer neutrality. To further exemplify this, some examples from the ChEMBL literature set are shown in Fig. 3 where the effect of standardisation on neutralising the molecules can be observed.

Summary of the number of compounds that have changed InChIKeys following standardisation for the SureChEMBL, ChEMBL literature and PubChem deposited set

Examples of compounds from the ChEMBL literature set where the InChIKey changed on standardisation due to the rebalancing of the charge on the compound

mechanisms↗limitationscontrolsconcepts↗concepts↗unhoused_relationsclaim_relationsconcept_edgescontent_tagscontent_tagscontent_tagscontent_tags↗As different databases use different rules to standardise compound structures, it was of interest to compare the new ChEMBL Standardizer with the standardiser used by the PubChem database [ 39 ]. However, as the PubChem PUG service was slow to run via their API, only a small set of compounds were used for this comparison and comprised approved small molecule drugs as annotated in ChEMBL 25 (3071 compounds). This dataset is provided as an sd file in Supplementary Information S4. The ChEMBL 25 structures for these were taken and standardised using the new ChEMBL RDKit Standardizer and also the PubChem standardiser. In total there were 97 compounds that gave different Standard InChIKeys after the respective standardisations. The key difference is that the PubChem standardiser generates a canonical tautomer as part of the process but ChEMBL does not. In many instances this is not reflected by a change to the Standard InChI but for some molecules the InChI does change. There are also some differences in the double bond representation (cis or trans (either)). Furthermore, PubChem generates all structures with explicit hydrogens which are not present in the ChEMBL structures. Some of these examples are shown in Fig. 4 .

Examples of approved drugs standardised by the ChEMBL RDKit Standardizer and the PubChem standardiser

GetParent component

concepts↗content_tagscontent_tagscontent_tags↗content_tagscontent_tagsThe GetParent module was used to obtain the parent structures for the standardised structures from ChEMBL where these contained more than one component or an isotope. This resulted in over 100,000 compounds where a salt, solvent, isotope or combination thereof could be removed to create a parent structure. Molfiles that are a mixture of components can contain a number of different combinations such as: a parent and its salts; a parent, its salts and solvent; a combination of only salts; or a true mixture. A true mixture, for example, would include compounds such as Co-trimoxazole (CHEMBL58061) which is a marketed product comprising trimethoprim and sulfamethoxazole and which has been tested as a combination in a number of bioactivity assays. Additionally, any of these multicomponent compounds may have been tested for bioactivity or used in a clinical setting as a specific isotopic form. A summary of the composition of the multicomponent compounds in ChEMBL 26 are shown in Fig. 5 . Whilst only ~ 6% of the compounds in ChEMBL are multicomponent (mostly salts), these compounds have over a million activity values recorded against them.

The composition and number of the compounds containing more than one component in ChEMBL 26 as identified by the GetParent module. The numbers in brackets refer to the number of compounds in each grouping that contain isotopes

Some examples of the output from the GetParent process are shown in Fig. 6 . This illustrates a number of features of the GetParent module including the need to re-standardise a parent to some extent once a salt is removed, and in particular to re-neutralise the charges on the parent molecule. The sodium salt of a carboxyl-containing compound is an obvious example of this. Once the Na+ cation is removed this leaves a net negative change on the parent so the GetParent module will add a proton to neutralise it. Quaternary nitrogen compounds are the exception, where the counterion (for example a chloride) is removed but, due to the quaternary nature of the nitrogen, it is not possible to neutralise the parent which therefore remains as the positively charged cation. Another important function of the GetParent module is that if a compound is a 2:1 complex with two parent molecules and one salt molecule, when the GetParent module is applied it can recognise that the two components remaining after salt removal are identical and so only one molecule is returned as the parent. Atorvastatin calcium is an example of this as can be seen in Fig. 6 .

Examples of applying the GetParent module to some representative ChEMBL compounds containing varying combinations of salts, isotopes and solvents. The “Child” is the compound before and “Parent” the compound after the process has been applied

Future work

Now that the components of the curation pipeline are being used in a production context for curation of compounds being added to the ChEMBL database, it will provide opportunities to review and refine any of the rules on the basis of a large consistently standardised dataset. The ChEMBL group will continue to evolve the curation pipeline as further needs are identified. The code is also now freely available to the community and other researchers are encouraged to suggest modifications so that the curation pipeline can improve further over time. Comments and issues can be added to the issues section of the ChEMBL Structure Pipeline GitHub repository [ 28 ].

Conclusion

contributionlimitationsconcepts↗unhoused_relationssensescontent_tagscontent_tags↗content_tags↗The three components of the structure curation pipeline described here have been developed as an open source project and are now available for researchers to use and adapt for their own applications. These components have been used by the ChEMBL group to produce the chemical structures in the latest release of the ChEMBL database (ChEMBL26). This has resulted in the correction of certain errors in standardisation that were present in previous ChEMBL releases and the identification of other issues that can now be prioritised for future manual curation. Additionally, the pipeline has been tested on less well curated datasets and demonstrated to be sufficiently robust to be used in the automatic structure checking and standardisation of such datasets. A comparison between the standardiser used by PubChem (another large publicly available database) and the one developed here gave only a small percentage of compounds with non-identical structures (defined as having different Standard InChIs). Where such differences were present this was largely due to variations in the business rules of the two database providers.

Acknowledgements

The authors would like to explicitly acknowledge the indirect contributions of Matt Swain, the original author of the standalone MolVS package, and Susan Leung, who ported the python version of MolVS to C++ and integrated it into the RDKit core.

Authors’ contributions

APB, AH, AG and ARL initiated and organised the work. LJB developed the original curation pipeline, which this work is built upon. APB, AH, AG, LJB, MdV and FA devised the business rules. GL, EF and APB developed and wrote the code. AG and EF implemented the pipeline. LJB and MdV curated the data. AH, APB and AG performed the analysis and wrote the manuscript with contributions from GL, EF and ARL. All authors read and approved the final manuscript.

Funding

This work was funded by Strategic Awards from the Wellcome Trust [WT086151/Z/08/Z, WT104104/Z/14/Z] and the Member States of the European Molecular Biology Laboratory (EMBL); Funding for open access charge: Wellcome Trust.

Availability of data and materials

The datasets used for the analyses are provided as sd files in Supplementary Files. S1_surechembl_set, S2_pubchem_set, S3_chembl_literature_set, S4_approved_drug_set and are available from the ChEMBL FTP site: ftp://ftp.ebi.ac.uk/pub/databases/chembl/standardiser_data_sets .

Competing interests

The authors have no competing interests.

Footnotes

References

Associated Data

Data Citations

Data Availability Statement

The datasets used for the analyses are provided as sd files in Supplementary Files. S1_surechembl_set, S2_pubchem_set, S3_chembl_literature_set, S4_approved_drug_set and are available from the ChEMBL FTP site: ftp://ftp.ebi.ac.uk/pub/databases/chembl/standardiser_data_sets .

Every tag on this page

claim_relations 4 · claim_type 1 · concept_edges 6 · concepts 52 · content_tags 61 · contribution 1 · controls 4 · limitations 12 · mechanisms 13 · method 1 · object_of_study 1 · phenomenon 1 · research_question 1 · senses 12 · unhoused_relations 14

Relations on this page carry a quotation for the claim. Where a relation was separately evidenced — and so tested against the vocabulary for its type — the row says so; 6 of 6 relations here carry that mark. The rest are the tagger’s reading of the sentence quoted beside them.

facettagfieldconf.whose words
object_of_studyautomated validation, standardization, and parent generation for chemical structures entering ChEMBLobject_of_studythe paper's words
research_questionwhether a maintainable open-source RDKit pipeline can curate diverse chemical-structure inputs robustly and replace ChEMBL's commercial legacy workflowresearch_questionthe paper's words
contributiona public three-component ChEMBL structure pipeline, revised curation rules, production deployment, and comparative tests on curated and uncurated datasetscontributionthe paper's words
claim_typemethodclaim_typethe paper's words
phenomenonchemical-structure identity, representation errors, standardization differences, salt and isotope parentage, and bioactivity aggregationphenomenonthe paper's words
methodsystem-or-tool-buildingmethodthe paper's words
mechanismsDetects structure problems, emits severity scores, and sends prioritized cases to manual curation.
also in: Checker
mechanisms[0]0.95the tagger's words
mechanismsApplies a deterministic sequence of predefined formatting and chemistry rules.
also in: Standardizer
mechanisms[1]0.95the tagger's words
mechanismsRemoves permitted salts, solvents, and isotope information before neutralizing the parent.
also in: GetParent
mechanisms[2]0.95the tagger's words
mechanismsFolds source-specific structures onto ChEMBL compound identity and identifier assignment.mechanisms[3]0.95the tagger's words
mechanismsRoutes fatal, serious, and lower-priority issues to different loading and curation actions.
also in: penalty score
mechanisms[4]0.95the tagger's words
mechanismsCompare stereocentre counts perceived by molfile, InChI, and RDKit methods.mechanisms[5]0.95the tagger's words
mechanismsPrevents unsafe automatic standardization for representations unsupported by V2000.
also in: exclude flag
mechanisms[6]0.95the tagger's words
mechanismsRepairs charge, valence, aromatic, tautomeric, and bond conventions.mechanisms[7]0.95the tagger's words
mechanismsAdds, removes, or moves hydrogens between atoms and components where possible.mechanisms[8]0.95the tagger's words
mechanismsMakes ambiguous proton additions reproducible for the same input molecule.mechanisms[9]0.95the tagger's words
mechanismsGroups bioactivity from related salts and isotopes without changing the measured-form record.mechanisms[10]0.95the tagger's words
mechanismsTests manually drawn, patent-extracted, and depositor-supplied structures.mechanisms[11]0.95the tagger's words
mechanismsCompares Standard InChIKeys after ChEMBL and PubChem rules process the same approved drugs.mechanisms[12]0.95the tagger's words
limitationsIncoming compounds are not consistently standardized across sources.limitations[0]0.95the tagger's words
limitationsManual curation cannot keep up with more than fifty thousand new structures per release.limitations[1]0.95the tagger's words
limitationsNo universal molfile or SMILES standard prevents subtle conversion changes.limitations[2]0.95the tagger's words
limitationsStandard InChI misses some tautomerism and organometallic cis-trans identity and cannot encode relative stereochemistry.limitations[3]0.95the tagger's words
limitationsThe legacy commercial workflow became hard to maintain and modify.limitations[4]0.95the tagger's words
limitationsAn automated standardizer can safely correct only some imperfect or ambiguous structures.limitations[5]0.95the tagger's words
limitationsV2000 molfiles cannot accurately represent coordination bonds in excluded compound classes.limitations[6]0.95the tagger's words
limitationsAmbiguous proton placement requires an arbitrary, though canonical, choice.limitations[7]0.95the tagger's words
limitationsUnsafe removal of components from organometallic compounds can yield an invalid ion as the parent.limitations[8]0.95the tagger's words
limitationsThe Standardizer's quality improvement cannot be quantified unambiguously because it inherits many legacy rules.limitations[9]0.95the tagger's words
limitationsThe PubChem comparison used only a small compound set because its API was slow.limitations[10]0.95the tagger's words
limitationsStandardization differences remain dependent on database-specific business rules.limitations[11]0.95the tagger's words
controlsthree datasets with distinct curation and extraction origins
eliminates: dependence of Checker utility on one input source · outcome: held
controls[0]0.95the tagger's words
controlsthe same approved-drug structures processed by ChEMBL and PubChem standardizers
eliminates: different starting compounds as the explanation for output differences · outcome: held
controls[1]0.95the tagger's words
controlscomplete re-standardization of ChEMBL 26
eliminates: inconsistent legacy starting rules within the production database · outcome: held
controls[2]0.95the tagger's words
controlsmanual-curated, patent-extracted, and unstandardized depositor sets
eliminates: one data-quality regime as the sole test condition · outcome: held
controls[3]0.95the tagger's words
conceptsChEMBL databaseconcepts[0]0.95the paper's words
conceptsbioactivity dataconcepts[1]0.95the paper's words
conceptssmall molecule compoundsconcepts[2]0.95the paper's words
conceptschemical structuresconcepts[3]0.95the paper's words
conceptschemical curation pipelineconcepts[4]0.95the paper's words
conceptsRDKit
also in: RDKit
concepts[5]0.95the paper's words
conceptsChecker
also in: Checker
concepts[6]0.95the paper's words
conceptsStandardizer
also in: Standardizer
concepts[7]0.95the paper's words
conceptsGetParent
also in: GetParent
concepts[8]0.95the paper's words
conceptsmanual curationconcepts[9]0.95the paper's words
conceptsautomated procedureconcepts[10]0.95the paper's words
conceptsmolfiles
also in: molfiles
concepts[11]0.95the paper's words
conceptsSMILES
also in: SMILES
concepts[12]0.95the paper's words
conceptsV2000 molfile
also in: V2000 molfile
concepts[13]0.95the paper's words
conceptsStandard InChIconcepts[14]0.95the paper's words
conceptsidentifier
also in: identifier
concepts[15]0.95the paper's words
conceptsuniqueness for a chemical structureconcepts[16]0.95the paper's words
conceptsInChIKey
also in: InChIKey
concepts[17]0.95the paper's words
conceptsChEMBL identifierconcepts[18]0.95the paper's words
conceptscanonical SMILESconcepts[19]0.95the paper's words
conceptscanonical tautomerconcepts[20]0.95the paper's words
conceptslegacy pipelineconcepts[21]0.95the paper's words
conceptsMolVS
also in: MolVS
concepts[22]0.95the paper's words
conceptspenalty score
also in: penalty score
concepts[23]0.95the paper's words
conceptsseverity of the perceived problemconcepts[24]0.95the paper's words
conceptswarning flag
also in: warning flag
concepts[25]0.95the paper's words
conceptsfatal error
also in: fatal error
concepts[26]0.95the paper's words
conceptsstereocentres
also in: stereocentres
concepts[27]0.95the paper's words
conceptsstereo mismatchconcepts[28]0.95the paper's words
conceptsexclude flag
also in: exclude flag
concepts[29]0.95the paper's words
conceptscoordination bondsconcepts[30]0.95the paper's words
conceptsexplicit H atomsconcepts[31]0.95the paper's words
conceptshypervalent nitro groupsconcepts[32]0.95the paper's words
conceptsneutralised
also in: neutralised
concepts[33]0.95the paper's words
conceptsarbitrary choiceconcepts[34]0.95the paper's words
conceptssalt form
also in: salt form
concepts[35]0.95the paper's words
conceptsparent structureconcepts[36]0.95the paper's words
conceptsconnected componentconcepts[37]0.95the paper's words
conceptsisotopes
also in: isotopes
concepts[38]0.95the paper's words
conceptssolvents
also in: solvents
concepts[39]0.95the paper's words
conceptssalts
also in: salts
concepts[40]0.95the paper's words
conceptsgenuine mixturesconcepts[41]0.95the paper's words
conceptsparent aggregation processconcepts[42]0.95the paper's words
conceptsChEMBL 26
also in: ChEMBL 26
concepts[43]0.95the paper's words
conceptsChEMBL literature setconcepts[44]0.95the paper's words
conceptsSureChEMBL
also in: SureChEMBL
concepts[45]0.95the paper's words
conceptsPubChem
also in: PubChem
concepts[46]0.95the paper's words
conceptsPubChem standardiserconcepts[47]0.95the paper's words
conceptschanged InChIsconcepts[48]0.95the paper's words
conceptsdifferent Standard InChIKeysconcepts[49]0.95the paper's words
conceptsmulticomponent compoundsconcepts[50]0.95the paper's words
conceptsbusiness rulesconcepts[51]0.95the paper's words
unhoused_relationsincoming compounds → chemical standardisation
Incoming structures require standardization before reliable comparison and integration.
unhoused_relations[0]0.95the tagger's words
unhoused_relationsStandard InChI and InChIKey equality → ChEMBL identifier
Equal identifiers make structures count as the same compound and receive one ChEMBL identifier.
unhoused_relations[1]0.95the tagger's words
unhoused_relationschemical structure format conversion → subtle structure changes
Loading structures across packages can subtly change them.
unhoused_relations[2]0.95the tagger's words
unhoused_relationslegacy pipeline → difficult maintenance
Accumulated exceptions made the legacy code difficult to maintain and modify.
unhoused_relations[3]0.95the tagger's words
unhoused_relationschemical curation pipeline → eTOX standardiser tool
The new pipeline is explicitly not a replacement for the molecular-modelling standardiser.
unhoused_relations[4]0.95the tagger's words
unhoused_relationspenalty score → manual curation priority
Penalty severity determines loading and manual-curation priority.
unhoused_relations[5]0.95the tagger's words
unhoused_relationsV2000 molfile → coordination bonds
V2000 cannot accurately represent coordination bonds.
unhoused_relations[6]0.95the tagger's words
unhoused_relationsGetParent → parent structure
GetParent removes listed components and transforms the remainder into a neutralized parent.
unhoused_relations[7]0.95the tagger's words
unhoused_relationsorganometallic compounds → salt removal
Organometallic compounds do not have salts removed because the transformation can create an invalid parent ion.
unhoused_relations[8]0.95the tagger's words
unhoused_relationsparent aggregation process → bioactivity data
Parent aggregation groups measurements across related forms while preserving measured-form registration.
unhoused_relations[9]0.95the tagger's words
unhoused_relationsdifferent data sources → different Checker issue profiles
Datasets of different origin exhibit different structural-error profiles.
unhoused_relations[10]0.95the tagger's words
unhoused_relationsStandardizer neutralisation → changed InChIs
Most identity changes occur when the Standardizer neutralizes a charged molecule.
unhoused_relations[11]0.95the tagger's words
unhoused_relationscanonical tautomer policy → different Standard InChIKeys
PubChem's canonical-tautomer policy is a key source of cross-standardizer differences.
unhoused_relations[12]0.95the tagger's words
unhoused_relationsdatabase business rules → non-identical structures
Residual ChEMBL-PubChem differences are largely due to provider business rules.
unhoused_relations[13]0.95the tagger's words
senseschemical identity as equality of Standard InChI and InChIKeysenses[0]0.95the tagger's words
sensesStandard InChI as an identifier rather than an application-ready structure formatsenses[1]0.95the tagger's words
sensescanonical SMILES as secondary representation rather than primary identitysenses[2]0.95the tagger's words
sensesChecker warning as prioritization rather than automatic correctionsenses[3]0.95the tagger's words
sensespenalty seven as refusal, six as structure withholding, and lower scores as curation prioritysenses[4]0.95the tagger's words
senseslow-priority InChI warnings as context dependent rather than universal errorssenses[5]0.95the tagger's words
sensesstandardization as safe rule application under imperfect source drawingssenses[6]0.95the tagger's words
sensesparent as a neutralized grouping structure rather than the necessarily measured formsenses[7]0.95the tagger's words
sensesgenuine mixture as a retained multicomponent parentsenses[8]0.95the tagger's words
sensesorganometallic exclusion as a representation limit rather than missing bioactivitysenses[9]0.95the tagger's words
sensesStandardizer effectiveness as changed InChI rather than release-to-release differencesenses[10]0.95the tagger's words
sensescross-database disagreement as a business-rule difference rather than simple errorsenses[11]0.95the tagger's words
claim_relationsbuilds-on → the legacy ChEMBL structure-curation pipeline
note: The new implementation retains and revises accumulated ChEMBL rules.
claim_relations[0]0.95the tagger's words
claim_relationsbuilds-on → RDKit and MolVS
note: The implementation is explicitly built around these open-source tools.
claim_relations[1]0.95the tagger's words
claim_relationscontrasts-with → commercial chemical-standardization software
note: Removing commercial dependency is a stated design goal.
claim_relations[2]0.95the tagger's words
claim_relationscontrasts-with → the PubChem standardizer
note: The paper directly compares output identity and policy differences.
claim_relations[3]0.95the tagger's words
concept_edgesChecker —part-of→ chemical curation pipeline
the relation itself is separately evidenced · strength of the relation: 1 · note: Explicit component membership. · the relation stated: The chemical curation pipeline comprises a Checker component.
concept_edges[0]0.95the tagger's words
concept_edgesStandardizer —part-of→ chemical curation pipeline
the relation itself is separately evidenced · strength of the relation: 1 · note: Explicit component membership. · the relation stated: The chemical curation pipeline comprises a Standardizer component.
concept_edges[1]0.95the tagger's words
concept_edgesGetParent —part-of→ chemical curation pipeline
the relation itself is separately evidenced · strength of the relation: 1 · note: Explicit component membership. · the relation stated: The chemical curation pipeline comprises a GetParent component.
concept_edges[2]0.95the tagger's words
concept_edgesV2000 molfile —is-a→ chemical structures
the relation itself is separately evidenced · strength of the relation: 1 · note: Direct categorical representation statement. · the relation stated: A standardized V2000 molfile is the primary chemical-structure representation in ChEMBL. Audit 2026-09-29: DOUBTFUL - read against its full span and kept, but the span calls the molfile the primary chemical structure REPRESENTATION; is-a 'chemical structures' is loose.
concept_edges[3]0.95the tagger's words
concept_edgesStandard InChI —is-a→ identifier
the relation itself is separately evidenced · strength of the relation: 1 · note: Direct categorical definition. · the relation stated: Standard InChI was designed as an identifier rather than a structure format.
concept_edges[4]0.95the tagger's words
concept_edgesStandardizer —contrasted-with→ PubChem standardiser
the relation itself is separately evidenced · strength of the relation: 0.95 · note: Direct comparison of outputs and rules. · the relation stated: The ChEMBL Standardizer is directly compared with the PubChem standardiser on approved drugs.
concept_edges[7]0.95the tagger's words
content_tagsThe pipeline standardized nearly two million ChEMBL compounds and prioritized severe structural issues for manual curation.content_tags.findings[0]0.95the tagger's words
content_tagsThe open-source pipeline consists of Checker, Standardizer, and GetParent components.content_tags.findings[1]0.95the tagger's words
content_tagsMore than 50,000 new structures per release make purely manual ChEMBL curation impracticable.content_tags.findings[2]0.95the tagger's words
content_tagsNo universal standard exists for molfile and SMILES structure formats, and conversion can subtly change structures.content_tags.findings[3]0.95the tagger's words
content_tagsStandard InChI provides a practical but imperfect identity compromise for ChEMBL.content_tags.findings[4]0.95the tagger's words
content_tagsThe legacy commercial pipeline had become difficult to maintain and modify.content_tags.findings[5]0.95the tagger's words
content_tagsPenalty score seven prevents loading, six loads without a molfile, and five or two triggers manual-curation priority.content_tags.findings[6]0.95the tagger's words
content_tagsThe standardizer excludes structures that V2000 molfiles cannot represent accurately.content_tags.findings[7]0.95the tagger's words
content_tagsGetParent removes isotopes, solvents, and salts, neutralizes the remainder, and creates a parent molfile when safe.content_tags.findings[8]0.95the tagger's words
content_tagsThe salt and solvent lists currently contain 162 salts and 9 solvents.content_tags.findings[9]0.95the tagger's words
content_tagsBioactivity remains registered against the experimentally measured form even though parent aggregation groups related forms.content_tags.findings[10]0.95the tagger's words
content_tagsThe Checker found source-specific error profiles across ChEMBL literature, SureChEMBL, and PubChem deposits.content_tags.findings[11]0.95the tagger's words
content_tagsSeventy-five percent of ChEMBL literature compounds and sixty percent of SureChEMBL and PubChem compounds returned no Checker issue.content_tags.findings[12]0.95the tagger's words
content_tagsExcluding low-priority InChI warnings reduced undesirable-feature rates to between four and eleven percent.content_tags.findings[13]0.95the tagger's words
content_tagsSixty-nine ChEMBL 26 compounds with penalty score six were assigned highest curation priority.content_tags.findings[14]0.95the tagger's words
content_tagsFewer than two percent of molecules in each test set changed InChI under the Standardizer.content_tags.findings[15]0.95the tagger's words
content_tagsChEMBL and PubChem standardizers disagreed on 97 of 3,071 approved drugs.content_tags.findings[16]0.95the tagger's words
content_tagsGetParent produced parent structures for more than 100,000 multi-component or isotopic compounds.content_tags.findings[17]0.95the tagger's words
content_tagsOnly about six percent of ChEMBL compounds are multi-component, yet they carry over one million activity values.content_tags.findings[18]0.95the tagger's words
content_tagsThe pipeline corrected previous standardization errors and robustly handled less curated datasets.content_tags.findings[19]0.95the tagger's words
content_tagsthe component that validates structures, flags problems, and assigns severity penalties
also in: Checker
content_tags.definitions[0]0.95the tagger's words
content_tagsthe component applying predefined chemical-structure rules and conventions
also in: Standardizer
content_tags.definitions[1]0.95the tagger's words
content_tagsthe component generating parent structures from rules and salt-solvent lists
also in: GetParent
content_tags.definitions[2]0.95the tagger's words
content_tagsChEMBL's primary open identifier and measure of chemical-structure uniquenesscontent_tags.definitions[3]0.95the tagger's words
content_tagsthe hashed companion to Standard InChI used in ChEMBL identity assignment
also in: InChIKey
content_tags.definitions[4]0.95the tagger's words
content_tagsthe neutralized structure remaining after removable salts and solvents are strippedcontent_tags.definitions[5]0.95the tagger's words
content_tagsa Checker penalty seven that prevents a molfile from loading
also in: fatal error
content_tags.definitions[6]0.95the tagger's words
content_tagsdisagreement among molfile, InChI, and RDKit stereocentre countscontent_tags.definitions[7]0.95the tagger's words
content_tagsa marker preventing attempted standardization of unsupported compound types
also in: exclude flag
content_tags.definitions[8]0.95the tagger's words
content_tagsa structure containing parents, salts, solvents, isotopes, or genuine mixturescontent_tags.definitions[9]0.95the tagger's words
content_tagsdatabase-specific standardization policies explaining residual ChEMBL-PubChem differencescontent_tags.definitions[11]0.95the tagger's words
content_tagsclose to 2.5 million — ChEMBL compound recordscontent_tags.quantities[0]0.95the tagger's words
content_tagsnearly 2 million — unique ChEMBL chemical structurescontent_tags.quantities[1]0.95the tagger's words
content_tagsover 5000 — compounds with data from at least ten sourcescontent_tags.quantities[2]0.95the tagger's words
content_tagsmore than 50000 — new structures added per ChEMBL releasecontent_tags.quantities[3]0.95the tagger's words
content_tags7 — fatal Checker penaltycontent_tags.quantities[4]0.95the tagger's words
content_tags6 — significant-issue penalty that loads without a molfilecontent_tags.quantities[5]0.95the tagger's words
content_tagsmore than 7 — boron-atom threshold for excluding a molecule from standardizationcontent_tags.quantities[6]0.95the tagger's words
content_tags162 — salts in the current GetParent listcontent_tags.quantities[7]0.95the tagger's words
content_tags9 — solvents in the current GetParent listcontent_tags.quantities[8]0.95the tagger's words
content_tags1.9 million — ChEMBL 26 compounds fully re-standardizedcontent_tags.quantities[9]0.95the tagger's words
content_tags75% — ChEMBL literature compounds with no Checker issuecontent_tags.quantities[10]0.95the tagger's words
content_tags60% — SureChEMBL and PubChem compounds with no Checker issuecontent_tags.quantities[11]0.95the tagger's words
content_tags4 to 11% — undesirable-feature range after low-priority warnings are excludedcontent_tags.quantities[12]0.95the tagger's words
content_tags69 — ChEMBL 26 compounds assigned highest penalty-six prioritycontent_tags.quantities[13]0.95the tagger's words
content_tagsabout 2500 — penalty-five compounds assigned second-tier curationcontent_tags.quantities[14]0.95the tagger's words
content_tagsless than 2% — molecules with changed InChI in each Standardizer test setcontent_tags.quantities[15]0.95the tagger's words
content_tags3071 — approved drugs used for ChEMBL-PubChem comparisoncontent_tags.quantities[16]0.95the tagger's words
content_tags97 — approved drugs with different Standard InChIKeys between standardizerscontent_tags.quantities[17]0.95the tagger's words
content_tagsover 100000 — compounds for which GetParent removed salts, solvents, isotopes, or combinationscontent_tags.quantities[18]0.95the tagger's words
content_tagsabout 6% — share of ChEMBL compounds that are multicomponentcontent_tags.quantities[19]0.95the tagger's words
content_tagspenalty score
also in: penalty score
content_tags.variables[0]0.95the tagger's words
content_tagsStandard InChIcontent_tags.variables[1]0.95the tagger's words
content_tagsstereocentre countscontent_tags.variables[2]0.95the tagger's words
content_tagsdata source
also in: data source
content_tags.variables[3]0.95the tagger's words
content_tagschanged InChIscontent_tags.variables[4]0.95the tagger's words
content_tagscanonical tautomercontent_tags.variables[5]0.95the tagger's words
content_tagscharge status
also in: charge status
content_tags.variables[6]0.95the tagger's words
content_tagsstereochemistrycontent_tags.variables[7]0.95the tagger's words
content_tagsbioactivity datacontent_tags.variables[8]0.95the tagger's words
content_tagsbusiness rulescontent_tags.variables[9]0.95the tagger's words

Interpretive choices

Tags that could not be placed in the text:

What was deliberately not tagged, and why, is recorded per paper by the tagger. Where a paper has no such record, this page says so rather than implying that nothing was declined.

© 2026 Shir Sivroni · ORCID 0009-0000-2597-2824