NPOmix: A machine learning classifier to connect mass spectrometry fragmentation data to biosynthetic gene clusters — TEI-tagged view

Tiago F Leão, Mingxun Wang, Ricardo da Silva, Alexey Gurevich, Anelize Bauermeister, Paulo Wender P Gomes, Asker Brejnrod, Evgenia Glukhov, Allegra T Aron, Joris J R Louwen, Hyun Woo Kim, Raphael Reher, Marli F Fiore, Justin J J van der Hooft, Lena Gerwick, William H Gerwick, Nuno Bandeira, Pieter C Dorrestein · 2022 · computer-science · doi:10.1093/pnasnexus/pgac257 · TEI xml · tagged edition · index · concepts · authors
Where this record's text came from. 2026-09-27 schema-0.3 pass: every quote ON THIS RECORD verified as an exact substring of the staged text and anchored, at the merge dated above; concept terms verified present; every edge endpoint an existing node.
3 quotes on this page break a word across a line. The PDF this text was extracted from hyphenated those words at the end of a printed line — adversar- ial, repre- sentations — and the extractor kept the hyphen and the space. The quotes keep them because a quote is reproduced exactly or it proves nothing: the break is the typesetter’s, not the author’s. A search of this page will not find the affected words.
Other fields define these differently the same word, defined another way in another discipline
Precision 10 fields · measurement 2 fields
Tags on this paper every tag the record carries, whether or not the words occur in the text below — a number is how many papers in the corpus carry that tag; a tag with no number is unique to this paper
Natural Products Mixed Omics NPOmix biosynthetic gene clusters BGCs gene cluster family GCF K -Nearest Neighbor2 KNN2 Liquid chromatography coupled with tandem mass spectrometry LC-MS/MS Jaccard index2 measurement3 system-or-tool-building173

Colour legend

PNAS Nexus<title level="j">A work — the journal / venue title.
2022<date>A year or date.

Tiago F LeãopersName, Mingxun WangpersName, Ricardo da SilvapersName, Alexey GurevichpersName, Anelize BauermeisterpersName, Paulo Wender P GomespersName, Asker BrejnrodpersName, Evgenia GlukhovpersName, Allegra T AronpersName, Joris J R LouwenpersName, Hyun Woo KimpersName, Raphael ReherpersName, Marli F FiorepersName, Justin J J van der HooftpersName, Lena GerwickpersName, William H GerwickpersName, Nuno BandeirapersName, Pieter C DorresteinpersName (2022date). “NPOmix: A machine learning classifier to connect mass spectrometry fragmentation data to biosynthetic gene clusters.” PNAS Nexustitle·j.

Object of study — linking mass spectrometryterm·key fragmentation spectra of microbial metabolites to the biosynthetic gene clustersterm·dom that make them

Research question — how to connect microbial metabolites to their biosynthetic gene clustersterm·dom with confidence, at repository scale

Contribution — NPOmixterm·mth, a k-nearest-neighbour classifier that links MS/MS spectra to gene cluster families from paired omics data

Cross-disciplinary analysis
content-tags & facets: phenomenon · claim-type · cross-domain-transfer · mechanism · claim-relation · replication-status · limitation — grounded in the full text
phenomenongenome mining of microbial specialized metabolites — “We conclude that NPOmix minimizes the need for culturing (it worked well on microbiomes) and facilitates specialized metabolite prioritization based on integrative omics mining.”
claim-typemethod — “Here, we present a k -nearest neighbor classifier to systematically connect mass spectrometry fragmentation spectra to their corresponding biosynthetic gene clusters (independent of their chemical class).”
method — evidence — “We illustrated a computational example of how to use our Natural Products Mixed Omics (NPOmix) tool for siderophore mining that can be reproduced by the users.”
object of study — evidence — “Here, we present a k -nearest neighbor classifier to systematically connect mass spectrometry fragmentation spectra to their corresponding biosynthetic gene clusters (independent of their chemical class).”
research question — evidence — “However, one of the challenges in the genome mining field is connecting microbial metabolites to their BGCs with confidence.”
contribution — evidence — “Here, we present a k -nearest neighbor classifier to systematically connect mass spectrometry fragmentation spectra to their corresponding biosynthetic gene clusters (independent of their chemical class).”
mechanismfingerprint nearest-neighbour linking BGC fingerprints are plotted in a feature space and each MS/MS fingerprint takes the family labels of its nearest BGC neighbours. — “In more detail, the KNN algorithm links BGCs to fragmented metabolites (represented by their MS/MS spectra) by plotting the BGC fingerprints in the KNN feature space”mechanisms[0]
sensemulti-omics dereplication - a spectrum's fingerprint across paired samples is matched to the nearest gene-cluster fingerprints, so a metabolite inherits a gene cluster family label — “In more detail, the KNN algorithm links BGCs to fragmented metabolites (represented by their MS/MS spectra) by plotting the BGC fingerprints in the KNN feature space”senses[0]
relationNPOmix —same-as→ Natural Products Mixed Omics — (NPOmix) — “We illustrated a computational example of how to use our Natural Products Mixed Omics (NPOmix) tool for siderophore mining that can be reproduced by the users.”concept_edges[0]
weightNPOmix —same-as→ Natural Products Mixed Omics — 0.95 — “We illustrated a computational example of how to use our Natural Products Mixed Omics (NPOmix) tool for siderophore mining that can be reproduced by the users.”concept_edges[0]
relationBGCs —same-as→ biosynthetic gene clusters — (BGCs) — “Microbial specialized metabolites are often made by biosynthetic genes that are physically grouped into clusters known as biosynthetic gene clusters (BGCs).”concept_edges[1]
weightBGCs —same-as→ biosynthetic gene clusters — 0.95 — “Microbial specialized metabolites are often made by biosynthetic genes that are physically grouped into clusters known as biosynthetic gene clusters (BGCs).”concept_edges[1]
relationGCF —same-as→ gene cluster family — (GCF, — “we deployed a K -Nearest Neighbor (KNN) algorithm that uses similarity BGC fingerprints and analogously similarity MS/MS fingerprints to classify gene cluster family (GCF, a group of similar BGCs) candidates for each MS/MS spectrum.”concept_edges[2]
weightGCF —same-as→ gene cluster family — 0.9 — “we deployed a K -Nearest Neighbor (KNN) algorithm that uses similarity BGC fingerprints and analogously similarity MS/MS fingerprints to classify gene cluster family (GCF, a group of similar BGCs) candidates for each MS/MS spectrum.”concept_edges[2]
relationKNN —same-as→ K -Nearest Neighbor — (KNN) — “we deployed a K -Nearest Neighbor (KNN) algorithm that uses similarity BGC fingerprints and analogously similarity MS/MS fingerprints to classify gene cluster family (GCF, a group of similar BGCs) candidates for each MS/MS spectrum.”concept_edges[3]
weightKNN —same-as→ K -Nearest Neighbor — 0.9 — “we deployed a K -Nearest Neighbor (KNN) algorithm that uses similarity BGC fingerprints and analogously similarity MS/MS fingerprints to classify gene cluster family (GCF, a group of similar BGCs) candidates for each MS/MS spectrum.”concept_edges[3]
relationLC-MS/MS —same-as→ Liquid chromatography coupled with tandem mass spectrometry — (LC-MS/MS) — “Liquid chromatography coupled with tandem mass spectrometry (LC-MS/MS) is an efficient technique to access metabolites from fractions and even environmental samples”concept_edges[4]
weightLC-MS/MS —same-as→ Liquid chromatography coupled with tandem mass spectrometry — 0.95 — “Liquid chromatography coupled with tandem mass spectrometry (LC-MS/MS) is an efficient technique to access metabolites from fractions and even environmental samples”concept_edges[4]
relationJaccard index —is-a→ measurement — is a — “The Jaccard index is a measurement between the number of features (similarities, biosynthetic classes, and substructure predictions) that are present or absent while comparing two fingerprints (one BGC and one MS/MS fingerprint).”concept_edges[5]
weightJaccard index —is-a→ measurement — 0.75 — “The Jaccard index is a measurement between the number of features (similarities, biosynthetic classes, and substructure predictions) that are present or absent while comparing two fingerprints (one BGC and one MS/MS fingerprint).”concept_edges[5]
replicationoriginal
limitationAs a correlation-based approach it cannot distinguish isomers or regioselectivity among homologs. — “Therefore, NPOmix (a correlation-based approach ) does not have the resolution to distinguish between isomers and regioselectivity of the various homologs.”limitations[0]
limitationEvaluation was limited by the lack of test data linking structures, spectra and gene clusters. — “The major limitation of the evaluation of our method was the lack of available test data for structures that are linked to their MS/MS spectra and biosynthetic gene clusters”limitations[1]
limitationIt applies only to organisms that have BGCs. — “We would like to acknowledge that NPOmix and the pattern-based Genome Mining approaches are limited to organisms that have BGCs”limitations[2]
limitationPerformance may drop on datasets unlike the training set. — “therefore, NPOmix features might not perform as well on a given atypical dataset.”limitations[3]
limitationMicrobiome metagenomes can yield fragmented and too few BGCs. — “A major limitation of using microbiomes for genome mining is that the quality of their metagenomes can hinder BGC assembly, leading to a smaller number of BGCs than expected and many of these BGCs can be fragmented.”limitations[4]
Content tags
content-observations: finding · quantity · variable · definition · key-term — grounded in the full text
findingWith the co-occurrence filter, 13 of 14 reference spectra were correctly labelled (precision 92.9% at top-3). — “we obtained a precision of 92.9% as 13 out of 14 reference MS/MS spectra were correctly labeled when top- n = 3”content_tags.findings[0]
findingAbout 28% of validated spectra were annotated after the co-occurrence threshold. — “We observed an annotation rate of around 28%, as 14 out of 50 MS/MS validated spectra were retained after the co-occurrence threshold.”content_tags.findings[1]
findingNPOmix correctly predicted about 2.5 times more BGC-metabolite links than other tools. — “NPOmix was able to correctly predict about 2.5 times more BGCs-metabolites links than other tools.”content_tags.findings[2]
findingAdding biosynthetic class and substructure features improves performance. — “We showed that the addition of biosynthetic class and substructure features improves the performance of our Natural Products Mixed Omics tool”content_tags.findings[3]
quantity3,331 — — “Our analysis contained 3,331 BGCs (used for training) that were present in 1,040 networked genomes/metagenomes with paired LC-MS/MS data that could be downloaded from the PoDP database.”content_tags.quantities[0]
definitionPrecision — “Precision is the ratio between the true positive links over all the tested positives (true positives plus false positives). Top- n represents how often the correct GCF label was found among the top- n labels classified by the KNN approach.”content_tags.definitions[0]
key-termsbiosynthetic gene clusters, mass spectrometry, genome mining, specialized metabolites, dereplication, Paired Omics Data Platform, siderophores, k -nearest neighbor
Concepts
terms this paper carries, each with the sentence it was cut from — the layer that joins one paper to another. Terms with no quote yet are on CONCEPTS.html.
conceptNatural Products Mixed Omics — not defined in this paper's own words in this sentence — “We illustrated a computational example of how to use our Natural Products Mixed Omics (NPOmix) tool for siderophore mining that can be reproduced by the users.”concepts[0]
conceptNPOmix — Natural Products Mixed Omics — “We illustrated a computational example of how to use our Natural Products Mixed Omics (NPOmix) tool for siderophore mining that can be reproduced by the users.”concepts[1]
conceptbiosynthetic gene clusters — biosynthetic genes that are physically grouped into clusters — “Microbial specialized metabolites are often made by biosynthetic genes that are physically grouped into clusters known as biosynthetic gene clusters (BGCs).”concepts[2]
conceptBGCs — biosynthetic gene clusters — “Microbial specialized metabolites are often made by biosynthetic genes that are physically grouped into clusters known as biosynthetic gene clusters (BGCs).”concepts[3]
conceptgene cluster family — a group of similar BGCs — “we deployed a K -Nearest Neighbor (KNN) algorithm that uses similarity BGC fingerprints and analogously similarity MS/MS fingerprints to classify gene cluster family (GCF, a group of similar BGCs) candidates for each MS/MS spectrum.”concepts[4]
conceptGCF — gene cluster family — “we deployed a K -Nearest Neighbor (KNN) algorithm that uses similarity BGC fingerprints and analogously similarity MS/MS fingerprints to classify gene cluster family (GCF, a group of similar BGCs) candidates for each MS/MS spectrum.”concepts[5]
conceptK -Nearest Neighbor — not defined in this paper's own words in this sentence — “we deployed a K -Nearest Neighbor (KNN) algorithm that uses similarity BGC fingerprints and analogously similarity MS/MS fingerprints to classify gene cluster family (GCF, a group of similar BGCs) candidates for each MS/MS spectrum.”concepts[6]
conceptKNN — K -Nearest Neighbor — “we deployed a K -Nearest Neighbor (KNN) algorithm that uses similarity BGC fingerprints and analogously similarity MS/MS fingerprints to classify gene cluster family (GCF, a group of similar BGCs) candidates for each MS/MS spectrum.”concepts[7]
conceptLiquid chromatography coupled with tandem mass spectrometry — an efficient technique to access metabolites from fractions and even environmental samples — “Liquid chromatography coupled with tandem mass spectrometry (LC-MS/MS) is an efficient technique to access metabolites from fractions and even environmental samples”concepts[8]
conceptLC-MS/MS — Liquid chromatography coupled with tandem mass spectrometry — “Liquid chromatography coupled with tandem mass spectrometry (LC-MS/MS) is an efficient technique to access metabolites from fractions and even environmental samples”concepts[9]
conceptJaccard index — a measurement between the number of features — “The Jaccard index is a measurement between the number of features (similarities, biosynthetic classes, and substructure predictions) that are present or absent while comparing two fingerprints (one BGC and one MS/MS fingerprint).”concepts[10]
conceptmeasurement — not defined in this paper's own words in this sentence — “The Jaccard index is a measurement between the number of features (similarities, biosynthetic classes, and substructure predictions) that are present or absent while comparing two fingerprints (one BGC and one MS/MS fingerprint).”concepts[11]

Full text — tagged

NPOmixterm·mth: A machine learning classifier to connect mass spectrometryterm·key fragmentation data to biosynthetic gene clustersterm·dom Abstract Microbial specialized metabolitesterm·key are an important source of and inspiration for many pharmaceuticals, biotechnological products and play key roles in ecological processes. Untargeted metabolomics using liquid chromatography coupled with tandem mass spectrometryterm·mth is an efficient technique to access metabolites from fractions and even environmental crude extracts. Nevertheless, metabolomics is limited in predicting structures or bioactivities for cryptic metabolites. Efficiently linking the biosynthetic potential inferred from (meta)genomics to the specialized metabolome would accelerate drug discovery programs by allowing metabolomics to make use of genetic predictions. Here, we present a k -nearest neighborterm·ai classifier to systematically connect mass spectrometryterm·key fragmentation spectra to their corresponding biosynthetic gene clustersterm·dom (independent of their chemical class). Our new pattern-based genome miningterm·key pipeline links biosynthetic genes to metabolites that they encode for, as detected via mass spectrometryterm·key from bacterial cultures or environmental microbiomes. Using paired datasets that include validated genes-mass spectral links from the Paired Omics Data Platformterm·key, we demonstrate this approach by automatically linking 18 previously known mass spectra (17 for which the biosynthesis gene clusters can be found at the MIBiG database plus palmyramide A) to their corresponding previously experimentally validated biosynthetic genes (e.g., via nuclear magnetic resonance or genetic engineering). We illustrated a computational example of how to use our Natural Products Mixed Omicsterm·mth (NPOmixterm·mth) tool for siderophoreterm·key mining that can be reproduced by the users. We conclude that NPOmixterm·mth minimizes the need for culturing (it worked well on microbiomes) and facilitates specialized metaboliteterm·key prioritization based on integrative omics mining.

Keywords: genomics, mass spectrometryterm·key, machine learning, specialized metabolitesterm·key, biosynthetic gene clustersterm·dom The pace of natural product discovery has remained relatively constant over the last two decades. At the same time, there is an urgent need to find new therapeutics to fight antibiotic-resistant bacteria, cancer, tropical parasites, pathogenic viruses, and other severe diseases. Here, we introduce a new k -nearest neighborterm·ai algorithm that can efficiently connect metabolites to their biosynthetic genes. Linking metabolites with the Natural Products Mixed Omicsterm·mth tool allows to make genetic predictions to prioritize relevant products and facilitate their structural elucidation. Our approach can be applied to biosynthetic genes from bacteria (used in this study), fungi, algae, and plants where (meta)genomes are paired with corresponding mass spectometry fragmentation data.

Introduction Microbial specialized metabolitesterm·key are often made by biosynthetic genes that are physically grouped into clusters known as biosynthetic gene clustersterm·dom (BGCsterm·dom). Liquid chromatography coupled with tandem mass spectrometryterm·mth (LC-MS/MSterm·mth) is an efficient technique to access metabolites from fractions and even environmental samples; however, the metabolomic diversity tends to not represent the full biosynthetic potential of a given microbe (not all BGCsterm·dom are expressed in certain conditions). The great majority of metabolomics approaches rely on culturing and/or chromatographic isolation for bioactivity assays and structure elucidation. Combining metabolomics analyzes with genome miningterm·key would allow making in-silico predictions about: (i) the structure, the bioinformatics tool antiSMASH ( 1 ) can make accurate structure prediction for some cases, especially for peptides; (ii) the bioactivity, a BGCterm·dom can be used to predict antibiotic activity via the presence of specific genes or database dereplicationterm·key; and (iii) the novelty of a given unknown metabolite, via gene networking or beta-diversity. These unknown metabolites can be from microbial cultures or even environmental microbiomes. For example, the random forest classifiers by Walker and Clardy ( 2 ) use only the BGCterm·dom sequences to predict if a BGCterm·dom will produce an anticancer, antifungal, or antibacterial metabolite (with a maximum accuracy of 80% and each bioactivity required the construction of a classifier to predict if a new entry was bioactive or not). The antimicrobial activity prediction from this tool can be combined with the Antibiotic Resistance Target Seeker (ARTS 2) ( 3 ), which annotates antibiotic-resistance genes. Coelichelin was isolated using an in-silico structure prediction that indicated the peptide was a siderophoreterm·key ( 4 ). This was confirmed by culturing the producer in an iron-deficient media and isolating the induced (and overexpressed) metabolite. BiG-SLICE ( 5 ) was used to predict the connections between more than 1 million BGCsterm·dom, providing clues to the most diverse/novel BGCsterm·dom in thousands of samples. These predictions are made using genomics, but metabolomics can access these genomic predictions when metabolites are connected to their BGCsterm·dom.

However, one of the challenges in the genome miningterm·key field is connecting microbial metabolites to their BGCsterm·dom with confidence. Even the genome of Streptomyces coelicolor A3(2), one of the first sequenced microbial genomes, still contains a large number of cryptic BGCsterm·dom—BGCsterm·dom without known associated metabolites ( 6 ). In 2011, antiSMASH improved the identification and annotation of BGCsterm·dom based on automated genome miningterm·key. Moreover, since 2018, BiG-SCAPE ( 7 ) can reliably calculate the similarity between pairs of BGCsterm·dom, grouping them into gene cluster families (GCFsterm·dom). Recently, some approaches and tools have been created to connect specialized metabolitesterm·key (known and cryptic MS/MS spectra) to their biosynthetic gene clustersterm·dom, such as pattern-based Genome Miningterm·key ( 8 , 9 ), MetaMiner ( 10 ), DeepRiPP ( 11 ), NRPquest ( 12 ), NRPminer ( 13 ), GNP ( 14 ), and NPLinker ( 15 ), recently reviewed by Van der HooftpersName et al., 2020 ( 16 ). Pattern-based Genome Miningterm·key is based on the idea that the distribution of a given natural product should be comparable to the distribution of the BGCsterm·dom responsible for their production. Nerpa ( 17 ) and GARLIC ( 18 ) can connect structures to BGCsterm·dom; structures are normally represented in the SMILES (Simplified Molecular-Input Line-Entry System) format, a type of computer-readable annotation language for chemical structures. However, most of these tools are neither high throughput nor efficient, or can only be used for a particular class of BGCterm·dom (e.g., peptides or BGCsterm·dom homologous to known BGCsterm·dom).

These aforementioned tools fall into two main categories: (i) feature-based approaches (like GNP, MetaMiner, DeepRiPP, NRPminer, NRPquest, GARLIC, and Nerpa) that use substructure predictions as a link between biosynthetic genes and metabolites (for example, amino acid predictions from biosynthetic adenylation domains or precursor peptides compared to amino acids predicted from known structures or peaks in the MS/MS fragmentation spectra); and (ii) correlation-based approaches (like pattern-based Genome Miningterm·key and the standardized Metcalf score, e.g., available within NPLinker)( 15, 19 ) that use the distribution of metabolites (via similarity scores that can be obtained based on mass spectral GNPS molecular networking) in the dataset and they compare to the distribution of BGCsterm·dom (also using similarity scores as calculated by tools like BiG-SCAPE or BiG-SLICE) to create possible BGC-MS/MS links. Of note, NPLinker combines a correlation-based approach (via gene and molecular networking) with a feature-based approach (Input–Output Kernel Regression method). While our new approach uses unique fingerprints and a k -nearest neighborterm·ai’s algorithm for connecting metabolites to BGCsterm·dom, it can be considered a type of pattern-based Genome Miningterm·key, which was previously reported by Doroghazi et al. and Duncan et al. ( 8, 9, 19 ). Similarly to NPLinker, the addition of substructures as features to our method allows for combining a correlation-based approach with a feature-based approach .

Another important resource made available recently is the Paired Omics Data Platformterm·key (PoDP) ( 20 ), which contains paired data (genome and metabolome data of the same samples), as well as validated links between BGCsterm·dom and MS/MS spectra and annotated structures, which all can be used for the creation and improvement of the aforementioned multi-omics tools and the development of the new approach described in this manuscript. Currently, of over 2,500 paired genomes in the PoDP database, half are metagenomes (mostly feces, human gut, and mouse gut) and the other half are genomes (mostly of bacterial isolates); the 4900 unique metabolomics linked samples (with several genomes having metabolomics data obtained under multiple conditions) were all analyzed via LC-MS/MSterm·mth, about 90% of the LC-MS/MSterm·mth runs are from positive mode and the most common extraction solvents used were methanol (39% of the extractions) and ethyl acetate (36% of the extractions). Additionally, most of the BGCsterm·dom (known and unknown) that we were able to obtain from the PoDP database have biosynthetic components from nonribosomal peptide-synthetases (NRPSs, 31.6% of the BGCsterm·dom), polyketide synthases (PKSs, 22%) or ribosomally synthesized and post-translationally modified peptides (RiPPs, 19.3%).

It has been challenging to create a systematic tool that can work at the repository scale to connect genotypes (BGCsterm·dom) with their phenotypes (for example, fragmentation spectra, MS/MS spectra, from untargeted liquid chromatography coupled with mass spectrometryterm·key profiles, e.g., LC-MS/MSterm·mth datasets). This difficulty results from the fact that some metabolites differ in the way that they are biosynthesized and finding a systematic approach relies on identifying common patterns in their biosynthetic pathways. Another challenge is processing the paired data, since it requires combining two types of data that are different in nature (genomics versus metabolomics) and paired datasets are large, being computationally difficult to process. As a result, a large disparity exists between the number of known metabolites from an organism versus the number of BGCsterm·dom with known metabolite products. For example, the recently designated cyanobacterial genus Moorena has already yielded over 200 metabolites, yet only a dozen of validated BGCsterm·dom are currently deposited for this genus in the expert-annotated Minimum Information about a Biosynthetic Gene clusterterm·dom (MIBiG) database ( 21 ). Connecting metabolites to their biosynthetic genes would also facilitate research concerning the ecological role and functions of the specialized metabolome by studying the regulation of the expression of their biosynthetic gene clustersterm·dom.

To better address the gap between genomics and metabolomics in drug discovery, we deployed a K -Nearest Neighborterm·ai (KNNterm·ai) algorithm that uses similarity BGCterm·dom fingerprints and analogously similarity MS/MS fingerprints to classify gene cluster familyterm·dom (GCFterm·dom, a group of similar BGCsterm·dom) candidates for each MS/MS spectrum. A fingerprint is a group of features measured across the dataset samples for a particular BGCterm·dom or MS/MS spectrum (for example, the similarity scores between a given BGCterm·dom and all other BGCsterm·dom in the dataset, resulting in features that represent each maximum score per genome). We used antiSMASH to annotate all BGCsterm·dom in this study and BiG-SCAPE to calculate the similarity between annotated BGCsterm·dom. AntiSMASH annotates BGCsterm·dom by searching them with profile hidden Markov models of domains from gene/protein sequences known to biosynthesize metabolites and these models are specific to a certain class of BGCterm·dom. For annotating the similarity between MS/MS spectra, we used the modified cosine score from GNPS ( 14 , 22 ). We showed that the addition of biosynthetic class and substructure features improves the performance of our Natural Products Mixed Omicsterm·mth tool (NPOmixterm·mth, available at https://www.tfleao.com/npomix1 ). We would like to acknowledge that NPOmixterm·mth and the pattern-based Genome Miningterm·key approaches are limited to organisms that have BGCsterm·dom (not all organisms have BGCsterm·dom as well-defined as bacteria and fungi, for example, higher plants and animals typically have less well-structured clusters of biosynthetic genes) and to BGCsterm·dom that are somewhat similar to at least one of the reference BGCsterm·dom in the PoDP datasets.

Of note, in this study, six of the 11 BGC-metabolite links used for validation (not counting analogs) were previously fully characterized via knockouts, heterologous expression, and/or isolation, and unambiguous NMR structure elucidation as recorded at the PoDP database. The number of genomes, metabolomes, BGCsterm·dom, GCFsterm·dom, GNPS metabolites, metabolites with MIBiG BGCterm·dom, and BGC-metabolite links (with and without filtering) are listed in Table S1. The major limitation of the evaluation of our method was the lack of available test data for structures that are linked to their MS/MS spectra and biosynthetic gene clustersterm·dom—a bottleneck that the application of NPOmixterm·mth can help solve and we discuss in more detail in the “ Supplementary Material and Background ” section. We believe that NPOmixterm·mth will assist with the discovery of novel metabolites as well as known metabolites with new biosynthesis (more details in the “ Supplementary Material and Background ” section). We exemplify a computational method combining NPOmixterm·mth and MassQL ( 23 ) for prioritizing siderophoresterm·key from thousands of metabolome profiles and this method can be reproduced by the users with their own samples.

Results Our proposed solution: the NPOmixterm·mth approach To enable in-silico predictions of molecular novelty, bioactivity, and chemical structure, metabolites need to be connected to their corresponding BGCsterm·dom, which is, as aforementioned, a major challenge in the metabolite discovery field. Therefore, we present a KNNterm·ai classifier named NPOmixterm·mth that can use just DNA sequences and unlabeled mass fragmentation profiles to accurately create links between metabolites and their corresponding biosynthetic gene clusterterm·dom, helping to prioritize metabolites by also making use of in-silico genomic predictions.

To use the NPOmixterm·mth approach (schematic in Fig. 1 and more details in Fig. S1 ), it is required to have a paired dataset with genomic and MS/MS information as inputs. Fig. 1 shows a conceptual example using only a few samples and only using similarity as a feature (same for Fig. S1 ). The genomic information can be either that of a genome or metagenome and the MS/MS spectra should be obtained via untargeted LC-MS/MSterm·mth. Paired datasets have become available at the PoDP database ( 20 ), one of the first initiatives to gather paired genomic and MS/MS information. Our analysis contained 3,331 BGCsterm·dom (used for training) that were present in 1,040 networked genomes/metagenomes with paired LC-MS/MSterm·mth data that could be downloaded from the PoDP database.

Schematic of how NPOmixterm·mth works including inputs, transformations, processing tools, outputs, and the idea of combining the outputs with other tools. BGCterm·dom = biosynthetic gene clusterterm·dom; MS = mass fragmentation spectrum; KNNterm·ai = k -nearest neighborterm·ai; BiG-SCAPE = software to calculate pairwise BGCterm·dom–BGCterm·dom similarity; GCFterm·dom = gene cluster familyterm·dom (group of similar BGCsterm·dom); GNPS = tool to calculate the modified cosine score indicating the pairwise spectrum–spectrum similarity; BGC-MS links = links between metabolites and BGCsterm·dom produced by the KNNterm·ai classifier; Dereplicator+, MassQL = other downstream analyses tools that can be combined with NPOmixterm·mth to validate outputs or improve NPOmixterm·mth predictions.

We first grouped known and cryptic BGCsterm·dom in GCFsterm·dom based on domain similarity using BiG-SCAPE ( 7 ) to obtain labels that can be used for supervised learning (BGCterm·dom networking section in Fig. 1 or Fig. S1A ). Regarding this training set, out of the 3,331 BGCsterm·dom annotated by antiSMASH in the (meta)genomes from the PoDP database and networked by BiG-SCAPE, 260 BGCsterm·dom (7.8%) were dereplicated by similarity to the MIBiG database (in other words, BGCsterm·dom from families containing at least one known MIBiG BGCterm·dom). To create a BGCterm·dom fingerprint (training features section in Fig. 1 or Fig. S1C ), we identified the similarity between the individual BGCterm·dom and each of the BGCsterm·dom in each genome in the training dataset (similarity scores are computed as “1 minus the raw distance”). The BGCterm·dom fingerprint that emerges is a series of columns for each compared genome, the column value of which represents the similarity score between the individual BGCterm·dom and the BGCterm·dom to which it is maximally similar in each genome (column). Similarity scores range from 0.0 to 1.0; identical BGCsterm·dom have perfect similarity and are scored as 1.0 whereas a score of 0.8 would indicate that a homologous BGCterm·dom is present in the genome. A score below the (user-defined) similarity cutoff of 0.7 indicates that the queried BGCterm·dom is likely absent in the genome. We selected the cutoff as 0.7 because it is the same cutoff used for BiG-SCAPE ( 7 ) similarity (a value that was determined using a cutoff calibration with the MIBiG database) ( 24 ). An analogous process is used to create MS/MS fingerprints (testing features section in Fig. 1 or Fig. S1B and S1D ); an individual MS/MS spectrum is compared to all of the MS/MS spectra in the testing set using the GNPS modified cosine score ( 14 , 22 ) and the maximum similarity cosine score between the individual MS/MS spectrum and the spectra in a given metabolome is incorporated as part of the MS/MS fingerprint. Furthermore, we add the presence/absence of biosynthetic classes and substructures to the BGCterm·dom and MS/MS fingerprints (for more details, refer to the “Methods” section). We then use the BGCterm·dom fingerprint in the training together with the generated family labels. In more detail, the BGCterm·dom fingerprints form a training matrix (training features section in Fig. 1 or Fig. S1E , where each column is a genome and each value is the maximum similarity between the individual BGCterm·dom and the BGCsterm·dom in this given genome) and, in this case, the matrix contains 1,040 columns due to the 1,040 sets of paired experimental samples plus the columns corresponding to the biosynthetic class and annotated substructures.

The trained KNNterm·ai classifier takes as input the same kind of features (MS/MS fingerprint, Fig. S1D , and the testing matrix is exemplified in Fig. S1F or testing features section in Fig. 1 ), where the similarity is now represented by the modified cosine score but these features are annotated from individual mass fragmentation profiles (known or cryptic metabolites). The aim of NPOmixterm·mth is then to label these MS/MS fingerprints with the proper gene cluster familyterm·dom, thus accurately linking fragmented metabolites to their corresponding BGCsterm·dom. The testing MS/MS spectrum used as a query could be either a reference spectrum from the Global Natural Products Social Molecular Networking database (GNPS) ( 14 , 22 ) or a cryptic MS/MS spectrum from a new sample that contains a sequenced genome and experimental MS/MS spectra. In more detail, the KNNterm·ai algorithm links BGCsterm·dom to fragmented metabolites (represented by their MS/MS spectra) by plotting the BGCterm·dom fingerprints in the KNNterm·ai feature space (NPOmixterm·mth step in Fig. 1 or Fig. S1G ). The KNNterm·ai feature space is exemplified by only two dimensions since a 1,040-dimensional space is not feasible to comprehensively visualize (one dimension per sample). We would like to emphasize that the actual KNNterm·ai prediction is made in many dimensions (equivalent to the number of features), and we only depicted these multidimensional fingerprints in 2D in Fig. S1G (as a schematic, we did not perform dimensionality reduction). More details of how this multidimensional plotting occurs are illustrated in Fig. S2 , where the samples correspond to the 3D axes and the similarity scores are the coordinates. Each testing MS/MS fingerprint (a row in the testing metabolomic matrix and columns are the experimental MS/MS spectra per sample) is plotted into the same KNNterm·ai feature space (NPOmixterm·mth step in Fig. 1 or Fig. S1G ) so the algorithm can obtain the GCFterm·dom labels for the nearest neighbors to the testing MS/MS fingerprint (e.g., for three most similar BGCterm·dom neighbors, k = 3). We note that GCFterm·dom labels can be present more than once in the returned list if two or more BGCterm·dom nearest neighbors belong to the same GCFterm·dom. Given that many related BGCsterm·dom are part of the same GCFterm·dom, this repetition of the GCFterm·dom classification is a common behavior of our KNNterm·ai approach. The BGC-MS/MS links generated as outputs by NPOmixterm·mth can be combined with the outputs of other tools like Dereplicator+, MassQL, and so on; as exemplified (later in this manuscript) for the case of brasilicardin A and new putative siderophoresterm·key.

In principle, our approach is suitable for bacterial (exemplified here), fungal, algal, and plant genomes, and MS/MS spectra obtained from the same organism (if these organisms contain BGCsterm·dom). Metagenomes and metagenome-assembled genomes (MAGs) can also be used instead of genomes; however, complete genomes are preferred in the training set primarily due to the expected data quality. This KNNterm·ai approach also supports LC-MS/MSterm·mth from fractions or different culture conditions; multiple LC-MS/MSterm·mth files for the same genome were merged into a single set of experimental MS/MS spectra.

Validation and multi-omics dereplicationterm·key: linking known metabolites to known BGCsterm·dom, validated links from the PoDP database, and BGCsterm·dom from the MIBiG database To validate NPOmixterm·mth, we used 36 out of 71 meta-datasets from the PoDP database (from February 2021, meta-datasets listed at Dataset S1 , sheet one). We were not able to download all meta-datasets due to data issues (such as lack of access to some genomes and incorrect links/IDs) that we believe will be fixed in the future. There are currently 75 datasets in the PoDP database. We selected genomic samples that contained a valid Genome ID or BioSample ID to aid their downloading from the National Center for Biotechnology Information database and totaling 732 genomes/MAGs obtained from these 36 meta-datasets. In addition to these genomes/MAGs, the 36 meta-datasets also contained paired data for metagenomes. Hence, we selected and assembled 1,034 metagenomes and these metagenomes were concentrated on two major meta-datasets: (1) MSV000082969 and PoDP ID cd327ceb-f92b-4cd3-a545-39d29c602b6b.1–556 cheetah fecal samples and environmental samples ( 25 ); and (2) MSV000080179 and PoDP ID 50f9540c-9c9c-44e6-956c-87eabc960d7b.3–The American Gut Project ( 26 ) that contains fecal samples from 481 human subjects. These (meta)genomes were downloaded with the code shared at the GitHub repository https://github.com/tiagolbiotech/NPOmixterm·mth , notebook 1. The LC-MS/MSterm·mth files can be downloaded using “FTP” from links recorded in Dataset 1, sheet two. We were able to network 1,040 (meta)genomes that contained 3,331 BGCsterm·dom (including 260 BGCsterm·dom from the MIBiG database) distributed into 997 GCFsterm·dom. In the untargeted metabolomics data, we matched 3,248 LC-MS/MSterm·mth files to 22 GNPS ( 14 , 22 ) reference library MS/MS spectra and one spectrum not available at GNPS (brasilicardin A, obtained from the microbial metabolome) to create the MS/MS fingerprints for testing the KNNterm·ai classification (one fingerprint per spectrum). We envision creating a more balanced, diverse, and less sparse training dataset in ongoing efforts. To maximize precisionterm·def rates in the future, we plan to purchase cultures from collections that have well-assembled genomes so we can obtain the paired LC-MS/MSterm·mth. However, the current dataset produced highly supportive results by testing validated links from the PoDP and semimanually connected links used in the NPLinker publication, all of which will be reused for posterior benchmarking of BGC-MS/MS linking algorithms. We attempted to test all 242 BGC-metabolite links used as training data for the Rosetta scoring method in NPLinker (totaling 2,069 unique MS/MS spectra, Dataset S1 , sheet two) plus 109 manually added MS/MS links (connected to BGCsterm·dom, annotated by experts at the PoDP database, Dataset S1 , sheet three). However, most of these validated MS/MS spectra were not present in the 1,040 paired (meta)genomes-MS/MS samples from the PoDP, or their BGCterm·dom scores did not co-occur with their MS/MS scores because they were not present in the nearly exact same samples. To further illustrate this, 178 MIBiG BGCsterm·dom networked with PoDP BGCsterm·dom, and 50 GNPS-annotated metabolites were reported at PoDP. The intersection of these two resulted in 22 BGC-metabolite links including analogs. We obtained the largest validation dataset of metabolites linked to BGCsterm·dom possible (that also contained genomes and metabolomes). We note that we used all links available in the PoDP database that could be annotated in the downloaded paired data, thereby not on purpose biasing this validation set toward metabolites that would be better classified using NPOmixterm·mth, but we acknowledge that we are dependent on the availability of validated BGC-MS/MS links. You can see these and other metrics in Table S1.

Hence, our validation dataset was limited to 11 validated links (22 with analogs) from the MIBiG and PoDP databases and found in the paired (meta)genomes-MS/MS samples (barbamides, antimycin, pyocyanines, 2,4-diacetylphloroglucinol, brasilicardin A, orfamides, albicidins, bafilomycin B1, nevaltophin D, jamaicamides, and cryptomaldamide, totaling 22 references MS/MS spectra that were present in the GNPS database). We only included analogs for which the MIBiG BGCterm·dom was present in our paired samples downloaded from the PoDP; hence, we included orfamide A to C but not orfamide E, F, and so on (because they are not reported as products from the MIBiG orfamide BGCsterm·dom). We stress that a larger training dataset with more complete genomes is likely to increase the size of the validation set by adding more valid BGCsterm·dom into the analysis. We were also able to combine NPOmixterm·mth with in-silico metabolomics tools like Dereplicator+ ( 21 ) to make new links between MS/MS spectra, BGCsterm·dom, and molecular structures, as we will exemplify by brasilicardin A. This was accomplished by annotating cryptic MS/MS spectra (without a GNPS library hit and therefore not present in the GNPS database) to known BGCsterm·dom (found in the MIBiG database). Such new links could be confirmed experimentally to improve the size of the validation set, as well as to expand MS/MS databases by adding these cryptic spectra to them.

A 2D comparison of both types of fingerprints (BGCterm·dom and MS/MS) can be a proxy for distinguishing some true positives from false positives. As observed in Fig. S3 , we can visualize a mismatch between the BGCterm·dom fingerprints (one GCFterm·dom) and the MS/MS fingerprint in the “reduced” KNN-space (represented schematically in only two dimensions, we did not perform actual dimensionality reduction), indicative of a possible false positive link. This GCFterm·dom is dereplicated as the known metabolite, pyocyanin, and it was incorrectly associated with the metabolite 2,4-diacetylphloroglucinol, confirming the false positive (at k = 3). In contrast, Fig. 2 illustrates that five metabolites, albicidin (structure in Fig. 2A and MS/MS spectra in Fig. 2B ) and four albicidin analogs, could be correctly assigned to their corresponding GCFterm·dom that contains two BGCsterm·dom (one from the MIBiG database and another from Xanthomonas albilineans GPE PC73, GenBank ID GCA_000,087,965.1 ). In this case, the BGCterm·dom fingerprints match the MS/MS fingerprints (Fig. 2C and D ). This observation of “co-occurrence” between the strains in the BGCterm·dom fingerprint and MS/MS fingerprints can be quantified by the Jaccard indexterm·mth (a score ranging from zero to one and calculated by the intersection of the presence/absence between the strains in fingerprints over the total number of strains). The Jaccard indexterm·mth is a measurementterm·mth between the number of features (similarities, biosynthetic classes, and substructure predictions) that are present or absent while comparing two fingerprints (one BGCterm·dom and one MS/MS fingerprint). In other words, the Jaccard indexterm·mth is a proxy of how good an NPOmixterm·mth link is between a given metabolite and the connected BGCterm·dom and it can be interpreted as a confidence score or used as a filter on the results.

Multi-omics enabled the dereplicationterm·key of albicidin by automatically predicting a true BGC-metabolite link. Structure of the dereplicated metabolite with highlighted observed fragments (A) and its corresponding representative MS/MS spectrum (B, spectrum example from GNPS ID CCMSLIB00000579285, m/z of 843.2620, and ppm error of 3.55), obtained via Metabolite Spectrum Resolver ( 27 ). The two BGCterm·dom fingerprints (1,130 and 1,131) are represented in a 2D plot (C) and they match the 2D plot for the five MS/MS fingerprints obtained from GNPS for albicidin and its analogs (D). m/z = mass over charge calculated via mass spectrometryterm·key; exp. m/z = experimental m/z ; theor. m/z = theoretical m/z .

Using the PoDP dataset, a Jaccard indexterm·mth cutoff of 0.7, and similarity plus biosynthetic class as features for the k -nearest neighborterm·ai model, we obtained a precisionterm·def of 92.9% as 13 out of 14 reference MS/MS spectra were correctly labeled when top- n = 3 ( k equal to 3, metabolites and their predicted GCFsterm·dom listed in Table 1 ). Precisionterm·def is the ratio between the true positive links over all the tested positives (true positives plus false positives). Top- n represents how often the correct GCFterm·dom label was found among the top- n labels classified by the KNNterm·ai approach. We have determined that the use of three neighbors is the optimal performance (also using the co-occurrence threshold), providing a good balance between precisionterm·def and the number of links to validate (very high precisionterm·def and randomness equal to 0, as detailed in Table S2). Randomness is observed by shuffling the testing columns, experimental MS/MS names, and counting how many correct links are present between the top- n GCFterm·dom candidates. Lastly, we regard our NPOmixterm·mth approach as multi-omics enabled dereplicationterm·key because the 13 MS/MS spectra were automatically assigned to a known GCFterm·dom that confirmed their metabolite labels, thereby minimizing the need for purchasing standards, performing isolation and NMR characterization, gene knockout, or heterologous expression. This kind of multi-omics analysis allows us to dereplicate more metabolites than genomics or metabolomics separately and it helps researchers to focus on novel structures that can also present novel bioactivities.

Fourteen links between GNPS MS/MS spectra (with metabolite ID) and networked gene cluster familyterm·dom (true GCFterm·dom that contained a known MIBiG BGCterm·dom and passed the co-occurrence threshold).

We expect that our approach will improve with a larger training set and with further improvement of the features in the BGCterm·dom and MS/MS fingerprints (e.g., by adding BGCterm·dom regulation and predicted bioactivity). We confirmed that all 13 correct GCFterm·dom predictions reported here were found in the original producer of the identified metabolites; they matched the reported masses and most of these BGC-metabolite links were reported at the PoDP database as validated via knockouts, heterologous expression, and/or isolation, and NMR structure elucidation. NPLinker ( 15 ), another recently published paired-omics tool, also uses validated links from the PoDP to assess linking precisionterm·def scores. With 50 known GCF-MS/MS links that were present in the 1,040 samples with paired data (some metabolites have multiple MS/MS spectra), the annotation rate was reasonably good (around 28%, 14 out of 50 links were retained after the Jaccard co-occurrence threshold, a threshold to keep only the metabolites that are found among the same samples that contain the candidate BGCsterm·dom). Table S1 provides an overview of the various numbers of genomes, metabolomes, BGCsterm·dom, metabolites, etc.

Dereplicating a new analogous MS/MS spectrum (with a library hit from GNPS but not found at the PoDP database) to a known BGCterm·dom In addition to dereplicating known metabolites (from the GNPS and/or the PoDP database), NPOmixterm·mth can also dereplicate new putative analogs (orfamides marked by asterisks in Table 1 ). For example, the BGCterm·dom for the metabolite orfamide C (genes 1 to 6 in Fig. S4 , MIBiG ID BGC0000399) was automatically connected by our KNNterm·ai approach (both using only similarity as a training/testing feature or by adding the biosynthetic class) to a GNPS metabolite labeled “putative orfamide C” (CCMSLIB00004679300). This MS/MS spectrum was also found in the same strain where the BGCterm·dom was first identified ( Pseudomonas protegens Pf-5, Genbank ID GCA_000,012,265 ) ( 28 ). The nine amino acid (AA) predictions for this BGCterm·dom, based on the specificity of adenylation domains, match the structure of orfamide C in the correct order: leu, asp, thr, ile, leu, ser, leu, leu, and ser. AntiSMASH was not able to predict the tenth and last AA in the biosynthetic series, although, the mass difference between the partial structure and the experimentally observed m/z pointed that the last AA was indeed valine. Of note, NPOmixterm·mth does not make structure predictions and the orfamide C structure was predicted semimanually (we relied on antiSMASH to make most of the genome-based predictions, whereas we predicted the last amino acid using a mass difference between the antiSMASH structure and the observed ion via mass spectrometryterm·key). The matching between the predicted structures (via dereplicationterm·key versus de novo prediction using the NPOmixterm·mth link) confirmed the multi-omics enabled dereplicationterm·key of this “putative orfamide C” (using k = 3, BGCterm·dom predictions and predicted metabolite structure are represented in Fig. S4 ), annotating this metabolite without the need for isolation. We would like to stress that this version of the KNNterm·ai GCFterm·dom predictions did not use structures/substructures for linking MS/MS spectra to BGCsterm·dom; hence, as demonstrated in Fig. S4 , substructure predictions can be an extra dimension for selecting links that are true positives over false positives.

Connecting a cryptic/new MS/MS spectrum (not present in the GNPS database) to a known BGCterm·dom (validated link from the PoDP database) We used a combination of MS/MS fingerprints (notebook 2 from https://github.com/tiagolbiotech/NPOmixterm·mth ), BGCterm·dom fingerprints (notebook 3), Mzmine ( 29 ), and Dereplicator+ ( 30 ) to link and dereplicate brasilicardin A. After selecting 300 MS/MS spectra from the 16 most diverse genomes in the dataset (diversity estimated using GCFterm·dom presence/absence) of 1,040 samples, Dereplicator+ had three in-silico metabolomics predictions and one of them was the unique tricyclic glycosylated terpene brasilicardin A. The observed m/z matches the value previously reported in the literature ( 31 ), identifying an MS/MS spectrum that is currently absent from the GNPS database. NPOmixterm·mth connected the MS/MS spectrum (predicted to be brasilicardin A by Dereplicator+; please note that this information was not used during the NPOmixterm·mth training) with the correct BGCterm·dom (brasilicardin A MIBiG ID BGC0000632 from the strain Nocardia terpenica IFM 0406, GenBank ID GCA_001,625,105 ) ( 32 ), highlighting how NPOmixterm·mth can connect cryptic metabolites without library matches (absent from MS/MS databases like GNPS) to their corresponding BGCsterm·dom. Predicted fragmentation ( Fig. S5 ) strongly suggested that the query MS/MS spectrum is corresponding to the planar structure of brasilicardin A (all deltas between fragmented exact m/z and observed m/z were extremely low, below 0.001, more information in Dataset S1 , sheet four). Thus, NPOmixterm·mth can provide links between cryptic MS/MS spectra and known/cryptic BGCsterm·dom from the most diverse strains and potentially new BGCsterm·dom that can be explored experimentally (e.g., BGCterm·dom knock-out, heterologous expression, or isolation, and NMR structure elucidation), especially if coupled to SMART-NMR analysis ( 33 ) to confirm their novelty. We would like to emphasize that NPOmixterm·mth used the similarity scores (in other words, the distribution of the metabolite among the training samples) to connect the so far cryptic MS/MS spectrum (brasilicardin A) to its correct BGCterm·dom. The biosynthetic class, substructure predictions, annotation of the spectrum, and comparison to existing spectra libraries were not used as inputs for NPOmixterm·mth to make this correct link. We did use this information to validate the link: for example, the MIBiG annotation matched the Dereplicator+ annotation of brasilicardin A. Since we initially selected the PoDP metabolites that were dereplicated by GNPS to be part of the validation set, we overlooked brasilicardin A (which was absent in the GNPS database). After this analysis combining NPOmixterm·mth, MZmine, and Dereplicator+ that correctly linked the metabolite brasilicardin A to its BGCterm·dom, we returned to the PoDP database and found an entry corresponding to this link that was already validated (via “knockouts, heterologous expression, or other gene cluster manipulation,” information at the dataset 1b0dccac-5212–4dfd-a9f2-6fa953ab16bd.5). This entry had the same m/z , LC-MS/MSterm·mth metabolome, and retention time of brasilicardin A that we observed for the previously cryptic metabolite.

Comparing the three different kinds of features for linking metabolites to BGCsterm·dom using NPOmixterm·mth In order to increase the precisionterm·def of our NPOmixterm·mth algorithm, we added to the BGCterm·dom and MS/MS similarity fingerprints the presence/absence of biosynthetic classes (polyketide synthases, nonribosomal peptide-synthetases, terpenes, siderophoresterm·key, RiPPs, phosphonates, oligosaccharides, phenolic metabolites, others/unknowns, other minor classes, and combinations of more than one class) and substructures (tyrosine, proline, amine, malonyl-CoA, and so on—all 85 predicted substructures can be found at Dataset S1 , sheet five). A comparison of the various models is provided in Fig. 3 , with Fig. 3A without using the co-occurrence threshold, and Fig. 3B with use of the co-occurrence threshold. Of note, since all testing BGC-MS/MS links (in the validation set) are present in the MIBiG database, we used the information from this database to infer the biosynthetic class and substructure predictions in this particular analysis. However, the biosynthetic class can be predicted for unknown metabolites using MolNetEnhancer ( 34 ) and/or CANOPUS ( 35 ) and the substructure predictions for unknown metabolites can be obtained using tools like MS2LDA ( 36 ), MassQL ( 23 ), and/or CSI: FingerID/SIRIUS 4 ( 37 ). To obtain genomics-inferred substructure features for large paired omics datasets in the future, we envision that the recently proposed iPRESTO approach ( 38 ) could be applied to discover commonly occurring patterns of biosynthesis genes that together likely produce a substructure of a specialized metaboliteterm·key.

(A) Precisionterm·def curves without the Jaccard co-occurrence threshold for different features: similarity only (blue), biosynthetic class and similarity (green), substructure predictions and similarity (brown), and using both biosynthetic class, substructure predictions, and similarity (pink). Precisionterm·def is the ratio between the true positive links over all the tested positives (true positives plus false positives). (B) Precisionterm·def curves for the same cases using the co-occurrence threshold. Random (yellow) was calculated by using similarity only and shuffling the testing columns. The red dot indicates the best precisionterm·def of 92.9% (using biosynthetic class and similarity as features, co-occurrence threshold, and k = 3). K represents the number of nearest neighbors. (C) We illustrate the modifications made in the training matrix with the addition of biosynthetic class and substructure prediction. For this work, we used 1,040 samples, therefore, 1,040 similarity columns plus 12 biosynthetic classes and 82 predicted substructures.

The comparison of the different features for running NPOmixterm·mth is exhibited in Fig. 3 , using the same set of samples previously described (1,040 paired samples and 22 validated BGC-metabolite links). As observed in the figure, the Jaccard co-occurrence threshold (a threshold to ensure that the query metabolite is connected to BGCsterm·dom in the genome of the same microbial producer) substantially improved the precisionterm·def scores, but it dropped the number of validated links from 22 to around 14 (these links are listed in Table 1 ). However, we obtained high precisionterm·def scores even without threshold (Fig. 3A ), for example, 81.8% for k = 5 using the three kinds of features (similarity, biosynthetic class, and substructure prediction) or just similarity and substructure features. Interestingly, we observed a slightly higher precisionterm·def for k = 1 when only the substructures and similarity features are used in opposed to using all three kinds of features (without threshold); this is because the biosynthetic class for pyocyanines at MIBiG (used for manual annotation of the MS/MS spectrum) are annotated as “other” but antiSMASH automatically annotates its corresponding BGCsterm·dom as “minor” and in some cases as both “minor” and “NRPS,” creating a mismatch between the biosynthetic classes. Additionally, we summarized KS domains and PKS substrates in only two columns (one for each) but we obtained the same precisionterm·def scores. We elected the best precisionterm·def score as 92.9% (red dot in Fig. 3B , score with co-occurrence threshold) because this very high value was obtained using only the similarity and the biosynthetic class features and three nearest neighbors, a good number of candidates for genome miningterm·key. Moreover, the use of just the similarity and biosynthetic class is very appealing because these kinds of features can be well predicted for metabolites with known or unknown metabolites, for example, by using GNPS for similarity and CANOPUS and/or MolNetEnhancer for biosynthetic class predictions, as demonstrated by NPClassScore ( 39 ). It is much more challenging to predict substructures for unknown/cryptic metabolites, which is a topic of ongoing research by our group and others.

In Fig. 3C , if a given BGCterm·dom is a hybrid polyketide synthase (PKS) and nonribosomal peptide-synthetase (NRPS), it was annotated as 1 in the PKS and NRPS columns, and with a 0 in the remaining classes (additional columns). Analogously to the biosynthetic classes, each substructure prediction represented a new column in the BGCterm·dom fingerprint or MS/MS fingerprints, and the columns were filled with 1 (if the substructure was present) and 0 (if the substructure was absent). For the MS/MS fingerprints in the testing set, we manually annotated these biosynthetic class features based on the known structures and MIBiG information. In cases where the structure is unknown, tools like CANOPUS ( 35 ) and MolNetEnhancer ( 34 ) can provide a similar biosynthetic class prediction relying on NPClassifier ( 40 ). For the substructure features in the MS/MS testing set, we made use of genomics-inferred information provided by antiSMASH to annotate substructures for a BGCterm·dom from the same GCFterm·dom as the validated MIBiG BGCterm·dom. In cases where the BGCterm·dom is unknown, these predictions can be obtained: manually (by checking the known structure for common substructures); via unsupervised tools like MS2LDA ( 36,41 ); or via supervised tools like MassQL (based on specific MS/MS fragments found in the spectra) ( 23 ) or CSI: FingerID/SIRIUS 4 ( 37 ). For example, we manually annotated the substructures predicted from the palmyramide A structure and we were able to correctly link the validated MS/MS spectrum with the corresponding palmyramide A BGCterm·dom. This BGCterm·dom is not yet published at MIBiG, but the biosynthetic gene clusterterm·dom was previously annotated and reported in Moorena producens PAL ( 42 ), and in this study, the same genome, LC-MS/MSterm·mth metabolome, and MS/MS spectral data were used to obtain this BGC-metabolite correlation. Lastly, we observed the distribution ( Fig. S6 ) and the variance of the training dataframe (including all three kinds of features) used for this comparative analysis. The average variance of the columns was the same as rows (about 0.008), the maximum variance for the columns was 0.213, and for the rows was 0.068. The distribution ( Fig. S6 ) is very sparse (many zeros) and it also explains why the average variance is relatively small since all nonzero scores ranged from 0.7 to 1.0. Additionally, the latter score was the most common score in the training dataframe since every self-hit had a perfect score of 1.0 and the biosynthetic classes/substructure predictions were binary (either 0 or 1.0).

Comparing the performance of NPOmixterm·mth with other published tools We used the same previously described dataset of 1,040 paired samples that includes 22 validated BGCs-metabolites links to compare precisionterm·def scores (same links used in the calculation of the precisionterm·def scores in Fig. 3 ) to other eight multi-omics (tools and their websites are listed in Table S3). Precisionterm·def is the ratio between the true positive links over all the tested positives (true positives plus false positives), and this metric was calculated using only the best candidate (top-1) from the tools’ outputs. For the tools that do not have a training step, we selected from the 1,040 paired samples only the ones that contained at least one of the 22 BGCs-metabolites validated links, a total of nine paired samples. We compared NPOmixterm·mth to NRPminer ( 13 ) and NPLinker ( 15 ), the other currently available tools that create links between MS/MS data and BGCsterm·dom. NPLinker includes the correlation scores first developed in the pattern-based Genome Miningterm·key publications ( 8 , 9 ) and derivatives thereof. GNP ( 14 ) and NRPquest ( 12 ) seem to be discontinued (see Table S3 for further details).

MetaMiner ( 10 ) and DeepRiPP ( 11 ) could not be used in the comparison because, unfortunately, there are no RiPPs among the 22 links in our validation set. As far as we can tell, there are only two validated RiPPs in the entire PoDP database: capistruin C and polytheonamide A–B. However, neither of the two were available for our validation test (more details in the “ Supplementary Material and Results ” section). Under these circumstances, we did not test RiPP BGC-metabolite links, and we could not measure the performance of MetaMiner and DeepRiPP for this validation set; however, we tested both for the full metabolomes and genomes of these nine validation strains. In this test, MetaMiner annotated zero matches, despite the presence of 49 uncharacterized RiPP BGCsterm·dom in the nine genomes. DeepRiPP “failed to load results,” even though the input data was correctly processed by other tools. On top of testing tools that connect mass spectrometryterm·key fragmentation data to BGCsterm·dom, we also tested Nerpa ( 17 ) and GARLIC ( 18 ) which can connect structures (SMILES strings) to BGCsterm·dom.

Fig. 4 is a histogram illustrating the performance of these tools (nature of each BGC-MS/MS link, precisionterm·def and recall scores), including the two best versions out of eight versions of NPOmixterm·mth displayed in Fig. S7 (four with and four without co-occurrence threshold). Recall is the ratio between the true positives over the true positives plus the false negatives (links that were supposed to be true or negative positive results but were not classified as positives, in this case, links without results). Fig. S8 exemplifies how fragmented BGCsterm·dom can lead to scores below the threshold. More details on the Figs. S7 and S8 in the “ Supplementary Material and Results ” section. We note that we did not observe differences in NPLinker results using the standardized Metcalf score, the Rosetta score or both together. We selected top-1 accuracy to represent the precisionterm·def scores since some tools only provide a single BGCterm·dom candidate per metabolite tested. In theory, NRPminer and Nerpa should be able to test four links that are nonribosomal peptides (three orfamides and nevaltophin D) plus 11 additional hybrids between nonribosomal peptides and polyketides (two barbamides, five albicidins, two jamaicamides, cryptomaldamide, and antimycin). However, NRPminer could only generate predictions for four of these peptidic metabolites in the validated set (one incorrect and three correct links) and Nerpa only predicted three metabolites that were correctly linked to their BGCsterm·dom. GARLIC can test all but four links (three pyocyanines and brasilicardin A) since it should work for nonribosomal peptides, polyketides, and hybrids. We were unable to compile GRAPE (tool required to use GARLIC) and we found an unanswered issue on their GitHub page with that same question, as well as another issue from 2016 that is left unanswered, thus it seems that this tool is also no longer supported or is discontinued.

(A) Histogram displaying the number of correct links (true positives, in black), incorrect links (false positives, in gray), links not tested (due to limitations of the tool or threshold selected, in blue), and links without results (in yellow) for different currently available multi-omics tools. NPOmixterm·mth, NPLinker, and NRPminer can link MS/MS spectra (known or cryptic) to BGCsterm·dom; GARLIC and Nerpa can link known structures to BGCsterm·dom. NPOmixterm·mth has different versions that yield different precisionterm·def scores and so does NPLinker, however, in this case, the scores were the same for the different versions. NPLinker has regular ranks and shared ranks (for example, from the 2nd to the 10th position, if all scores were equal, then all of them would be tied for second). The precisionterm·def is the ratio between true positive links over all links that tested positives (true positives plus false positives), and this metric was calculated using only the best candidate (top-1) from the tools’ outputs. The recall is the ratio between true positives and true positives plus false negatives (links that were supposed to be true or negative positive results but were not classified as positives, in this case, links without results). NPOmixterm·mth (all three features with co-occurrence threshold) had nine links below the threshold and these links were not tested. NRPminer and Nerpa can only test peptidic metabolites. GARLIC and GNP were discontinued (in pink), and they could not test any of the links. NRPquest was replaced by NRPminer (hence, also discontinued, in pink). There were no known RiPP metabolites in the validation set for MetaMiner and DeepRiPP to test; however, these tools did not generate results for the 49 unknown RiPP BGCsterm·dom found in the genomes from the validation set. W/= with; W/o = without.

NPLinker is systematic (it does not depend on the BGCterm·dom/metabolite class) and, just like NPOmixterm·mth without threshold, it can test all links. For all tools, we used standard settings (commands found in the notebook “NPOmixterm·mth_SI-installation_and_running,” GitHub repository https://github.com/tiagolbiotech/NPOmixterm·mth ); and we note that for these analyses we did not attempt to optimize settings and scores of the various tools but used their (recommended) default settings. We also note that due to the use of a relatively small number of strains for the NPLinker benchmarking purposes (nine strains), it is likely that the correct links are part of a longer list of possible matches based on their co-occurrence score and that several links have the same score. Hence, the correct match may not be in the top-1 rank if we do not consider a shared rank (for example, from the 2nd to the 100th position, if all scores were equal, then all of them would be tied for second using their shared rank). The use of (many) more strains is likely to improve some rankings as the co-occurrence score is more likely to differentiate between different links. Comparing NPOmixterm·mth to the strain-correlation-based (co-occurrence score) approach used within NPLinker we can see that: (i) the first tool uses a k -nearest neighborterm·ai approach that requires a training step (that can improve with more training paired data) while the second one does not need any training; (ii) the training step for NPOmixterm·mth can process thousands of samples (paired genomes and metabolomes) in a scalable manner, while a strain-correlation-based approach requires much more processing power to run thousands of samples. The latter is mainly due to the fact that NPOmixterm·mth selects which metabolites (MS/MS spectra) should be targeted for classification in opposition to NPLinker that attempts to link all metabolites present in the analyzed metabolomes; (iii) NPOmixterm·mth is a tool for connecting metabolites to BGCsterm·dom, NPLinker is a framework that facilitates integrative omics analysis, and in the future, NPOmixterm·mth will likely become part of the NPLinker framework. We stress that “benchmarking NPLinker” effectively means benchmarking the (standardized) Metcalf strain-correlation and Rosetta scoring systems; in the future, it is likely a combination of various strain-correlation-based and feature-based scoring systems (such as NPClassScore) ( 39 ) that will enable the most effective integrative omics mining. Both precisionsterm·def for top-1, and top-1 shared ranks are provided in Fig. 4 . The complete results list with regular ranking and shared ranking for NPLinker can be found at Dataset S1 , sheet six.

As illustrated in Fig. 4 , the maximum number of correct links is 18 (17 from the MIBiG-GNPS validation set plus palmyramide, a new link partially validated) and this corresponded to using NPOmixterm·mth with substructure and similarity scores without threshold and it presented a recall of 100% (no links were classified as false negatives). However, the highest precisionterm·def (92.3%) could be found using NPOmixterm·mth with all three features (similarity, substructures, and biosynthetic classes) with threshold and it also presented a recall of 100%. This top precisionterm·def from NPOmixterm·mth in our benchmarking experimentation was 34% more precise than the second-best tool tested, NPLinker with shared rank (Nerpa and NRPminer did present very high precisionterm·def scores but their recall was fairly low because most of the tested links had no results), and NPOmixterm·mth was able to correctly predict about 2.5 times more BGCs-metabolites links than NPLinker. Of note, the precisionterm·def of NPLinker without shared rank was about 40% lower. Another difference between the most precise NPOmixterm·mth version and the most precise NPLinker version was the recall, which NPOmixterm·mth was 30% higher (100% versus 70%). As aforementioned, five tools could not be tested because they were: discontinued like GNP and NRPquest; generated no results like MetaMiner; had unclear instructions like GARLIC; or could not read the same input that other tools were able to process normally like DeepRiPP. We concluded from this figure that NPOmixterm·mth not only can predict more links (Fig. 4A ) than most of the other tools but also the ratio of correct links is significantly higher than other methodologies (Fig. 4B ) and the recall displayed is optimal (100%, indicating the absence of false negatives). Of note, the prediction power of machine learning tools like NPOmixterm·mth can be even higher with more top candidates (for this comparison we only used top-1) and better features, such as demonstrated by the implementation of biosynthetic class with NPClassScore ( 39 ) to improve NPLinker links and the use of extra features other than similarity by NPOmixterm·mth. Additionally, the precisionterm·def of NPOmixterm·mth can improve with a bigger training set. In the future, we will compare NPOmixterm·mth using the biosynthetic class feature with NPClassScore, since it would require standardizing and improving the current class predictions (using CANOPUS and MolNetEnhancer) for unknown/cryptic MS/MS spectra. Of course, an ideal NPOmixterm·mth version would not only provide a perfect recall (100%) with a high precisionterm·def (e.g. 92.3%), but also work for all links in the validation set, despite the use of a confidence threshold. We believe the current NPOmixterm·mth represents a springboard for further development and improvements, also through integration with other mining tools.

Using NPOmixterm·mth and MassQL to computationally genome mine for new siderophoresterm·key The mining for specific specialized metabolitesterm·key in a large number of metabolomics profiles is a challenging task. The available 3,248 LC-MS/MSterm·mth chromatographic profiles obtained from the PoDP database would generate over 2.6 million MS/MS fragmentation spectra (representing measured ions via MS/MS fragmentation) if each file contains an average 800 spectra (as observed by inspecting some of these files). Post-dereplication, there are far too many new metabolites that can be isolated for natural product discovery. One way to subset spectra is by focusing on a particular type of activity. For example, siderophoresterm·key can bind iron and, in some cases, can serve as an antibiotic by depleting iron levels in the media. MassQL ( 20 ) can detect whether a metabolite is bound to iron because its isotopic pattern is different from the apo (unbound) form and the delta m/z between the apo and the bound is equivalent to the mass for iron. By using MassQL on these 3,248 LC-MS/MSterm·mth profiles (MassQL query listed in the “Methods” section), we detected only 380 putative siderophoresterm·key (MS/MS fragmentation spectra, listed at Dataset S1 , sheet seven), indicating a low recall and/or that siderophoresterm·key are very rare in these samples. The latter is likely true because only 5.1% of the BGCsterm·dom obtained from the PoDP database detected by antiSMASH are annotated as a siderophoreterm·key. The putative siderophoresterm·key identified by MassQL were filtered to remove redundancies and the final MGF format MS/MS spectra were used as input for NPOmixterm·mth (MGF files can be obtained from the MassQL job listed in the “Methods” section).

NPOmixterm·mth connected two of these siderophoresterm·key with 100% Jaccard similarity (between BGCterm·dom and MS/MS fingerprints) to BGCsterm·dom labeled as siderophoresterm·key by antiSMASH. The NPOmixterm·mth version applied did not use biosynthetic classes or substructures for training (only similarity scores as features); given this, connecting metabolites bound to iron to siderophoreterm·key BGCsterm·dom increases the chances of true positives, since there is a very low probability of NPOmixterm·mth matching the correct siderophoreterm·key class randomly. The metabolite of [M-2H++Fe3+]+ m/z 780.918909 (hereafter m/z 780) was linked to the only siderophoreterm·key BGCterm·dom annotated by antiSMASH in the genome of the Burkholderiales Achromobacter xylosoxidans NH44784-1996 (GCA_000,967,095), indicating that NPOmixterm·mth likely made a correct inference. Only one gene in the BGCterm·dom linked to the m/z 780 has annotation (IucA/IucC family siderophoreterm·key biosynthesis protein from the aerobactin BGCterm·dom); however, aerobactin is not the closest MIBiG homolog (using a cutoff of 0.7, there is no homolog to this cryptic siderophoreterm·key BGCterm·dom). The gene cluster familyterm·dom for this candidate BGCterm·dom had only two BGCsterm·dom and the PoDP database average is six BGCsterm·dom per family, highlighting the novelty of these BGCsterm·dom. GNPS and Dereplicator+ had no library hits for the metabolite fragmentation spectra. Unfortunately, this sample was a cystic fibrosis bacterial isolate from the clinical laboratory, and it is no longer available to confirm a NPOmixterm·mth prediction via isolation and structure elucidation. This pipeline can be reproduced by the users with their samples for prioritizing new siderophoresterm·key out of many unknown metabolites.

Discussion In this work, we demonstrated the use of machine learning (a new k -nearest neighborsterm·ai algorithm named NPOmixterm·mth) and genome miningterm·key for processing several thousand LC-MS/MSterm·mth files and about a thousand genomes to connect MS/MS spectra to GCFsterm·dom. Our approach can systematically connect MS/MS spectra from known metabolites (links validated experimentally), spectra from metabolites analogous to known (links with GNPS library matches, exemplified by orfamide C), and spectra from cryptic metabolites (links without GNPS library matches and therefore absent from the MS/MS database, as exemplified by brasilicardin A). The advantage of using paired data is that the genomic information represents the full metabolic potential of an organism, and hence, we can prioritize the discovery of the most diverse naturally occurring BGCsterm·dom via genome miningterm·key. In other words, novelty predictions using BGC-metabolite links are likely more comprehensive than just using metabolomics and a more accurate picture of the actual chemical diversity in nature. Additionally, the use of genetic information can help in the structure elucidation and prediction of bioactivity ( 2 ), highlighting the advantage of using the BGCterm·dom information in the drug discovery process. Moreover, predicting linked MS/MS spectra for a promising BGCterm·dom can facilitate their heterologous expression as the expression can be difficult if the target metabolite is not known. We also show how cryptic MS/MS spectra (absent from MS/MS databases like GNPS) can be annotated using NPOmixterm·mth, MZmine ( 29 ), and Dereplicator+ ( 30 ), allowing expansion of the current MS/MS databases. Overall, NPOmixterm·mth presents a new methodology to efficiently address the challenging task of connecting metabolites to BGCsterm·dom and the results illustrated that this new method could impact future drug discovery pipelines since this kind of connection allows metabolomics to make use of in-silico predictions made via genomics (e.g., novelty, structures, and bioactivity).

The current focus of the NPOmixterm·mth use was on finding BGCsterm·dom for metabolites represented by their MS/MS spectra; however, NPOmixterm·mth could also be used to go vice-versa. Also, despite this manuscript being centered on how paired data can make better in-silico predictions than just metabolomics, it could also be focused on how paired data is better than just genomics and the benefits would be very similar. We believe this strategy aims to be a pipeline that better uses the wealth of available data; therefore, it could maximize the chances of finding new drug-like metabolites.

We observed very good precisionterm·def scores of top-1 = 81.8% and top-10 = 92.9% (both with randomness equal to 0, using the similarity and biosynthetic class features and using the Jaccard co-occurrence threshold). Additionally, we also obtained a good precisionterm·def score of 77.3% even without the co-occurrence threshold (for k = 3 and all three kinds of features including similarity, biosynthetic class, and substructure predictions). We observed an annotation rate of around 28%, as 14 out of 50 MS/MS validated spectra were retained after the co-occurrence threshold. The annotation rate was even higher without the use of the co-occurrence threshold, 44% (22 out of 50 dereplicated MS/MS validated spectra). Table S1 details the number of genomes, metabolomes, BGCsterm·dom, GCFsterm·dom, and metabolites used in this study. More details on these 22 BGC-MS/MS links can be found in the Supporting Material (see the “Discussion” section) and Fig. S9 .

In fact, compared to the other eight multi-omics tools, NPOmixterm·mth seems to be the only available tool that is (i) systematic (suitable to many classes of BGCsterm·dom), (ii) highly efficient (about 34% higher score in Fig. 4B than other approaches with 100% recall), (iii) high throughput (we processed around a thousand genomes and 3× more LC-MS/MSterm·mth files), and (iv) scalable (requiring low-processing power, we used 8 MB of RAM and 8 cores). We note that NPLinker is also systematic, high throughput, and scalable; however, its precisionterm·def score during benchmarking was 34% lower than NPOmixterm·mth, in part due to the relatively low number of strains used during NPLinker benchmarking. NPOmixterm·mth was able to correctly predict about 2.5 times more BGCs-metabolites links than other tools. The combination of multiple multi-omics tools (and other genomics and metabolomics tools) can be a potent genome miningterm·key approach that would enable the visualization of many kinds of predictions (similarity scores for the links, biosynthetic classes, complete/partial structures, taxa, and bioactivity) in a single “omics network” (work in progress), prioritizing new true positives. Here, it is also interesting to find out how the use of alternative mass spectral similarity scores, such as the recently developed machine learning-based Spec2Vec and MS2DeepScore ( 43, 44 ), will affect the performance of NPOmixterm·mth. We also illustrated how combining NPOmixterm·mth with MassQL can prioritize the discovery of putatively new siderophoresterm·key, exemplifying the application of NPOmixterm·mth for cryptic metabolites. This siderophoreterm·key mining method can be easily reproduced by the NPOmixterm·mth users if they search for metabolites bound to iron using the query string provided in the methods, extracting the MGF files (MS/MS spectra), running the NPOmixterm·mth python version using only similarity as a feature and checking if NPOmixterm·mth links a putative siderophoreterm·key metabolite to a new siderophoreterm·key BGCterm·dom.

Of note, new links between metabolites with predicted structure and known BGCsterm·dom may not mean that the metabolite fully corresponds to the predicted structure because mass spectrometryterm·key tends to not distinguish isomers and small changes in BGCsterm·dom can yield substantial changes in the final structure. Therefore, NPOmixterm·mth (a correlation-based approach ) does not have the resolution to distinguish between isomers and regioselectivity of the various homologs. We would like to emphasize that new links (not experimentally validated links that are, for example, reported in the PoDP database) require proper elucidation to confirm the metabolite’s planar (2D) and absolute (3D) chemical structure. Hence, in this study, 6 of the 11 BGC-metabolite links (family of analogs) used for validation were previously fully elucidated (via knockouts, heterologous expression, and/or isolation and NMR structure elucidation) as recorded in the PoDP database. We want to emphasize that despite the small size of the validation set (11 BGC-metabolite links plus analogs, a total of 22 MS/MS spectra), we were able to combine in-silico tools like Mzmine, Dereplicator+, and NPOmixterm·mth to create new links that can expand MS/MS mass spectral reference database as "level bronze" metabolites (new putatively annotated MS/MS spectra) ( 14 ). Interestingly, some of our in-silico structure predictions (such as for orfamides) were very accurate and they would substantially facilitate NMR structure elucidation of the naturally occurring metabolite.

Another aspect to mention is that the precisionterm·def score may not be reproducible for every dataset, especially if the dataset is not too similar to the current training set, as they may present very different features; therefore, NPOmixterm·mth features might not perform as well on a given atypical dataset. For example, by submitting a fungal species that has no BGCterm·dom similar to any BGCterm·dom in the NPOmixterm·mth training dataset (obtained from the PoDP database), the output would contain no answer, since NPOmixterm·mth requires similarity scores for classifying BGCsterm·dom. Although, the insertion of even one additional fungal species to the training set that is similar to the submitted strain would cause the strain’s BGCsterm·dom to network with training BGCsterm·dom and NPOmixterm·mth would generate outputs. Hence, by amplifying the training set (e.g., with the natural expansion of the PoDP database), NPOmixterm·mth will be able to perform better for many different kinds of samples, including novel ones that have some similarity to strains in the training data. Unfortunately, none of the currents validated metabolites in the PoDP database belongs to the RiPP class (more details in the “ Supplementary Material and Results ” section); hence, we encourage specialized metabolism researchers to deposit examples of these types of ribosomal peptides (genomic and metabolomic data) to the existing PoDP database and these examples will be used in future tests.

The use of complete genomes over MAGs and metagenomes is preferred to create a more “complete” training set; we predict that this would result in better precisionterm·def than if the training set is populated with several fragmented BGCsterm·dom. It is important to clarify that some organisms do not have BGCsterm·dom (e.g., higher plants and animals) and therefore their metabolites cannot be linked to biosynthetic genes using NPOmixterm·mth. Regarding lower plants, the annotation of BGCsterm·dom is now a hot topic; however, there is a current lack of paired data for plants and the current NPOmixterm·mth demonstration is done on the suitable and available data from the PoDP (almost exclusively from bacteria). On top of that, BGCterm·dom detection is more challenging for plants (e.g., more scattered biosynthesis genes).

Another challenging type of samples are microbiomes, such as nonaxenic cyanobacterial cultures like the example of the mix between Moorea producens JHB and its 15 detected heterotrophic genera plus viruses ( 45 ). Although, we successfully processed 40 cyanobacterial microbiomes and we linked five metabolites to their correct BGCsterm·dom, demonstrating that this tool can also be used with microbiomes. A major limitation of using microbiomes for genome miningterm·key is that the quality of their metagenomes can hinder BGCterm·dom assembly, leading to a smaller number of BGCsterm·dom than expected and many of these BGCsterm·dom can be fragmented. We plan to address microbiomes, plants, algae, and fungi samples more comprehensively in our future work (other future goals are also highlighted in the “ Supplementary Material and Discussion ” section).

Finally, we would like to stress that all true positive BGC-MS/MS validated links reported here were found in a known producer of the metabolites, they matched the reported masses, and 6 of the 11 BGC-metabolite links used for validation (true and false positives, including brasilicardin A) were reported at the PoDP database as validated via knockouts, heterologous expression, or isolation and/or NMR structure elucidation. In a similar way, NPLinker also used such validated links from the PoDP database to assess the impact of novel BGC-MS/MS linking scores and the complementary of them. Palmyramide A was also previously validated via isolation and NMR structure elucidation ( 46 ) (hence, making 7 out of 12 validated GCF-MS/MS links), and it will be soon published at MIBiG and PoDP. The putative orfamides were not confirmed via structure elucidation or co-elution with standards (the new metabolite spectra were annotated via GNPS library matching) but the comparison to a reference from GNPS and BGCterm·dom amino acid predictions strongly indicates that they share the same planar structure as the reference metabolite from GNPS. Our results highlight the importance of making genomics and metabolomics data publicly available with curated metadata, because more available paired data would enable better training of models, and therefore, better tools for the research community.

Conclusions We developed a promising tool to search for new specialized metabolitesterm·key in paired omics data of natural extracts by using links between cryptic MS/MS and cryptic biosynthetic gene clustersterm·dom (BGCsterm·dom) but also more efficiently dereplicating known BGCsterm·dom or known metabolites. This will facilitate the use of genome miningterm·key in drug discovery pipelines. For example, we illustrated that our tool could integrate multiple kinds of information about biosynthetic classes, family beta-diversity, dereplicationterm·key, and the probability of being a correct link. These bits of information are very useful for finding novel metabolites from nature (cultures or metagenomic samples). Thus, we believe that the current version of NPOmixterm·mth will already facilitate access to the so far under-explored bacterial biosynthetic potential, allowing to bioprospect a larger portion of this potential.

Of note, we developed NPOmixterm·mth and we were able to use other third-party tools like NPLinker ( 15 ), CANOPUS ( 35 ), NRPminer ( 13 ), Nerpa ( 17 ), GNPS molecular networking ( 14 ), BiG-SCAPE ( 7 ), and MetaMiner ( 10 ); these tools processed data from three databases (MIBiG, PoDP, and GNPS) ( 14 , 20 , 21 ). Interestingly, the information from linked BGC-MS/MS data enabled good predictions for partial structures like cryptomaldamide and even complete planar structures like orfamide C (including hints of the AA stereochemistry that can aid in the elucidation of absolute structures). Many of the links were known antifungal and antibiotic metabolites, therefore, reproducing this analysis for new metabolites can be a very promising methodology for drug discovery (work also in progress, especially focusing on the discovery of new siderophoresterm·key, here exemplified by a computational approach including NPOmixterm·mth and MassQL that can be reproduced by the users).

To facilitate the use of NPOmixterm·mth, we are hosting workshops (in English and Portuguese) and we created video tutorials, both available at https://www.tfleao.com/npomix1 . We will assist the NPOmixterm·mth use so the genome miningterm·key community can benefit from its capabilities, especially via GitHub ( https://github.com/tiagolbiotech/NPOmixterm·mth_python for the python version or https://github.com/tiagolbiotech/NPOmixterm·mth for the Jupyter notebook version).

We anticipate the use of this pipeline for many applications including (but not limited to): (1) studying siderophoresterm·key and iron cycling under nutrient limitation; (2) studying humans, mammals, plants, marine invertebrates, and other microbiomes and their relationship with host health; (3) finding new bioactive metabolites for drug development; (4) better understanding metabolite-mediated cell function of a model organism like E. coli (important for heterologous expression); (5) learning how plants, corals, and phytoplankton can be more resilient to global warming and other anthropogenic impacts. In conclusion, we expect that our tool will play an important role to form an integrative omics mining community, and that it will have a range of implications for genomics, metabolomics, natural products discovery, and other associated research fields.

Methods See the “ Supplementary Material and Methods ” section for details on obtaining the data, assembly, BGCterm·dom comparison, the NPOmixterm·mth tool itself, and other bioinformatic analyses.

Authors' Contributions T.F.L. conceptualized the software; T.F.L., R.d.S., and As.B. programmed the software; M.W. and A.G. assembled the metagenomic reads and annotated all biosynthetic gene clustersterm·dom; An.B. and R.R. worked on the predicted fragmentation for brasilicardin A; P.W.P.G. matched the predicted structure to the fragmentation of promising candidates and created structural insights; T.F.L., J.J.J.v.d.H., and M.W. curated the dataset and verified the known BGCs-metabolites links; T.F.L., J.J.R.L., J.J.J.v.d.H., and A.G. compared the performance of our tool with other multi-omics tools; E.G. cultured cyanobacterial samples and collected the cyanobacterial LC-MS/MSterm·mth data published at PoDP database; J.J.J.v.d.H., H.W.K., R.R., A.T.A, P.W.P.G., and A.B. provided feedback on the approach and how to present the results; T.F.L. and J.J.J.v.d.H. wrote the manuscript; J.J.J.v.d.H., L.G., W.H.G., N.B., M.F.F., and P.C.D. funded and designed the research; L.G., W.H.G., N.B., M.F.F., J.J.J.v.d.H., and P.C.D. edited the manuscript; and all authors read, reviewed, and agreed to the published version of the manuscript.

Preprint https://www.biorxiv.org/content/10.1101/2021.10.05.463235 .

Supplementary Material Click here for additional data file.

ACKNOWLEDGEMENTS We would like to acknowledge Sandra Neubert, Bohan Ni, Dr. Kiefer Forsch, Dr. Christopher Leber, Dr. Chen Zhang, Dr. Andres Mauricio Caraballo-Rodriguez, Dr. Louis-Félix Nothias, Dr. Benjamin Naman, and Dr. Mitja Zdouc for the productive discussions about the topic. Additionally, we would like to acknowledge Dr. Andrew Ramsay for the help and advice on how to run NPLinker.

Notes Competing interest: W.H.G. has an equity interest in NMRFinder and SirenasMD Inc., companies that may potentially benefit from the research results and W.H.G. also serves on the companies’ Scientific Advisory Boards. The terms of this arrangement have been reviewed and approved by the University of California San Diego in accordance with its conflict-of-interest policies. P.C.D. is a scientific advisor to SirenasMD Inc., Galileo and Cybele, and co-founder and scientific advisor to Ometa and Enveda with approval by the University of California San Diego. M.W. is a cofounder of Ometa Labs, LLC. J.J.J.v.d.H is a member of the Scientific Advisory Board of NAICONS Srl., Milano, Italy.

Contributor Information Tiago F LeãopersName, Collaborative Mass Spectrometryterm·key Innovation Center, Skaggs School of Pharmacy and Pharmaceutical Sciences, University of California San Diego, La Jolla, CA 92093, USA; Center for Nuclear Energy in Agriculture, University of São Paulo, Piracicaba 13400-970, SP, Brazil.

Mingxun WangpersName, Collaborative Mass Spectrometryterm·key Innovation Center, Skaggs School of Pharmacy and Pharmaceutical Sciences, University of California San Diego, La Jolla, CA 92093, USA; Center for Computational Mass Spectrometryterm·key, University of California San Diego, La Jolla, CA 92093, USA.

Ricardo da SilvapersName, NPPNS, Physic and Chemistry Department, School of Pharmaceutical Sciences of Ribeirão Preto, University of São Paulo, Ribeirão Preto 14040-900, Brazil.

Alexey GurevichpersName, Center for Algorithmic Biotechnology, St. Petersburg State University, St Petersburg 199004, Russia.

Anelize BauermeisterpersName, Collaborative Mass Spectrometryterm·key Innovation Center, Skaggs School of Pharmacy and Pharmaceutical Sciences, University of California San Diego, La Jolla, CA 92093, USA.

Paulo Wender P GomespersName, Collaborative Mass Spectrometryterm·key Innovation Center, Skaggs School of Pharmacy and Pharmaceutical Sciences, University of California San Diego, La Jolla, CA 92093, USA.

Asker BrejnrodpersName, Collaborative Mass Spectrometryterm·key Innovation Center, Skaggs School of Pharmacy and Pharmaceutical Sciences, University of California San Diego, La Jolla, CA 92093, USA.

Evgenia GlukhovpersName, Center for Marine Biotechnology and Biomedicine, Scripps Institution of Oceanography, University of California San Diego, La Jolla, CA 92093, USA.

Allegra T AronpersName, Collaborative Mass Spectrometryterm·key Innovation Center, Skaggs School of Pharmacy and Pharmaceutical Sciences, University of California San Diego, La Jolla, CA 92093, USA; Department of Chemistry and Biochemistry, University of Denver, Denver, CO 80210, USA.

Joris J R LouwenpersName, Bioinformatics Group, Wageningen University, 6708 PB Wageningen, The Netherlands.

Hyun Woo KimpersName, College of Pharmacy and Integrated Research Institute for Drug Development, Dongguk University, Gyeonggi-do 10326, Korea.

Raphael ReherpersName, Institute of Pharmaceutical Biology and Biotechnology, University of Marburg, 35043 Marburg, Germany.

Marli F FiorepersName, Center for Nuclear Energy in Agriculture, University of São Paulo, Piracicaba 13400-970, SP, Brazil.

Justin J J van der HooftpersName, Bioinformatics Group, Wageningen University, 6708 PB Wageningen, The Netherlands; Department of Biochemistry, University of Johannesburg, Auckland Park, Johannesburg 2006, South Africa.

Lena GerwickpersName, Center for Marine Biotechnology and Biomedicine, Scripps Institution of Oceanography, University of California San Diego, La Jolla, CA 92093, USA.

William H GerwickpersName, Collaborative Mass Spectrometryterm·key Innovation Center, Skaggs School of Pharmacy and Pharmaceutical Sciences, University of California San Diego, La Jolla, CA 92093, USA; Center for Marine Biotechnology and Biomedicine, Scripps Institution of Oceanography, University of California San Diego, La Jolla, CA 92093, USA.

Nuno BandeirapersName, Collaborative Mass Spectrometryterm·key Innovation Center, Skaggs School of Pharmacy and Pharmaceutical Sciences, University of California San Diego, La Jolla, CA 92093, USA; Center for Computational Mass Spectrometryterm·key, University of California San Diego, La Jolla, CA 92093, USA.

Pieter C DorresteinpersName, Collaborative Mass Spectrometryterm·key Innovation Center, Skaggs School of Pharmacy and Pharmaceutical Sciences, University of California San Diego, La Jolla, CA 92093, USA; Center for Microbiome Innovation, University of California San Diego, La Jolla, CA 92093, USA; Departments of Pharmacology and Pediatrics, University of California San Diego, La Jolla, CA 92093, USA.

Funding This research was supported by the National Institutes of Health (NIH) grants GM107550 (to P.C.D., W.H.G., and L.G.) and GM118815 (to W.H.G. and L.G.). This work was supported in part by a seed grant from the Center for Microbiome Innovation at the University of California San Diego. R.S. was supported by the São Paulo Research Foundation (Awards FAPESP 2017/18922–2 and 2019/05026–4). J.J.J.v.d.H. and J.J.R.L. were supported by the Netherlands eScience Center (ASDI eScience grant ASDI.2017.030). J.J.J.v.d.H. was supported by the Netherlands eScience Center Open eScience Call (NLESC.OEC.2021.002). A.G. was supported by the System Biology Fellowship of Skoltech & PMI (Research Agreement number 8299).

Code and Data Availability The code (a collection of Jupyter notebooks) required to reproduce this work and to use the NPOmixterm·mth tool for new samples can be found on the following GitHub repository page: https://github.com/tiagolbiotech/NPOmixterm·mth . The repository also includes short video explanations on how the tool works and its importance for natural product discovery. We also wrapped the code in a few python scripts found here: https://github.com/tiagolbiotech/NPOmixterm·mth_python . This python repository is the most updated version of the code, and it also contains more comments on each step of the pipeline. This page with the python version also includes a video explanation of how to prepare inputs and how to run NPOmixterm·mth in python. Additionally, we provide a webpage ( https://www.tfleao.com/npomix1 ) for submitting a limited number of samples for free processing (maximum of 50 queries MS/MS fragmentation spectra) and this page also includes workshops on how to submit samples and interpret results. We are going to purchase a server and allow users to submit many more metabolites than just 50.

The (meta)genomes used to create the NPOmixterm·mth training dataset for validation were downloaded from the PoDP ( 20 ) using notebook 1 from the GitHub repository (Jupyter notebook version). All BGCsterm·dom from these training (meta)genomes can be found here for downloading: https://doi.org/10.5281/zenodo.6637083 . The paired experimental MS/MS files were downloaded using the ftp links (also from the PoDP) found in Dataset S1 , sheet eight. The links for these MS/MS files can also be found in the “NPOmixterm·mth_SI-installation_and_running” notebook for downloading (GitHub repository https://github.com/tiagolbiotech/NPOmixterm·mth ). The testing set included MS/MS spectra from the PoDP database, spectra from the GNPS ( 14 ), and also spectra also used in the NPLinker publication ( 39 ). If the potential users find the tool challenging to run, we have our contact information on the main webpage ( https://www.tfleao.com/npomix1 ) to submit samples and we expect that promising results will lead to fruitful collaborations.

References Associated Data Supplementary Materials Click here for additional data file.

Data Availability Statement The code (a collection of Jupyter notebooks) required to reproduce this work and to use the NPOmixterm·mth tool for new samples can be found on the following GitHub repository page: https://github.com/tiagolbiotech/NPOmixterm·mth . The repository also includes short video explanations on how the tool works and its importance for natural product discovery. We also wrapped the code in a few python scripts found here: https://github.com/tiagolbiotech/NPOmixterm·mth_python . This python repository is the most updated version of the code, and it also contains more comments on each step of the pipeline. This page with the python version also includes a video explanation of how to prepare inputs and how to run NPOmixterm·mth in python. Additionally, we provide a webpage ( https://www.tfleao.com/npomix1 ) for submitting a limited number of samples for free processing (maximum of 50 queries MS/MS fragmentation spectra) and this page also includes workshops on how to submit samples and interpret results. We are going to purchase a server and allow users to submit many more metabolites than just 50.

The (meta)genomes used to create the NPOmixterm·mth training dataset for validation were downloaded from the PoDP ( 20 ) using notebook 1 from the GitHub repository (Jupyter notebook version). All BGCsterm·dom from these training (meta)genomes can be found here for downloading: https://doi.org/10.5281/zenodo.6637083 . The paired experimental MS/MS files were downloaded using the ftp links (also from the PoDP) found in Dataset S1 , sheet eight. The links for these MS/MS files can also be found in the “NPOmixterm·mth_SI-installation_and_running” notebook for downloading (GitHub repository https://github.com/tiagolbiotech/NPOmixterm·mth ). The testing set included MS/MS spectra from the PoDP database, spectra from the GNPS ( 14 ), and also spectra also used in the NPLinker publication ( 39 ). If the potential users find the tool challenging to run, we have our contact information on the main webpage ( https://www.tfleao.com/npomix1 ) to submit samples and we expect that promising results will lead to fruitful collaborations.

Interpretive notes.
• Highlighted spans are tagged entities: persName (author), title (venue), placeName (place), date (year), and term (a key concept: domain / ai / method).
• Eponymous or retrospective terms (e.g. “Nash equilibrium”, “segregation”) do not appear in the original source and so are not highlighted — a deliberate choice (see Report 4).
• Some entries begin with a word in capitals. EVIDENCE CORRECTED means the finding still stands and it was our quotation that was wrong — it has been replaced. RETRACTED means the entry itself was wrong; it stays on the page, marked, with its reason, rather than being deleted. WITHDRAWN AND REPLACED means a corrected version of it appears in the entries below. Each mark carries its own reason, because the reasons differ from one entry to the next. An entry we have WITHDRAWN is removed from this page and kept in the record, with its reason. A line reading Audit and a date is a later re-reading of the entry against its whole sentence: DOUBTFUL means it was kept, and the reason says what is loose about it.
• Quotation marks inside the tagger's sentence. Where a tag is the tagger's own sentence, a phrase in quotation marks inside it is borrowed from the paper — the tagger's wording around it is not. The paper's own sentence is the evidence quote shown on the same row, so the borrowing can be checked against the thing borrowed from without leaving this page. Nothing inside quotation marks anywhere on this page is ours: if it is quoted, it is the paper's. Whose words a concept carries. A concept entry records a term the paper itself uses, so the term, the sense given for it, and its evidence are the paper's own words, quoted where the paper fixes them. This is the opposite of a sense entry in the tag table, which is the tagger's sentence about how the paper uses a term. Where a concept entry could not be grounded in the paper's words, the entry says so on its own row.
• Counts: 1 work · 1 date.
Meta-Tagging Project · record leao2022-npomix-machine-learning-mass-spectrometry.
© 2026 Shir Sivroni