No retraction, correction or concern found when last checked on Oct 17, 2026.
Systems Biology and Multi-Omics Integration: Viewpoints from the Metabolomics Research Community
Farhana R. Pinu, David J. Beale, Amy M. Paten and 4 more
Metabolites · 2019 · CC BY
Abstract
The use of multiple omics techniques (i.e., genomics, transcriptomics, proteomics, and metabolomics) is becoming increasingly popular in all facets of life science. Omics techniques provide a more holistic molecular perspective of studied biological systems compared to traditional approaches. However, due to their inherent data differences, integrating multiple omics platforms remains an ongoing challenge for many researchers. As metabolites represent the downstream products of multiple interactions between genes, transcripts, and proteins, metabolomics, the tools and approaches routinely used in this field could assist with the integration of these complex multi-omics data sets. The question is, how? Here we provide some answers (in terms of methods, software tools and databases) along with a variety of recommendations and a list of continuing challenges as identified during a peer session on multi-omics integration that was held at the recent ‘Australian and New Zealand Metabolomics Conference’ (ANZMET 2018) in Auckland, New Zealand (Sept. 2018). We envisage that this document will serve as a guide to metabolomics researchers and other members of the community wishing to perform multi-omics studies. We also believe that these ideas may allow the full promise of integrated multi-omics research and, ultimately, of systems biology to be realized.
Full text
From PubMed Central, U.S. National Library of Medicine, as current on Oct 17, 2026. Paragraph numbers are ours, so an answer can point at one.
1. Introduction
Systems biology is an interdisciplinary research field that requires the combined contribution of chemists, biologists, mathematicians, physicists, and engineers to untangle the biology of complex living systems by integrating multiple types of quantitative molecular measurements with well-designed mathematical models. The premise and promise of systems biology has provided a powerful motivation for scientists to combine the data generated from multiple omics approaches (e.g., genomics, transcriptomics, proteomics, and metabolomics) to create a more holistic understanding of cells, organisms, and communities, relating to their growth, adaptation, development, and progression to disease.
Over the past decade technological advancements in next-generation DNA sequencing, SNP-chip profiling, transcriptome measurements via RNA-seq, SWATH-based proteomics, and metabolomics via UPLC-MS and GC-MS techniques have greatly increased the ease, and significantly reduced the cost, of collecting rich, multi-omics data. As a result, many researchers are now conducting comprehensive multi-omics experiments, and more data scientists are attempting to integrate these data sets to create new and meaningful biological knowledge. In a clinical setting, a growing number of private companies (e.g., www.arrivale.com, www.viome.com, www.molecularyou.com) are now also using the same low-cost, high throughput technologies to offer multi-omics and precision health assessments.
While large-scale omics data are becoming more accessible, and multi-omics studies are becoming much more frequent—real multi-omics integration remains very challenging. This is because many of the specific analytical tools and experimental designs traditionally used for individual omics disciplines (e.g., genomics, transcriptomics, and proteomics) are not sufficiently well-suited to permit proper comparisons or intelligent integration across multiple omics disciplines. For instance, the preferred collection methods, storage techniques, required quantity and choice of biological samples used for genomics studies are often not suited for metabolomics, proteomics or transcriptomics. Similarly, qualitative methods commonly used in transcriptomics and proteomics are not suited to the quantitative methods used in genomics. While transcriptomics and proteomics are increasingly more quantitative (i.e., RNA-seq in transcriptomics and stable labeled isotope tagging in proteomics), it is increasingly pertinent to compare the applicability and accuracy/precision of quantification strategies (e.g., absolute vs. relative quantification). Furthermore, carefully integrated multi-omics data must be ‘deconstructed’ into single data sets before being deposited into omics-specific databases in order to make it publicly available. These issues underline the fact that high-quality multi-omics studies require: 1) proper experimental design, 2) thoughtful selection, preparation, and storage of appropriate biological samples, 3) careful collection of quantitative multi-omics data and associated meta-data, 4) better tools for integration and interpretation of the data, 5) agreed minimum standards for multi-omics methods and meta-data, and 6) new resources for the deposition of intact multi-omics data sets.
Interestingly, many of the experimental, analytical and data integration requirements that are essential for metabolomics studies are actually fully compatible with genomics, transcriptomics and proteomics studies. In other words, due to its closeness to cellular or tissue phenotypes, metabolomics can provide a ‘common denominator’ to the design and analysis of many multi-omics experiments. It also provides broadly useful guidelines for sampling, handling and processing. Therefore, a greater awareness of metabolomics by other omics researchers or by researchers performing multi-omics experiments could significantly improve the quality and utility of integrated-omics research. To take this integration a step further, it will be critical to be able to associate integrated omics data with the meta-data in the context of the studies being undertaken. For instance, data from host-associated microbiomes can also now be integrated with the exometabolome data to better understand the mechanistic bases of their associations.
During the most recent Australian and New Zealand Metabolomics Conference (ANZMET 2018) held in Auckland, New Zealand (from 30 August to 1 September, 2018), the listed authors participated in a peer session on ‘systems biology and multi-omics integration’. The peer session was attended by >20 senior researchers and early to mid-career scientists actively working in the field of metabolomics as well as other omics disciplines. This article summarizes many of the viewpoints raised by those who attended the conference and participated in the peer session. It also provides some guidance on how experimental designs, methods and analytical tools used in metabolomics can facilitate multi-omics studies and data integration.
2. Designing Experiments Suitable for Multi-Omics Integration
Massive increases in throughput and spectacular reductions in costs has enabled multi-omics studies to be routinely performed at a scale not previously imagined. Although each omics platform allows a comprehensive survey for a particular molecular phenotype, the cross-talk between multiple molecular layers cannot be properly assessed by a reductionist approach that analyzes each omics layer in isolation. Instead, systems biology approaches that integrate data from different omics levels offer the potential to improve our understanding of their interrelation and combined influence. A conceptual model for designing a systems biology experiment is depicted in Figure 1. The first step for any system biology experiment is to capture prior knowledge and to formulate appropriate, hypothesis-testing questions. This includes reviewing the available literature across all omics platforms and asking specific questions that need to be answered before considering sample size and power calculations for experiments and subsequent analysis. For example, what is the scope of the study? What are the restrictions for the study? What perturbations will be included/controlled? How will the perturbations be measured? What dose(s)/time point(s) are required? What/which omics platforms will provide the most value? What omics platforms are optional noting that not all platforms need to be accessed to constitute a systems biology study nor do they all provide information that is necessarily required? How will experiments be replicated taking into account biological, technical, analytical and environmental replication? Will individuals be analyzed or will biological samples be pooled? What is the scientific rationale for pooling/not pooling? Does the experimental design properly address these questions? If yes, sample size and power calculations can be assessed and experiments can be planned/performed. If no, the design principals need to be re-evaluated until all criteria are fulfilled.
A high quality, well-thought-out experimental design is the key to success for any multi-omics study. As mentioned above, this includes careful consideration of the samples or sample types, the selection or choice of controls, the level of control over external variables, the required quantities (biomass) of the sample(s), the number of biological and technical replicates, and the preparation and storage of the samples. Additionally, other important factors that need to be considered while designing good multi-omics experiments are the meta-information collected about the samples, the selection of omics methods used and the requirements for data storage, bioinformatics, and computing capabilities. Lastly, it is of utmost importance to ensure that sufficient time and financial resources are available to carry out the experiments.
A successful systems biology experiment requires that the multi-omics data should ideally be generated from the same set of samples to allow for direct comparison under the same conditions. However, this is not always possible due to limitations in sample biomass, sample access or financial resources. In some cases, generating multi-omics data from the same set of samples may not be the most appropriate design. For instance, the use of formalin fixed paraffin-embedded (FFPE) tissues is compatible with genomic studies, but is incompatible with transcriptomics and, until recently, proteomic studies. This is because formalin does not halt RNA degradation, and it induces protein cross-linking. Furthermore, paraffin interferes with mass spectrometry performance (affecting both proteomics and metabolomics assays). It is only with the recent advancement of MS technology that very deep and quantitative proteomic profiling of FFPE tissue has become achievable. However, until such time that specialized high-end instrumentation is more broadly available, FFPE analysis remains an issue for many researchers looking to perform multi-omics experiments. Another example of multi-omics incompatibility can occur over the choice of biological matrix for a given study. For instance, urine may be an ideal bio-fluid for metabolomics studies, but it has a limited number of proteins, RNA and DNA, making urine a poor choice of biological matrix for proteomics, transcriptomics, and genomics studies. However, on the other hand, blood, plasma or tissues are excellent bio-matrices for generating multi-omics data. This is because they can be quickly processed and frozen to prevent rapid degradation of RNA and metabolites, which would render them unusable for transcriptomic or metabolomics studies.
Sample collection, processing, and storage requirements (and limitations) need to be factored into any good experimental design. These variables may affect the types of omics analyses that can be undertaken. Some experiments may have logistical limitations that delay or limit immediate freezing, such as field-work or travel-related restrictions. However, FAA (Federal Aviation Administration)-approved commercial solutions are now available for transporting cryo-preserved samples onboard flights. Other limitations may include sample size restrictions (collecting samples that are too large or too small to process at a single time point or by a single individual) or initial sample handling procedures that may influence biomolecule profiles (e.g., handling live animals). Therefore, careful consideration as to how effectively collected samples can be used, particularly for metabolomics and transcriptomic studies, along with the downstream consequences for data analysis and interpretation is required. Other considerations for experimental design and strategies that should also be considered are shown in Table 1. Recognizing and accounting for these effects early in the experimental design stage will help mitigate their impact on results and down-stream data processing. For more information on the relationship between variance in the data, statistical power, the degree of insights one can gain (e.g., the problem of overfitting when developing statistical models), please refer to the following references.
Sample size relative to resource allocation is one of the main factors affecting experimental design in multi-omics studies. That is, how can one ensure that the sample size is adequate to provide the statistical power needed to detect significant differences while still managing scarce resources (time/money)? As a general rule, the number of variables measured or measurable in a given omics experiment often dictates the number of samples that should be collected and measured (Table 1). Nearly all omics experiments measure hundreds to thousands of variables (metabolites, proteins, genes, transcripts and SNPs). Therefore, the number of biological samples should be sufficient to provide the required statistical power. Underpowered studies may not have the ability to detect associations. This can lead to data misinterpretation and generation of many false negatives and false positives. In single omics experiments, larger sample sizes are often required to overcome this problem. Furthermore, different omics technologies often have different sample size requirements. These number of samples required for statistical power also greatly depends on the extent of variation within and between the treatments, which is reflected statistically in the “effect size”, as described below.
As a general rule, fully quantitative studies (targeted metabolomics and proteomics) require fewer samples than non-quantitative studies (untargeted metabolomics and proteomics). This is due to the greater analytical precision/accuracy that is achievable with targeted and fully quantitative omics measurements. Likewise, for omics studies where the effect size is inherently small (e.g., ambiguous disease phenotypes, most SNP or CNV studies) the number of samples often has to be in the tens of thousands, while in other studies where the effect size is inherently large (e.g., strong disease phenotypes or strong omics signals) the number of samples can be much smaller. For example, the number of samples/patients needed to fully identify, understand or model a simple monogenic disorder such a phenylketonuria (PKU) is on the order of one or two, while the number of samples/patients needed to fully identify, understand or model a complex disease, such as schizophrenia, may be on the order of hundreds of thousands. Power calculations can be a useful tool to help estimate sample numbers. However, the information on effect size needed for this is often not known until a good body of pilot multi-omics data has already been collected.
Based on the multi-omics studies conducted by our laboratories as well as studies described in the literature, we contend that the experimental design requirements of metabolomics experiments are highly compatible with most multi-omics studies. The adoption of metabolomics experimental design requirements by other omics disciplines could greatly facilitate multi-omics research. Metabolomics experiments are highly compatible with multiple bio-sample types including blood, serum, plasma, cells, cell culture and tissues. These same bio-samples are also preferred for transcriptomics, genomics and proteomics studies. For example, samples intended for metabolomics studies must be stored at −80 °C (to prevent enzymatic degradation of the metabolites and also to stop ongoing metabolic activities). This storage protocol for samples also ensures that RNA and protein integrity is maintained for transcriptomics and proteomics studies. The sample processing times for metabolomics must be relatively quick (minutes) due to the rapid metabolism of metabolites in most bio-samples. Rapid sample processing times are also required for transcriptomics and modestly rapid sample processing times are required for proteomics studies. Adhering to metabolomics processing times ensures that all other samples being used in a multi-omics study will not be compromised. Likewise, metabolomics experiments typically require more material than genomic, proteomic or transcriptomic experiments, therefore the collection of sufficient material for a metabolomics experiment will almost guarantee that enough material will be available for all other omics experiments. Metabolites are also particularly sensitive to environmental influences (diurnal cycles, heat, humidity, diet, age, developmental stage and social interactions) and the tracking of sample meta-data is very important to mitigate the effects of environmental confounders. While environmental confounders are generally less significant for transcriptomics and proteomics studies (and almost negligible for genomics studies), the careful tracking of environmental, social, dietary or other meta-data is a wise practice for all multi-omics studies to facilitate transparency and reproducibility.
Multi-omics analyses should ideally be guided by the sampling guidelines listed above and by the experimental hypothesis being tested. For example, metabolomics would be appropriate in an experiment where metabolic changes are expected but may be less useful if the hypothesis is predicting changes in genetic regulation, especially in upstream signal reception and transduction. Phenotypic landscapes reflect the epigenetic, transcriptional, translational and post-translational implementation of an organism’s genomic information. To establish direct causal and functional associations between genotype and phenotype, it is essential to observe intermediate molecular levels, such as transcript, protein and metabolite abundance. Using one type of omics technology to drive an integrated analysis can be a good strategy to effectively link data sets and build evidence for causation rather than just correlating multiple untargeted data sets. One option for multi-omics integration is to use top-down data reduction approaches that employ genomics or transcriptomics data as a basis to predict phenotypic responses and changes in key signaling and metabolic pathways (Figure 2). Targeted metabolomics and/or proteomics analyses can then be used to measure and validate the functional activity of identified pathways. A benefit of this top-down data reduction approach is that the coverage from genomics/transcriptomics data is inherently greater and so changes in regulation, transport and metabolism may be captured more easily. Limitations include cost (sequencing many samples can become expensive) and the fact that the relationship from gene to protein to metabolite is not necessarily proportional. Therefore, expression differences may not always correlate to functional differences.
An alternative approach to top-down data reduction integration is bottom-up data reduction integration approaches, using either global or targeted metabolomics as the starting point to guide other omics analyses (Figure 2). Metabolites represent the endpoint of gene-environment interactions, and so they are closer to, and more representative of, phenotypic differences. In this approach, metabolomics data are used to target subsequent up-stream proteomics or transcriptomics analyses to uncover mechanistic genes or proteins driving the process/es. Metabolite measurements are relatively quick and affordable compared to many other omics measurements, thus making this approach more appealing from a cost-benefit perspective. However, the coverage of the metabolomics layer is often far more limited than the coverage from the genome or transcriptome layer. This modest coverage may limit the systems biology “search space” and thereby limit the interpretation of the final results.
3. Multi-omics Data Integration
Data integration has been characterized as the key bottleneck to all multi-omics studies. This is because data integration requires input and interpretation by a diverse range of scientists or specialists, as previously described. Some of these specialists are needed to evaluate the quality and validity of the study (experimental) design, as well as the quality of the data acquired from the instrument. Assuming that the data obtained are of high quality and are properly validated (see Section 2), a number of approaches can be followed for analyzing and interpreting multi-omics data. These include: (1) post-analysis data integration, (2) integrated data analysis, and (3) systems modeling techniques. Post-analysis data integration and integrated data analysis are primarily discovery tools or hypothesis generators that are intended to reveal new insights or provide some high-level mechanistic understanding. Systems modeling techniques are primarily interpretive or hypothesis testing tools intended to describe mechanistic insight mathematically. Systems modeling can also be used to predict system-wide responses or even treatments (e.g., identifying interventions). Here we briefly summarize these three approaches for multi-omics data integration and the methodologies and tools associated with them.
3.1. Post-Analysis Data Integration Approaches
In a post-analysis data integration approach, different omics data sets are first analyzed in isolation, and then key features are “networked” or stitched together through the synthesis of significant features at joint nodes in an overall model pathway (Figure 3). This approach has been used in a diverse range of studies, including the assessment of biological wastewater treatment systems, the exploration of microbial resistance of marine sediments after an oil spill and studying the permafrost microbial ecosystem. Post-analysis data integration is also used by some precision health or precision nutrition companies to generate client-specific interpretations.
3.2. Integrated Data Analysis Approaches
In contrast to post-analysis data integration, the integrated data analysis approach employs specialized tools to merge different omics data sets prior to undertaking any further data analysis and interpretation. This enables the shared similarities between each omics approach and platform to be statistically derived, as opposed to relying on human interpretation or human biases (Figure 3). Table 2 provides a list of tools that are currently available and can be used in integrated omics data analysis. For instance, methods, such as orthogonal two-way projection to latent structures (O2PLS) and its variant OnPLS, were developed to extract systematic variation that is common to two (or multiple) sets of omics data. In clinical science, these methods have been used to evaluate combine metabolomics and proteomic data in a xenograft model of human prostate cancer, or to interrogate biological interactions between six different omics data sets in asthma. In environmental science, the same techniques have been used to characterize stress responses or adaptations to different day lengths in poplars or to investigate marine sediments. Other methods for investigating ecosystem homeostasis with multi-omics approaches have been recently reviewed. Furthermore, the web-based platform 3Omics enables the integration of human transcriptomics, proteomics and metabolomics data. In particular, 3Omics generates inter-omics correlation network to aid data visualization. In addition, this “one-click” platform also assists in statistical analyses of the integrated omics data and is able to perform pathway and gene ontology enrichment. Another popular web-based platform for integrated omics data analysis is “MetaboAnalyst”. As shown in Table 2, this tool is able to integrate and analyze metabolomics data with transcriptomics, proteomics, and genomics data and can be used for data generated for a wide range of biological samples including human, animal, plants and microorganisms.
3.3. Systems Modeling
In addition to post-analysis data integration and integrated data analysis techniques, the third approach to data integration is also available—namely systems modeling. Systems modeling and simulation techniques are valuable tools for understanding and even predicting the details of complex biological systems. Model-based integration methods rely on a well-defined understanding of the system being investigated in order to compare new experimental findings against modeled predictions. Such an understanding is often based on having comprehensive, pre-existing genomic, transcriptomics and/or metabolomics data on the system being studied. These modeling systems may incorporate dynamic/kinetic models that solve systems of differential, or partial differential equations, agent-based kinetic models, or Petri-Net models or they may involve steady state models, such as flux-balance models. Interestingly, almost all of these systems modeling approaches are anchored with metabolic reactions and extensive metabolomics data.
Some of the most impressive examples of multi-omics integration and many of the most compelling successes in systems biology have been achieved through systems modeling methods. For example, in the 1990s Palsson and co-workers quantitatively predicted growth and byproduct secretion in E. coli by modeling cellular metabolism and developed the concept of flux balance modeling. Subsequently, the first successful attempt to model a living cell kinetically was the E-cell project led by Masanori Tomita in 1999. This project focused on modeling the kinetic dynamics of metabolic pathways and the control of enzyme production through gene expression of Mycoplasma genitalium. This single cell model integrated experimental metabolomics data with genomics, transcriptomics and proteomics data. The E-cell concept was later extended to modeling human erythrocyte metabolism. Several practical outcomes have been achieved with the E-cell erythrocyte model including an improved understanding of erythrocyte hypoxic responses, enhanced blood storage methods, and the development of a new nucleo-base solution for extended blood storage. By the mid-2000s particularly impressive simulation work was being done with modeling E. coli. This led to the successful prediction of dozens of conditionally essential genes in E. coli through metabolic flux-balance modeling. Similar work using Petri-Net models led to the identification of key protein and gene regulators in E. coli glycogen metabolism. These activities inspired the development of a variety of open source tools and mark-up languages for system modeling, such as the Systems Biology Markup Language or SBML, CellML, Cell System Markup Language or CSML as well as modeling tools, such as Cell Illustrator.
Extensions from single cells to multi-cellular systems and multi-organ systems started to occur around 2013 with the appearance of Recon 2, a community based global reconstruction of human metabolism. This comprehensive model incorporates cell and tissue-specific metabolomics data, proteomic data and gene expression data for the human body and its many cell types. Through Recon 2 and its later derivatives, it has been possible to model the effects of common drugs on human metabolism to predict the effects of disease-gene mutations and to model disease conditions, such as inflammatory bowel disease. Of particular note is the development of the COBRA (Constraint-Based Reconstruction and Analysis) system for working with Recon 2. COBRA permits integrated modeling of metabolism and macromolecular expression (proteome or transcriptome) at a genome-scale. Over the past three years, the COBRA modeling system has been used to create a 3D model of gene variation in human metabolism—Recon3D. COBRA has also been used as a tool to develop models in order to subsequently predict dietary supplements for treating Crohn’s disease and to integrate human and gut microbiome metabolism with nutrition and disease in the Virtual Metabolic Human database. The extension of systems modeling to microbiome studies (where metabolomics is integrated with metagenomics) is becoming particularly popular. For example, Noecker et al. integrated taxonomic and metabolomics data to predict the effects of community ecology on metabolite concentrations. These predictions were evaluated with measured metabolome profiles from the vaginal microbiome and it was concluded that predicted species composition correlated with identified putative metabolic mechanisms. The availability of previously published data on the vaginal microbiome and its metagenomics data were key to the success of this model.
As seen from the above examples of systems modeling for multi-omics integration, as well as through many other examples, most multi-omics systems models are based on some form of metabolic model or metabolic readout. This is true even though they invariably include genomics, proteomics and/or transcriptomics data in the model. This fact serves to emphasize the key role that metabolomics must play in multi-omics integration, especially as it relates to systems modeling. The reason why metabolomics plays such an integral role in systems modeling and multi-omics integration is because it can be quantitative. Systems modeling cannot be performed without accurate values or accurate concentrations as inputs and, likewise, systems models cannot be easily verified without accurate, quantitative concentrations as outputs. Metabolomics can deliver both (quantitative input and output data), making it extremely valuable to systems modelers. It should be noted that quantitative proteomics also meets this requirement, albeit at a level that is not as close to the observed phenotype as the metabolome. Therefore, the central challenge for systems modeling is the collection of accurate, quantitative reference data on the genome, the transcriptome, the proteome or the metabolome. As a result, model-based integration is often limited to only those systems that are already well defined (i.e., common model organisms) or systems for which accurate, quantitative multi-omics data have been collected.
3.4. Software Tools, Databases and Approaches for Multi-Omics Integration
Biswapriya et al. recently reviewed different tools available for multi-omics data integration in detail. This work highlights the fact that numerous databases, software tools, and approaches are now freely accessible to assist with integrating multi-omics data sets, regardless of the multi-omics data integration approach.
As listed in Table 3, a number of context-specific databases and tools have been developed (i.e., targeted towards the integration of omics data from specific animal models, medical and clinical studies, and selected plant species) and are in use. While most available databases are fairly general, there is a range of databases with a specific focus. For instance, certain species-specific databases are now publicly available that include data on the genome, transcriptome, proteome and/or metabolome of several model organisms. These include the mouse genome database or MGD, FlyBase (Drosophila spp), WormBase (Caenorhabditis elegans and helminth), the E. coli metabolome database or ECMDB, the EcoCyc database, the Yeast metabolome data or YMDB, the Plant Metabolic Network or PMN and the Saccharomyces genome database or SGD, just to name a few. There are also extensive databases on humans that contain rich data on the human genome, proteome, metagenome and/or metabolome. These include the Human Metabolome Database or HMDB, Recon 2, Recon3D and the Virtual Metabolic Human database. In addition to these species-specific resources, there are also general multi-species resources on genes and proteins, such as GenBank and UniProt, multi-species collections on metabolites, such as ChEBI, and MetaboLights, multi-species collections on lipids, such as Lipid Maps, multi-species collections on proteomics or protein expression data, such as PRIDE, and multi-species pathway databases, such as KEGG, Reactome and MetaCyc. Additional details on these databases are provided in Table 3.
While there are many open access databases to help with multi-omics integration, a variety of open-access tools are also available to help with statistics and visualization of multi-omics data. These include tools to facilitate data quality checks, data normalization and data transformation (e.g., MetaboAnalyst 4.0 and mixOmics). They also include software to assist with performing multivariate statistics, data clustering and data interpretation. Many multi-omics integration tools include methods to generate and view interactive correlation or association maps (hairballs), as well as metabolic and signaling pathways. A number of these tools and databases are listed in Table 2 and Table 3.
4. Challenges in Multi-Omics Integration
Meaningful biological interpretation of multi-omics data requires a constant evolution of databases and data analysis tools. Analytical and data analysis platforms have improved substantially over the past decade, however, multiple challenges still exist. Here, we identify and discuss some of the key pitfalls and challenges that appear to be hindering the progress in multi-omics integration and systems biology research. However, we acknowledge that some of these challenges might be solved in the near future while new challenges may arise with time.
4.1. The Nature of the Omics Data Sets
Omics data are inherently highly variable and noisy. Furthermore, most omics data are only qualitative in nature, making it very hard to reproduce and even harder to compare. When only qualitative data are available, multi-omics integration, particularly from multiple sources, becomes difficult, if not almost impossible. While DNA sequence data are often very accurate and highly reproducible (error rates of <0.001%), they are widely considered qualitative with a large number of false positives based on the sheer number of reads obtained: transcriptomic, proteomic, metagenomics and the majority of metabolomics data are highly qualitative and poorly reproducible, as reflected in reported false discovery rates (FDR) and adjusted p-values. Many of the difficulties that these omics techniques have are inherent to the practices or measurement methods adopted by many platform users. For example, most proteomics researchers do not use well-defined peptide reference standards or isotopically labeled peptide standards for identification or quantification. Likewise, many microarray/transcriptome researchers use inherently qualitative microarray technologies and do not use universal reference materials with precisely known numbers of transcripts. Similarly, most metagenomics labs do not employ standard OTU definitions or standardized 16S-RNA to consistently identify microbes. It is now well-accepted by the microbiome community now that even RNA-Seq counts are not the actual counts, rather they represent relative abundances of those transcripts. Similarly, the vast majority (>80%) of published metabolomics studies are also qualitative, with little or no use of multiple reaction monitoring (MRM) or well-defined metabolite reference standards or isotopically labeled metabolite standards. As a result, omics labs that analyze exactly the same material using similar or identical omics technologies (i.e., comparing one metabolomics/proteomics approach to another comparable metabolomics/proteomics approach) will often get wildly different results, so much so that in some instances upward trends in one data set, could become downward trends in another.
Even if the problems with the omics technologies could be controlled or managed through improved availability and use of reference standards and standardized operating protocols, there still remains a problem with significant inter-laboratory variations in sample storage, extraction and handling protocols. These issues are often related to the skills, organization, and patience of individual technicians or researchers. Sample-specific factors, such as the population structure in the sample, the cell or tissue composition, inherent sampling biases, batch effects, and other technical artifacts can add further heterogeneity to omics measurements as does the way in which different classes of biomolecules behave and interact (e.g., response time, stability, half-life, regulation).
Precisely measured, quantitative data that is calibrated to standard reference materials, checked against authentic standards, assessed with quality controls and measured with universal standard operating protocols (SOPs) is what is needed for robust, reproducible multi-omics integration. This type of high quality, quantitative data are actually obtainable via genomics, metabolomics, and proteomics. They are potentially obtainable via transcriptomics and meta-genomics. When quantitative data are available, it is possible to perform multi-omics integration. It is also possible to perform robust intra- and inter-lab comparisons (i.e., ring trials). Examples of this can be seen with the impressive results described in the systems modeling section (see Section 3.1) where essentially all of the baseline data sets used for modeling were obtained from open-source quantitative data repositories.
The lack of sufficient meta-data is another key hurdle to the successful integration of multi-omics data sets. Often considerable time, money and effort may go into the collection of molecular omics data, while very little effort goes into collecting the meta-data about the samples, organisms or patients. Meta-data are information about the data, which typically includes where, when and how the data were collected as well as information about the observable phenotypes of the samples. Meta-data are important to enabling reproducibility and biologically relevant interpretation of omics results. For example, in the case of plant multi-omics analysis information about the soil type, soil composition, watering conditions, temperature trends, relative humidity, plant age, season, light levels and plant breed can have a significant impact on metabolite, protein and transcriptome measurements. For cell or tissue culture multi-omics analyses, important meta-data could include information about the cell types, cell sex, cell growth media, cell oxygenation levels, and cell generation. For animal studies, meta-data could include information about age, sex, weight, feeding levels, feed composition, strain or breed, cage location, light conditions, activity, diurnal cycle, health status and proximity to other animals. For human studies, meta-information including age, sex, job type, ethnicity, marital status, BMI, smoking/drinking habits, lifestyle, exercise, diet, health status, drug intake, diurnal cycle, menstrual cycle, and ethnicity should be collected, as they could also affect omics measurements. Meta-data could also be considered in the form of ionomics or metallomics data from the cells or tissues being investigated. Without taking into account these confounders, it is often difficult to identify clear signals in the molecular data or signals may be misinterpreted (e.g., one may misidentify a molecular trend that is simply due to an age difference). If these meta-data are not captured, the collection of large data sets is required to mitigate the sources of variation, which may greatly increase the cost of a multi-omics study.
4.2. Dispersed Data Sets and Non-Interoperable Tools
There is no shortage of data tools and software available for multi-omics integration, as clearly demonstrated by the size and scope of Table 2. Often, the available multi-omics databases are of very high quality and exceptionally well curated and many of the software tools are well designed and maintained. However, it is clear that researchers (including many of the authors of this manuscript) may be unaware of all of these tools and what they may offer. This problem may be due to the sheer number of resources (now numbering hundreds) or the lack of a central repository which catalogs, links and rates or summarizes these tools. A third reason may be the tendency of researchers to ‘stick with what they know’. This leads to a bias among scientists to treat every problem as a nail that has to be hit with the same hammer. This could be partly caused by the user-unfriendliness of many multi-omics programs. Some are difficult to install, others have limited operating system compatibilities, while others have enormously steep learning curves. Increasing researcher awareness and accessibility to tools (e.g., through central repositories and making tools available over the web or converting them to web-servers) will improve their use and uptake.
Lack of interoperability is another frequently cited problem with bioinformatics tools, not just multi-omics tools. Different bioinformatics and cheminformatics databases have different formats, many of which are non-standard. Similarly, different programs may also require their input data to be in non-standard formats and will output data in a format that is incompatible with other programs. This can make it difficult to create a multi-program or a multi-database workflow and may require users to spend their time writing scripts to convert and reconvert data so that it can be read by other programs. The movement to FAIR (findable, accessible, interoperable, and re-usable) data standards in bioinformatics software and databases could potentially alleviate these challenges.
4.3. Inadequate Pathway and Data Visualization Tools
While there are many excellent tools for multi-omics integration and visualization (see Table 2), there is clearly still room for improvement. One area where significant work is needed lies in the scope and availability of pathway databases. Pathway databases provide biological context while at the same time providing clear links between genes, proteins, and metabolites. KEGG, MetaCyc and Reactome are freely available and widely used pathway databases, however, they limited in portraying what is known about biological pathways or molecular processes. While all three databases emphasize metabolic pathways, they were all developed before the advent of metabolomics (or even proteomics) and thus lack some of the new insights that these technologies bring. It is important to remember that many other kinds of pathways are also important in biology, including: protein signaling, metabolite signaling, gene activation, protein and metabolite transport, disease, drug action and drug or xenobiotic metabolism pathways, as well as many more. Although some of these pathways are captured in commercial resources, such as the Ingenuity Pathway Analysis (IPA) system produced by Qiagen, the high cost, closed nature of the database, and the lack of compatibility with many other bioinformatics software tools makes such commercial tools difficult to integrate into multi-omics pipelines. Certainly, the creation of far more extensive, open access pathway databases with suitable rendering functions and machine-readable features, would make multi-omics integration much easier and far more user-friendly. As in the case of open platforms of open-source R-packages, R-based multi-omics packages can be encouraged through collaborations internationally.
Construction and visualization of network models is another challenging aspect of multi-omics integration. The use of metabolic network models, generated via metabolomics, has greatly facilitated the integration of multi-omics data. These metabolic network models have been extended to genetic regulatory networks, protein-protein interaction network models and metabolic-reaction network models. However, these models remain ‘insular’ in that they only allow the modeling a single omics network. Clearly, if network models could be extended to more clearly illustrate or connect multi-omics data, this would greatly enhance visualization and interpretation of multi-omics data. Recently, multi-layer networks—which can be defined as networks formed by multiple omics layers—have been created that allow the rendering of specific interactions between different omics layers.
4.4. Failing to Demonstrate Utility
Multi-omics studies potentially represent the pinnacle of achievement in molecular characterization. However, there are questions around their real value and utility. For example, is a multi-omics signature for diabetes or obesity really useful if the same diagnosis can be made by a simple blood glucose test or having someone step on a weight scale? Likewise, if a single, carefully interpreted, metabolomics study provides just as much information as a comprehensive multi-omics study, is anything useful gained? Currently, many published multi-omics studies appear to simply demonstrate that they are feasible and modestly informative. Some have demonstrated a post-hoc rationale for what was long known or commonly observed while others have provided some new useful mechanistic insights but have not led to new drugs, new therapies, new diagnostics or new biotechnologies. As yet no truly significant or ‘groundbreaking’ results have emerged from multi-omics studies. That is not to say that these types of studies will not have an impact, but for multi-omics research to gain traction with the public and with funding agencies, it will need to demonstrate clear utility and highlight novel insights. Currently, the most tangible and useful applications for multi-omics studies are in the areas of precision medicine, personalized health, or precision nutrition. These appear modestly useful, and certainly, if larger population studies could be performed, their utility could grow significantly. Useful/practical applications are also appearing in environmental protection and environmental adaptation/resilience, especially after significant and ongoing contamination events or natural disasters.
4.5. Limited Research Funding
Multi-omics research can be expensive, and access to multiple analytical instrumentations and multidisciplinary specialists requires a considerable level of research funding. Indeed, a robust multi-omics study on a human research population can easily cost in excess of US$500,000. Therefore, the availability of sufficient funding is often the central limiting factor for any multi-omics study. Traditionally, most research funding has been allocated to genomic, metagenomics and transcriptomics studies while proteomics, in most jurisdictions around the world, is only funded at about 10% of the level of genomics and, in most countries, metabolomics funding is usually at about 2% of the funding level of genomics. As a result, most multi-omics studies in humans involve combined genomics and transcriptomics studies or combined genomics and metagenomics/microbiome studies. Multi-omics studies involving metabolomics are relatively rare, yet they are consistently among the most informative or most highly cited. Clearly, if true multi-omics research is going to be conducted, a re-balancing of research funding is needed. As emphasized throughout this document, we believe that the metabolomics field has a great deal to offer to multi-omics researchers and that metabolomics methods should lie at the core of any truly multi-omics research study.
5. Recommendations
Based on the challenges identified above along with some of the potential solutions (achieved by us and others) we have produced a list of recommendations to consider when designing or contemplating a multi-omics study. These are:Adopt the sample collection, preparation and measurement standards used in metabolomics studies. This would ensure high-quality data collection in most multi-omics studies;Measure multi-omics data in a robust, quantitative manner to ensure reproducibility, enforce comparability and permit facile integration;Use reference standards, quality control (QC) samples, and universal standardized operating protocols (SOPs) to enable consistent multi-omics measurements across laboratories;Perform power analyses, where possible, prior to conducting large scale multi-omics studies; and,Collect and record comprehensive meta-data to guide and inform well-designed multi-omics studies (please see).
Adopt the sample collection, preparation and measurement standards used in metabolomics studies. This would ensure high-quality data collection in most multi-omics studies;
Measure multi-omics data in a robust, quantitative manner to ensure reproducibility, enforce comparability and permit facile integration;
Use reference standards, quality control (QC) samples, and universal standardized operating protocols (SOPs) to enable consistent multi-omics measurements across laboratories;
Perform power analyses, where possible, prior to conducting large scale multi-omics studies; and,
Collect and record comprehensive meta-data to guide and inform well-designed multi-omics studies (please see).
We have also identified the following as key requirements to support the multi-omics community in its efforts to carry out truly integrated, systems biology research:Create centralized data repositories, curated or reviewed software lists and improved software/database interoperability (adherence to FAIR data standards) to improve multi-omics integration;Improve or develop more comprehensive open source pathway databases and network visualization tools;Increase levels of funding and increase awareness of the need for metabolomics in multi-omics studies;Demonstrate clear utility of multi-omics studies to both the public and funding agencies; and,Undertake more community-driven activities to lead to the creation of multi-omics tools and resources better suited to the community’s needs.
Create centralized data repositories, curated or reviewed software lists and improved software/database interoperability (adherence to FAIR data standards) to improve multi-omics integration;
Improve or develop more comprehensive open source pathway databases and network visualization tools;
Increase levels of funding and increase awareness of the need for metabolomics in multi-omics studies;
Demonstrate clear utility of multi-omics studies to both the public and funding agencies; and,
Undertake more community-driven activities to lead to the creation of multi-omics tools and resources better suited to the community’s needs.
In addition to these above recommendations, we also encourage software developers to take more initiative to develop more user-friendly omics integration of web tools and software. Advancements in machine learning approaches would also be highly beneficial for the integration and interpretation of multi-omics data. Moreover, successful researchers should ensure to pass on their successes or share their stories of multi-omics integration to a much broader audience. Communicating successes or discoveries to the popular press raises awareness and shows both the public and scientific funding agencies that multi-omics research can have a real social impact. The use of social media is changing how we conduct social communication, it could and should change how we conduct our scientific communication too.
6. Conclusions
Most of the data generated over the past 25 years by various omics platforms have been qualitative or semi-quantitative in nature. While qualitative data can be used to compare similar variables across samples within a single lab (using a single measurement platform), they do not support comparisons across labs or across platforms. Likewise, qualitative measurements do not allow for consistent and accurate integration of multi-omics data where measurements typically have to be done on multiple platforms, across multiple laboratories, over extended time periods. Careful quantitation of omics data allows much more accurate comparison to reference values, more consistent inter-laboratory comparisons, greater reproducibility, improved interpretability, and far simpler data integration. Indeed, because of the widespread lack of quantification, only one single proteomic assay and only five transcriptomics assays have ever been translated into the clinic. On the other hand, quantitative metabolite measurements have enabled the translation of more than 300 chemical tests to the clinic, while the use of quantitative genotyping has led to the development of about 75,000 genetic tests.
In addition to the importance of generating quantitative omics data, it is also important to make use of publicly available data sets, where omics-specific reporting and higher quality data standards have been followed. Such an approach will benefit the scientific community and reduce the amount of repeated work amongst different groups. The description of a given domain can be represented in any format, but the use of common ontologies makes it easier to compare, integrate and interpret data from similar domains, multiple omics platforms as it facilitates the integration, computational processing and comprehensive interpretation of that data.
Lastly, there is a greater need for cross-talk among the different omics communities. This is especially true given the insular or “silo-ed” approach that most omics researchers have traditionally adopted in publishing or presenting their work. There is a tremendous amount that can be learned from shared interactions, particularly from those omics areas that are developing comparatively faster than others. Webinars could be one approach that could inexpensively facilitate such conversations. Likewise, the formation of professional societies whose central aim is integrating multi-omics data could also help break down some of the existing barriers and improve collaboration between the existing professional omics societies and systems biology societies. It could be achieved by, for example, establishing mutual education programs, creating common data standards, forming common task groups and developing cross-omics engagement guidelines that address authorship policies and promote the advancement of early to mid-career researchers. Furthermore, greater connectivity and collaboration between the respective scientific conferences could be encouraged through shared/mutually supported conference sessions.
References 165
- 1.
- 2.
Hillmer R.A. Systems biology for biologists. PLoS Pathog. 2015;11:e1004786.
Not in our library10.1371/journal.ppat.1004786
- 3.
Cho C.R., Labow M., Reinhardt M., van Oostrum J., Peitsch M.C. The application of systems biology to drug discovery. Curr. Opin. Chem. Biol. 2006;10:294-302.
Not in our library10.1016/j.cbpa.2006.06.025
- 4.
Cisek K., Krochmal M., Klein J., Mischak H. The application of multi-omics and systems biology to identify therapeutic targets in chronic kidney disease. Nephrol. Dial. Transplant. 2016;31:2003-2011.
Not in our library10.1093/ndt/gfv364
- 5.
Hagemann M., Hesse W.R. Systems and synthetic biology for the biotechnological application of cyanobacteria. Curr. Opin. Biotechnol. 2018;49:94-99.
Not in our library10.1016/j.copbio.2017.07.008
- 6.
Herrgard M.J., Swainston N., Dobson P., Dunn W.B., Arga K.Y., Arvas M., Bluthgen N., Borger S., Costenoble R., Heinemann M., et al. A consensus yeast metabolic network reconstruction obtained from a community approach to systems biology. Nat. Biotechnol. 2008;26:1155-1160.
Not in our library10.1038/nbt1492
- 7.
Xu P. Production of chemicals using dynamic control of metabolic fluxes. Curr. Opin. Biotechnol. 2018;53:12-19.
Not in our library10.1016/j.copbio.2017.10.009
- 8.
Grav L.M., Sergeeva D., Lee J.S., de Mas I.M., Lewis N.E., Andersen M.R., Nielsen L.K., Lee G.M., Kildegaard H.F. Minimizing clonal variation during mammalian cell line engineering for improved systems biology data generation. ACS Synth. Biol. 2018;7:2148-2159.
Not in our library10.1021/acssynbio.8b00140
- 9.
Gilchrist M., Thorsson V., Li B., Rust A.G., Korb M., Kennedy K., Hai T., Bolouri H., Aderem A. Systems biology approaches identify ATF3 as a negative regulator of Toll-like receptor 4. Nature. 2006;441:173.
Not in our library10.1038/nature04768
- 10.
Otero J.M., Nielsen J. Industrial Systems Biology. Biotechnol. Bioeng. 2010;105:439-460.
Not in our library10.1002/bit.22592
- 11.
Nielsen J., Kornberg R.D. Systems Biology of Metabolism. Annual Review of Biochemistry. 2017;Volume 86:245-275.
Not in our library10.1146/annurev-biochem-061516-044757
- 12.
Thiele I., Swainston N., Fleming R.M., Hoppe A., Sahoo S., Aurich M.K., Haraldsdottir H., Mo M.L., Rolfsson O., Stobbe M.D., et al. A community-driven global reconstruction of human metabolism. Nat. Biotechnol. 2013;31:419-425.
Not in our library10.1038/nbt.2488
- 13.
Mardis E.R. Next-Generation DNA Sequencing Methods. Annu. Rev. Genom. Hum. Genet. 2008;9:387-402.
Not in our library10.1146/annurev.genom.9.081307.164359
- 14.
LaFramboise T. Single nucleotide polymorphism arrays: A decade of biological, computational and technological advances. Nucleic Acids Res. 2009;37:4181-4193.
Not in our library10.1093/nar/gkp552
- 15.
Wang Z., Gerstein M., Snyder M. RNA-Seq: A revolutionary tool for transcriptomics. Nat. Rev. Genet. 2009;10:57.
Not in our library10.1038/nrg2484
- 16.
- 17.
Nassar A.F., Wu T., Nassar S.F., Wisnewski A.V. UPLC–MS for metabolomics: A giant step forward in support of pharmaceutical research. Drug Discov. Today. 2017;22:463-470.
Not in our library10.1016/j.drudis.2016.11.020
- 18.
Beale D.J., Pinu F.R., Kouremenos K.A., Poojary M.M., Narayana V.K., Boughton B.A., Kanojia K., Dayalan S., Jones O.A.H., Dias D.A. Review of recent developments in GC–MS approaches to metabolomics-based research. Metabolomics. 2018;14:152.
Not in our library10.1007/s11306-018-1449-2
- 19.
Brunk E., George K.W., Alonso-Gutierrez J., Thompson M., Baidoo E., Wang G., Petzold C.J., McCloskey D., Monk J., Yang L., et al. Characterizing Strain Variation in Engineered E.coli Using a Multi-Omics-Based Workflow. Cell Syst. 2016;2:335-346.
Not in our library10.1016/j.cels.2016.04.004
- 20.
Yizhak K., Benyamini T., Liebermeister W., Ruppin E., Shlomi T. Integrating quantitative proteomics and metabolomics with a genome-scale metabolic network model. Bioinformatics. 2010;26:i255-i260.
Not in our library10.1093/bioinformatics/btq183
- 21.
Zampieri M., Sauer U. Metabolomics-driven understanding of genotype-phenotype relations in model organisms. Curr. Opin. Syst. Biol. 2017;6:28-36.
Not in our library10.1016/j.coisb.2017.08.007
- 22.
Beale D.J., Karpe A.V., McLeod J.D., Gondalia S.V., Muster T.H., Othman M.Z., Palombo E.A., Joshi D. An ‘omics’ approach towards the characterisation of laboratory scale anaerobic digesters treating municipal sewage sludge. Water Res. 2016;88:346-357.
Not in our library10.1016/j.watres.2015.10.029
- 23.
Chen R., Mias G.I., Li-Pook-Than J., Jiang L., Lam H.Y., Chen R., Miriami E., Karczewski K.J., Hariharan M., Dewey F.E., et al. Personal Omics Profiling Reveals Dynamic Molecular and Medical Phenotypes. Cell. 2012;148:1293-1307.
Not in our library10.1016/j.cell.2012.02.009
- 24.
Günther O.P., Shin H., Ng R.T., McMaster W.R., McManus B.M., Keown P.A., Tebbutt S.J., Lê Cao K.-A. Novel Multivariate Methods for Integration of Genomics and Proteomics Data: Applications in a Kidney Transplant Rejection Study. OMICS J. Integr. Biol. 2014;18:682-695.
Not in our library10.1089/omi.2014.0062
- 25.
Koh H.W.L., Fermin D., Choi K.P., Ewing R., Choi H. iOmicsPASS: A novel method for integration of multi-omics data over biological networks and discovery of predictive subnetworks. bioRxiv. 2018;374520.
Not in our library10.1101/374520
- 26.
- 27.
Sun Y.V., Hu Y.-J., Friedmann T., Dunlap J.C., Goodwin S.F. Chapter Three—Integrative Analysis of Multi-omics Data for Discovery and Functional Studies of Complex Human Diseases. Advances in Genetics. 2016;Volume 93:147-190.
Not in our library10.1016/bs.adgen.2015.11.004
- 28.
Strom S.P., Yong W.H. Fundamentals of RNA Analysis on Biobanked Specimens. Biobanking: Methods and Protocols. 2019;345-357.
Not in our library10.1007/978-1-4939-8935-5_29
- 29.
O’Rourke M.B., Padula M.P. Analysis of formalin-fixed, paraffin-embedded (FFPE) tissue via proteomic techniques and misconceptions of antigen retrieval. BioTechniques. 2016;60:229-238.
Not in our library10.2144/000114414
- 30.
Coscia F., Lengyel E., Duraiswamy J., Ashcroft B., Bassani-Sternberg M., Wierer M., Johnson A., Wroblewski K., Montag A., Yamada S.D., et al. Multi-level Proteomics Identifies CT45 as a Chemosensitivity Mediator and Immunotherapy Target in Ovarian Cancer. Cell. 2018;175:159-170.e116.
Not in our library10.1016/j.cell.2018.08.065
- 31.
Mertins P., Mani D.R., Ruggles K.V., Gillette M.A., Clauser K.R., Wang P., Wang X., Qiao J.W., Cao S., Petralia F., et al. Proteogenomics connects somatic mutations to signalling in breast cancer. Nature. 2016;534:55.
Not in our library10.1038/nature18003
- 32.
Chetwynd A.J., Dunn W.B., Rodriguez-Blanco G., Sussulini A. Collection and Preparation of Clinical Samples for Metabolomics. Metabolomics: From Fundamentals to Clinical Applications. 2017;19-44.
Not in our library10.1007/978-3-319-47656-8_2
- 33.
Broadhurst D.I., Kell D.B. Statistical strategies for avoiding false discoveries in metabolomics and related experiments. Metabolomics. 2006;2:171-196.
Not in our library10.1007/s11306-006-0037-z
- 34.
Hou S., Wentzell P.D. Regularized projection pursuit for data with a small sample-to-variable ratio. Metabolomics. 2014;10:589-606.
Not in our library10.1007/s11306-013-0612-z
- 35.
Ren S., Hinzman A.A., Kang E.L., Szczesniak R.D., Lu L.J. Computational and statistical analysis of metabolomics data. Metabolomics. 2015;11:1492-1513.
Not in our library10.1007/s11306-015-0823-6
- 36.
Shi Z., Sellers J., Moult J. Protein stability and in vivo concentration of missense mutations in phenylalanine hydroxylase. Proteins. 2012;80:61-70.
Not in our library10.1002/prot.23159
- 37.
Cattaneo A., Pariante C.M. Integrating ‘omics’ approaches to prioritize new pathogenetic mechanisms for mental disorders. Neuropsychopharmacology. 2018;43:227-228.
Not in our library10.1038/npp.2017.221
- 38.
- 39.
- 40.
Hultman J., Waldrop M.P., Mackelprang R., David M.M., McFarland J., Blazewicz S.J., Harden J., Turetsky M.R., McGuire A.D., Shah M.B., et al. Multi-omics of permafrost, active layer and thermokarst bog soil microbiomes. Nature. 2015;521:208-212.
Not in our library10.1038/nature14238
- 41.
- 42.
Trygg J. O2-PLS for qualitative and quantitative analysis in multivariate calibration. J. Chemom. 2002;16:283-293.
Not in our library10.1002/cem.724
- 43.
Trygg J., Wold S. O2-PLS, a two-block (X–Y) latent variable regression (LVR) method with an integral OSC filter. J. Chemom. 2003;17:53-64.
Not in our library10.1002/cem.775
- 44.
Löfstedt T., Trygg J. OnPLS—A novel multiblock method for the modelling of predictive and orthogonal variation. J. Chemom. 2011;25:441-455.
Not in our library10.1002/cem.1388
- 45.
Kirwan G.M., Johansson E., Kleemann R., Verheij E.R., Wheelock Å.M., Goto S., Trygg J., Wheelock C.E. Building multivariate systems biology models. Anal. Chem. 2012;84:7064-7071.
Not in our library10.1021/ac301269r
- 46.
Rantalainen M., Cloarec O., Beckonert O., Wilson I.D., Jackson D., Tonge R., Rowlinson R., Rayner S., Nickson J., Wilkinson R.W., et al. Statistically integrated metabonomic−proteomic studies on a human prostate cancer xenograft model in mice. J. Proteome Res. 2006;5:2642-2655.
Not in our library10.1021/pr060124w
- 47.
Reinke S.N., Galindo-Prieto B., Skotare T., Broadhurst D.I., Singhania A., Horowitz D., Djukanović R., Hinks T.S.C., Geladi P., Trygg J., et al. OnPLS-based multi-block data integration: A multivariate approach to interrogating biological interactions in asthma. Anal. Chem. 2018;90:13400-13408.
Not in our library10.1021/acs.analchem.8b03205
- 48.
Bylesjö M., Eriksson D., Kusano M., Moritz T., Trygg J. Data integration in plant biology: The O2PLS method for combined modeling of transcript and metabolite data. Plant J. 2007;52:1181-1191.
Not in our library10.1111/j.1365-313x.2007.03293.x
- 49.
Srivastava V., Obudulu O., Bygdell J., Löfstedt T., Rydén P., Nilsson R., Ahnlund M., Johansson A., Jonsson P., Freyhult E., et al. OnPLS integration of transcriptomic, proteomic and metabolomic data shows multi-level oxidative stress responses in the cambium of transgenic hipI- superoxide dismutase Populus plants. BMC Genom. 2013;14:893.
Not in our library10.1186/1471-2164-14-893
- 50.
Beale D.J., Crosswell J., Karpe A.V., Ahmed W., Williams M., Morrison P.D., Metcalfe S., Staley C., Sadowsky M.J., Palombo E.A., et al. A multi-omics based ecological analysis of coastal marine sediments from Gladstone, in Australia’s Central Queensland, and Heron Island, a nearby fringing platform reef. Sci. Total Environ. 2017;609:842-853.
Not in our library10.1016/j.scitotenv.2017.07.184
- 51.
Beale D.J., Crosswell J., Karpe A.V., Metcalfe S.S., Morrison P.D., Staley C., Ahmed W., Sadowsky M.J., Palombo E.A., Steven A.D.L. Seasonal metabolic analysis of marine sediments collected from Moreton Bay in South East Queensland, Australia, using a multi-omics-based approach. Sci. Total Environ. 2018;631–632:1328-1341.
Not in our library10.1016/j.scitotenv.2018.03.106
- 52.
Kikuchi J., Ito K., Date Y. Environmental metabolomics with data science for investigating ecosystem homeostasis. Prog. Nuclear Magn. Reson. Spectrosc. 2018;104:56-88.
Not in our library10.1016/j.pnmrs.2017.11.003
- 53.
Chong J., Soufan O., Caraus I., Xia J., Li C., Wishart D.S., Bourque G., Li S. MetaboAnalyst 4.0: Towards more transparent and integrative metabolomics analysis. Nucleic Acids Res. 2018;46:W486-W494.
Not in our library10.1093/nar/gky310
- 54.
Wierling C., Herwig R., Lehrach H. Resources, standards and tools for systems biology. Brief. Funct. Genom. 2007;6:240-251.
Not in our library10.1093/bfgp/elm027
- 55.
Shapiro B.E., Levchenko A., Meyerowitz E.M., Wold B.J., Mjolsness E.D. Cellerator: Extending a computer algebra system to include biochemical arrows for signal transduction simulations. Bioinformatics. 2003;19:677-678.
Not in our library10.1093/bioinformatics/btg042
- 56.
Wishart D.S., Yang R., Arndt D., Tang P., Cruz J. Dynamic cellular automata: An alternative approach to cellular simulation. Silico Biol. 2005;5:139-161.
Not in our library
- 57.
Voss K., Heiner M., Koch I. Steady state analysis of metabolic pathways using Petri nets. Silico Biol. 2003;3:367-387.
Not in our library
- 58.
Orth J.D., Thiele I., Palsson B.O. What is flux balance analysis? Nat. Biotechnol. 2010;28:245-248.
Not in our library10.1038/nbt.1614
- 59.
Varma A., Palsson B.O. Stoichiometric flux balance models quantitatively predict growth and metabolic by-product secretion in wild-type Escherichia coli W3110. Appl. Environ. Microbiol. 1994;60:3724.
Not in our library10.1128/aem.60.10.3724-3731.1994
- 60.
Schilling C.H., Edwards J.S., Letscher D., Palsson B.Ø. Combining pathway analysis with flux balance analysis for the comprehensive study of metabolic systems. Biotechnol. Bioeng. 2000;71:286-306.
Not in our library10.1002/1097-0290(2000)71:4<286::aid-bit1018>3.0.co;2-r
- 61.
Lee I.D., Palsson B.O. A Macintosh software package for simulation of human red blood cell metabolism. Comput. Methods Programs Biomed. 1992;38:195-226.
Not in our library10.1016/0169-2607(92)90102-d
- 62.
Varma A., Palsson B.O. Metabolic flux balancing: Basic concepts, scientific and practical use. Bio/Technology. 1994;12:994-998.
Not in our library10.1038/nbt1094-994
- 63.
Tomita M., Hashimoto K., Takahashi K., Shimizu T.S., Matsuzaki Y., Miyoshi F., Saito K., Tanida S., Yugi K., Venter J.C., et al. E-CELL: Software environment for whole-cell simulation. Bioinformatics. 1999;15:72-84.
Not in our library10.1093/bioinformatics/15.1.72
- 64.
Ishii N., Robert M., Nakayama Y., Kanai A., Tomita M. Toward large-scale modeling of the microbial cell for computer simulation. J. Biotechnol. 2004;113:281-294.
Not in our library10.1016/j.jbiotec.2004.04.038
- 65.
Nakayama Y., Kinoshita A., Tomita M. Dynamic simulation of red blood cell metabolism and its application to the analysis of a pathological condition. Theor. Biol. Med. Model. 2005;2:18.
Not in our library10.1186/1742-4682-2-18
- 66.
Yachie-Kinoshita A., Nishino T., Shimo H., Suematsu M., Tomita M. A metabolic model of human erythrocytes: Practical application of the E-Cell Simulation Environment. J. Biomed. Biotechnol. 2010;2010:642420.
Not in our library10.1155/2010/642420
- 67.
Nishino T., Yachie-Kinoshita A., Hirayama A., Soga T., Suematsu M., Tomita M. In silico modeling and metabolome analysis of long-stored erythrocytes to improve blood storage methods. J. Biotechnol. 2009;144:212-223.
Not in our library10.1016/j.jbiotec.2009.08.010
- 68.
Nishino T., Yachie-Kinoshita A., Hirayama A., Soga T., Suematsu M., Tomita M. Dynamic simulation and metabolome analysis of long-term erythrocyte storage in adenine-guanosine solution. PLoS ONE. 2013;8:e71060.
Not in our library10.1371/journal.pone.0071060
- 69.
Mori H. From the sequence to cell modeling: Comprehensive functional genomics in Escherichia coli. J. Biochem. Mol. Biol. 2004;37:83-92.
Not in our library10.5483/bmbrep.2004.37.1.083
- 70.
Joyce A.R., Reed J.L., White A., Edwards R., Osterman A., Baba T., Mori H., Lesely S.A., Palsson B.O., Agarwalla S. Experimental and computational assessment of conditionally essential genes in Escherichia coli. J. Bacteriol. 2006;188:8259-8271.
Not in our library10.1128/jb.00740-06
- 71.
Tian Z., Faure A., Mori H., Matsuno H. Identification of key regulators in glycogen utilization in E. coli based on the simulations from a hybrid functional Petri net model. BMC Syst. Biol. 2013;7(Suppl. 6):S1.
Not in our library10.1186/1752-0509-7-s6-s1
- 72.
Hucka M., Finney A., Sauro H.M., Bolouri H., Doyle J.C., Kitano H., Arkin A.P., Bornstein B.J., Bray D., Cornish-Bowden A., et al. The systems biology markup language (SBML): A medium for representation and exchange of biochemical network models. Bioinformatics. 2003;19:524-531.
Not in our library10.1093/bioinformatics/btg015
- 73.
Cooling M.T., Hunter P., Crampin E.J. Modelling biological modularity with CellML. IET Syst. Biol. 2008;2:73-79.
Not in our library10.1049/iet-syb:20070020
- 74.
Nagasaki M., Saito A., Jeong E., Li C., Kojima K., Ikeda E., Miyano S. Cell Illustrator 4.0: A computational platform for systems biology. Silico Biol. 2010;10:5-26.
Not in our library10.3233/isb-2010-0415
- 75.
Sahoo S., Haraldsdottir H.S., Fleming R.M., Thiele I. Modeling the effects of commonly used drugs on human metabolism. FEBS J. 2015;282:297-317.
Not in our library10.1111/febs.13128
- 76.
Echeverri Olga Y., Salazar Diego A., Rodriguez-Lopez A., Janneth G., Almeciga-Diaz Carlos J., Barrera Luis A. Understanding the metabolic consequences of human arylsulfatase a deficiency through a computational systems biology study. Cent. Nerv. Syst. Agents Med. Chem. 2017;17:72-77.
Not in our library
- 77.
Knecht C., Fretter C., Rosenstiel P., Krawczak M., Hutt M.T. Distinct metabolic network states manifest in the gene expression profiles of pediatric inflammatory bowel disease patients and controls. Sci. Rep. 2016;6:32584.
Not in our library10.1038/srep32584
- 78.
Ma D., Yang L., Fleming R.M., Thiele I., Palsson B.O., Saunders M.A. Reliable and efficient solution of genome-scale models of metabolism and macromolecular expression. Sci. Rep. 2017;7:40863.
Not in our library10.1038/srep40863
- 79.
Lewis N.E., Nagarajan H., Palsson B.O. Constraining the metabolic genotype–phenotype relationship using a phylogeny of in silico methods. Nat. Rev. Microbiol. 2012;10:291.
Not in our library10.1038/nrmicro2737
- 80.
Brunk E., Sahoo S., Zielinski D.C., Altunkaya A., Drager A., Mih N., Gatto F., Nilsson A., Preciat Gonzalez G.A., Aurich M.K., et al. Recon3D enables a three-dimensional view of gene variation in human metabolism. Nat. Biotechnol. 2018;36:272-281.
Not in our library10.1038/nbt.4072
- 81.
Bauer E., Thiele I. From metagenomic data to personalized in silico microbiotas: Predicting dietary supplements for Crohn’s disease. NPJ Syst. Biol. Appl. 2018;4:27.
Not in our library10.1038/s41540-018-0063-2
- 82.
- 83.
- 84.
- 85.
Srinivasan S., Morgan M.T., Fiedler T.L., Djukovic D., Hoffman N.G., Raftery D., Marrazzo J.M., Fredricks D.N. Metabolic signatures of bacterial vaginosis. mBio. 2015;6.
Not in our library10.1128/mbio.00204-15
- 86.
Theriot C.M., Koenigsknecht M.J., Carlson P.E., Hatton G.E., Nelson A.M., Li B., Huffnagle G.B., Li J.Z., Young V.B. Antibiotic-induced shifts in the mouse gut microbiome and metabolome increase susceptibility to Clostridium difficile infection. Nat. Commun. 2014;5:3114.
Not in our library10.1038/ncomms4114
- 87.
- 88.
Jozefczuk S., Klie S., Catchpole G., Szymanski J., Cuadros-Inostroza A., Steinhauser D., Selbig J., Willmitzer L. Metabolomic and transcriptomic stress response of Escherichia coli. Mol. Syst. Biol. 2010;6:364.
Not in our library10.1038/msb.2010.18
- 89.
Hastings J., Mains A., Virk B., Rodriguez N., Murdoch S., Pearce J., Bergmann S., Le Novère N., Casanueva O. Multi-Omics and Genome-Scale Modeling Reveal a Metabolic Shift During C. elegans Aging. Front. Mol. Biosci. 2019;6:364.
Not in our library10.3389/fmolb.2019.00002
- 90.
Fondi M., Liò P. Multi -omics and metabolic modelling pipelines: Challenges and tools for systems microbiology. Microbiol. Res. 2015;171:52-64.
Not in our library10.1016/j.micres.2015.01.003
- 91.
Wanders R.J.A., Vaz F.M., Ferdinandusse S., van Kuilenburg A.B.P., Kemp S., van Karnebeek C.D., Waterham H.R., Houtkooper R.H. Translational Metabolism: A multidisciplinary approach towards precision diagnosis of inborn errors of metabolism in the omics era. J. Inherit. Metab. Dis. 2019;42:197-208.
Not in our library10.1002/jimd.12008
- 92.
Biswapriya B.M., Carl L., Michael O., Laura A.C. Integrated omics: Tools, advances and future approaches. J. Mol. Endocrinol. 2019;62:R21-R45.
Not in our library10.1530/jme-18-0055
- 93.
Haas R., Zelezniak A., Iacovacci J., Kamrad S., Townsend S., Ralser M. Designing and interpreting ‘multi-omic’ experiments that may change our understanding of biology. Curr. Opin. Syst. Biol. 2017;6:37-45.
Not in our library10.1016/j.coisb.2017.08.009
- 94.
Bult C.J., Eppig J.T., Kadin J.A., Richardson J.E., Blake J.A., Mouse Genome Database Group. The Mouse Genome Database (MGD): Mouse biology and model systems. Nucleic Acids Res. 2008;36:D724-D728.
Not in our library10.1093/nar/gkm961
- 95.
Marygold S.J., Crosby M.A., Goodman J.L., FlyBase C. Using FlyBase, a database of Drosophila genes and genomes. Methods Mol. Biol. (Clifton, N.J.). 2016;1478:1-31.
Not in our library10.1007/978-1-4939-6371-3_1
- 96.
- 97.
- 98.
Karp P.D., Ong W.K., Paley S., Billington R., Caspi R., Fulcher C., Kothari A., Krummenacker M., Latendresse M., Midford P.E., et al. The EcoCyc Database. EcoSal Plus. 2018;8.
Not in our library10.1128/ecosalplus.esp-0006-2018
- 99.
Ramirez-Gaona M., Marcu A., Pon A., Guo A.C., Sajed T., Wishart N.A., Karu N., Djoumbou Feunang Y., Arndt D., Wishart D.S. YMDB 2.0: A significantly expanded version of the yeast metabolome database. Nucleic Acids Res. 2017;45:D440-D445.
Not in our library10.1093/nar/gkw1058
- 100.
Schläpfer P., Zhang P., Wang C., Kim T., Banf M., Chae L., Dreher K., Chavali A.K., Nilo-Poyanco R., Bernard T., et al. Genome-wide prediction of metabolic enzymes, pathways, and gene clusters in plants. Plant Physiol. 2017;173:2041.
Not in our library10.1104/pp.16.01942
- 101.
MacPherson K.A., Starr B., Wong E.D., Dalusag K.S., Hellerstedt S.T., Lang O.W., Nash R.S., Skrzypek M.S., Engel S.R., Cherry J.M. Outreach and online training services at the Saccharomyces Genome Database. Database. 2017;2017:bax002.
Not in our library10.1093/database/bax002
- 102.
Wishart D.S., Feunang Y.D., Marcu A., Guo A.C., Liang K., Vazquez-Fresno R., Sajed T., Johnson D., Li C., Karu N., et al. HMDB 4.0: The human metabolome database for 2018. Nucleic Acids Res. 2018;46:D608-D617.
Not in our library10.1093/nar/gkx1089
- 103.
Benson D.A., Cavanaugh M., Clark K., Karsch-Mizrachi I., Lipman D.J., Ostell J., Sayers E.W. GenBank. Nucleic Acids Res. 2013;41:D36-D42.
Not in our library10.1093/nar/gks1195
- 104.
- 105.
- 106.
Kale N.S., Haug K., Conesa P., Jayseelan K., Moreno P., Rocca-Serra P., Nainala V.C., Spicer R.A., Williams M., Li X., et al. Metabolights: An open-access database repository for metabolomics data. Curr. Protoc. Bioinform. 2016;53:14.13.1-14.13.18.
Not in our library10.1002/0471250953.bi1413s53
- 107.
Fahy E., Alvarez-Jarreta J., Brasher C.J., Nguyen A., Hawksworth J.I., Rodrigues P., Meckelmann S., Allen S.M., O’Donnell V.B. LipidFinder on LIPID MAPS: Peak filtering, MS searching and statistical analysis for lipidomics. Bioinformatics. 2018;35:685-687.
Not in our library10.1093/bioinformatics/bty679
- 108.
- 109.
Kanehisa M. The KEGG database. Novartis Found. Symp. 2002;247:91-101.
Not in our library
- 110.
- 111.
Caspi R., Altman T., Dale J.M., Dreher K., Fulcher C.A., Gilham F., Kaipa P., Karthikeyan A.S., Kothari A., Krummenacker M., et al. The MetaCyc database of metabolic pathways and enzymes and the BioCyc collection of pathway/genome databases. Nucleic Acids Res. 2010;38:D473-D479.
Not in our library10.1093/nar/gkp875
- 112.
Beale D.J., Karpe A.V., Ahmed W., Beale D.J., Kouremenos K.A., Palombo E.A. Beyond metabolomics: A review of multi-omics-based approaches. Microbial Metabolomics: Applications in Clinical, Environmental, and Industrial Microbiology. 2016;289-312.
Not in our library
- 113.
Lourenço A., Ferreira A., Veiga N., Machado I., Pereira M.O., Azevedo N.F. BiofOmics: A web platform for the systematic and standardized collection of high-throughput biofilm data. PLoS ONE. 2012;7:e39960.
Not in our library10.1371/journal.pone.0039960
- 114.
Xia T., Hemert J.V., Dickerson J.A. OmicsAnalyzer: A Cytoscape plug-in suite for modeling omics data. Bioinformatics. 2010;26:2995-2996.
Not in our library10.1093/bioinformatics/btq583
- 115.
Enjalbert B., Jourdan F., Portais J.-C. Intuitive visualization and analysis of multi-omics data and application to Escherichia coli carbon metabolism. PLoS ONE. 2011;6:e21318.
Not in our library10.1371/journal.pone.0021318
- 116.
- 117.
Shannon P.T., Reiss D.J., Bonneau R., Baliga N.S. The Gaggle: An open-source software system for integrating bioinformatics software and data sources. BMC Bioinform. 2006;7:176.
Not in our library10.1186/1471-2105-7-176
- 118.
- 119.
- 120.
Kamburov A., Cavill R., Ebbels T.M., Herwig R., Keun H.C. Integrated pathway-level analysis of transcriptomics and metabolomics data with IMPaLA. Bioinformatics. 2011;27:2917-2918.
Not in our library10.1093/bioinformatics/btr499
- 121.
- 122.
Tokimatsu T., Sakurai N., Suzuki H., Ohta H., Nishitani K., Koyama T., Umezawa T., Misawa N., Saito K., Shibata D. KaPPA-view: A web-based analysis tool for integration of transcript and metabolite data on plant metabolic pathway maps. Plant Physiol. 2005;138:1289-1300.
Not in our library10.1104/pp.105.060525
- 123.
Lin K., Kools H., de Groot P.J., Gavai A.K., Basnet R.K., Cheng F., Wu J., Wang X., Lommen A., Hooiveld G.J., et al. MADMAX - Management and analysis database for multiple ~omics experiments. J. Integr. Bioinform. 2011;8:160.
Not in our library10.1515/jib-2011-160
- 124.
Usadel B., Nagel A., Thimm O., Redestig H., Blaesing O.E., Palacios-Rojas N., Selbig J., Hannemann J., Piques M.C., Steinhauser D., et al. Extension of the visualization tool MapMan to allow statistical analysis of arrays, display of coresponding genes, and comparison with known responses. Plant Physiol. 2005;138:1195-1204.
Not in our library10.1104/pp.105.060459
- 125.
Thimm O., Blasing O., Gibon Y., Nagel A., Meyer S., Kruger P., Selbig J., Muller L.A., Rhee S.Y., Stitt M. MAPMAN: A user-driven tool to display genomics data sets onto diagrams of metabolic pathways and other biological processes. Plant J. Cell Mol. Biol. 2004;37:914-939.
Not in our library10.1111/j.1365-313x.2004.02016.x
- 126.
Kaever A., Landesfeind M., Feussner K., Mosblech A., Heilmann I., Morgenstern B., Feussner I., Meinicke P. MarVis-Pathway: Integrative and exploratory pathway analysis of non-targeted metabolomics data. Metabolomics. 2015;11:764-777.
Not in our library10.1007/s11306-014-0734-y
- 127.
Wagele B., Witting M., Schmitt-Kopplin P., Suhre K. MassTRIX reloaded: Combined analysis and visualization of transcriptome and metabolome data. PLoS ONE. 2012;7:e39860.
Not in our library10.1371/journal.pone.0039860
- 128.
Karnovsky A., Weymouth T., Hull T., Tarcea V.G., Scardoni G., Laudanna C., Sartor M.A., Stringer K.A., Jagadish H.V., Burant C., et al. Metscape 2 bioinformatics tool for the analysis and visualization of metabolomics and gene expression data. Bioinformatics. 2012;28:373-380.
Not in our library10.1093/bioinformatics/btr661
- 129.
- 130.
- 131.
Wheeler H.E., Aquino-Michaels K., Gamazon E.R., Trubetskoy V.V., Dolan M.E., Huang R.S., Cox N.J., Im H.K. Poly-omic prediction of complex traits: OmicKriging. Genetic Epidemiol. 2014;38:402-415.
Not in our library10.1002/gepi.21808
- 132.
Droste P., Miebach S., Niedenführ S., Wiechert W., Nöh K. Visualizing multi-omics data in metabolic networks with the software Omix—A case study. Biosystems. 2011;105:154-161.
Not in our library10.1016/j.biosystems.2011.04.003
- 133.
Garcia-Alcalde F., Garcia-Lopez F., Dopazo J., Conesa A. Paintomics: A web based tool for the joint visualization of transcriptomics and metabolomics data. Bioinformatics. 2011;27:137-139.
Not in our library10.1093/bioinformatics/btq594
- 134.
- 135.
Neuweger H., Persicke M., Albaum S.P., Bekel T., Dondrup M., Huser A.T., Winnebald J., Schneider J., Kalinowski J., Goesmann A. Visualizing post genomics data-sets on customized pathway maps by ProMeTra-aeration-dependent gene expression and metabolism of Corynebacterium glutamicum as an example. BMC Syst. Biol. 2009;3:82.
Not in our library10.1186/1752-0509-3-82
- 136.
Eriksson L., Byrne T., Johansson E., Trygg J., Vikström C. Multi- and Megavariate Data Analysis Basic Principles and Applications, Volume 1. 2013.
Not in our library
- 137.
- 138.
Grimplet J., Cramer G.R., Dickerson J.A., Mathiason K., Van Hemert J., Fennell A.Y. VitisNet: “Omics” integration through grapevine molecular networks. PLoS ONE. 2009;4:e8365.
Not in our library10.1371/journal.pone.0008365
- 139.
Aderem A. Systems biology: Its practice and challenges. Cell. 2005;121:511-513.
Not in our library10.1016/j.cell.2005.04.020
- 140.
Dihazi H., Asif A.R., Beißbarth T., Bohrer R., Feussner K., Feussner I., Jahn O., Lenz C., Majcherczyk A., Schmidt B., et al. Integrative omics - from data to biology. Expert Rev. Proteom. 2018;15:463-466.
Not in our library10.1080/14789450.2018.1476143
- 141.
Perez-Riverol Y., Bai M., da Veiga Leprevost F., Squizzato S., Park Y.M., Haug K., Carroll A.J., Spalding D., Paschall J., Wang M., et al. Discovering and linking public omics data sets using the Omics Discovery Index. Nat. Biotechnol. 2017;35:406-409.
Not in our library10.1038/nbt.3790
- 142.
Kuo W.P., Jenssen T.K., Butte A.J., Ohno-Machado L., Kohane I.S. Analysis of matched mRNA measurements from two different microarray technologies. Bioinformatics. 2002;18:405-412.
Not in our library10.1093/bioinformatics/18.3.405
- 143.
- 144.
- 145.
Tabb D.L., Vega-Montoto L., Rudnick P.A., Variyath A.M., Ham A.J., Bunk D.M., Kilpatrick L.E., Billheimer D.D., Blackman R.K., Cardasis H.L., et al. Repeatability and reproducibility in proteomic identifications by liquid chromatography-tandem mass spectrometry. J. Proteome Res. 2010;9:761-776.
Not in our library10.1021/pr9006365
- 146.
Wilhelm B.T., Landry J.-R. RNA-Seq—Quantitative measurement of expression through massively parallel RNA-sequencing. Methods. 2009;48:249-257.
Not in our library10.1016/j.ymeth.2009.03.016
- 147.
Nayfach S., Pollard K.S. Toward accurate and quantitative comparative metagenomics. Cell. 2016;166:1103-1116.
Not in our library10.1016/j.cell.2016.08.007
- 148.
Zeevi D., Korem T., Zmora N., Israeli D., Rothschild D., Weinberger A., Ben-Yacov O., Lador D., Avnit-Sagi T., Lotan-Pompan M., et al. Personalized nutrition by prediction of glycemic responses. Cell. 2015;163:1079-1094.
Not in our library10.1016/j.cell.2015.11.001
- 149.
- 150.
Jeong H., Tombor B., Albert R., Oltvai Z.N., Barabasi A.L. The large-scale organization of metabolic networks. Nature. 2000;407:651-654.
Not in our library10.1038/35036627
- 151.
Barabasi A.L., Oltvai Z.N. Network biology: Understanding the cell’s functional organization. Nat. Rev. Genet. 2004;5:101-113.
Not in our library10.1038/nrg1272
- 152.
Boccaletti S., Bianconi G., Criado R., del Genio C.I., Gómez-Gardeñes J., Romance M., Sendiña-Nadal I., Wang Z., Zanin M. The structure and dynamics of multilayer networks. Phys. Rep. 2014;544:1-122.
Not in our library10.1016/j.physrep.2014.07.001
- 153.
Kivelä M., Arenas A., Barthelemy M., Gleeson J.P., Moreno Y., Porter M.A. Multilayer networks. J. Complex Netw. 2014;2:203-271.
Not in our library10.1093/comnet/cnu016
- 154.
Price N.D., Magis A.T., Earls J.C., Glusman G., Levy R., Lausted C., McDonald D.T., Kusebauch U., Moss C.L., Zhou Y., et al. A wellness study of 108 individuals using personal, dense, dynamic data clouds. Nat. Biotechnol. 2017;35:747-756.
Not in our library10.1038/nbt.3870
- 155.
Valdes A.M., Walter J., Segal E., Spector T.D. Role of the gut microbiota in nutrition and health. BMJ (Clin. Res. Ed.). 2018;361:k2179.
Not in our library10.1136/bmj.k2179
- 156.
Bashiardes S., Godneva A., Elinav E., Segal E. Towards utilization of the human genome and microbiome for personalized nutrition. Curr. Opin. Biotechnol. 2018;51:57-63.
Not in our library10.1016/j.copbio.2017.11.013
- 157.
Ogura T., Date Y., Tsuboi Y., Kikuchi J. Metabolic dynamics analysis by massive data integration: Application to tsunami-affected field soils in Japan. ACS Chem. Biol. 2015;10:1908-1915.
Not in our library10.1021/cb500609p
- 158.
Ara T., Enomoto M., Arita M., Ikeda C., Kera K., Yamada M., Nishioka T., Ikeda T., Nihei Y., Shibata D., et al. Metabolonote: A Wiki-Based Database for Managing Hierarchical Metadata of Metabolome Analyses. Front. Bioeng. Biotechnol. 2015;3:38.
Not in our library10.3389/fbioe.2015.00038
- 159.
Ćwiek H., Krajewski P., Klukas C., Chen D., Lange M., Weise S., Scholz U., van Dijk A.D.J., Nap J.P., Fiorani F., et al. Towards recommendations for metadata and data handling in plant phenotyping. J. Exp. Bot. 2015;66:5417-5427.
Not in our library10.1093/jxb/erv271
- 160.
Meyer R.S. Encouraging metadata curation in the Diversity Seek initiative. Nature Plants. 2015;1:15099.
Not in our library10.1038/nplants.2015.99
- 161.
Diamandis E.P. Cancer biomarkers: Can we turn recent failures into success? J. Natl. Cancer Inst. 2010;102:1462-1467.
Not in our library10.1093/jnci/djq306
- 162.
- 163.
- 164.
Phillips K.A., Deverka P.A., Hooker G.W., Douglas M.P. Genetic Test Availability And Spending: Where Are We Now? Where Are We Going? Health Aff. (Proj. Hope). 2018;37:710-716.
Not in our library10.1377/hlthaff.2017.1427
- 165.
Yurkovich J.T., Palsson B.O. Quantitative -omic data empowers bottom-up systems biology. Curr. Opin. Biotechnol. 2018;51:130-136.
Not in our library10.1016/j.copbio.2018.01.009
Cited by papers we hold 15
- The metabolomics of human aging: Advances, challenges, and opportunities · 2022No notice
- Applications of Multi-Omics Technologies for Crop Improvement · 2021No notice
- Integration of Omics Tools for Understanding the Fish Immune Response Due to Microbial Challenge · 2021Not checked
- Data Management and Modeling in Plant Biology · 2021Not checked
- Application of Proteomics in Cancer: Recent Trends and Approaches for Biomarkers Discovery · 2021No notice
- Recent Advanced Technologies for the Characterization of Xenobiotic-Degrading Microorganisms and Microbial Communities · 2021No notice
- Approaches to Integrating Metabolomics and Multi-Omics Data: A Primer · 2021No notice
- The contribution of gut bacterial metabolites in the human immune signaling pathway of non-communicable diseases · 2021No notice
- Genome-Scale Metabolic Modeling Enables In-Depth Understanding of Big Data · 2021No notice
- Meta-Inflammation and Metabolic Reprogramming of Macrophages in Diabetes and Obesity: The Importance of Metabolites · 2021No notice
- Metabolomics as an Emerging Tool for the Study of Plant–Pathogen Interactions · 2020No notice
- Metabolomics and Multi-Omics Integration: A Survey of Computational Methods and Resources · 2020No notice
- State of the Field in Multi-Omics Research: From Computational Needs to Data Mining and Sharing · 2020No notice
- Deep metabolome: Applications of deep learning in metabolomics · 2020No notice
- Translational Metabolomics: Current Challenges and Future Opportunities · 2019No notice
Reads
Read by people on this page
None yet.
Checked or read by AI through naulon
None yet.
A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.
Are you an author?
Is this your paper?
Claim it to add your note and be paid when agents cite it. Free.