Skip to content
naulon

No retraction, correction or concern found when last checked on Oct 19, 2026.

SBML Level 3: an extensible format for the exchange and reuse of biological models

Sarah M Keating, Dagmar Waltemath, Matthias König and 97 more

Molecular Systems Biology · 2020 · Review · CC BY

doi:10.15252/msb.20199110

Abstract

Systems biology has experienced dramatic growth in the number, size, and complexity of computational models. To reproduce simulation results and reuse models, researchers must exchange unambiguous model descriptions. We review the latest edition of the Systems Biology Markup Language (SBML), a format designed for this purpose. A community of modelers and software authors developed SBML Level 3 over the past decade. Its modular form consists of a core suited to representing reaction‐based models and packages that extend the core with features suited to other model types including constraint‐based models, reaction‐diffusion models, logical network models, and rule‐based models. The format leverages two decades of SBML and a rich software ecosystem that transformed how systems biologists build and interact with models. More recently, the rise of multiscale models of whole cells and organs, and new data sources such as single‐cell measurements and live imaging, has precipitated new ways of integrating data with models. We provide our perspectives on the challenges presented by these developments and how SBML Level 3 provides the foundation needed to support this evolution.

Full text

From PubMed Central, U.S. National Library of Medicine, as current on Oct 20, 2026. Paragraph numbers are ours, so an answer can point at one.

Introduction

Systems modeling and numerical simulations in biology can be traced to the mid‐20th century. Though general theorizing about systems began earlier, the application of systems analysis to biology gained attention in the 1950s thanks to the work of biologists such as von Bertalanffy and Kacser (Von Bertalanffy,; Kacser, ). The era of numerical simulation in biology truly began with the landmark works of Chance on enzyme kinetics (Chance et al, ), Hodgkin and Huxley on the molecular basis of neuronal transmission (Hodgkin & Huxley, ), and Turing on the chemical basis of morphogenesis (Turing, ). Since then, the number and variety of models have grown in all of the life sciences. As precise descriptions of phenomena that can be simulated, analyzed, and compared with experimental data, models provide unique insights that can confirm or refute hypotheses, suggest new experiments, and identify refinements to the models.

The availability of more data, more powerful modeling methods, and dramatically increased computing power led to the rise of systems biology as a compelling research theme around the turn of the millennium (Kitano,; Ideker et al, ). Though computational models were at first published as printed equations in journal articles, the desire to reuse an ever‐increasing number of models called for digital formats that were interoperable between software systems and could be easily exchanged between scientists (topics of interest as early as the 1960s; c.f. Garfinkel, ). This drove efforts to create tool‐independent ways of representing models that could avoid the potential for human translation errors, be stored in databases, and provide a common starting point for simulations and analyses regardless of the software used (Goddard et al,; Hucka et al,; Lloyd et al, ). One such effort was SBML, the Systems Biology Markup Language. Its initial design was motivated by discussions to create a “metabolic model file format” following a 1999 workshop (recounted by Kell & Mendes, ). A distributed community thereafter discussed ideas that informed work at Caltech in late 1999/early 2000 and led (after a series of public drafts) to the specification of the official version of SBML Level 1 version 1 being released in March 2001 (Hucka et al, ).

While SBML was initially developed to exchange compartmental models of biochemical reaction networks primarily formulated in terms of chemical kinetics (Hucka et al, ), it was always understood that there existed more types of models than the initial version of SBML could represent explicitly. However, seeking community consensus on a limited set of simpler features, which could be readily implemented in software at the time, was deemed a more pragmatic strategy. A deliberate decision was taken to delay the addition of more advanced capabilities to a later time. As a result, SBML has evolved in stages in a community‐driven fashion that has benefited from the efforts of many researchers worldwide over two decades. As time passed, the need to support a broader range of model types, modeling frameworks, and research areas became apparent. SBML's success in serving as an interchange format for basic types of models led communities of modelers to ask whether it could be adapted or expanded to support more types. In addition to reaction‐diffusion models, alternative modeling frameworks have risen in popularity in the past decade (Machado et al, ), and researchers have faced interoperability problems between software tools developed for their use. These needs drove a profound change in SBML's structure: A facility to permit layering the core of SBML with new features suited to more types of models, together with a way for individual models to identify which sets of extensions they need for proper interpretation. The release of SBML Level 3 (Hucka et al, ) has provided a new foundation to enable the exchange of a greater variety of models in various domains of biology (Fig 1).

In the rest of this article, we begin by summarizing SBML's general structure and then describe the modularity introduced in Level 3 and the wide range of modeling formalisms supported by Level 3 packages. We follow that by describing the community aspects of SBML development. We continue with a discussion of SBML's impact on both computational modeling and the modeling community, and finally, we close with a discussion of forthcoming challenges.

The structure of SBML

The core of SBML is focused on encoding models in which entities are located in containers and are acted upon by processes that modify, create, or destroy entities. The containers do not need to correspond to physical structures; they can be conceptual or abstract. Additional constructs allow parameters, initial conditions, other variables, and other mathematical relationships to be defined (Fig 2A). In the most common type of model, the “entities” are biochemical substances, the “containers” are well‐mixed and spatially homogeneous, and the “processes” are biochemical reactions happening within or between the containers. This originally led to the SBML constructs being named species, compartments, and reactions, respectively (Fig 2B), but these names are historical artifacts and belie the generality of the underlying scheme. Software applications can map the names to other concepts to better suit their purposes. For instance, “species” could be mapped to populations of molecules, cells, or even organisms.

Modelers and software developers are encouraged to use SBML's reaction construct to define a model's behavior in preference to formulating the model explicitly as a system of equations. This gives users freedom to convert the model into the final format they prefer—a simpler operation than (for example) inferring a reaction network from a system of differential equations. More importantly, the approach also naturally handles models where reaction kinetics are unknown or unneeded, such as interaction maps, and supports the elaboration of the reaction construct using SBML packages (discussed below). That said, the use of reactions is optional, and SBML provides features sufficient for encoding a large diversity of purely mathematical models, too. Whether using reactions or not, values of model variables and their changes over time may be fixed or determined by mathematical expressions, either before or during simulation, continuously or in response to discrete events, with or without time delays. Units of measurement can be specified for all entities and values; in addition to adding a layer of essential physical knowledge (after all, how else could one interpret whether a time course is in milliseconds or years?), information about units can be used to verify the relationships expressed in a model. Units also facilitate reuse of models and components, interconnection of models, conversion of models between different frameworks, and integration of data with models.

SBML does not dictate which framework must be used to analyze or simulate a model; in fact, it purposefully lacks any explicit way to specify what is done with a model—whether to run simulations or other types of analyses, how to run them, or how to present the results—because externalizing this information enhances model reusability and permits independent innovation in separate but complementary formats. Two of the most popular methods for time‐course simulation are commonly used: one is numerical integration of differential equations created from the reactions and other relationships affecting model variables, and the other is simulating the time evolution of the model as a stochastic system via algorithms such as the one developed by Gillespie. Alternative approaches are also in use, particularly when a model is enhanced with SBML packages.

Any element of an SBML model can be elaborated using machine‐readable metadata as well as human‐readable notes. For metadata, two schemes are supported. The first is direct labeling of SBML elements with terms from the Systems Biology Ontology (SBO; Courtot et al, ), which allows the mathematical semantics of every element of a model to be precisely specified. The second scheme uses semantic web technologies and provides greater flexibility to capture additional metadata. For instance, a molecular species in a model can be linked to a UniProt entry (The UniProt Consortium, ) if it represents a protein, or to ChEBI entry (Hastings et al, ) if it represents a simple chemical. Gene Ontology terms (GO; Ashburner et al, ) can be attached to species, compartments, and mathematical elements representing biological processes and functions. Simple provenance data such as identities of creators can be added to facilitate attribution and versioning. To help standardize how annotations are stored, SBML encourages the use of guidelines and resources established for this purpose (Le Novère et al, ). Finally, software tools can also use annotations to encode tool‐specific data in their own formats, thus providing a way to capture data that might otherwise be lost. Annotations thereby help enrich the meaning of model components, facilitate the understanding and reuse of models, and help software work with SBML more flexibly (Neal et al, ).

The core features described above have been a backbone of SBML ever since Level 2, even as SBML continued to evolve. The development of the modular Level 3, discussed in the next section, provided an opportunity to rethink and redesign a few other rarely used features. For example, the species charge attribute, designed to represent molecular charge, was removed in Level 3 in favor of letting an SBML package introduce more complete support for the relevant concepts.

SBML Level 3's modularity and breadth

Constant evolution in scientific methods presents challenges for the creation of software tools and standards. One challenge arises because the creation of new standards requires labor, testing, and time. This often causes standardization efforts to lag behind the latest technical developments in a constantly moving field. A second challenge is that users want support for new methods and standards in software tools, which pressures developers to implement support quickly. Combined with the first challenge, it means that sometimes problems with a standard's definition are not discovered until more developers attempt to use it in different situations, which in turn often means that revisions to a standard are needed after it is published. Finally, another challenge is that software development often takes place under resource constraints (funding and time), limiting the scope of work that software developers can undertake—including, sometimes, limiting how many features of a standard they can support in their software.

The SBML community sought to address these challenges by putting in place certain structural features in SBML's development process. The first is the notion of Levels. A Level in SBML is an attempt to provide a given set of features for describing models, with higher Levels providing more powerful features. For example, the ability to express discrete events was added to SBML Level 2 but does not exist in Level 1. SBML Levels are mostly upwardly compatible, in the sense that the vast majority of models encoded in Level n can be translated to Level n + 1. Versions are used to introduce refinements to a given Level to account for realizations that come from real‐life use of SBML. Finally, SBML Level 3 introduced an extensible modular architecture consisting of a central set of fixed features (named SBML Level 3 Core), and a scheme for adding packages that can augment the Core by extending existing elements, adding new elements, and adjusting the meaning or scope of elements. A model declares which packages it uses in order to guide its interpretation by software applications. If a software tool detects the presence of packages that it does not support, it may inform users if it cannot work with the model. Together, these three features (Levels, Versions, packages) help address the challenges discussed above: they ease coping with evolution in methods by collecting significant changes into discrete stages (SBML Levels), they help deal with the inevitable need for revisions (Versions within Levels), and they allow developers to limit the feature set they implement (SBML Levels on the one hand, and SBML Level 3 packages on the other).

Packages allow SBML Level 3 (Hucka et al, ) to represent many model types and characteristics in a more natural way than if they had to be shoehorned into SBML Core constructs exclusively. Twelve packages have been proposed to date (Table 1); eight have been fully developed into consensus specifications and are each used by at least two software implementations (Box 1), and another two have draft specifications in use by software tools. New packages can be developed independently, within dedicated communities, at a pace that suits them. This was the case for logical modeling with the CoLoMoTo community (Naldi et al, ), constraint‐based modeling within the COBRA community (Heirendt et al, ), and rule‐based modeling with a community of like‐minded software creators (Faeder et al,; Zhang et al,; Palmisano et al,; Boutillier et al, ).

Distributions

The “distrib” package (Smith et al, ) provides the means to encode information about the distribution and uncertainty of numerical values assigned to a model element. Biological models often contain elements that have inexact numerical values, since they are based on values that are stochastic in nature or data that contains uncertainty; however, core SBML has no direct support for encoding values sampled from distributions. The recently‐finalized “distrib” package adds constructs for sampling of random values from probability distributions and describing uncertainty statistics about element values.

Hierarchical model composition

The “comp” package (Smith et al, ) allows users to build models from other complete models or from model fragments, as a way to manage complexity and construct composite models. “Submodels” can be described within the same SBML file or linked from external files. A submodel can act as a template, and the same definition can be reused multiple times in other models to avoid duplication and enable reuse of parts. The “comp” package also enables submodels to have explicit interfaces (known as ports) for optional black‐box encapsulation. Finally, “comp” was designed so that a hierarchical model can be converted into a single SBML model that does not use any “comp” features, making it readable by software that does not directly support the package. The library libSBML (Bornstein et al, ) provides a facility to do this.

Flux balance constraints

The “fbc” package (Olivier & Bergmann, ) provides a means of encoding constraint‐based models and optimizations, such as is done in Flux Balance Analysis (Bordbar et al, ). Constructs in the “fbc” package allow for the definition of a list of objectives for minimization or maximization, as well as flux bounds on reactions and gene‐reaction mappings. Additional information such as chemical formula and charge enable further model analyses, including calculation of reaction mass balances, electron leaks, or implausible sources of matter.

Groups

The “groups” package (Hucka & Smith, ) provides constructs to describe conceptual relationships between model elements. Groupings can indicate classification, partonomy, or merely a collection of things; a group's meaning can be specified using semantic annotations. Groups have no semantic meaning and cannot influence the mathematical interpretation of an SBML model.

Multistate, multicomponent, and multicompartment species

The “multi” package (Zhang and Meier‐Schellersheim, ) manages the combinatorics produced by entities either composed of multiple components, such as molecular complexes, or that can exist in multiple states, such as proteins with post‐translational modifications. With the “multi” package, rules can be defined for how reactions depend on the states of the entities and their locations. The package adds syntactic constructs for molecular species types, compartment types, features, binding sites, and bonds. Entire families of molecular complexes sharing certain properties can be defined using patterns created using these constructs.

Qualitative models

The “qual” package (Chaouiya et al, ) provides constructs to encode models whose dynamics can be represented by discrete, reachable states connected by state transitions denoting qualitative updates of model elements. Examples include logical regulatory networks (Boolean or multivalued) and Petri nets. The “qual” package introduces SBML elements to allow the definition of qualitative species, which are used to associate discrete levels of activities with entity pools, as well as transitions, which define the possible changes between states in the transition graph.

Layout and rendering

The “layout” (Gauges et al, ) and “render” (Bergmann et al, ) packages extend SBML to allow graphical representations of networks or pathways to be stored within SBML files. The “layout” package enables the encoding of positions and sizes of graphical elements such as nodes and lines, while the information about colors, fonts, etc., is defined by the “render” package. This separation presents several advantages. For example, applications can offer multiple styles for visualizing the same layout of a network map. Most of the essential aspects of a network diagram can be expressed using just the “layout” package, and thus tools do not necessarily have to implement a full graphics environment if they do not need to support customizing a diagram's look‐and‐feel.

SBML Level 3's modularity and breadth

Several benefits accrue from leveraging SBML as a starting point rather than creating a new, independent format. One is it makes clear where common features overlap. Most computational modeling frameworks in the domain of biology share some common concepts—variables that represent characteristics of different kinds of entities and processes that represent interactions between entities, containers/locations, etc.—and reusing SBML Level 3 Core constructs makes the conceptual similarities explicit. This in turn makes interpretation of models easier (no need to learn new terminology) and reuse simpler (no need to translate between independent formats). Another benefit is that the creators of the format can leverage existing features developed for SBML, such as mechanisms for annotations, rather than spend time developing new approaches to achieving the same goals in a new format. This in turn leads to another benefit: the ability to reuse at least some parts of existing software libraries developed for SBML. It also means that a software application may be able to interpret at least some fundamental aspects of a model even if the application is not designed to work with a particular SBML Level 3 package, by virtue of understanding SBML Core (and perhaps other packages used by the model). This improves the potential for model reuse, and benefits model creators and software developers alike. Finally, a common foundation simplifies the creation of multiframework models in which some parts of the model use one formalism and other parts use others [e.g., coupling kinetic models with flux balance analysis; Watanabe et al, ).

Though this modular approach has benefits, it is not without potential pitfalls. The main risks are fragmentation of the community, and incompatibility of packages due to complex feature dependencies. The SBML community has addressed the former by maintaining communications between package developers; the community processes have such interactions built in. As for the latter, API libraries (see Box 2) can handle some combinations of packages and hide some of the complexity. Still, there remain some combinations of packages that are not fully understood, and it remains for future work to define how (if ever) they can be combined for use in a single model.

Software Guide

A catalog (http://sbml.org/SBML_Software_Guide) of software applications, libraries, and online services known to support SBML—over 290 entries to date A tabular interface highlights supported SBML features of each software system.A list interface displays human‐readable summaries of software systems.Software can be added to the list upon request.

A tabular interface highlights supported SBML features of each software system.

A list interface displays human‐readable summaries of software systems.

Software can be added to the list upon request.

SBML as a community standard

SBML's success can be attributed largely to its community‐based development and its consensus‐oriented approach. SBML has always been developed through engagement with its user community to achieve goals expressed by that same community. To resolve occasionally conflicting technical demands, a guiding principle has been to seek consensus between different viewpoints and the needs of different groups, to find a middle ground that would be—while perhaps not a perfect solution—an acceptable and usable solution. This attracted the researchers and software developers who constitute SBML's foremost stakeholders. By using SBML in everything from software to textbooks, they helped drive further development to face the real needs expressed by the people who have those needs. This engagement allowed faster feedback from users to developers and has helped produce a rich toolkit of software and other resources that facilitate SBML's incorporation into software (Box 2).

Over the years, the community has designed rules to organize its governance, develop and maintain the specifications, and facilitate collaboration among users. The development of SBML and its Level 3 packages is shepherded by the SBML Editors, a group of community‐elected volunteers serving terms of 3 years who follow a written and public process detailed on the web portal SBML.org.1 SBML Editors write or review SBML specification documents, organize discussions and vote on specific technical issues, and enact the decisions of the community. Major proposed changes to the specifications and packages are discussed by the community via the SBML mailing lists2 as well as during annual face‐to‐face meetings.

The community currently comes together twice a year within the context of meetings organized by COMBINE the Computational Modeling in Biology Network; Hucka et al, ). HARMONY (the Hackathon on Resources for Modeling in Biology) is a codefest that focuses on the development of software, in particular via the development of libraries, tools, and specifications; by contrast, the COMBINE Forum meetings focus on the presentation of novel tools and the discussion of proposed features. In addition to these general meetings, special SBML working groups are organized as needed to drive SBML package development. COMBINE's central activity is coordinating and harmonizing standardization in computational biology, and SBML is one of its core standards. FAIRsharing, a broader community network that covers life sciences more comprehensively (Sansone et al, ), maintains interconnected and organized collections of resources in many areas, including curated links between SBML and many associated funders, databases, and standards.3

Impact of SBML

As contributors to developments in methods, software, and standards over the past two decades (Hucka et al, ), we can attest to SBML's profound impact on the field, both from our own first‐hand experiences and from surveys (Klipp et al, ) that indicate SBML has become a de facto standard. The impact is a result of SBML's community‐oriented development approach and its design.

The SBML development process has helped shape the field partly by directly involving software developers and modelers. Frequent workshops have provided essential feedback for developers to help them better serve modelers’ needs (e.g., Waltemath et al, ). Workshops as well as resources such as the SBML Software Guide (see Box 2) helped raise awareness of existing tools, which in turn increased their use and the use of SBML. This helped create a culture of sharing models and building on existing work in systems biology (Stanford et al, ). It also led to new activities centered on the models themselves, including automatic model generation, analysis of model structures, model retrieval, and integration of models with experimental data (Dräger & Palsson, ). SBML's successful approach to community organization has led other standardization efforts (BioPAX, NeuroML, SBGN, SED‐ML) to adopt some of the same approaches; SBML was also a founding member of COMBINE (Hucka et al, ), discussed above. Some of the primary standardization efforts in COMBINE, such as BioPAX (Demir et al, ) and NeuroML (Gleeson et al, ), are more domain‐specific than SBML; others, such as CellML (Lloyd et al, ), overlap SBML's primary domains but offer alternative abstractions; and finally, still others, such as SBGN (van Iersel et al, ), SBOL (Roehner et al, ), and SED‐ML (Waltemath et al, ), are complementary formats.

Before the advent of SBML, it was challenging to exchange models because software tools used incompatible definition schemes. As models increased in size and complexity, manually rewriting them became more difficult, error‐prone, and eventually untenable. The development of SBML has enabled the use of a single model description throughout a project's life cycle even when projects involve heterogeneous software tools (Box 3). SBML‐compatible software tools today allow researchers to use SBML in all aspects of a modeling project, including creation (manual or automated), annotation, comparison, merging, parametrization, simulation/analysis, results comparison, network motif discovery, system identification, omics data integration, visualization, and more. Such use of a standardized format, along with standard annotation schemes (Neal et al, ) and training in reproducible methods, improves research workflows and is generally recognized as promoting research reproducibility (Waltemath & Wolkenhauer, ).

Examples of SBML use cases

SBML's impact on computational systems biology includes its facilitation of collaborative work. In multiple instances, it has precipitated entirely new projects, as illustrated by the examples below.

SBML throughout the model life cycle

Encoding a model in a standard format such as SBML makes it easier to use different software tools for different purposes without format conversion, and thus makes it easier to leverage the most suitable tools at different points in a workflow. The following is an example. A signaling pathway can be designed graphically using CellDesigner (Funahashi et al, ). The resulting model can then be semi‐automatically annotated using the online tool semanticSBML (Krause et al, ). Experimental kinetic information can be retrieved in SBML format from the SABIO‐Reaction Kinetics database (Wittig et al,). Tools such as COPASI (Hoops et al, ) and PyBioNetFit (Mitra et al, ) provide facilities to estimate parameters and to simulate the model with various algorithms. Other SBML‐enabled tools such as Tellurium (Medley et al, ) and PySCeS (Olivier et al, ) provide capabilities such as identifiability and bifurcation analysis. Each step of the process applied to a model from creation to publication of results—modeling, simulation, and analysis—can be documented using notes attached to every model element. The model can even be turned into a publishable document using SBML2LaTeX (Dräger et al, ). Finally, the model can be exported from selected modeling tools, together with data and other information all bundled together in COMBINE Archive format (Bergmann et al, ) and published in model repositories such as BioModels Database (Malik‐Sheriff et al, ).

Pipeline for automated model building

Being able to describe model elements precisely using semantic annotations facilitates the creation of automated pipelines (Dräger et al, ). Such pipelines can combine existing models with databases of molecular phenotypes or reaction kinetics (Li et al, ). They can also generate models de novo from data resources, as has been demonstrated by the Path2Models project (Büchel et al, ). Path2Models has produced 143,000 SBML models—all fully annotated—for over 2,600 organisms, by using pathway data. Metabolic pathways were encoded in SBML Level 3 Core while signaling pathways were encoded with the SBML “qual” package (Chaouiya et al, ). Moreover, constraint‐based models of genome‐scale reconstruction were provided for each organism. Other pipelines have now been built, including ones that can systematically generate alternative models for different tissue types (Wang et al, ) and patient data (Uhlen et al, ), an important step toward personalized medicine.

Development, sharing, and reuse of genome‐scale models of human metabolism

Constraint‐based modeling approaches such as Flux Balance Analysis and its variants permit the use of whole‐genome reconstructions together with experimental molecular phenotypes, in order to predict how mutations or different environments affect metabolism as well as predict drug targets and biomarkers (O'Brien et al, ). With the availability of genome‐scale metabolic reconstructions, the use of metabolic flux models at the same scale has been increasing (Bordbar et al, ). A recent development in the field has been the curation of consensus metabolic models, in particular for human metabolism (Brunk et al, ). Those community efforts rely on SBML for encoding and sharing the models, including annotations, which are crucial to being able to reuse the reconstructions later, and also for visual representation using the Layout (Gauges et al, ) and Rendering (Bergmann et al, ) packages. The Flux Balance Constraint package (Olivier & Bergmann, ) enables encoding of the information required for model optimization and flux calculation. Unambiguous encoding in SBML has been shown to be crucial for interpreting models and precisely computing fluxes (Ebrahim et al,; Ravikrishnan & Raman, ), and new validation tools for genome‐scale metabolic models have been made available by the larger community (e.g., MEMOTE; Lieven et al, ).

Impact of SBML

The availability of a well‐defined format has also facilitated the comparison of software tools to each other. Using SBML‐encoded models has become the norm to assess the accuracy of modeling software: initially it is done manually using models from BioModels Database (Bergmann & Sauro, ), and now, it is more commonly done using the SBML Test Suite (Box 2). SBML's semantics are defined precisely enough that many simulation systems can produce equivalent results for over 1200 test cases, lending confidence that SBML‐based simulations can be reproducible in different software environments.

While chemical kinetics models have been a staple of systems biology, other modeling frameworks exist. These have benefited from efforts to extend Level 3 to better suit their specific characteristics. Even when models could in principle be encoded using core SBML constructs, the use of features explicitly adapted to the needs of a domain can make model interpretation less error‐prone and more natural. The former issue was demonstrated vividly when ad hoc methods of encoding genome‐scale models led to incorrect interpretations, and a subsequent proposal to use SBML Level 3 “fbc” addressed representational inconsistencies that had hindered reproducibility (Ebrahim et al, ). The use of more domain‐specific forms of encoding has been preferred by several communities, such as the qualitative and rule‐based modeling communities. For example, the quickly adopted package SBML Level 3 “qual” (Chaouiya et al, ) supports software interoperability for qualitative modeling, illustrated by the use of CellNOpt (Terfve et al, ), which provides a set of optimal Boolean models that best explains the causal relationships between elements of a signal transduction network and associated data, and the subsequent use of GINsim (Chaouiya et al, ) or Cell Collective (Helikar et al, ) to assess the dynamical properties of these models. Rule‐based modeling can represent models that are impossible to express as reaction networks, such as polymerization (Faeder et al, ), or simply impractical to represent due to the combinatorial number of reactions implied by the rules (Hlavacek et al, ). Storing rule definitions in SBML is now feasible with the “multi” package, allowing rule‐based modeling tools such as Simmune (Zhang et al, ) and BioNetGen (Faeder et al, ) to read and write the same model definitions.

SBML has also eased the automated processing of models to the point where they have become just another type of data in the life sciences. SBML is used today as an import/export format by many databases of mathematical models (Misirli et al,; Norsigian et al,; Malik‐Sheriff et al, ), as well as by pathway databases (Caspi et al,; Mi et al,; Fabregat et al, ) and reaction databases (Ganter et al,; Wittig et al, ). SBML is the preferred format for model curation in BioModels Database (Malik‐Sheriff et al, ), not only because of its popularity but also because of its provisions to precisely encode and annotate models to support reproducible modeling. SBML is also used to share models by more generic data management platforms such as SEEK (Wolstencroft et al, ) and comprehensive online simulation environments (e.g., Moraru et al,; Weidemann et al,; Lee et al,; Peters et al, ). Moreover, having an agreed‐upon format has facilitated the introduction of better model management strategies. This includes support for tasks such as model storage and retrieval (Henkel et al, ), version control (Scharm et al, ), and checking quality and validity (Liebermeister,; Lieven et al, ). The proliferation of derived models has led to the development of methods to compare model structure and semantic annotations (Lambusch et al, ), culminating in the development of several methods to quantify model similarities (Henkel et al, ), that can then be used to improve the relevance of model searches. Once model elements can be compared, one can align, combine, and merge different models (Krause et al, ).

A broader impact of SBML as a de facto standard has been the support of publishers and funding agencies. Many journals, aware of the challenges surrounding the reproducibility of scientific results, encourage authors not only to describe their models but also to make their models available in electronic form. Molecular Systems Biology was the first supporter of submissions in SBML format (beginning in 20054, 5). Today, most journals still avoid requiring a specific format, though some such as the BMC6 and FEBS7 journals do explicitly encourage authors to submit SBML files as supporting material for research where it is relevant. Others, such as Biophysical Journal (Nickerson & Hunter, ), recommend authors deposit models in repositories such as BioModels Database, which encourages the use of common standard formats such as SBML. Many funding agencies also now have policies related to data sharing, and some program announcements suggested the use of SBML where appropriate.8

Finally, the continued development of SBML has stimulated collaborative work and the creation of consortia. This has led to better awareness and communication within groups interested in specific modeling frameworks. A good example is the CoLoMoTo effort mentioned above; it was launched by researchers who needed a format to exchange qualitative models between their software tools and developed the Qualitative Modeling package for SBML (Naldi et al, ) as the solution. Nevertheless, challenges remain, as discussed in the next section. These will need to be confronted to ensure the longevity of SBML as well as continued developments.

Forthcoming challenges

For nearly two decades, SBML has supported mathematical modeling in systems biology by helping to focus the efforts of the community and foster a culture of openness and sharing. The field is evolving rapidly, which presents challenges that the community and SBML must face.

The first challenge is to remain usable in the face of relentless growth in model sizes. One of the drivers of larger size is the rising popularity of genome‐scale metabolic models (Bordbar et al, ), which can be produced semi‐automatically (Henry et al, ). Modeling approaches have also been developed to combine the use of several such models (e.g., Bordbar et al, ). It is reasonable to expect models of ecosystems to be produced soon (microbiomes and their host). Model sizes will also increase as more models of tissues and organs are exchanged and reused, encouraged by the use of software packages that facilitate this approach, such as the open‐source tools CHASTE (Mirams et al, ) and CompuCell3D (Swat et al, ). The challenge this presents is how to define, organize, and manage large models. Meeting the challenge will require a combination of novel approaches to model storage (e.g., Henkel et al, ) and comparison (e.g., Scharm et al,,), as well as more effective use of SBML Level 3 features. For example, the SBML Hierarchical Model Composition (“comp”) package (Smith et al, ) provides a way to encode models in SBML out of separate building blocks or from preexisting models; this can make larger models easier to structure and maintain, and it is a natural way to construct multiscale models. Similarly, the Arrays package may help to define and structure larger models by allowing models to be defined in a more compact form.

A related challenge concerns human usability of SBML and similar XML‐based formats. Though SBML is intended for software, not humans, to use directly, desire for a text‐based or spreadsheet‐based equivalent is often voiced (e.g., Kirouac et al, ). Various answers have been developed in the form of text‐based notations (e.g., Gillespie et al,; Smith et al, ) and spreadsheet conventions (e.g., Lubitz et al, ), with bidirectional translators for SBML. These formats have undeniable appeal for many users and use cases, despite that they do not capture the entirety of SBML (often having limited or missing facilities to express units, annotations, or SBML packages). Their chief drawback is that they become error‐prone to use as model size increases. Graphical user interfaces (GUIs; e.g., Funahashi et al,; Hoops et al,; Moraru et al, ) can overcome this; software with GUIs can help with the cognitive burden of tracking large numbers of model elements. On the other hand, GUIs can be tedious to use when entering large models, performance of some software does not scale well with increasing model sizes, and some cannot be controlled programmatically for automation purposes. A middle ground may be domain‐specific modeling languages layered on top of programming languages such as Python (e.g., Lopez et al,; Olivier et al,. However, these tend to appeal only to users who are comfortable with (or willing to take time to learn) the programming language used as a substrate. Overall, further innovation in this area would be welcome, both to help support SBML Level 3 packages and to help users cope with ever‐increasing model sizes.

Because of the diversity of biological phenomena amenable to mathematical modeling, as well as their scales and properties, it is likely that a broad variety of modeling approaches will be added to every researcher's essential toolbox (Cvijovic et al, ). Methods such as multiagent and lattice approaches are coming into wider use to represent evolving cell populations, cell migration, and deformation. Some researchers are experimenting with solutions using existing SBML packages (Watanabe & Myers,; Varela et al, ). Modeling the development of tissues and organ function may also require combining these approaches with reaction‐diffusion models, or multiphysics approaches (Nickerson et al, ). Population modeling will need to complement traditional instance‐based systems if we want to take into account patient variability or information coming from single‐cell measurements (Levin et al, ). The coupling of different approaches within the same simulation experiment is also becoming more frequent. Biomolecular reactions modeled using ODEs, Poisson processes, and Flux Balance Analyses have been coupled in the first whole‐cell model (Karr et al, ). At the organ level, liver lobules have been modeled using a combination of metabolism and multiagent models (Schliess et al, ). Several approaches mixing modeling of cell mechanical properties and gene regulatory networks or signaling networks have been used to study morphogenesis (e.g., Tanaka et al, ). The coupling of different approaches can be done within a single hybrid model, or each model can be simulated using different software and with dynamic synchronization at run time (Mattioni & Le Novère, ). Once again, the SBML “comp” package can play a role in supporting these approaches, but other methods and software will be needed in the future, as well as better support for coupling models at run time using, for example, SED‐ML (Waltemath et al, ).

These developments are arising in a landscape where structural models are sometimes not the central object of study, and instead function as collection of integrated information. An example of this is RECON3D, a comprehensive human metabolic network with metabolite and protein structure information (Brunk et al, ). SBML will continue to have a pivotal role here too. When SBML was introduced, the state of modeling workflows and software tools was more primitive and it was natural that a model was self‐contained. SBML‐encoded models often had predefined parameter values (as initial values for state variables or parameters for mathematical expressions), but today, modelers increasingly want to use the same model with different parameterizations, sometimes with parameter values expressed as distributions, lists, or ranges rather than unique values. A project may also use an ensemble of related models that differ in parameters or in turning some model elements on or off (Kuepfer et al, ). The semantic annotation of SBML elements also has become increasingly important, forming a bedrock for many of the analyses using SBML‐encoded models. The growth in size and scope of annotations has recently led the modeling community to propose a standard way of storing annotations in separate linked files (Neal et al, ), relying on the COMBINE Archive format (Bergmann et al, ) to bundle everything together. Other formats that can complement SBML have been developed, and further coordination and evolution will undoubtedly happen in the future. As mentioned above, SED‐ML is a format that provides a way to encode what to do with a model, which complements SBML and compensates for its lack of features to define procedures. Finally, experimentation in integrating SBML more directly with other formats and data also continues. For instance, preliminary work has shown that SBML can be enriched with SBOL (Voigt et al, ) to provide models of DNA components’ behavior (Roehner & Myers, ), and conversely, ongoing work in supporting genome‐scale models of metabolism and gene expression (known as ME‐models, Thiele et al, ) augments SBML with SBOL to more fully capture models for use with ME‐modeling software. Future developments in modeling paradigms may require similar flexibility in how models are represented: some may be best served by implementing new SBML packages, others by extending existing packages, still others by combining SBML with other formats.

Besides the technical challenges, social and cultural challenges also exist for formats such as SBML. One is to continue raising awareness among researchers, software developers, and funders of the existence of SBML and related COMBINE standards. Some may not yet be using SBML simply because they are not aware of it, or its recent addition of support for many modeling formalisms (Fig 1). Raising awareness will require continual education and outreach, especially to students and early‐career scientists. Awareness would be aided by greater promotion on the part of journals and reviewers of the use of SBML and related formats in paper submission guidelines. Despite some progress in this area (discussed in the previous section), the lack of stronger demands by journals and reviewers is surely one reason authors are either not aware or not motivated to publish their models in software‐independent formats.

In addition, usability of standard formats depends crucially on their implementation in software tools, and motivating this work is another challenge for SBML. A pivotal factor for the success of SBML has been the extensive software ecosystem, which provides relatively easy import and export of SBML from popular software systems. However, implementing full SBML compatibility in software is not a simple matter, and problems with compatibility in the software ecosystem can be a significant source of frustration. Improving the software requires continuous investment in tool development.

That, in turn, is related to a final challenge: obtaining and maintaining funding. By virtue of not being a native format of any particular software tool, a format such as SBML may require extra work to define by consensus, and then again for developers to implement in software—and still, it will lag behind the leading edge of research because exchange formats only become important after more than one software system has something to exchange. Funders may wonder whether the resources, time and effort spent on standards development would not be better applied to other goals. However, these costs must be weighed against the costs to a whole research field of not having standards—and there are many such costs. To take one example, models in nonstandard formats are more difficult to review, verify, and reuse. Journal reviewers may not have access to the necessary software, or the software may not be well tested, all of which increase the chances that the published model contains errors. Researchers can spend substantial time attempting to reproduce the results, only to fail. Worse, this is a repeating cost: failures to reproduce models are rarely published or publicized, which means an untold number of researchers may spend time (and research funding) on a futile effort. Funders recognize that too many research results are irreproducible, and have urged community action (e.g., Collins & Tabak, ). The continued development of exchange formats, such as SBML, is a crucial and cost‐effective means to enable reproducible research.

Conclusion

SBML and associated software libraries and tools have been instrumental in the growth of systems biology. As modeling and simulation grew in popularity, SBML allowed researchers to exchange and (re)use new models in an open, well‐supported, interoperable format. SBML has made possible much of the research pursued by the authors of this article and also helped us to structure our thoughts about our models and the biology they represent. Today, scientists can build, manipulate, annotate, store, reuse, publish, and connect models to each other and to basic data sources. In effect, SBML has turned models into a kind of data and transformed modeling in biology from an art to an exercise in engineering.

As the field of systems biology continues to grow and address emerging challenges, SBML will grow along with it. This evolution will (as it always has) depend on close cooperation between biologists and software developers. We hope that SBML will continue to be a source of inspiration for many researchers, especially those new to the field. In return, may they help develop the next generation of SBML to support more comprehensive, richer, and more diverse models, and expand the reach of systems modeling toward entire cells, organs, and organisms.

Author contributions

SMK, DW, MK, FZ, AD, CC, and MH wrote the bulk of the manuscript. Together with FTB, AF, CSG, TH, SH, RM‐S, SLM, IIM, CJM, AN, BGO, SS, JCS, LPS, MJS, DT, LW, and DJW, they also wrote and/or edited specifications for SBML Level 3 Core and the Level 3 packages. MLB, KB, JRF, HFG, TMH, YI, WL, ALL, DL, EM, CJP, KR, NR, CAS, BES, JS, JCS, NS, NT, and JW contributed proposals for SBML Level 3 and/or are past or current members of the SBML Team. MM‐S, HMS, BP, HB, HK, AF, HH, JCD, and MH were principal investigators (or the equivalent, depending on the institution) for grants supporting SBML development.

The SBML community members listed in the Appendix supported the development of SBML Level 3 through participation in discussions, commentary on specification documents, and/or implementation of SBML‐using software.

Conflict of interest

TH has served as a shareholder and/or has consulted for Discovery Collective, Inc.

References 121

  1. 1.

    Ashburner M, Ball CA, Blake JA, Botstein D, Butler H, Cherry JM, Davis AP, Dolinski K, Dwight SS, Eppig JT et al (2000 ) Gene Ontology: tool for the unification of biology. Nat Genet 25: 25–29

    Not in our library10.1038/75556

  2. 2.

    Bergmann FT, Sauro HM (2008 ) Comparing simulation results of SBML capable simulators. Bioinformatics 24: 1963–1965

    Not in our library10.1093/bioinformatics/btn319

  3. 3.

    Bergmann FT, Adams R, Moodie S, Cooper J, Glont M, Golebiewski M, Hucka M, Laibe C, Miller AK, Nickerson DP et al (2014 ) COMBINE archive and OMEX format: one file to share all information to reproduce a modeling project. BMC Bioinformatics 15: 369

    Not in our library10.1186/s12859-014-0369-z

  4. 4.

    Bergmann FT, Keating SM, Gauges R, Sahle S, Wengler K (2018 ) SBML level 3 package: render, version 1, release 1. J Integr Bioinform 15: 20170078

    Not in our library10.1515/jib-2017-0078

  5. 5.
  6. 6.

    Bordbar A, Monk JM, King ZA, Palsson BØ (2014 ) Constraint‐based models predict metabolic and associated cellular functions. Nat Rev Genet 15: 107–120

    Not in our library10.1038/nrg3643

  7. 7.

    Bornstein BJ, Keating SM, Jouraku A, Hucka M (2008 ) LibSBML: an API library for SBML. Bioinformatics 24: 880–881

    Not in our library10.1093/bioinformatics/btn051

  8. 8.

    Boutillier P, Maasha M, Li X, Medina‐Abarca HF, Krivine J, Feret J, Cristescu I, Forbes AG, Fontana W (2018 ) The Kappa platformfor rule‐based modeling. Bioinformatics 34: i583–i592

    Not in our library10.1093/bioinformatics/bty272

  9. 9.

    Brunk E, Sahoo S, Zielinski DC, Altunkaya A, Dräger A, Mih N, Gatto F, Nilsson A, Gonzalez GAP, Aurich MK et al (2018 ) Recon3D enables a three‐dimensional view of gene variation in human metabolism. Nat Biotechnol 36: 272â˘A ¸S281

    Not in our library10.1038/nbt.4072

  10. 10.
  11. 11.
  12. 12.

    Chance B, Brainerd J, Cajori F, Millikan G (1940 ) The kinetics of the enzyme‐substrate compound of peroxidase and their relation to the Michaelis theory. Science 92: 455

    Not in our library

  13. 13.

    Chaouiya C, Naldi A, Thieffry D (2012 ) Logical Modelling of Gene Regulatory Networks with GINsim. In Bacterial Molecular Networks, van Helden J, Toussaint A, Thieffry D (eds), Vol. 804, Methods in Molecular Biology (Methods and Protocols), New York, NY: Springer.

    Not in our library10.1007/978-1-61779-361-5_23

  14. 14.
  15. 15.

    Chaouiya C, Keating SM, Berenguier D, Naldi A, Thieffry D, Le Novère N, Iersel MPV, Helikar T (2015 ) SBML level 3 package: qualitative models, version 1, release 1. J Integr Bioinform 12: 691–730

    Not in our library10.2390/biecoll-jib-2015-270

  16. 16.

    Collins FS, Tabak LA (2014 ) Policy: NIH plans to enhance reproducibility. Nature 505: 612–613

    Not in our library10.1038/505612a

  17. 17.

    Courtot M, Juty NJ, Knüpfer C, Waltemath D, Zhukova A, Dräger A, Dumontier M, Finney A, Golebiewski M, Hastings J et al (2011 ) Controlled vocabularies and semantics in systems biology. Mol Syst Biol 7: 1

    Not in our library10.1038/msb.2011.77

  18. 18.

    Cvijovic M, Almquist J, Hagmar J, Hohmann S, Kaltenbach HM, Klipp E, Krantz M, Mendes P, Nelander S, Nielsen J et al (2014 ) Bridging the gaps in systems biology. Mol Genet Genomics 289: 727–734

    Not in our library10.1007/s00438-014-0843-3

  19. 19.

    Demir E, Cary MP, Paley S, Fukuda K, Lemer C, Vastrik I, Wu G, D'Eustachio P, Schaefer C, Luciano J et al (2010 ) The BioPAX community standard for pathway data sharing. Nat Biotechnol 28: 935

    Not in our library10.1038/nbt.1666

  20. 20.

    Dräger A, Planatscher H, Wouamba DM, Schröder A, Hucka M, Endler L, Golebiewski M, Müller W, Zell A (2009 ) SBML2LATEX: conversion of SBML files into human‐readable reports. Bioinformatics 25: 1455–1456

    Not in our library10.1093/bioinformatics/btp170

  21. 21.

    Dräger A, Schröder A, Zell A (2010 ) Automating mathematical modeling of biochemical reaction networks. In Systems Biology for Signaling Networks, Choi S (ed), pp 159–205. New York, NY: Springer

    Not in our library

  22. 22.

    Dräger A, Palsson BØ (2014 ) Improving collaboration by standardization efforts in systems biology. Front Bioeng Biotechnol 2: 61

    Not in our library10.3389/fbioe.2014.00061

  23. 23.

    Ebrahim A, Almaas E, Bauer E, Bordbar A, Burgard AP, Chang RL, Dräger A, Famili I, Feist AM, Fleming RMT et al (2015 ) Do genome‐scale models need exact solvers or clearer standards? Mol Syst Biol 11: 831

    Not in our library10.15252/msb.20156157

  24. 24.
  25. 25.

    Faeder JR, Blinov ML, Hlavacek WS (2009 ) Rule‐based modeling of biochemical systems with BioNetGen. In Methods in Molecular Biology: Systems Biology, Maly IV (ed), pp 113–167. Totowa, NJ: Humana Press

    Not in our library10.1007/978-1-59745-525-1_5

  26. 26.

    Funahashi A, Tanimura N, Morohashi M, Kitano H (2003 ) Cell Designer: a process diagram editor for gene‐regulatory and biochemical networks. BIOSILICO 1: 159–162

    Not in our library

  27. 27.

    Ganter M, Bernard T, Moretti S, Stelling J, Pagni M (2013 ) MetaNetX.org: a website and repository for accessing, analysing and manipulating metabolic networks. Bioinformatics 29: 815–816

    Not in our library10.1093/bioinformatics/btt036

  28. 28.

    Garfinkel D (1969 ) Construction of biochemical computer models. FEBS Lett 2: S9–S13

    Not in our library10.1016/0014-5793(69)80070-0

  29. 29.

    Gauges R, Rost U, Sahle S, Wengler K, Bergmann FT (2015 ) The systems biology markup language (SBML) level 3 package: layout, version 1 core. J Integr Bioinform 12: 267

    Not in our library10.2390/biecoll-jib-2015-267

  30. 30.

    Gillespie DT (1977 ) Exact stochastic simulation of coupled chemical reactions. J Phy Chem 81: 2340–2361

    Not in our library

  31. 31.

    Gillespie CS, Wilkinson DJ, Proctor CJ, Shanley DP, Boys RJ, Kirkwood TBL (2006 ) Tools for the SBML community. Bioinformatics 22: 628–629

    Not in our library10.1093/bioinformatics/btk042

  32. 32.
  33. 33.

    Goddard NH, Hucka M, Howell F, Cornelis H, Shankar K, Beeman D (2001 ) Towards NeuroML: model description methods for collaborative modelling in neuroscience. Philos Trans R Soc Lond B Biol Sci 356: 12091228

    Not in our library10.1098/rstb.2001.0910

  34. 34.

    Hastings J, deMatos P, Dekker A, Ennis M, Harsha B, Kale N, Muthukrishnan V, Owen G, Turner S, Williams M et al (2013 ) The ChEBI reference database and ontology for biologically relevant chemistry: enhancements for 2013. Nucleic Acids Res 41: D456–D463

    Not in our library10.1093/nar/gks1146

  35. 35.

    Heirendt L, Arreckx S, Pfau T, Mendoza SN, Richelle A, Heinken A, Haraldsdóttir HS, Wachowiak J, Keating SM, Vlasov V et al (2019 ) Creation and analysis of biochemical constraint‐basedmodels using the COBRA toolbox vol 3.0. Nat Protoc 14: 639–702

    Not in our library10.1038/s41596-018-0098-2

  36. 36.
  37. 37.

    Henkel R, Wolkenhauer O, Waltemath D (2015 ) Combining computational models, semantic annotations and simulation experiments in a graph database. Database 2015: bau130

    Not in our library10.1093/database/bau130

  38. 38.

    Henkel R, Hoehndorf R, Kacprowski T, Knüpfer C, Liebermeister W, Waltemath D (2016 ) Notions of similarity for systems biology models. Brief Bioinform 19: 77–88

    Not in our library10.1093/bib/bbw090

  39. 39.

    Henry CS, DeJongh M, Best AA, Frybarger PM, Linsay B, Stevens RL (2010 ) High‐throughput generation, optimization and analysis of genome‐scale metabolic models. Nat Biotechnol 28: 977

    Not in our library10.1038/nbt.1672

  40. 40.

    Hlavacek WS, Faeder JR, Blinov ML, Perelson AS, Goldstein B (2003 ) The complexity of complexes in signal transduction. Biotechnol Bioeng 84: 783–794

    Not in our library10.1002/bit.10842

  41. 41.

    Hodgkin AL, Huxley AF (1952 ) A quantitative description of membrane current and its application to conduction and excitation in nerve. J Physiol 117: 500–544

    Not in our library10.1113/jphysiol.1952.sp004764

  42. 42.

    Hoops S, Sahle S, Gauges R, Lee C, Pahle J, Simus N, Singhal M, Xu L, Mendes P, Kummer U (2006 ) COPASI – a complex pathway simulator. Bioinformatics 22: 3067–3074

    Not in our library10.1093/bioinformatics/btl485

  43. 43.

    Hucka M, Sauro HM, Finney A, Bolouri H, Doyle J, Kitano H (2001 ) The ERATO systems biology work bench: an integrated environment for multiscale and multitheoretic simulations in systems biology. In Foundations of Systems Biology, Kitano H (ed), pp 125–143. Cambridge, MA: MIT Press

    Not in our library

  44. 44.

    Hucka M, Finney A, Sauro HM, Bolouri H, Doyle JC, Kitano H, Arkin AP, Bornstein BJ, Bray D, Cornish‐Bowden A et al (2003 ) The systems biology markup language (SBML): a medium for representation and exchange of biochemical network models. Bioinformatics 19: 524–531

    Not in our library10.1093/bioinformatics/btg015

  45. 45.

    Hucka M, Bergmann FT, Hoops S, Keating SM, Sahle S, Schaff JC, Smith L, Wilkinson DJ (2010 ) The systems biology markup language (SBML): language specification for level 3 version 1 core. Nature Preced https://www.nature.com/articles/npre.2010.4959.1

    Not in our library10.2390/biecoll-jib-2015-266

  46. 46.

    Hucka M, Nickerson DP, Bader GD, Bergmann FT, Cooper J, Demir E, Garny A, Golebiewski M, Myers CJ, Schreiber F et al (2015 ) Promoting coordinated development of community‐based information standards for modeling in biology: the COMBINE Initiative. Front Bioeng Biotechnol 3: 19.

    Not in our library10.3389/fbioe.2015.00019

  47. 47.

    Hucka M, Smith LP (2016 ) SBML level 3 package: groups, version 1 release 1. J Integr Bioinform 13: 8–29

    Not in our library10.2390/biecoll-jib-2016-290

  48. 48.

    Hucka M, Bergmann FT, Chaouiya C, Dräger A, Hoops S, Keating SM, König M, Novère NL, Myers CJ, Olivier BG et al (2019 ) The systems biology markup language (SBML): language specification for level 3 version 2 core release 2. J Integr Bioinform 16: 20190021

    Not in our library10.1515/jib-2019-0021

  49. 49.

    Ideker T, Galitski T, Hood L (2001 ) A new approach to decoding life: systems biology. Annu Rev Genomics Hum Genet 2: 343–372

    Not in our library10.1146/annurev.genom.2.1.343

  50. 50.

    van Iersel MP, Villéger AC, Czauderna T, Boyd SE, Bergmann FT, Luna A, Demir E, Sorokin A, Dogrusoz U, Matsuoka Y et al (2012 ) Software support for SBGN maps: SBGN‐ML and LibSBGN. Bioinformatics 28: 2016–2021

    Not in our library10.1093/bioinformatics/bts270

  51. 51.

    Kacser H (1957 ) Some physico‐chemical aspects of biological organisation. In The Strategy of the Genes: A Discussion of Some Aspects of Theoretical Biology, Waddington CH (ed), pp 191–249. London: George Allen & Unwin Ltd

    Not in our library

  52. 52.

    Karr JR, Takahashi K, Funahashi A (2015 ) The principles of whole‐cell modeling. Curr Opin Microbiol 27: 18–24

    Not in our library10.1016/j.mib.2015.06.004

  53. 53.

    Kell DB, Mendes P (2008 ) The markup is the model: reasoning about systems biology models in the Semantic Web era. J Theor Biol 252: 538–543

    Not in our library10.1016/j.jtbi.2007.10.023

  54. 54.

    Kirouac DC, Cicali B, Schmidt S (2019 ) Reproducibility of quantitative systems pharmacology models: current challenges and future opportunities. CPT Pharmacometrics Syst Pharmacol 8: 205–210

    Not in our library10.1002/psp4.12390

  55. 55.

    Kitano H (2000 ) Perspectives on systems biology. New Generat Comput 18: 199–216

    Not in our library

  56. 56.

    Klipp E, Liebermeister W, Helbig A, Kowald A, Schaber J (2007 ) Systems biology standards—the community speaks. Nat Biotechnol 25: 390–391

    Not in our library10.1038/nbt0407-390

  57. 57.

    Krause F, Uhlendorf J, Lubitz T, Schulz M, Klipp E, Liebermeister W (2010 ) Annotation and merging of SBML models with semantic SBML. Bioinformatics 26: 421–422

    Not in our library10.1093/bioinformatics/btp642

  58. 58.

    Kuepfer L, Peter M, Sauer U, Stelling J (2007 ) Ensemble modeling for analysis of cell signaling dynamics. Nat Biotechnol 25: 1001

    Not in our library10.1038/nbt1330

  59. 59.

    Lambusch F, Waltemath D, Wolkenhauer O, Sandkuhl K, Rosenke C, Henkel R (2018 ) Identifying frequent patterns in biochemical reaction networks: a workflow. Database 2018

    Not in our library10.1093/database/bay051

  60. 60.

    Le Novère N, Finney A, Hucka M, Bhalla US, Campagne F, Collado‐Vides J, Crampin EJ, Halstead M, Klipp E, Mendes P et al (2005 ) Minimum information requested in the annotation of biochemicalmodels (MIRIAM). Nat Biotechnol 23: 1509–1515

    Not in our library10.1038/nbt1156

  61. 61.

    Lee DY, Saha R, KhanYusufi FN, Park W, Karimi IA (2009 ) Web‐based applications for building, managing and analysing kineticmodels of biological systems. Brief Bioinform 10: 65–74

    Not in our library10.1093/bib/bbn039

  62. 62.

    Levin SA, Grenfell B, Hastings A, Perelson AS (1997 ) Mathematical and computational challenges in population biology and ecosystems science. Science 275: 334–343

    Not in our library10.1126/science.275.5298.334

  63. 63.

    Li P, Dada JO, Jameson D, Spasic I, Swainston N, Carroll K, Dunn W, Khan F, Malys N, Messiha HL et al (2010 ) Systematic integration of experimental data and models in systems biology. BMC Bioinformatics 11: 582

    Not in our library10.1186/1471-2105-11-582

  64. 64.

    Liebermeister W (2008 ) Validity and combination of biochemical models. In Proceedings of 3rd International ESCECWorkshop on Experimental Standard Conditions on Enzyme Characterizations, Kettner C, Hicks MG (eds), pp 24. Frankfurt: Beilstein‐Institut

    Not in our library

  65. 65.

    Lieven C, Beber ME, Olivier BG, Bergmann FT, Ataman M, Babaei P, Bartell JA, Blank LM, Chauhan S, Correia K et al (2020 ) MEMOTE for standardized genome‐scale metabolic model testing. Nat Biotechnol 38: 272–276

    Not in our library10.1038/s41587-020-0446-y

  66. 66.

    Lloyd CM, Halstead MDB, Nielsen PF (2004 ) CellML: its future, present and past. Prog Biophys Mol Biol 85: 433–450

    Not in our library10.1016/j.pbiomolbio.2004.01.004

  67. 67.

    Lopez CF, Muhlich JL, Bachman JA, Sorger PK (2013 ) Programming biological models in python using PySB. Mol Syst Biol 9: 646

    Not in our library10.1038/msb.2013.1

  68. 68.

    Lubitz T, Hahn J, Bergmann FT, Noor E, Klipp E, Liebermeister W (2016 ) SBtab: a flexible table format for data exchange in systems biology. Bioinformatics 32: 2559–2561

    Not in our library10.1093/bioinformatics/btw179

  69. 69.

    Machado D, Costa RS, Rocha M, Ferreira EC, Tidor B, Rocha I (2011 ) Modeling formalisms in systems biology. AMB Express 1: 45

    Not in our library10.1186/2191-0855-1-45

  70. 70.
  71. 71.

    Mattioni M, Le Novère N (2013 ) Integration of biochemical and electrical signaling‐multiscale model of the medium spiny neuron of the striatum. PLoS ONE 8: e66811

    Not in our library10.1371/journal.pone.0066811

  72. 72.

    Medley JK, Choi K, König M, Smith L, Gu S, Hellerstein J, Sealfon SC, Sauro HM (2018 ) Tellurium notebooks–An environment for reproducible dynamical modeling in systems biology. PLoS Comput Biol 14: e1006220

    Not in our library10.1371/journal.pcbi.1006220

  73. 73.

    Mi H, Huang X, Muruganujan A, Tang H, Mills C, Kang D, Thomas PD (2016 ) PANTHER version 11: expanded annotation data from Gene Ontology and Reactome pathways, and data analysis tool enhancements. Nucleic Acids Res 45: D183–D189

    Not in our library10.1093/nar/gkw1138

  74. 74.
  75. 75.

    Misirli G, Hallinan J, Wipat A (2014 ) Composable modular models for synthetic biology. ACM J Emerg Technol Comput Syst 11: 22

    Not in our library

  76. 76.
  77. 77.

    Moraru II, Morgan F, Li Y, Loew LM, Schaff JC, Lakshminarayana A, Slepchenko BM, Gao F, Blinov ML (2008 ) Virtual Cell modelling and simulation software environment. IET Syst Biol 2: 352–362

    Not in our library10.1049/iet-syb:20080102

  78. 78.

    Naldi A, Monteiro PT, Müssel C, Consortium for Logical Models and Tools, Kestler HA, Thieffry D, Xenarios I, Saez‐Rodriguez J, Helikar T, Chaouiya C (2015 ) Cooperative development of logical modelling standards and tools with CoLoMoTo. Bioinformatics 31: 1154–1159

    Not in our library10.1093/bioinformatics/btv013

  79. 79.

    Neal ML, König M, Nickerson D, Mısırlı G, Kalbasi R, Dräger A, Atalag K, Chelliah V, Cooling MT, Cook DL et al (2019 ) Harmonizing semantic annotations for computational models in biology. Brief Bioinform 20: 540–550

    Not in our library10.1093/bib/bby087

  80. 80.

    Nickerson D, Atalag K, de Bono B, Geiger J, Goble C, Hollmann S, Lonien J, Müller W, Regierer B, Stanford NJ et al (2016 ) The Human Physiome: how standards, software and innovative service infrastructures are providing the building blocks to make it achievable. Interface Focus 6: 20150103

    Not in our library10.1098/rsfs.2015.0103

  81. 81.

    Nickerson DP, Hunter PJ (2017 ) Introducing the physiome journal: improving reproducibility, reuse, and discovery of computational models. In 2017 IEEE 13th International Conference on e‐Science (e‐Science), Auckland. 2017: 448–449

    Not in our library10.1109/escience.2017.65

  82. 82.
  83. 83.

    O'Brien EJ, Monk JM, Palsson BØ (2015 ) Using genome‐scale models to predict biological capabilities. Cell 161: 971–987

    Not in our library10.1016/j.cell.2015.05.019

  84. 84.

    Olivier BG, Rohwer JM, Hofmeyr JHS (2005 ) Modelling cellular systems with PySCeS. Bioinformatics 21: 560–561

    Not in our library10.1093/bioinformatics/bti046

  85. 85.

    Olivier BG, Bergmann FT (2018 ) SBML level 3 package: flux balance constraints version 2. J Integr Bioinform 15: 20170082

    Not in our library10.1515/jib-2017-0082

  86. 86.

    Palmisano A, Hoops S, Watson LT, Jones TC Jr, Tyson JJ, Shaffer CA (2014 ) Multistate Model Builder (MSMB): a flexible editor for compact biochemical models. BMC Syst Biol 8: 42

    Not in our library10.1186/1752-0509-8-42

  87. 87.

    Peters M, Eicher JJ, van Niekerk DD, Waltemath D, Snoep JL (2017 ) The JWS online simulation database. Bioinformatics 33: 1589–1590

    Not in our library10.1093/bioinformatics/btw831

  88. 88.

    Ravikrishnan A, Raman K (2015 ) Critical assessment of genome‐scale metabolic networks: the need for a unified standard. Brief Bioinform 16: 1057–1068

    Not in our library10.1093/bib/bbv003

  89. 89.

    Roehner N, Myers CJ (2014 ) A methodology to annotate systems biology markup language models with the synthetic biology open language. ACS Synth Biol 3: 57–66

    Not in our library10.1021/sb400066m

  90. 90.

    Rodriguez N, Thomas A, Watanabe L, Vazirabad IY, Kofia V, Gómez HF, Mittag F, Matthes J, Rudolph JD, Wrzodek F et al (2015 ) JSBML 1.0: providing a smorgasbord of options to encode systems biology models. Bioinformatics 31: 3383–3386

    Not in our library10.1093/bioinformatics/btv341

  91. 91.

    Roehner N, Beal J, Clancy K, Bartley B, Misirli G, Grünberg R, Oberortner E, Pocock M, Bissell M, Madsen C et al (2016 ) Sharing structure and function in biological design with SBOL 2.0. ACS Synth Biol 5: 498–506

    Not in our library10.1021/acssynbio.5b00215

  92. 92.

    Rodriguez N, Pettit JB, Dalle Pezze P, Li L, Henry A, van Iersel MP, Jalowicki G, Kutmon M, Natarajan KN, Tolnay D et al (2016 ) The systems biology format converter. BMC Bioinformatics 17: 154

    Not in our library10.1186/s12859-016-1000-2

  93. 93.
  94. 94.

    Scharm M, Waltemath D, Mendes P, Wolkenhauer O (2016a ) COMODI: an ontology to characterise differences in versions of computational models in biology. J Biomed Semantics 7: 46

    Not in our library10.1186/s13326-016-0080-2

  95. 95.

    Scharm M, Wolkenhauer O, Waltemath D (2016b ) An algorithm to detect and communicate the differences in computational models describing biological systems. Bioinformatics 32: 563–570

    Not in our library10.1093/bioinformatics/btv484

  96. 96.

    Schliess F, Hoehme S, Henkel SG, Ghallab A, Driesch D, Böttger J, Guthke R, Pfaff M, Hengstler JG, Gebhardt R et al (2014 ) Integrated metabolic spatial‐temporal model for the prediction of ammonia detoxification during liver damage and regeneration. Hepatology 60: 2040–2051

    Not in our library10.1002/hep.27136

  97. 97.
  98. 98.

    Smith LP, Bergmann FT, Chandran D, Sauro HM (2009 ) Antimony: a modular model definition language. Bioinformatics 25: 2452–2454

    Not in our library10.1093/bioinformatics/btp401

  99. 99.

    Smith LP, Hucka M, Hoops S, Finney A, Ginkel M, Myers CJ, Moraru I, Liebermeister W (2015 ) SBML level 3 package: hierarchical model composition, version 1 release 3. J Integr Bioinform 12: 268

    Not in our library10.2390/biecoll-jib-2015-268

  100. 100.

    Stanford NJ, Wolstencroft K, Golebiewski M, Kania R, Juty N, Tomlinson C, Owen S, Butcher S, Hermjakob H, Le Novère N et al (2015 ) The evolution of standards and data management practices in systems biology. Mol Syst Biol 11: 851

    Not in our library10.15252/msb.20156053

  101. 101.

    Swat MH, Thomas GL, Belmonte JM, Shirinifard A, Hmeljak D, Glazier JA (2012 ) Multi‐scale modeling of tissues using CompuCell3D. In Methods in Cell Biology, Volume 110, pp. 325–366. Amsterdam: Elsevier

    Not in our library10.1016/b978-0-12-388403-9.00013-8

  102. 102.

    Tanaka S, Sichau D, Iber D (2015 ) LBIBCell: a cell‐based simulation environment for morphogenetic problems. Bioinformatics 31: 2340–2347

    Not in our library10.1093/bioinformatics/btv147

  103. 103.
  104. 104.
  105. 105.
  106. 106.
  107. 107.

    Uhlen M, Zhang C, Lee S, Sjöstedt E, Fagerberg L, Bidkhori G, Benfeitas R, Arif M, Liu Z, Edfors F et al (2017 ) A pathology atlas of the human cancer transcriptome. Science 357: eaan2507

    Not in our library10.1126/science.aan2507

  108. 108.

    Varela PL, Ramos CV, Monteiro PT, Chaouiya C (2019 ) EpiLog: a software for the logical modelling of epithelial dynamics [version 2; peer review3 approved]. F1000Research 7: 1145

    Not in our library10.12688/f1000research.15613.1

  109. 109.

    Voigt MA, Dräger A, Lloyd C, King ZA, Yang L (2018 ) draeger‐lab/SBMLme: SBMLme converter (Version 0.0.6). Available from Zenodo at

    Not in our library10.5281/zenodo.1238905

  110. 110.

    Von Bertalanffy L (1950 ) An outline of general system theory. Br J Philos Sci 1: 134–165

    Not in our library

  111. 111.
  112. 112.

    Waltemath D, Bergmann FT, Chaouiya C, Czauderna T, Gleeson P, Goble C, Golebiewski M, Hucka M, Juty N, Krebs O et al (2014 ) Meeting report from the fourth meeting of the Computational Modeling in Biology Network (COMBINE). Stand Genomic Sci 9: 1285–1301

    Not in our library10.1186/s40793-018-0320-4

  113. 113.

    Waltemath D, Wolkenhauer O (2016 ) How modeling standards, software, and initiatives support reproducibility in systems biology and systems medicine. IEEE Trans Biomed Eng 63: 1999–2006

    Not in our library10.1109/tbme.2016.2555481

  114. 114.
  115. 115.

    Watanabe LH, Myers CJ (2016 ) Efficient analysis of systems biologymarkup language models of cellular populations using arrays. ACS Synth Biol 5: 835–841

    Not in our library10.1021/acssynbio.5b00242

  116. 116.

    Watanabe LH, König M, Myers CJ (2018 ) Dynamic Flux Balance AnalysisModels in SBML. bioRxiv 245076.

    Not in our library10.1101/245076

  117. 117.

    Weidemann A, Richter S, Stein M, Sahle S, Gauges R, Gabdoulline R, Surovtsova I, Semmelrock N, Besson B, Rojas I et al (2008 ) SYCAMORE—a systems biology computational analysis and modeling research environment. Bioinformatics 24: 1463–1464

    Not in our library10.1093/bioinformatics/btn207

  118. 118.

    Wittig U, Rey M, Weidemann A, Kania R, Müller W (2017 ) SABIO‐RK: an updated resource for manually curated biochemical reaction kinetics. Nucleic Acids Res 46: D656–D660

    Not in our library10.1093/nar/gkx1065

  119. 119.

    Wolstencroft K, Krebs O, Snoep JL, Stanford NJ, Bacall F, Golebiewski M, Kuzyakiv R, Nguyen Q, Owen S, Soiland‐Reyes S et al (2016 ) FAIRDOMHub: a repository and collaboration environment for sharing systems biology research. Nucleic Acids Res 45: D404–D407

    Not in our library10.1093/nar/gkw1032

  120. 120.

    Zhang F, Angermann BR, Meier‐Schellersheim M (2013 ) The Simmune Modeler visual interface for creating signaling networks based on bi‐molecular interactions. Bioinformatics 29: 1229–1230

    Not in our library10.1093/bioinformatics/btt134

  121. 121.

Cited by papers we hold 4

Reads

Read by people on this page

None yet.

Checked or read by AI through naulon

None yet.

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.

Are you an author?

Is this your paper?

Claim it to add your note and be paid when agents cite it. Free.