No retraction, correction or concern found when last checked on Oct 23, 2026.
A Resource Allocation Trade-Off between Virulence and Proliferation Drives Metabolic Versatility in the Plant Pathogen Ralstonia solanacearum
Rémi Peyraud, Ludovic Cottret, Lucas Marmiesse and 2 more
PLOS Pathogens · 2016 · CC BY
doi:10.1371/journal.ppat.1005939
Abstract
Bacterial pathogenicity relies on a proficient metabolism and there is increasing evidence that metabolic adaptation to exploit host resources is a key property of infectious organisms. In many cases, colonization by the pathogen also implies an intensive multiplication and the necessity to produce a large array of virulence factors, which may represent a significant cost for the pathogen. We describe here the existence of a resource allocation trade-off mechanism in the plant pathogen R. solanacearum. We generated a genome-scale reconstruction of the metabolic network of R. solanacearum, together with a macromolecule network module accounting for the production and secretion of hundreds of virulence determinants. By using a combination of constraint-based modeling and metabolic flux analyses, we quantified the metabolic cost for production of exopolysaccharides, which are critical for disease symptom production, and other virulence factors. We demonstrated that this trade-off between virulence factor production and bacterial proliferation is controlled by the quorum-sensing-dependent regulatory protein PhcA. A phcA mutant is avirulent but has a better growth rate than the wild-type strain. Moreover, a phcA mutant has an expanded metabolic versatility, being able to metabolize 17 substrates more than the wild-type. Model predictions indicate that metabolic pathways are optimally oriented towards proliferation in a phcA mutant and we show that this enhanced metabolic versatility in phcA mutants is to a large extent a consequence of not paying the cost for virulence. This analysis allowed identifying candidate metabolic substrates having a substantial impact on bacterial growth during infection. Interestingly, the substrates supporting well both production of virulence factors and growth are those found in higher amount within the plant host. These findings also provide an explanatory basis to the well-known emergence of avirulent variants in R. solanacearum populations in planta or in stressful environments.
Full text
From PubMed Central, U.S. National Library of Medicine, as current on Oct 23, 2026. Paragraph numbers are ours, so an answer can point at one.
Introduction
Studies in a number of bacterial pathogens in recent years have made it increasingly clear that the ability to assimilate nutrients in the course of host infection is crucial for pathogenesis. Pathogens are known to specifically employ amino acid and sugar transporters to gain access to nutrients and may subvert the host cell metabolism to re-orientate metabolic fluxes for its own purpose. Consequently, the term of ‘nutritional virulence’ has emerged to describe the increasing evidence that, in addition to metabolic adaptation, specific virulence mechanisms enable pathogens to exploit host resources.
Metabolic potential (i.e versatility) is considered a critical element governing a pathogen’s virulence as well as its ability to survive in its host. Beyond the necessity to collect resources within their host, pathogens face a resource allocation dilemma. In one hand they have to use nutritional resources to proliferate inside the host, and in the other hand they need to mobilize matter and energy for the production of essential virulence factors. Indeed, production and secretion of virulence factors are key steps of many infectious strategies to overcome the host immune system, subvert the host metabolism, and/or kill the host and succeed in transmission. The resource allocation trade-off is well documented in bacteria: it has been shown for example to occur in the survival / multiplication balance under stress conditions and there is evidence that bacterial growth strategies are the result of trade-offs in the economy of the cell. However, this aspect has been poorly studied in the case of pathogens which have to simultaneously acquire nutrients, multiply and produce costly virulence factors in a stressful host environment. Although it is logical to presume that many pathogens experience a resource allocation trade-off to maintain both the proliferation (growth) and the virulence factor production traits during infection, the quantification of the cost for virulence is not documented.
The present study was aimed at understanding how bacterial metabolism supports simultaneously the burden of proliferation and the production of a broad array of virulence factors in the plant pathogen Ralstonia solanacearum. R. solanacearum strains belong to the beta class of Proteobacteria and collectively represent one of the most destructive plant pathogens worldwide due to their unusual wide range of host plants, long persistence in soil and water environments and their broad geographical distribution. Cytological studies have shown that the bacterium invades plants through root wounds and rapidly colonizes the xylem vessels, where it multiplies extensively and produces large amounts of exopolysaccharide (EPS). EPS accumulation in the vascular system and the ensuing collapse of the water flow causes the wilting symptoms and eventually plant death. Expression of virulence factors in R. solanacearum is controlled by a sophisticated, multicomponent regulatory network that responds to environmental conditions, the sensing of host cells, and bacterial density. More than 20 genes encoding transcriptional regulators, transmembrane sensors or signaling components have been described to control many virulence determinants such as EPS production, plant cell wall degrading enzymes, phytohormones or the Type III secretion system, and virulence-associated functions such as twitching or swarming motility. Much has been learned about how this virulence network functions in culture, but we still have few insights on the coordinated processes that occur during pathogenesis.
In this study, we used a genome-scale level approach to identify how the allocation of nutritional resource is orchestrated at the molecular level in the context of plant infection when virulence factors are abundantly produced. We conducted a genome-scale reconstruction of the metabolic network of R. solanacearum, together with a macromolecule network module, including many secreted virulence determinants, which could be used for constraint-based modeling. By coupling modeling and experimental approaches, we provide evidence of a trade-off between the expression of growth-supporting pathways and virulence factors. This trade-off mechanism is controlled by the regulatory protein PhcA in a quorum-sensing depending fashion. By using metabolic flux analysis, we show that the cost for virulence factor production in R. solanacearum strongly impacts bacterial growth and can restrict the metabolic versatility of the pathogen in specific environmental conditions.
Reconstruction of the genome-scale metabolic network and a macromolecule network involved in R. solanacearum virulence
We generated a metabolic reconstruction consisting of the chemical reactions that transport and interconvert metabolites in R. solanacearum strain GMI1000. This network reconstruction was achieved through the development of a bioinformatic pipeline (see Material and Methods and S1 Material for details) based on the functional annotation of the genome, literature and database searches, and a manual curation protocol. The reconstructed genome-scale metabolic network of strain GMI1000 encompasses 1825 biochemical reactions as well as 280 exchange reactions with the environment linking 1203 unique metabolites localized in three distinct compartments (cytoplasm, periplasm, extracellular). The gene to protein to reaction (GPR) association network, which describes the logical relationship between the genes and the catalyzed chemical reaction, includes 1206 open reading frames. The general features of the metabolic reconstruction are displayed in Fig 1. The full list of genes, metabolites, reactions and GPRs in the metabolic network can be found in S1 Table. The cell biomass composition was both determined experimentally and collected from bibliography (S2 Table).
We added to this reconstructed metabolic network a large subset of reactions involved in biosynthesis, activation and secretion of macromolecules, based on a large body of experimental data. Most of these secreted macromolecules are well-known extracellular virulence factors such as plant cell wall-degrading enzymes, extracellular polysaccharides or pathogenicity effector proteins, see Fig 2. This macromolecule module, thereafter called macromolecule network, encompasses 365 biochemical and transport reactions, in addition to 174 exchange reactions with the environment (Fig 1). Among biochemical reactions, 135 correspond to macromolecule biosynthesis reactions and 165 are specifically devoted to secretion processes (Fig 1, S1 Table). Because biosynthesis of macromolecule consumes substrates present within the metabolic network, the macromolecule network and the metabolic network were grouped in a global biochemical reaction network called iRP1476. In total, 109 bibliographic references support the presence of biochemical reactions in the biochemical model (S1 Table). The global model was converted into Systems Biology Markup Language (SBML) format suitable for constraint-based computing. It is available from S2 Material or can be downloaded on the website: http://lipm-bioinfo.toulouse.inra.fr/systemsbiology/models/rsolanacearum.
Prediction and validation of metabolic phenotypes
In order to evaluate the performance of the biochemical reaction module in predicting the metabolic versatility of R. solanacearum, we first determined experimentally the global metabolic capacities of strain GMI1000 using Biolog phenotype microarrays (see Material and Methods). We tested 864 environmental conditions with various Carbon, Nitrogen, Phosphorus and Sulfur sources. This included 190 carbon substrates, and 24 of them were also tested for promoting growth when supplemented to a minimal medium (S1 Fig, S3 Table). The results revealed the usage of 36 carbon substrates by R. solanacearum (Fig 3A, S3 Table). Dipeptides and nucleotides were neither significantly used as carbon substrates nor as nitrogen sources. Results from phenotype microarray assay were then compared to the model predictions using Flux Balance Analysis (FBA) which calculates the feasibility of cell growth under the different environmental constraints (see Material and Methods). The accuracy of the model prediction was 91.3% over 576 phenotypes, covering 91.4% of the substrates used by strain GMI1000 (Fig 3B). However, 40% of all substrates predicted to be used by the model were not validated in the tested experimental conditions. A similar discrepancy was observed when comparing the results anticipated from the biochemical reaction network with the in vitro growth experiments (81.8% of precision). Hence, some metabolites appeared to be not used by strain GMI1000 although the corresponding transporters and the catabolic pathways were predicted to be present from the genome annotation. This observation was suggestive of a potential catabolite repression operating under the conditions tested.
Evidence for a trade-off between bacterial growth and EPS production
To validate the reconstructed model quantitatively, we compared the maximal growth rate predicted using FBA with experimental data. For this purpose, we monitored the rate of L-glutamate consumption (Fig 4A) and release of compounds in the medium by 1H nuclear magnetic resonance or release of macromolecule using biochemical assays. The kinetics of molecule secretion in the supernatant of cell cultures in minimal medium are shown in Fig 4B and detailed in S4 Table: we found the polyamine putrescine to be strongly produced (S2 Fig), as well as EPS and proteins. The predicted maximal growth rate of the wild-type strain (0.439 h-1) was found to be 57% higher than the experimentally measured value (0.280 h-1 ± 0.017, 2*σ) based on the amount of consumed L-glutamate (S4 Table). We therefore reasoned that this observed lower growth rate could be due to the metabolic cost for the secretion of virulence factors which adds up to the biosynthesis cost already included in the FBA analysis (Fig 4C). We first investigated the cost for EPS production because EPS is known to be abundantly produced by R. solanacearum in planta when bacteria reach high cell density. Simulations performed through FBA revealed that the expected gain of growth rate of an EPS-defective mutant was 0.012 h-1, which is only 4.2% higher than the wild-type strain (0.280 h-1). However, a more important difference was observed experimentally: we created a Δeps mutant impaired for EPS production and found that at high cell density (i.e above 107 cells/ml) in minimal medium, this eps mutant had a growth rate significantly higher (22% ± 6 CI(95%)) than the wild-type (Fig 4D). The difference between the predicted cost for EPS biosynthesis and the global cost experimentally measured could be attributed to the energetic cost of EPS secretion. This cost was estimated to be around 8,5 mmol(ATPeq)·g-1·h-1 in ATP equivalent. It cannot be excluded that this estimation includes additional indirect cost for EPS production in addition to its secretion. These results indicated that EPS biosynthesis and its secretion in the environment already represent a significant cost for the pathogen which has a clear impact on bacterial growth.
A phcA regulatory mutant has an optimal growth rate, higher than the wild-type strain at high-cell density
The ‘cost for virulence’ hypothesis was further assessed by monitoring the growth rate of the phcA and xpsR regulatory mutants. xpsR encodes a regulator acting as a downstream cascade component required for activation of EPS biosynthesis. phcA encodes a global phenotypic switch regulator under the control of a specific quorum sensing system. PhcA is known to indirectly regulate the production of many virulence factors including EPS via xpsR, plant cell wall degrading enzymes and the type III secretion system. At high cell density, the maximal growth rate of the xpsR mutant was significantly higher than the one of the wild-type strain (47% ± 8 CI(95%)) and the eps mutant (20% ± 6 CI(95%)), see Fig 5A. An even sharper increase was observed with the phcA mutant since its measured maximal growth rate was 198% ± 15 CI(95%) higher than the wild-type. Accordingly, competition experiments conducted in complete medium using an initial 1:1 ratio of the wild-type strain and the phcA mutant revealed that after only four hours the fitness of the phcA mutant was significantly higher than the wild-type (S3 Fig).
We then performed FBA with the phcA mutant grown in minimal medium to determine if the spectacular increased growth rate of this strain was due to an increased substrate consumption rate or to a rerouting of the metabolic fluxes from virulence factor production toward growth. We monitored a similar consumption rate of L-glutamate for the phcA mutant (7.68 mmol·g-1·h-1 ± 0.85 2σ) compared to the wild-type strain (7.25 mM·g-1·h-1 ± 1.71 2σ) (p-value 0.57). Based on the rate of L-glutamate usage and measured exchange fluxes, the optimal growth rate of the phcA mutant was calculated to be 0.435 h-1, and found to be close (only 6% deviation) from the measured growth rate, 0.46 h-1 ± 0.01 (2*σ) (Fig 5B). This good match between the predicted and observed growth rate further supported the view that the phcA mutant had optimal metabolic capacities to sustain growth due to the absence of a cost for virulence factor production/secretion, contrary to the wild-type.
Finally, we inferred from the metabolic flux analysis of the wild-type strain the overall cost of virulence factor production dependent on PhcA. To do so, we optimized an ATP hydrolyzing flux using FBA by setting the biomass production and the L-glutamate consumption rates determined for the wild-type. We found that the cost (in ATP equivalent) for the production of virulence factors controlled by PhcA corresponds to the significant amount of 38.9 mmol(ATP)·g-1·h-1. This amount of energy is indeed comparable to the amount of ATP (34.10 mmol·g-1·h-1) generated to supply biomass biosynthesis in the phcA mutant.
The rerouting of metabolic resources from proliferation toward virulence factor production is quorum-sensing dependent
The metabolic activity of the phcA mutant appeared to be focused toward proliferation with a specific usage of resources to sustain optimal growth. Because the activation of PhcA is under the control of a quorum-sensing system, we hypothesized that the wild-type strain should have a similar optimal growth rate at low cell-density (i.e when PhcA is inactive, as in the phcA mutant). Therefore, we monitored the growth kinetics of the wild-type and the eps, xpsR and phcA mutant strains from low cell-density to high-cell density (Fig 6). The measured growth rate for the phcA strain at low cell density was in the same range than at high cell density. However, the growth rate of the wild-type strain at low cell density was similar to that of the phcA mutant at high cell density (p value = 0.28), thus confirming that the cost for the production of virulence factors which reduces the growth rate of the wild-type strain at high cell density is relieved at low cell density.
R. solanacearum metabolic versatility is restricted at high cell density and is under the control of PhcA
The FBA performed above used L-glutamate as sole carbon source. L-glutamate is abundant in the xylem and apoplasm of the tomato host and supports a strong growth of the bacteria in minimal medium. However, if a substrate does not support a strong proliferation rate due to a low efficiency of the corresponding catabolic pathways or a low substrate uptake rate, the cost for virulence factor production might impair bacterial proliferation. We defined a ‘substrate usage capacity’ value that corresponds to the quantification of a phenotypic trait (such as proliferation or virulence) that the bacterial cell produces from a given substrate upon a period of time (for details see S3 Material). Model simulation then showed that below a certain threshold of substrate usage capacity, the expression of virulence functions prevents bacterial proliferation (S4 Fig). This suggested that the trade-off relationship between these two traits is strongly dependent on the nature of the resources collected in the environment.
In order to explore whether the proliferation is impacted by virulence factors production upon usage of various nutritional resources, we determined the metabolic profile of the phcA mutant and two other strains defective for major virulence transcription factors (hrpB and hrpG). hrpB encodes the downstream regulator of the Type III secretion system and dependent substrates, and hrpG encodes a plant signal-responsive coordinator of multiple pathogenicity functions. Microarray phenotyping revealed that the metabolic profile of the hrpB and hrpG mutants was similar to those of the wild-type strain whereas the phcA mutant displayed remarkable expanded versatility (Fig 7A and S5 Fig, S5 Table). Indeed, the phcA mutant possessed a wider substrate usage than the wild-type strain, being able to catabolize 17 additional substrates to sustain proliferation. For example, L-proline, myo-inositol and L-serine were significantly used as carbon substrates only by the phcA mutant strain (p-value 4.0e-6, 2.7e-5, and 5.0e-5, respectively). Comparison of the versatility predicted by the biochemical reaction network and the versatility experimentally observed using the phcA mutant indicated a high accuracy of the model prediction (Fig 7B). Indeed, the precision increased from 57% with the wild-type strain to 89% with the phcA mutant.
To confirm the effect of the phcA mutation on metabolic versatility observed using substrate microarrays, we monitored bacterial growth of the hrpB, hrpG and phcA mutants in minimal medium supplemented with five substrates found to be differentially metabolized (p-value<0.01). Results shown on Fig 7C indicate that the phcA mutant had a significantly enhanced growth rates (p-value<0.01) on these five carbon substrates, indicating that not only usage of additional substrates but also quantitative increase of the usage of several substrates is dependent upon PhcA. Altogether these observations confirmed that the metabolic network is optimally oriented toward proliferation in the phcA mutant.
Flux balance analysis identifies the critical substrate usage capacity threshold required for R. solanacearum fitness
In order to determine if the observed reduced versatility was dependent on the metabolic cost of virulence factor production, we performed a FBA through the reconstructed genome-scale model. Previous FBA results indicated that the phcA mutant and the wild-type strain had a similar substrate uptake rate in presence of L-glutamate, a substrate which supports growth of both strains. We therefore estimated the minimal consumption rate of various substrates supporting the growth of the phcA mutant (such as L-serine, L-proline, L-threonine, sucrose, D-fructose, D-glucose and myo-inositol). The uptake rate for seven tested substrates was estimated in the range of 0.91 (for sucrose) to 6.24 mmol.g-1.h-1 (for L-Serine). The correlation (R² 0.53, see S6 Fig) between the substrate uptake rates (in C-mole) with the growth rates observed experimentally indicates that the difference in substrate usage capacity of the phcA mutant does not only rely on difference in uptake of substrates but also in the efficiency of metabolic pathways used for their assimilation. Then, we performed FBA simulations using as additional constraint the cost for virulence factor production (as determined previously in ATP equivalent). For all tested substrates, the optimal growth rate predicted through FBA matched remarkably well (R² 0.80) with the one monitored experimentally (S7 Fig). This analysis also revealed that certain carbon substrates (those supporting a growth rate of the phcA mutant below 0.15 h-1) are unable to support bacterial growth of the wild-type strain since their metabolic conversion into biomass cannot be realized due to the imposed cost for virulence factor production. This explains why certain carbon sources such as L-serine and D-fructose, as well as compounds just above the threshold in liquid culture like L-threonine and myo-inositol, do not support the wild-type strain proliferation on the phenotype microarray (Fig 8). Hence, a fixed cost of virulence factor production satisfactorily explains in most cases the observed reduction of versatility in the wild-type strain and allows defining (i) a critical substrate usage capacity threshold around 0.15 h-1, and (ii) a list of substrates which are not enough metabolized to promote substantial growth beyond this threshold (see S6 Table).
Discussion
A first achievement of this study was the reconstruction of a R. solanacearum genome-scale cell model integrating knowledge collected on this microorganism over the last 40 years. With more than 2644 reactions manually curated, this reconstruction is in the range of the highest standards for bacterial models. Moreover, this reconstruction associates a metabolic network with a macromolecule network to account for the production and secretion of virulence factors since R. solanacearum is known to produce hundreds of extracellular proteins involved in pathogenesis. R. solanacearum, as many other bacteria in the Burkholderiales order, can adapt to many different habitats and host plants. These bacteria generally possess a large genome (> 5.5 Mb) with a significant proportion of variable genes which are presumably involved in adaptive responses to changes in environment, permitting the bacteria to thrive in diverse ecological niches. The presence in the reconstructed model of specific pathways devoted to plant pathogenesis (such as phytohormone biosynthesis, Type III secretion or EPS production) provides a first estimate of the functional overlap between the bacterial metabolism and the establishment of the pathogenicity program. In addition, this first description of R. solanacearum versatility through a fine mapping of the used metabolic substrates opens the way to a global correlative analysis of the trophic abilities of the bacterium and its colonization capacity of a broad set of environmental niches including a large host spectrum.
Flux balance analyses using the reconstructed model along with the measurements of the metabolites/macromolecules uptake and secretion rates unexpectedly revealed that the wild-type strain, when grown under non-limiting nutrient availability (i.e. batch culture in minimal medium), had a significantly restricted growth rate when it exceeds the threshold of 107 cells/ml. The measured growth rate at high cell density is indeed around 60% lower than the one predicted by simulations when considering the full metabolic potential inferred from the reconstructed R. solanacearum model. We found that this optimal growth rate of the wild-type strain can be reached at low cell density and that the growth rate decrease observed above 107 cells/ml is therefore dependent upon a quorum-sensing mechanism. We have shown that this growth rate restriction is dependent on the phcA gene, a master regulator controlling multiple virulence traits of the pathogen. As expected from the behavior of the wild-type strain at low cell density, we found that the growth rate of the phcA mutant is more than 60% higher than the wild-type strain at high cell density, while it approximates the optimal growth rate predicted through model simulations (6% deviation). phcA is known to control a phenotypic switch from non-mucoid to mucoid EPS-producing colonies in response to cell density and in vitro expression studies have shown that, in addition to EPS, this gene controls multiple virulence functions including the production and secretion of plant cell wall degrading enzymes, flagellar motility, twitching motility, siderophore production or the Type III secretion system (reviewed in). Accordingly, a phcA mutant is unable to cause disease symptoms when inoculated on plants. Constraint-based modeling was used to predict and quantify the cost of the huge EPS production observed in R. solanacearum. These results were confirmed by monitoring growth rates of eps or xpsR mutants, and we showed that EPS biosynthesis indeed represents a significant cost for bacteria but this remains a marginal value compared to the growth rate gain observed in the phcA mutant. This strong phenotype certainly results from the pleiotropic nature of the phcA mutation since this gene orchestrates a so-called ‘phenotypic conversion’ and controls multiple virulence functions encoded by hundreds of genes, including xpsR and the eps gene cluster. Future determination of the PhcA regulon will provide clues on the additional biological functions which may represent a significant cost for the cell. This approach should also reveal the probable rewiring of the PhcA-downstream regulatory network which occurs in the mutant.
The picture emerging from these results is the existence in R. solanacearum of a clear trade-off between functions dedicated to proliferation (bacterial growth) and functions required to produce virulence factors. Bacteria use a complex regulatory network to organize the preferential allocation of metabolic resources to growth or virulence functions depending on the cell density status. PhcA appears to be the key regulatory component that governs this developmental switch occurring when bacterial populations reach 107 cells/ml. This trade-off implies that this pathogen, despite its huge multiplication in plant xylem vessels, doesn’t need to grow fast as theoretically possible to achieve a successful infection. It also highlights that bacterial virulence and metabolism are intertwined and illustrates how resource allocation is a critical mechanism with a profound impact on pathogenic fitness. Diverse range of growth/virulence balances have been described among various pathogens. For instance Salmonella deals with the trade-off between a fast growth in order to outcompete commensals or defective variants and the production of the Type III secretion system required to complete infection. Another strategy is to delay the massive production of a virulence factor until the success of host colonization. As observed for R. solanacearum, these traits are often under a social control system, such as quorum sensing or environmental stimuli, to ensure the coordination of the costly production of the virulence toxin.
We discovered that the phcA mutation had also a dramatic impact on the R. solanacearum metabolic versatility. The phcA mutant strain is indeed able to metabolize 17 carbon substrates that the wild-type strain is unable to use to support its growth. In addition, the phcA mutant has an increased ability to use many other substrates, better than the wild-type. Interestingly, this increased substrate usage pattern matches well (63%) with the list of substrates identified in the apoplasm and xylem fluids of the host plant tomato. For example, many amino acids, including L-proline and L-serine, which are present in xylem and apoplastic tissues, enable growth of the phcA mutant but not the wild-type strain.
Rather paradoxically, these results indicate that metabolic versatility is reduced when PhcA is active, i.e at high cell density and so presumably at the onset of the massive plant colonization. The growth/virulence trade-off hypothesis can explain this reduction of versatility as evidenced by FBA. However, it cannot be excluded that PhcA also negatively controls the expression of several metabolic transporters or catabolic pathways. On many substrates, R. solanacearum harbors a low substrate usage capacity and those substrates are unable to sustain efficient bacterial growth when PhcA is active. But the pathogen has also a clear nutritional preference towards certain compounds that are abundant in planta such as L-glutamine, L-glutamate and D-glucose, and which promote strong bacterial growth. The compounds detected in low amount in tomato fluids (<90 μM) were associated with a low substrate usage capacity by the wild-type strain (chi-test p-value 4·10−7) whereas the used compounds correlated with the range of the most abundant compounds in planta (p-value 0.033). Hence, it is tempting to speculate that R. solanacearum specialized to preferentially metabolize those prominent substrates in plant tissues, especially when it reaches high cell density in xylem vessels. This hypothesis is supported by the finding that L-glutamate has the higher uptake rate in C-mol by R. solanacearum over all the compounds tested. This also implies that despite a broad host range and a wide metabolic versatility, this pathogen tends to specialize to relatively few compounds present in planta. On the other hand, it suggests that at low cell density (in the soil or at the very early stages of infection) the phcA-dependent repression of virulence functions leads to an increased metabolic versatility that could be beneficial in a low-resource and competitive environment, see Fig 9.
Altogether, these results also highlight how the maintenance of a pathogenicity trait can be challenging for the pathogen since the existence of this growth/virulence trade-off can lead to the emergence of non-virulent variants with a better growth rate than their wild-type ancestor. Interestingly, it is known for more than fifty years that when inoculated into tomato plants, some members of the R. solanacearum population spontaneously undergo a phenomenon called ‘phenotypic conversion’. Phenotypic conversion (PC) was shown to be the consequence of DNA replication errors and transposition of insertion sequence elements that inactivate phcA. Recently, serial passage experiments of R. solanacearum on various hosts over 300 hundred generations also resulted in the occurrence and propagation of PC-type mutants that outcompeted the ancestor strain in several lineages, indicating that such mutants can be strongly selected in planta. Our results provide an explanatory hypothesis to this well-described occurrence of PC-type variants since such variants (i) do not pay the cost for virulence factor production and thus reach an optimal growth rate, and (ii) escape the restriction of metabolic versatility that takes place at high cell density in the wild-type strain. Both properties provide a clear competitive advantage to the variant in presence of the wild-type strain. Because PC-type mutants do not produce many virulence factors and are unable to cause disease symptoms, this raises the question of whether such variants that do not contribute to the public goods but exploit the resources can be considered as ‘cheaters’ in the infecting population. The fast-growing and highly motile phenotype of phcA mutants rather incites to view such variants as ‘colonizers’ when populations face stressful conditions or environments. Interestingly, the reversion of natural PC-type (phcA) mutants to the wild-type form after in planta multiplication was reported, suggesting that the balance in infecting populations between low-growing, virulent bacteria and ‘colonizer’, low-pathogenic variants could have a wider impact on the pathogenic strategy and global life cycle of R. solanacearum. Future work aimed to study the transmission of the pathogen and its persistence in the environment should provide further clues to evaluate the role of PC-type mutants in dissemination and ecological success of the pathogen.
Bacterial strains and growth conditions
R. solanacearum strains used are the wild-type strain GMI1000 and the following regulatory deletion or disruption mutant derivatives: GMI1525 (hrpB::Ω), GMI1755 (ΔhrpG) and GMI1605 (phcA::Ω). The EPS-defective mutant was obtained by inserting the Ω interposon strain into the distal EcoRV sites located within the epsB and epsD genes in the pSG837 plasmid from the GMI1000 library; this construct was used to transform R. solanacearum and a double recombination event was selected using spectinomycin resistance from the Ω cassette. The resulting strain GRS825 carries a 4.35 kb deletion encompassing the epsB, epsC and epsD gene, which was verified by PCR. Strains were grown in complete medium (BG medium) or in minimal medium at pH 6.5 at 28°C. The minimal medium was supplemented with various carbon sources at 20 mM. Liquid cultures for FBA were performed in shake flask containing 150 ml of culture agitated at 180 rpm. Liquid cultures for growth experiments were performed in 96 well-plates containing 200 μl of culture agitated linearly at 600 rpm and monitored using the FLUOstar Omega microplates reader (BMG Labtech). Optical density of the liquid culture was measured at 600 nm every 5 min. Growth experiments at low cell density were inoculated at a cell density of 5·105 cell·ml-1. Growth experiments at high cell density were inoculated at a cell density of 5·107 cell·ml-1., a value corresponding to the quorum sensing threshold.
Phenotype microarray
Phenotypic microarrays were performed using Biolog Phenotype Microarray plates, PM 1,2,3,4,6,7,8,9,10, and following the manufacturer’s protocol modified as following. Before inoculation of Biolog fluid IF-0, the cells were collected from a static culture on plate containing agar complete medium (BG medium) and resuspended in sterile H2O supplemented with D-glucose at 20 mM. Thus, they were starved for nitrogen, phosphorus and sulfate during 6h at 28°C and 180 rpm agitation. The step of starvation in H2O during 6h was found to reduce the background observed in PM 3 and PM4. D-glucose at 20 mM concentration was used as carbon source for the inoculation of the plates 3, 4, 6, 7, 8, 9, 10. The plates were incubated at 6·107 cell·ml-1 and measurements were recorded on Omnilog reader (Biolog) during 96 hours. Because the activity of the respiratory chain of bacteria is observed from the reduction of a tetrazolium-based chemical, stained cells can be monitored only if substantial proliferation is obtained. Data were analyzed and statistic calculated using the R software package OPM.
NMR analysis of bacterial culture supernatants
Exocellular compounds were collected from cultivation broth in shake flasks. A volume between 3 and 10 ml of culture supernatants was collected depending on bacterial concentration, filtered on 0.22 μm filter (Millex syringe filters) and frozen at -20°C until analysis. Metabolites in culture supernatants were quantified by Nuclear Magnetic Resonance (NMR) spectroscopy. 1D 1H spectra were recorded on an Avance II 500-MHz NMR spectrometer using a 5-mm z-gradient BBI probe head (Bruker, Rheinstatten, Germany) at a temperature of 298°K. NMR measurements were acquired by using a 30° pulse, 5.000-Hz sweep width, and 3.27-s acquisition times and recording 16 scans with a relaxation delay between scans of 10 seconds. A pre-saturation of the water signal was performed during the relaxation delay. An amount of 100 μl of D2O (> 99% Eurisotop) containing 1.6 mM of TSP-D4 (3-(trimethylsilyl)-2,2′,3,3′-tetradeuteropropionic acid) was spiked into 500 μl of filtered culture supernatant in order to correct the field drift and performing the quantification of compounds relatively to the TSP-D4 quantity. Identification of putrescine was performed by measuring chemical shifts of standard compounds (>98% Sigma-Aldrich).
Exopolysaccharide and protein quantifications
EPS quantification in culture broth supernatant was determined by measuring hexosamine content with the Elson Morgan Assay, using a similar protocol to Brumbley et al.. Briefly, EPS in culture supernatant were precipitated in 2.5 ml Eppendorf tubes by adding NaCl at 0.1 mM final concentration, then 4 volumes of acetone were added, and then the samples were stored at 4°C over night. Precipitated EPS pellet were recovered in 200 μl H20 and heated at 65°C on heatblock during 10 min. Insoluble material were discarded after centrifugation at 13 000 rpm during 5 min at 4°C. A volume of 0.15 ml 12M HCl and 0.250 ml H2O were added, and hydrolysis of the sugar polymers was performed at 110°C during 30 min with a heatblock. Hydrolyzed samples were cooled down at room temperature. Then, 0.4 ml of 2 M Na2CO3 was added, homogenized, and subsequently 0.5 ml of 2% Acetyl Acetone in 1.5 M Na2CO3 was added. The samples were then heated at 100°C with a heatblock for 20 min. After being cooled down at room temperature, the liquid was transferred in 15 ml Falcon tubes and 1.0 ml 95% ethanol (≥99.8% Sigma-Aldrich) was added. Then, 0.5 ml Erlich's reagent solution (0.4 g of para-dimethyl-aminobenzaldehyde (≥98%, Sigma-Aldrich) in 6.0 ml ethanol) was added. Samples have been kept for 30 min in the dark (with aluminum) and then the absorbance at 530 nm has been recorded. Quantification of hexosamine was determined by running standard curve of N-acetyl-galactosamine (>98%, Sigma-Aldrich) which has followed the overall process except precipitation.
Protein quantification in culture supernatant was performed using Bradford essay. 1 ml of Bradford 1X Dye reagent (Sigma-Aldrich) was added to 100 μl sample and absorption was measured at 595 nm after 5 minutes of incubation. Bovine serum albumin was used as standard for the quantification.
Competition experiment
The wild type strain and the phcA mutant were inoculated in equal proportion (5·107 cells·ml-1) in minimal medium supplemented with L-glutamate at sole carbon source. The proportion of each strain was monitored over time by plating serial dilutions of the culture medium on BG plates supplemented with triphenyl tetrazolium chloride which allows easy discrimination of phcA mutants (dark red non-mucoid colonies).
Genome-scale metabolic model reconstruction
The reconstruction of the metabolic model of R. solanacearum was performed following the protocol to generate a high-quality genome-scale network published by Thiele and Palsson. However, the production of the initial draft reconstruction from the genome annotation has been performed following a different process as described below and then the expert manual curation has been performed.
The draft metabolic reconstruction has been set up following the protocol explained below and detail in the S1 Material. Briefly, this draft was obtained by collecting reactions from already reconstructed networks of various organisms based on gene homology with R. solanacearum strain GMI1000 following three steps. Each step is supported by an automatic or a semi automatic bioinformatics tools. i) The first step of the draft reconstruction was to generate four draft metabolic networks built from four metabolic models from other bacteria, i.e. Ralstonia eutropha (RehMBEL1391), Bacillus subtilis (Bs_iYO844), P. aeruginosa (iMO1086), and Escherichia coli (iJO1366). The method used is inspired by the Autograph method (see Section I. B in S1 Material). Briefly, reactions of each bacteria models harboring an associated gene for an orthologous gene in strain GMI1000 filling the following requirement, >30% Identity and >50% coverage, were collected. Gene orthology was assessed using Inparanoid on bacterial proteomes. ii) Then, since these metabolic models use different ontologies, the second step has been to standardize the identifiers of the four draft metabolic models. For accelerating this step, we have developed SAMIR (Semi Automatic Metabolic Identifier Reconciliation), a web tool that allows reconciling the identifiers of reactions and metabolites between the different draft models in a semi automatic way (see Section I. C in S1 Material). iii) At last, the four standardized draft metabolic models were merged in a single one following an expert evaluation of the best annotation reactions based on the homology analysis and the evidence of the reactions. This step was facilitated by using a relational database in Access linking common identifiers through the four draft networks (see Section I. D in S1 Material). All the methods and tools used in these three steps are detailed in S1 Material.
Reaction candidates of the high-quality draft reconstruction and genes annotated to be involved in metabolic processes were curated one by one following an expert evaluation of their information. Thus, curation of the reactions was done by seeking for information in metabolic databases KEGG and MetaCyc as well as the transporter database TCDB. On purpose, a R. solanacearum GMI1000 specific pathway/genome database was generated using the Pathway-tools software to assess their metabolic pathway context, and concomitantly, the MicroScope platform was used to evaluate the genomic context (e.g. shared synteny). In addition, it was used to access easily the various information provided on the platform on genes, like blast through various databases and links to the bibliography for the blast hits, prediction of gene product localization, prediction of EC number. Dead-end reactions were computed thanks to MetExplore and the gap filling was performed by reassessment of pathway context through the previously listed tools and databases. Transport reactions as well as assimilation pathways of various substrates were curated thanks to the analysis of the phenotype microarrays performed with the Biolog technology (see below for detailed protocol). The mass and charge balance of the network were computed and corrected. Stoichiometrically balanced cycles were computed by running flux balance analysis without open exchange fluxes and those leading to free conversion between NADPH and NADH were curated; those which had no consequences on flux simulation results were kept. Finally, the model was converted into Systems Biology Markup Language (SBML) format (S2 Material) suitable for constraint-based computing and was documented following MIRIAM Registry recommendation, with assignment of a Systems Biology Ontology references at each component of the model, assignment of metadata like bibliography information and confidence level information. A dedicated webpage which allows downloading the latest version of the model and all additional information are available at this location (http://lipm-bioinfo.toulouse.inra.fr/systemsbiology/models/rsolanacearum. At last, the metabolic network has been added to the MetExplore web site, what allows visual exploration and -omics data mapping on the whole network (directly available at http://metexplore.toulouse.inra.fr/metexplore2/index.html?idBioSource=3631)
Biomass composition of the R. solanacearum cell was assessed from published composition of several biochemical components determined experimentally, or assumed to be similar to R. eutropha or E. coli. The cell dry weight (CDW) quantification of strain GMI1000 (0.414 g(CDW)·OD-1·l-1 ± 0.042, 2·σ) and the phcA mutant (0.453 g(CDW)·OD-1·l-1 ± 0.072, 2·σ) and the total protein content were determined experimentally as described previously using cultures grown exponentially until an optical density of 0.5 at 600nm in minimal medium supplemented with L-glutamate as sole carbon source. List of biomass composition is available in S2 Table.
Macromolecule network reconstruction
The reconstruction of the macromolecule network (macromolecule biosynthesis and secretion, host interaction, and DNA modification) was performed following the same rigorous process established for the metabolic network whether concerning expert curation of each reaction or validation of their stoichiometry, identification of dead-ends as well as gap-filling. The macromolecules included in the model are mainly secreted macromolecules identified from experimental data (bibliography) or genomic information coming from prediction of protein secretion signals using the software PSORTb. Reactions included in the model are the biosynthesis reactions of the macromolecules, transport reactions outside/inside of the bacterial cell, exchange fluxes with the environment and for host-interaction reactions. Cost of secretion, i.e. energy in ATP hydrolysis or proton gradient, was assigned by assuming one ATP hydrolysis for each metabolite unit in the macromolecule transported through one membrane when no information was available. For instance one ATP hydrolysis was considered for each amino acid in a protein, which is transported via the secretion system. Macromolecule interactions in the extracellular space were modeled by condensation reactions where a macromolecule complex is generated from macromolecule substrates. The macromolecule network modules were lumped together with the GS-metabolic network module in a SBML file, see Fig 2. Thus, calculation of the cost of production and secretion of various macromolecules can be assessed by performing flux balance analysis through the whole model.
Simulation of the biochemical network
Simulation of the biochemical reaction network state containing the genome-scale metabolic network module plus the macromolecule network module was performed using constraint based modeling. Flux distributions were simulated by Flux Balance Analysis using the software FlexFlux. Various constraints were applied on simulation. Environmental conditions were defined by constraining lower and/or upper bound of exchange fluxes depending of the availability of the substrate. Substrate uptake rates were constrained from experimentally measured fluxes when available or the upper bound was fixed to 5 mmol·g(CDW) -1·h-1 as default value. System outputs like EPS production or putrescine production fluxes were constrained using the experimentally measured fluxes (see S4 Table).
Phenotype microarray prediction
Qualitative evaluations of the cell scale model performance in predicting the phenotypes microarray were performed by comparing the model predictions with the experimental measurements. Growth predictions in various environments were performed by in silico simulation as described in previous section with optimizing the biochemical reaction corresponding to the biomass function. If the biomass reaction flux is not null the growth is considered as performed by the bacteria and thus the prediction is classified as active (1); if the biomass reaction flux is null the prediction is classified as not active (0). Then, a binary matrix (i*j) containing the contingency of the experimental growth (i) and network prediction growth (j) with the two classes (0, 1) are built and the network performance metrics are calculated as following. The true positive (TP) phenotypes correspond to identical value of 1 for i and j. The false positive (FP) phenotypes correspond to a value of 0 for i and 1 for j. The true negative (TN) phenotypes correspond to identical value of 0 for i and j, and the false negative (FN) phenotypes correspond to a value of 1 for i and 0 for j. The sensitivity (Sn) of the model prediction capacity which corresponds to the true positive rate is calculated as following, where (P) is the number of experimentally active results (i = 1):
The precision (Pr) which is the positive predictive value is calculated as following:
The faux positive rate (FPR) is calculated as following:
The accuracy (Acc) of the model prediction capacity is calculated as following:
References 74
- 1.
Brown SA, Palmer KL, Whiteley M. Revisiting the host as a growth medium. Nat. Rev. Microbiol. 2008; 6:657–666.
Not in our library10.1038/nrmicro1955
- 2.
Eisenreich W, Dandekar T, Heesemann J, Goebel W. Carbon metabolism of intracellular bacterial pathogens and possible links to virulence. Nat. Rev. Microbiol. 2010; 8:401–412.
Not in our library10.1038/nrmicro2351
- 3.
Barbier T, Nicolas C, Letesson JJ. Brucella adaptation and survival at the crossroad of metabolism and virulence. FEBS Lett. 2011; 585:2929–2934.
Not in our library10.1016/j.febslet.2011.08.011
- 4.
Rohmer L, Hocquet D, Miller SI. Are pathogenic bacteria just looking for food? Metabolism and microbial pathogenesis. Trends Microbiol. 2011; 19:341–348.
Not in our library10.1016/j.tim.2011.04.003
- 5.
Schoen C, Kischkies L, Elias J, Ampattu BJ. Metabolism and virulence in Neisseria meningitidis. Front Cell Infect Microbiol. 2014; 4:114
Not in our library10.3389/fcimb.2014.00114
- 6.
Rico A, Preston GM. Pseudomonas syringae pv. tomato DC3000 uses constitutive and apoplast-induced nutrient assimilation pathways to catabolize nutrients that are abundant in the tomato apoplast. Mol Plant Microbe Interact. 2008; 21:269–282.
Not in our library10.1094/mpmi-21-2-0269
- 7.
Zhang YJ, Rubin EJ. Feast or famine: the host-pathogen battle over amino acids. Cell Microbiol. 2013; 15:1079–1087.
Not in our library10.1111/cmi.12140
- 8.
Chen LQ, Hou BH, Lalonde S, Takanaga H, Hartung ML, Qu XQ, et al Sugar transporters for intercellular exchange and nutrition of pathogens. Nature 2010; 468:527–532.
Not in our library10.1038/nature09606
- 9.
- 10.
- 11.
Abu Kwaik Y, Bumann D. Microbial quest for food in vivo: “nutritional virulence” as an emerging paradigm. Cell Microbiol. 2013; 15:882–890.
Not in our library10.1111/cmi.12138
- 12.
Ding Y, Liu X, Chen F, Di H, Xu B, Zhou L, et al Metabolic sensor governing bacterial virulence in Staphylococcus aureus. Proc Natl Acad Sci USA. 2014; 111:E4981–E4990.
Not in our library10.1073/pnas.1411077111
- 13.
Asrat S, Davis KM, Isberg RR. Modulation of the host innate immune and inflammatory response by translocated bacterial proteins. Cell Microbiol. 2015; 17:785–795.
Not in our library10.1111/cmi.12445
- 14.
Macho AP, Zipfel C. Targeting of plant pattern recognition receptor-triggered immunity by bacterial type-III secretion system effectors. Curr. Opin. Microbiol. 2015; 23:14–22.
Not in our library10.1016/j.mib.2014.10.009
- 15.
Price CT, Al-Quadan T, Santic M, Rosenshine I, Abu Kwaik Y. Host proteasomal degradation generates amino acids essential for intracellular bacterial growth. Science 2011; 334: 1553–1557.
Not in our library10.1126/science.1212868
- 16.
Baruch M, Hertzog BB, Ravins M, Youting CC, Hanski E. Group A streptococcus and host metabolism: virulence influences and potential treatments. Future Microbiol. 2014; 9:713–716.
Not in our library10.2217/fmb.14.39
- 17.
Vakulskas CA, Potts AH, Babitzke P, Ahmer BM, Romeo T. Regulation of bacterial virulence by Csr (Rsm) systems. Microbiol Mol Biol Rev. 2015;79:193–224.
Not in our library10.1128/mmbr.00052-14
- 18.
Ferenci T. Trade-off mechanisms shaping the diversity of bacteria. Trends Microbiol. 2016; 24:209–223.
Not in our library10.1016/j.tim.2015.11.009
- 19.
Maharjan R, Nilsson S, Sung J, Haynes K, Beardmore RE, Hurst LD, Ferenci T, Gudelj I. The form of a trade-off determines the response to competition. Ecol Lett. 2013; 16:1267–76.
Not in our library10.1111/ele.12159
- 20.
Molenaar D, van Berlo R, de Ridder D, Teusink B. Shifts in growth strategies reflect tradeoffs in cellular economics. Mol Syst Biol. 2009; 5:323
Not in our library10.1038/msb.2009.82
- 21.
Peebo K, Valgepea K, Maser A, Nahku R, Adamberg K, Vilu R. Proteome reallocation in Escherichia coli with increasing specific growth rate. Mol Biosyst. 2015;11:1184–1193.
Not in our library10.1039/c4mb00721b
- 22.
Mansfield J, Genin S, Magori S, Citovsky V, Sriariyanum M, Ronald P, et al Top 10 plant pathogenic bacteria in molecular plant pathology. Mol. Plant Pathol. 2012; 13:614–629.
Not in our library10.1111/j.1364-3703.2012.00804.x
- 23.
Turner M, Jauneau A, Genin S, Tavella MJ, Vailleau F, Gentzbittel L, et al Dissection of bacterial wilt on Medicago truncatula revealed two type III secretion system effectors acting on root infection process and disease development. Plant Physiol. 2009; 150 1713–1722.
Not in our library10.1104/pp.109.141523
- 24.
Digonnet C, Martinez Y, Denancé N, Chasseray M, Dabos P, Ranocha P, et al Deciphering the route of Ralstonia solanacearum colonization in Arabidopsis thaliana roots during a compatible interaction: focus at the plant cell wall. Planta. 2012; 236:1419–1431.
Not in our library10.1007/s00425-012-1694-y
- 25.
Genin S, Denny TP. Pathogenomics of the Ralstonia solanacearum species complex. Annu Rev Phytopathol. 2012; 50:67–89.
Not in our library10.1146/annurev-phyto-081211-173000
- 26.
Jacobs JM, Babujee L, Meng F, Milling A, Allen C. The in planta transcriptome of Ralstonia solanacearum: conserved physiological and virulence strategies during bacterial wilt of tomato. mBio. 2012; 3(4). pii: e00114–12.
Not in our library10.1128/mbio.00114-12
- 27.
Monteiro F, Genin S, van Dijk I, Valls M. A luminescent reporter evidences active expression of Ralstonia solanacearum type III secretion system genes throughout plant infection. Microbiology 2012; 158:2107–2116.
Not in our library10.1099/mic.0.058610-0
- 28.
McCloskey D, Palsson BØ, Feist AM. Basic and applied uses of genome-scale metabolic network reconstructions of Escherichia coli. Mol Syst Biol. 2013; 9:661
Not in our library10.1038/msb.2013.18
- 29.
Bordbar A, Monk JM, King ZA, Palsson BO. Constraint-based models predict metabolic and associated cellular functions. Nat Rev Genet. 2014; 15:107–120.
Not in our library10.1038/nrg3643
- 30.
Salanoubat M, Genin S, Artiguenave F, Gouzy J, Mangenot S, Arlat M, et al Genome sequence of the plant pathogen Ralstonia solanacearum. Nature 2002; 415:497–502.
Not in our library10.1038/415497a
- 31.
Thiele I, Palsson BØ. A protocol for generating a high-quality genome-scale metabolic reconstruction. Nat. Protoc. 2010; 5:93–121.
Not in our library10.1038/nprot.2009.203
- 32.
Orth JD, Conrad TM, Na J, Lerman JA, Nam H, Feist AM, et al A comprehensive genome-scale reconstruction of Escherichia coli metabolism—2011. Mol Syst Biol. 2011; 7:535
Not in our library10.1038/msb.2011.65
- 33.
McGarvey JA, Denny TP, Schell MA. Spatial-temporal and quantitative analysis of growth and EPS I production by Ralstonia solanacearum in resistant and susceptible tomato cultivars. Phytopathology. 1999; 89:1233–1239.
Not in our library10.1094/phyto.1999.89.12.1233
- 34.
Huang J, Yindeeyoungyeon W, Garg RP, Denny TP, Schell MA. Joint transcriptional control of xpsR, the unusual signal integrator of the Ralstonia solanacearum virulence gene regulatory network, by a response regulator and a LysR-type transcriptional activator. J Bacteriol. 1998;180:2736–2743.
Not in our library10.1128/jb.180.10.2736-2743.1998
- 35.
Flavier AB, Clough SJ, Schell MA, Denny TP. Identification of 3-hydroxypalmitic acid methyl ester as a novel autoregulator controlling virulence in Ralstonia solanacearum. Mol Microbiol. 1997; 26:251–259.
Not in our library10.1046/j.1365-2958.1997.5661945.x
- 36.
Zuluaga AP, Puigvert M, Valls M. Novel plant inputs influencing Ralstonia solanacearum during infection. Front. Microbiol. 2013; 4:349
Not in our library10.3389/fmicb.2013.00349
- 37.
- 38.
Oh Y-K, Palsson BO, Park SM, Schilling CH, Mahadevan R. Genome-scale reconstruction of metabolic network in Bacillus subtilis based on high-throughput phenotyping and gene essentiality data. J Biol Chem. 2007; 282:28791–28799.
Not in our library10.1074/jbc.m703759200
- 39.
Oberhardt MA, Puchałka J, Martins dos Santos VAP, Papin JA. Reconciliation of genome-scale metabolic reconstructions for comparative systems analysis. PLoS Comput Biol. 2011; 7(3):e1001116
Not in our library10.1371/journal.pcbi.1001116
- 40.
Cited by papers we hold 1
Reads
Read by people on this page
None yet.
Checked or read by AI through naulon
None yet.
A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.
Are you an author?
Is this your paper?
Claim it to add your note and be paid when agents cite it. Free.