Skip to content
naulon

No retraction, correction or concern found when last checked on Oct 24, 2026.

Protein post-translational modifications: In silico prediction tools and molecular modeling

Martina Audagnotto, Matteo Dal Peraro

Computational and Structural Biotechnology Journal · 2017 · Review · CC BY

doi:10.1016/j.csbj.2017.03.004

Abstract

Post-translational modifications (PTMs) occur in almost all proteins and play an important role in numerous biological processes by significantly affecting proteins' structure and dynamics. Several computational approaches have been developed to study PTMs ( e.g. , phosphorylation, sumoylation or palmitoylation) showing the importance of these techniques in predicting modified sites that can be further investigated with experimental approaches. In this review, we summarize some of the available online platforms and their contribution in the study of PTMs. Moreover, we discuss the emerging capabilities of molecular modeling and simulation that are able to complement these bioinformatics methods, providing deeper molecular insights into the biological function of post-translational modified proteins.

Full text

From PubMed Central, U.S. National Library of Medicine, as current on Oct 24, 2026. Paragraph numbers are ours, so an answer can point at one.

Introduction

Post-translational modifications (PTMs) occur on a large number of proteins de facto increasing the actual complexity of the proteome. PTMs consist in a covalent modification of amino acids of the primary protein sequence and have the effect to create a much larger array of possible protein species. In response to specific physiological requirements, PTMs play a crucial role in regulating many biological functions, such as protein localization in the cell,, protein stability, and regulation of enzymatic activity. To date more than 90,000 individual PTMs were detected using biochemical and biophysical analyses. In particular, it was observed that almost 5% of the human genome encodes enzymes in charge of catalyzing reactions leading to PTMs, highlighting once more the importance of these chemical modifications of the proteome.

Enzymes often are responsible for regulating these chemical modifications in proteins, as in the case of phosphorylation, acetylation, methylation, carboxylation or hydroxylation. For instance, protein kinases can phosphorylate a given protein target to induce a signaling cascade, while this PTM can be further removed by specific protein phosphatases. These enzymes are found indeed in important signaling pathways, like G-protein, and Wnt signaling,. On the other side, PTMs not induced by specific enzymes (e.g., carbonylation or oxidations) were observed to be responsible of non-specific protein damage involved in neurodegenerative diseases, cancer and diabetes,,.

During the past 30 years, experimental techniques used for mapping and quantifying PTMs have seen an impressive progress. In particular, liquid chromatography (LC) with mass-spectrometry (MS) protein-based analysis allowed the detection of thousands of PTMs across entire proteomes. The study of PTMs in their biological context was achieved thanks to advancements in fluorophore chemistry, fluorescence spectrometry, and peptide and antibody synthesis. However, the identification and characterization of PTMs are still limited by the poor knowledge of the underlying enzymatic reactions and their final effects on protein stability and dynamics. In this context, in silico methods, often based on the current knowledge of PTMs, are a promising strategy to perform preliminary analysis and prediction that can guide further in vivo and in vitro experiments, leading to expand our understanding of the role of PTMs in cellular processes.

In this review, we provide an overview of some of the existing computational approaches used to study the most common PTMs, which we classified based on the covalent attachment of (i) small chemical groups, (ii) lipids or (iii) small proteins to the main peptide chain. Most of these tools are presented as online webservers, providing a user-friendly interface for PTM site identification. Although in this review we mainly focus our attention on this kind of resources, standalone software, like for instance PEAKS PTM, GlycoMaster or MODa, are also available but won't be covered here.

Phosphorylation

Phosphorylation is the most studied PTM that involves the covalent addition of a small chemical group. It is a reversible enzymatic reaction, which consists in the attachment of a phosphate group to the side chain of an arginine, lysine, histidine, tyrosine, serine or threonine residue (Fig. 1A). It plays a key role in almost every cellular process, including metabolism, division, organelle trafficking, membrane transport, immunity, learning and memory,, and function of target proteins. It can activate, and inhibit, enzyme activity through allosteric conformational changes, facilitate the recognition of other proteins,,,, promote protein-protein association,, or dissociation and also induce order-to-disorder transition, (Table 2).

It was estimated that 30% of the total proteome is phosphorylated at least at one residue,. However, this simple switch mechanism is in reality more complex since multiple enzymes can act on multiple sites of the same protein creating a highly connected network of interactions and modifications. For example, it was shown by high-resolution mass spectrometry that 37,248 phosphorylation sites are present on 5705 proteins in adipocyte cells. Other phospho-proteomic analyses demonstrated that proteins, on average, could be phosphorylated on at least five different sites, although these results could suffer from biases coming from high stoichiometry of the complexes,,.

Advances in mass spectrometry, both in terms of speed and sensitivity, allowed identifying and quantifying thousands of phosphorylation sites in different species,. The conservation of the functional phosphorylation sites in species like mice, rats and flies is a feature used by biologists for selecting specific sites of interest for functional characterization. Therefore, mapping the phosphorylation sites on proteins is an important step in order to understand the catalytic process and the effects of signal transduction events. However, it is still in general difficult to identify specific phosphorylation sites. In silico predictions play an important role in this field. Several methods (Table 1) were implemented in order to predict the target phosphorylation sites from the sequence- and structure-based analysis of the specific protein kinases' catalytic domain, such as KinasePhos2.0 or GPS. In particular, GPS is a group-based phosphorylation algorithm, which predicts kinase-specific phosphorylation sites in 71 protein kinase groups, such as Aurora-A, Aurora-B and NimA-like protein kinases. Other methods were instead implemented in a way to predict the phosphorylation sites simply from the substrate primary sequences. For example, Scansite is built on combined experimental binding and/or substrate information to derive a weighted matrix-based scoring that predicts protein-protein and protein-phospholipid interactions, as well as phosphorylation sites. NetPhos instead is based on an artificial neuronal network that allows the users to choose between a generic predictions based only on the substrate protein sequence or kinase-specific predictions.

Recently, in order to overcome the limitations due to a training set based only on the same type of kinases, two general predictors were developed: PPRED, which incorporates evolutionary information, and PhosphOrtholog that enables cross-species comparison of large-scale phosphorylation sites. Finally, several online databases are also available in order to curate and organize information about phosphorylation sites studied in vivo and in vitro in human and mouse proteomes (PhosphositePlus ), as well as rat, fly, yeast and worm (PhosphoELM ).

Glycosylation

Protein glycosylation is one of the most relevant and complex post-translational modifications in the cell,, which is thought to influence almost half of all proteins in nature. It consists of a covalent interaction between a glycosyl donor of a glycan and a glycosyl acceptor amino acid side chain of a protein (Fig. 1B). Protein glycosylation can be divided in four main categories based on the linkage between the amino acid and sugar: N-linked glycans, O-linked glycans, GPI anchors and C-mannosylation. In N-glycosylation, a sugar is attached to an amino group of an asparagine, while O-glycosylation is characterized by the interaction of a sugar with the hydroxyl group of a serine or threonine. GPI anchors consist of the attachment of glycophosphatidyl-inositol near to the C-terminal of a protein chain anchoring the protein to the membrane. C-mannosylation occurs when an α-mannopyranosyl moiety is attached to the indole of the tryptophan via C—C link.

Glycosylation modulates several protein biophysical properties influencing their native functions. In particular, it was observed that it could alter not only protein thermodynamic and kinetic properties, but also influence the structural features of the proteins. The covalent attachment of large hydrophilic carbohydrates modulates protein stability, oligomerization and aggregation,,, host cell-surface interactions, enzyme activity and protein trafficking (Table 2).

Several analytical tools were developed over the past 2–3 decades facilitating glycan analysis. In particular, capillary electrophoresis, liquid chromatography, mass spectrometry and microarray-based are extensively used in grycoproteomics,,. None of these tools can produce, however, a detailed molecular characterization of glycosylated proteins. The high heterogeneity of glycans and the difficulty of obtaining them in large amounts still preclude investigating the role of glycosylation at the molecular level. In the past years, the number of glycoconjugates' crystallographic protein structures have increased,,,,,, nevertheless, a complete chemical and structural description of a glycan structure is still challenging. Mass spectrometry as well as different web-servers (Table 1) currently provide information about existing glycosylation sites. Indeed, in the last decade, several algorithms, trained with sequences or sequence-based information, have been developed to improve prediction of glycosylation sites. Some of these resources are based on neuronal network algorithms, such as NetNGlyc, NetOGlyc for prokaryotes, or YingOYang for eukaryotes. Other useful tools are the GlycoMod server for prediction of glycans' structure based on experimental determined masses, and the NGlyPred server, which incorporates both structure and residue pattern information. More recent developments include prediction of glycosylation sites based on machine learning algorithms (i.e., GlycoMine ), an approach that has produced a significant improvement with respect to prediction performances of NetNGlyc and NectOGlyc.

S-nitrosylation

S-nitrosylation (SNO) consists in the covalent attachment of a nitric oxide (NO) to cysteine thiol moieties (Fig. 1C). Compared to phosphorylation, SNO is not catalyzed by an enzyme, but it depends on the chemical reactivity between the nitrosylation agent and the target, thus the specific residues' environment influences the reactivity of the target protein. Concentration of the nitrosylation agent and the protein, as well as the stability of the S—NO bond under physiological conditions, influences in turn the specificity of this reaction.

Over the past 2 decades, hundreds of soluble,,,,,,,, or membrane, proteins have been identified to be S-nitrosylated. The SNO modification not only modulates protein stability and activities,, but also plays an important role in a variety of biological processes, such as cell signaling, transcriptional regulation, apoptosis and chromatin remodeling (Table 2). Increasing evidences indicate that aberrant S-nitrosylation is implicated in various diseases like cancer, Parkinson's,, Alzheimer's and amyotrophic lateral sclerosis. Thus the identification of SNO sites in proteins can be also very important for the development of drugs.

Although S—NO bonds are highly labile and redox-sensitive, several techniques managed to detect SNO in cells. There are methods for the direct detection of S-nitrosylated sites, such as the measurement of S—NO characteristic absorbance at 340 nm, electrospray ionization mass spectrometry (ESI-MS) and NMR with 15N. Ozone chemiluminescence and specific reduction with Cu+/cysteine at pH 6 are indirect chemical methods that are instead based on the analysis of the cleavage products of SNO. Biotin switch assays and chemical reduction/chemiluminescence assays are specific and sensitive methods for measuring low levels of intracellular S-nitrosylated proteins. These experiments are laborious and low-throughput due to the labile nature and low abundance of SNO. Therefore, computational methods represent again a valid alternative to timely and reliably identifying SNO protein sites for further experimental verification. Several benchmark datasets were developed during the past years. SNOSID tests the prediction performance on 65 positive and 65 negative samples, while GPS-NO was developed based on 549 experimentally verified SNO sites. A support vector algorithm machine (SVM) and a nearest neighbor algorithm (NNA) were also proposed to predict SNO sites. However, no web server was later developed for any of these methods, so that their current usage is quite limited. Alternative web-servers are iSNO-PseAAc, which identifies nitrosylated proteins on an independent dataset, predicting sites with 90% accuracy, and GPS-SNO, which also represents a valid tool for an experimentalist providing information for hundreds of potentially S-nitrosylated substrates that have not been yet experimentally determined (Table 1).

Methylation

Protein methylation is a reversible PTM that modifies the nitrogen atoms of either the backbone or side-chain of several types of amino acids, such as lysine, arginine, histidine, alanine and asparagine,,,,,,; methylation has been also reported at cysteine residues (S-methylation) (Fig. 1D). Despite this variability, most studies have been predominantly focused on lysine and arginine modifications. Methylation research dates back to 1939, but just recently has attracted more and more attention with the identification of new methyltransferases, like protein arginine methyltransferases (PRMTs),, or histone lysine methyltransferases (HKMTs),,, which catalyze mono or double, methylation. In particular, the methylation of the N-terminal tails of the histone plays an important role in gene expression regulation, genome stability and nuclear architecture influencing several biological processes such as transcription, and chromosome maintenance (Table 2). Methylation can also occur on the C-5 position of the cytosine ring of the DNA (DNA methylation) resulting in its association with several human diseases such as cancer, mental retardation (Angelman syndrome) or diabetes mellitus. Although different biological processes are linked to DNA and histone methylation, there seems to be a mutual relationship between these processes, which could play an important role in gene expression.

Methylated proteins, as well as methylation regulatory enzymes, are involved in several human diseases such as cancer,,, cardiovascular diseases, multiple sclerosis and neurodegenerative disorders. Thus, the inhibition of these enzymes with small molecules could be an effective therapeutic means of intervention. Moreover, as it is key to identifying methylation sites, understanding methylation mechanistic and dynamic features is as important. In the past years several experimental methods were developed to study the molecular mechanism of methylation. Mutagenesis of potential methylated residues, methylation of a specific antibody, as well as Chip-Chip were extensively used for this purpose. Recently, mass spectrometry experiments have been also applied allowing the identification of 249 arginine methylated protein sites in 131 proteins from T cells. However, these techniques are usually very expensive and laborious limiting the research of potential methylation sites.

Computational predictions of methylation sites have helped handle these limitations providing an important resource for reducing the number of experiments needed to determine protein methylation sites. Eight web-servers for prediction of methylation sites are currently available (Table 1). MeMo is one of the first online tools to become available. It uses a support vector machine (SVM) as a prediction algorithm. Its dataset is based on a curated selection of all methylated residues annotated in SWISS-PROT, 264 experimentally manually verified methyl-lysine and 107 methyl-arginine extracted from roughly 1700 scientific articles. MeMo appears to be a powerful tool for predicting methylated-arginine sites when compared to methylated-lysine. However, its accuracy is affected by the lack of training data available at the time of development. Lately, the reliability of the prediction was improved by BPB-PPMS, where a Bi-Profile Bayesian approach was used to define methylated and non-methylated sites based on known experimental data,. The data set was increased to 363 candidates containing methylated arginines and 977 methylated lysine proteins. The combination of Bi-Profile Bayesian features with a larger data set improved the methylation prediction accuracy up to 92% for methylated lysine proteins and 88% for methylated arginine proteins. It was observed that protein methylation mainly occurs in regions that are easily accessible and intrinsically disordered, thus MASA used Solvent Accessible Surface Area (SASA) and secondary structure information for predicting methylated sites. This web-server allows the prediction not only of methylated lysines and methylated arginines, but also methyl-glutamates. However, most of these methods use only primary sequence information without taking into account any physicochemical property of residues. With the aim of improving the quality of the prediction, a novel approach called PMes was introduced, which considers physiochemical properties of amino acids surrounding methylation sites. A specific lysine-methylation prediction tool for histones was also proposed: METhK uses amino acids' composition, SASA, amino acid pair composition (i.e., the frequency of amino acid pairs in the primary sequence), amino acid index and protein disorder regions for discriminating between methylated lysine sites in histones and in non-histone proteins. More recently, another web-server has been introduced for in vivo or in vitro species-specific methylation sites' identification: PSSMe was tested on a large-scale experimental methylated site dataset originated from different species, revealing that methylation patterns are indeed species dependent.

N-acetylation

Protein acetylation is a covalent post-translational modification where the acetyl group from acetyl coenzyme A (acetyl CoA) is transferred either to the α-amino group of terminal residues (Nα-acetylation) or to the ε-amino group of internal lysine at specific sites (Nε-acetylation),,,, (Fig. 1E). Although Nα-acetylation is more common (roughly 85% in eukaryotic proteins), Nε-lysine acetylation is more biologically important,,,,,,,. Indeed Nε-acetylation on internal lysines is a reversible post-translational modification involved in several biological processes, such as transcription regulation,, protein expression and stability,,,,, DNA repair, apoptosis, and nuclear import (Table 2). Aberrant lysine acetylation is linked with cancer,,,, neurodegenerative disorders,, and cardiovascular diseases,,,,. Thus, the identification of acetylation sites is important for shedding light on the acetylation mechanism at the basis of numerous diseases.

Experimentally several techniques were applied to explore N-acetylation, such as radioactivity detection, immunity affinity detection and chromatin immunoprecipitation. The development of high-throughput technologies like immune-precipitation combined to mass spectrometry increased also the number of detected acetylated proteins. However, the experimental detection of acetylated sites is inefficient, expensive and have implicitly low throughput. Therefore, computational tools represent alternative methods for studying the acetylation modifications and provide information for further experiments. Some web-servers (Table 1) dealt only with one specific type of acetylation such as NetAcet for instance. NetAcet attempted to predict only Nα-acetylation sites using a neuronal network trained on yeast data and extendable only to mammalian acetylated substrates. However, NetAcet suffered from the limited size of the training dataset available at that time of development. Several web-servers aimed to predict acetylated lysine. PAIL was the first in silico tool for Nε-lysine acetylation sites' prediction. The Bayesian discriminant algorithm was employed on a training set of 246 experimentally verified acetylated sites. Despite a small data set, PAIL is able to achieved an accuracy of 85%. BRABSB-PHKA is a human-specific lysine acetylation predictor, which combines a bi-relative adaptive binomial score Bayesian algorithm with a support vector machine. Another method in lysine acetylation prediction is PSKace-Pred, where a position-specific view was considered for the characterization of acetylated proteins.

Protein sequences' information, evolution similarity and physiochemical properties can help in discriminating between acetyl-lysines and non-acetyl-lysines, improving lysine sites' evaluation. LAceP is based on a logistic regression model, where the physiochemical property of the amino acids and the transition probability of adjacent amino acids were considered during the prediction process. It also allows predicting acetylated sites not only for lysines, but also for glycine, methionine serine and threonine residues. This is actually done by N-Ace, where physiochemical properties (e.g., non-bonded energy, absolute entropy) and solvent accessibility were included in the original prediction code.

The status of lysine acetylation can also be influenced by the enzymes that catalyze the reaction. Although lysine acetyltransferases (KATs) act usually on a multiple-subunit complex, it is still difficult to determine which KATs are responsible for the acetylation of a given protein. ASEB was the first server for KAT-specific human acetylated lysine prediction that not only evaluates possible lysine acetylation sites, but also provides information about the responsible KAT enzyme.

Covalent attachment of acyl chains

Protein lipidation is a unique post-translational modification, which has the result of directly controlling the interaction of soluble protein with biological membranes affecting in turn cellular organization and trafficking. In this section we give an overview of several types of lipidation, their mechanism, involvement in diseases and the computational resources used for predicting lipidation sites.

Palmitoylation

Palmitoylation consists in the attachment of a 16-carbon acyl chain to cysteine residues via a thioesteric bond, (Fig. 1F). Among all PTM lipidations, palmitoylation is the only reversible one and can dynamically regulate protein function, as in the case of H-Ras and N-Ras,. Two families of enzymes regulate the palmitoylation/depalmitoylation process: palmitoyltransferases (PATs), which catalyze the attachment of a palmitate from CoA to specific cysteines, and Acyl Protein Thioesterases (APTs), which remove the palmitate acyl chain. Palmitoylation occurs both in soluble and membrane proteins playing a critical role in the regulation of key biological processes, such as protein membrane trafficking, signaling, cell growth and development (Table 2). Aberrant palmitoylation is associated to a variety of human diseases including neurological disorders (e.g., Huntington disease's or Alzheimer's disease ) and cancer,,,,,. However, the S-palmitoylated proteome is not yet well defined and little is known about the mechanism that regulates S-palmitoylation and its consequences. In fact, the identification of palmitoylation sites is not simple due to the lack of a distinct sequence motif on the substrates. Mass spectrometry allows the identification of several palmitoylated proteins in cells and tissues, which can be further experimentally characterized using Acyl Biotin Exchange (ABE) or Acyl Resin Assisted Capture (Acyl-RAC) techniques,,. Metabolic labeling and click chemistry probes, were developed to recognize palmitoylation sites in order to shed light on the molecular mechanism and dynamics of palmitoylation. All these experimental techniques are time and money consuming, thus computer-aided methods are a necessary alternative for predicting palmitoylation sites (Table 1). CSS-palm was one of the first methods to be developed for searching novel palmitoylated proteins in budding yeast. It is based on a clustering and scoring algorithm, where 263 experimentally verified palmitoylation sites are used as a training set, manually collected from the scientific literature. CKSAAP-PALM is another computational method to predict palmitoylation sites based on protein sequences. An encoding scheme composed by k-spaced amino acid pairs is at the basis of this approach, which improved accuracy compared to former strategies. SwissPalm has been recently introduced, which provides information from the comparison of different palmitoyl-proteomic studies and allows the users to easily search for the protein of interest, determine the predicted S-palmitoylation sites, identify orthologues and compare them across palmitoyl-proteomes. SeqPalm has been recently developed in order to get insights into the correlation between the disruption of palmitoylation sites and diseases. This new computational method allows for the identification of palmitoylation sites based on amino acid compositions, autocorrelation of amino acid physicochemical properties and amino acid position-weighted matrices.

N-myristoylation

Myristoylation is a covalent and irreversible attachment of a 14-carbon fatty acid to N-terminal Gly residues of eukaryotic or viral proteins (Fig. 1G). This PTM facilitates in turn the interaction with membranes or a hydrophobic protein domain,,,,. The substrates involved in myristoylation are generally characterized by the consensus motif Met-Gly-X-X-X-Ser/Thr at the N-terminus. This PTM acts predominantly by removal of the main methionine residues in order to expose the subsequent glycine. Less frequently, it can also expose an internal glycine by proteases' cleavage. These mechanisms are both catalyzed by the N-myristoyl transferase (NMT), a 50 kDa enzyme expressed in most organisms,.

Myristoylation is involved in several critical cellular processes, such as signaling pathways, apoptosis and extracellular protein export (Table 2). Usually myristoylation acts with other post-translational modifications like palmitoylation,,, or in combination with positively charged residues in order to enhance membrane-protein interactions. Several diseases are linked to N-myristoylation like cancer, epilepsy, Alzheimer's disease and viral and bacterial infections. The experimental detection of N-myristoylation includes radioactive techniques like the use of 3H or 14C radioactive myristate that requires a long exposure period (weeks to months). To the best of our knowledge only two online web-servers are available to predict myristoylation sites (Table 1). NMT uses a trial set that combines experimentally proved myristoylated proteins with potential myristoylated candidates. Based on structural and biochemical characterization of the N-myristoyl-transferase, a set of descriptors was suggested for better predicting myristoylated sites. This protocol improved the previous pattern suggested in PROSITE (pattern code: PDOC00008), which gave numerous false negative predictions.

Another N-myristoylated site predictor is called Myristoylator, which is based on a machine learning model that uses several combined neuronal networks and a test set of positive and negative sequences. Although this predictor seems to increase the specificity, it was trained to predict myristoylation only on terminal glycines, thus a priori knowledge of the proteolytic scission site is necessary when using this web-server.

Prenylation

Prenylation is a PTM leading to the attachment of a 15-carbon (farnesylation) or a 20-carbon (geranylgeranylation) lipid to cysteines catalyzed by farnesyltransferases or by protein geranlygeranyl transferases I, respectively (Fig. 1H). These isoprenyl anchors promote not only protein-membrane,,,,, but also protein-protein interactions,, (Table 2). Several diseases are correlated to this PTM, like cancer,, premature aging disorders,, neurite and hepatites C and D. Protein prenylation occurs also in a wide range of parasites, leading to the use of protein farnesyltransferase inhibitors in protozoan parasitic diseases.

The most common approach for detecting prenylation is to use expensive radiolabeling techniques,. Initially, the prenylation motif was suggested to be CaaX, i.e. consisting of a cysteine (C) followed by two aliphatic residues (aa) and a terminal residue X. However, further kinetic studies and mutation experiments showed a more flexible and complex recognition motif for prenylation. PrePS is the only online tool available, which is based on modeling of the substrate-enzyme interactions for each prenyltransferase.

Small proteins' modifications

An important field in cell signaling is the characterization of the covalent and reversible attachment of ubiquitin (ubiquitylation) and small ubiquitin-related modifiers (sumoylation). This peculiar class of PTMs provides new protein-protein interfaces remodeling the target proteins. In this section we review the latest findings on sumoylation and ubiquitylation with a particular attention on the in silico tools recently developed.

Ubiquitylation

Ubiquitylation is a three step process where, first, the ubiquitin is activated by a ubiquitin-activating enzyme (E1), then conjugated to a ubiquitin-conjugating enzyme (E2), and finally transferred by a ubiquitin-ligase enzyme (E3) to a substrate molecule via an isopeptide bond with an internal lysine (Fig. 1I). This reversible modification is implicated in the regulation of several cellular processes, like protein degradation,,, cell cycle division, the immune response, lysosomal trafficking and control of insulin (Table 2). The aberration of ubiquitylation is linked to human pathologies varying from inflammatory neurodegenerative diseases to different forms of cancers,.

Despite the availability of several ubiquitin-protein ligase complex structures,,,,, the ubiquitylation reaction mechanism is still poorly understood. It has been recently hypothesized that structural disorders of the substrate could actually facilitate this process. Analysis of sequences by mutant yeast strain experiments showed that most of the ubiquitylation sites are in the disordered and flexible regions of a protein. On the basis of this observation UbPred was developed (Table 1): a ubiquitylation site predictor based on a support vector machine algorithm (SVM), which allows studying the correlation between ubiquitylation and protein half-life. In order to overcome the lack of accuracy and training data deficiency, UbiProber and iUbiq were designed (Table 1). UbiProber predicts both general and species-specific ubiquitylation sites using large-scale experimental data as training set, while iUbiq is based on evolutionary information incorporated into the general form of pseudo-amino acid composition. However, all these in silico tools do not account for E3 binding/recognition sites, although it was shown to be an important feature for ubiquitylation. UbiNet (Table 1) is the first server that allows studying the regulatory network among E3 and ubiquitylated proteins.

Sumoylation

Sumoylation is a PTM characterized by a covalent attachment of the Small Ubiquitin-like Modifier (SUMO) to specific lysine residues via an enzymatic reaction (Fig. 1L). Sumoylation sites are identified by a canonical consensus sequence Ψ-K-X-E (where Ψ is a hydrophobic amino acid, such as A, I, L, M, P, F, V or W; X any amino acid residue),, and by SUMO-interacting motifs (3–4 aliphatic residues linked to acid and/or phosphorylatable amino acids) called SIM. Both these features are essential for characterizing the biological significance of sumoylation. This modification is involved in several cellular processes, like protein binding, subcellular transport, gene expression, DNA repair, chromosome assembly and cellular signaling,,, (Table 2). Aberrant sumoylation is correlated not only to Alzheimer's and Parkinson's diseases, but also to cancer and diabetes, highlighting the importance of detecting sumoylation sites. Mass spectrometry-based proteomic studies allow mapping hundreds of proteins identifying different sumoylation and SIM sites,,,. However, the limitations due to the reversibility of this modification and the difficult identification of peptides from trypsin digestion impose some limitations to the use of this technique. Computer-aided prediction represents a good alternative to reduce the number of potential targets to explore for further experimental verifications (Table 1).

While web-servers available for SIM prediction are only GPS-SUMO and JASSA, several online methods for sumoylation sites' prediction are currently available. SUMOhydro is based on a support vector machine (SVM) combined with amino acid hydrophobicity, while SUMOAMVR considers also other structural features, like average accessible surface area (AASA), secondary structure and evolutionary information of amino acids. Recently, a new in silico tool based on the covariance discriminant (CD) algorithm was developed in order to avoid errors caused by disparity in training data sets.

PTMs cross-talk

The hypothesis of a correlation between PTMs within the same protein (PTMs cross-talk) has emerged in the proteomic field in recent years. For instance, the regulatory interplay among PTMs was observed for histones and other proteins like p53,, RNA polymerase II or β-tubulin. In particular, the importance of PTM cross-talk was recognized in several biological pathways (e.g. DNA damage response and protein stability regulation,, ) pointing to a strong relationship between PTM cross-talk and protein functions.

While the structural and functional understanding of combinatorial PTMs has been initially limited by technological limitations, recent advances in proteomics have allowed integrating information on different types of modifications,. However, with the latest experimental methods it is also difficult to identify the whole set of PTM sites in the proteins. In this emerging context, computational methods are poised to support the study of PTM cross-talk. The first unified tool for a simultaneous prediction of PTM sites was ModPred, which predicts and analyses simultaneously multiple types of PTM sites in order to gain structural and functional information on the protein regulatory mechanism of multiple PTMs. Recently, a new webserver, PTM-X, allows the prediction of PTM cross-talk based on experimentally published data. The difference compared to ModPred is represented by the necessity to know a priori the PTM candidate sites.

Structural and dynamical characterization of PTMs

Despite the important role played by PTMs, their structural and dynamics effects of protein function remain poorly understood from a molecular point of view, due to the labile transient nature of most of these modifications and the lack of adequate experimental techniques able to detect and characterize them and the underlying chemical mechanism of formation. The online tools previously discussed are valid methods to overcome some of these experimental limitations and predict putative PTMed sites, but they do not usually provide any information about the impact of post-translational modifications from a mechanistic point of view.

Molecular modeling and molecular simulation (such as molecular dynamics, MD), which are based on empirical atomistic force fields,,,, are a powerful strategy for studying biological systems at single molecule resolution and nanosecond-to-millisecond time scales. Although this computational approach allows nowadays the study of protein processes and properties that are not easily accessible experimentally, there are still some apparent limitations regarding the availability of accurate parameters that would allow the investigation of PTMed proteins. In the past years several improvements have been made in order to expand this approach also to non-standard biomolecules. Within the AMBER force field atomic charges and parameters were developed for phosphorylated residues as phosphoserine, phosphothreonine, phosphotyrosine, phosphohistidine, and S-nitrosylated residues (S-nitrocysteine ) and methylation (trimethyllysine, ). Similarly, within the CHARMM force field there are parameters for methylated lysines and arginines, as well as acetylated lysines and palmitoylated cysteines. There are also ad hoc comprehensive atomistic force field parameters for treating the description of the link between carbohydrates and proteins such as in GLYCAM for AMBER /CHARMM and a modified version of GROMOS,. In theory, within these schemes, there are existing strategies to parameterize virtually any kind of non-standard amino acids, as for the case of PTMs; in practice, the development of new force field models always involves time-consuming parameterization protocols and rigorous a posteriori validations of the quality and robustness of the new models.

Moving to lower resolution, coarse-grained force fields can be also very useful for studying the impact of PTMs on protein function. In this domain there are no specific parameters for the description of PTMed residues. The Martini force field, for instance, provides parameters for treating non-covalently bound sugar molecules or phosphate groups but a complete general representation of modified residues is not yet available. However, a recent work described new parameters for modeling palmitoylated cysteines that were used to study H-Ras, and contributed to show the influence of this PTM in regulating the partition of the protein with the membrane.

While for a long time PTMs were not usually considered in modeling and molecular simulation works, the recent availability of more comprehensive experimental data along with accurate force field parameters have thus allowed investigating protein properties taking also into account the effect of PTMs on their structure and stability. Recent examples of this approach have revealed the impact of PTMs for the HIV-1 fusion peptide structure, rhodopsin, calnexyn and phosphatidylinositol 4-kinase.

Answering to the need of new and better molecular models to more realistically describe proteins, some automatic tools for generating force field parameters for new molecular species have become available, such as ParaChem or SwissParam compatible with the CHARMM force field, q4md-forcefieldtools for AMBER and ATB for GROMOS. However, none of them directly focus on the parameterization of PTMs, likely because of the complexity of the development of parameters required for most PTMs. Therefore, the necessity of having computational tools allowing an automatic parameterization of PTMed protein structures to be used in MD simulations resulted in the development of some new web-servers, such as FF_PTM (http://selene.princeton.edu/FFPTM/) and Vienna-PTM (http://vienna-ptm.univie.ac.at). FF_PTM focuses on expanding the existing AMBER force field (i.e., ff03) including parameters for 32 PTMs. In particular, it is characterized by parameters that describe the attachment of small molecules (e.g., phosphorylation, methylation or acetylation) and the covalent interaction with acyl chains such as palmitic acid (palmitoylation) and geranylgeranyl pyrophosphate (geranylgeranylation). On the other hand, Vienna-PTM is a web platform designed for introducing PTMs on PDB structures to run simulations using the GROMOS 54A7 and 45A3 force fields.

Summary and outlook

The chemical modification of amino acids plays an important role in a myriad of cellular processes that range from protein localization to disease development and aging. Enormous efforts, which combine the development of both experimental and computational methods, have been put in the past 2 decades in order to understand PTM mechanisms and effects for protein structure, dynamics and function.

In this review we summarized the main in silico tools mainly available as an online webserver for studying PTMs (Table 1). Recently, an integrative platform (dbPTM: http://dbptm.mbc.nctu.edu.tw/) has also become available. Originally developed as a comprehensive database of experimentally verified PTMs, dbPTM collects all available databases and webserver resources considering also other PTMs, like succinylation and S-glutathionylation. Although this platform does not provide an exhaustive description for the case of lipidation, it includes also standalone software (not discussed here), offering thus a complementary source of information to this review.

With an increasing amount of experimental data available every day, we think that, as the existing ones will keep improving their performance, many other methods will emerge in the future. Although most of the web-servers available are based on a sequence-based analysis of training data sets, some of them have also started to take into account other interesting properties, such as evolutionary information (e.g., PhosphoOrtholog, iUbiq), SASA (e.g., MASA, METhK, SUMOAMVR) and physiochemical properties (e.g., Pmes, SUMOhydro).

Altogether, these approaches are only rarely considering the molecular features associated with PTMs and the molecular impact they have for protein function in general. Within this context, molecular modeling and simulations have the capability to complement experimental and bioinformatics techniques providing a molecular description of the effect of PTMs on protein structures and stability. However, the lack of suitable tools and parameters for treating PTMs in proteins has limited so far the characterization of these covalent modifications. As some automatic tools (e.g., FF_PTM and Vienna-PTM) have recently appeared providing an online platform to parameterize post-translational modified proteins suitable for running atomistic MD simulations with AMBER or GROMOS force fields, for most PTMs ad hoc parameterizations still need to be developed. Similarly, coarse-grained force fields still lack reliable and robust models for dealing with PTMs, as well as systematic protocols to produce accurate parameters.

Nowadays, with the constant increment of computing power and the availability of always more accurate force fields for biomolecules, which accompany the tireless advances on the experimental side, it is possible to achieve a more precise and faithful description of biological systems in their physiological conditions using molecular modeling and simulation. For instance, the advances in lipidomic analyses have provided a much more detailed view of membrane composition, allowing the construction of more realistic membrane models, to better investigate membrane biophysical properties and their interplay with integral and peripheral membrane proteins,. Several computational tools have been developed with this aim in mind, such as CHARMM-GUI and LipidBuilder.

Along the same lines, it is also clear that protein PTMs are another important layer of complexity that integrally defines and modulates protein function and, for this reason, needs to be considered at all levels of both experimental and computational investigation. Therefore, the computational advances of bioinformatics and physics-based molecular modeling and simulation techniques appear as a fundamental requirement to complement the experimental investigation of PTMs' impact on cellular processes.

References 335

  1. 1.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  2. 2.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  3. 3.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  4. 4.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  5. 5.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  6. 6.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  7. 7.
  8. 8.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  9. 9.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  10. 10.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  11. 11.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  12. 12.
  13. 13.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  14. 14.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  15. 15.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  16. 16.
  17. 17.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  18. 18.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  19. 19.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  20. 20.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  21. 21.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  22. 22.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  23. 23.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  24. 24.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  25. 25.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  26. 26.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  27. 27.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  28. 28.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  29. 29.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  30. 30.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  31. 31.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  32. 32.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  33. 33.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  34. 34.
  35. 35.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  36. 36.
  37. 37.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  38. 38.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  39. 39.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  40. 40.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  41. 41.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  42. 42.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  43. 43.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  44. 44.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  45. 45.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  46. 46.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  47. 47.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  48. 48.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  49. 49.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  50. 50.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  51. 51.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  52. 52.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  53. 53.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  54. 54.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  55. 55.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  56. 56.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  57. 57.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  58. 58.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  59. 59.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  60. 60.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  61. 61.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  62. 62.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  63. 63.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  64. 64.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  65. 65.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  66. 66.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  67. 67.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  68. 68.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  69. 69.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  70. 70.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  71. 71.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  72. 72.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  73. 73.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  74. 74.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  75. 75.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  76. 76.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  77. 77.
  78. 78.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  79. 79.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  80. 80.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  81. 81.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  82. 82.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  83. 83.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  84. 84.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  85. 85.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  86. 86.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  87. 87.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  88. 88.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  89. 89.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  90. 90.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  91. 91.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  92. 92.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  93. 93.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  94. 94.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  95. 95.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  96. 96.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  97. 97.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  98. 98.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  99. 99.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  100. 100.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  101. 101.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  102. 102.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  103. 103.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  104. 104.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  105. 105.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  106. 106.
  107. 107.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  108. 108.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  109. 109.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  110. 110.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  111. 111.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  112. 112.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  113. 113.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  114. 114.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  115. 115.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  116. 116.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  117. 117.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  118. 118.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  119. 119.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  120. 120.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  121. 121.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  122. 122.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  123. 123.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  124. 124.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  125. 125.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  126. 126.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  127. 127.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  128. 128.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  129. 129.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  130. 130.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  131. 131.
  132. 132.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  133. 133.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  134. 134.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  135. 135.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  136. 136.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  137. 137.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  138. 138.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  139. 139.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  140. 140.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  141. 141.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  142. 142.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  143. 143.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  144. 144.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  145. 145.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  146. 146.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  147. 147.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  148. 148.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  149. 149.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  150. 150.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  151. 151.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  152. 152.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  153. 153.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  154. 154.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  155. 155.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  156. 156.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  157. 157.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  158. 158.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  159. 159.
  160. 160.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  161. 161.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  162. 162.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  163. 163.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  164. 164.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  165. 165.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  166. 166.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  167. 167.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  168. 168.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  169. 169.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  170. 170.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  171. 171.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  172. 172.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  173. 173.
  174. 174.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  175. 175.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  176. 176.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  177. 177.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  178. 178.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  179. 179.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  180. 180.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  181. 181.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  182. 182.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  183. 183.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  184. 184.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  185. 185.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  186. 186.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  187. 187.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  188. 188.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  189. 189.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  190. 190.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  191. 191.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  192. 192.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  193. 193.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  194. 194.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  195. 195.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  196. 196.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  197. 197.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  198. 198.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  199. 199.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  200. 200.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  201. 201.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  202. 202.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  203. 203.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  204. 204.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  205. 205.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  206. 206.
  207. 207.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  208. 208.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  209. 209.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  210. 210.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  211. 211.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  212. 212.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  213. 213.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  214. 214.
  215. 215.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  216. 216.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  217. 217.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  218. 218.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  219. 219.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  220. 220.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  221. 221.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  222. 222.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  223. 223.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  224. 224.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  225. 225.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  226. 226.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  227. 227.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  228. 228.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  229. 229.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  230. 230.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  231. 231.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  232. 232.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  233. 233.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  234. 234.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  235. 235.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  236. 236.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  237. 237.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  238. 238.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  239. 239.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  240. 240.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  241. 241.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  242. 242.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  243. 243.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  244. 244.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  245. 245.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  246. 246.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  247. 247.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  248. 248.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  249. 249.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  250. 250.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  251. 251.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  252. 252.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  253. 253.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  254. 254.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  255. 255.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  256. 256.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  257. 257.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  258. 258.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  259. 259.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  260. 260.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  261. 261.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  262. 262.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  263. 263.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  264. 264.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  265. 265.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  266. 266.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  267. 267.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  268. 268.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  269. 269.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  270. 270.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  271. 271.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  272. 272.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  273. 273.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  274. 274.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  275. 275.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  276. 276.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  277. 277.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  278. 278.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  279. 279.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  280. 280.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  281. 281.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  282. 282.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  283. 283.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  284. 284.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  285. 285.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  286. 286.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  287. 287.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  288. 288.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  289. 289.
  290. 290.
  291. 291.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  292. 292.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  293. 293.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  294. 294.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  295. 295.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  296. 296.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  297. 297.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  298. 298.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  299. 299.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  300. 300.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  301. 301.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  302. 302.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  303. 303.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  304. 304.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  305. 305.
  306. 306.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  307. 307.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  308. 308.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  309. 309.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  310. 310.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  311. 311.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  312. 312.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  313. 313.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  314. 314.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  315. 315.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  316. 316.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  317. 317.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  318. 318.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  319. 319.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  320. 320.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  321. 321.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  322. 322.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  323. 323.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  324. 324.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  325. 325.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  326. 326.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  327. 327.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  328. 328.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  329. 329.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  330. 330.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  331. 331.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  332. 332.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  333. 333.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  334. 334.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

  335. 335.

    This reference’s wording can’t be shown under the paper’s licence.

    Not in our library

Reads

Read by people on this page

None yet.

Checked or read by AI through naulon

None yet.

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.

Are you an author?

Is this your paper?

Claim it to add your note and be paid when agents cite it. Free.