Skip to content
naulon

No retraction, correction or concern found when last checked on Oct 27, 2026.

The effect of genetic structure on molecular dating and tests for temporal signal

Gemma G. R. Murray, Fang Wang, Ewan M. Harrison and 6 more

Methods in Ecology and Evolution · 2015 · CC BY

doi:10.1111/2041-210x.12466

Abstract

Summary ‘Dated‐tip’ methods of molecular dating use DNA sequences sampled at different times, to estimate the age of their most recent common ancestor. Several tests of ‘temporal signal’ are available to determine whether data sets are suitable for such analysis. However, it remains unclear whether these tests are reliable. We investigate the performance of several tests of temporal signal, including some recently suggested modifications. We use simulated data (where the true evolutionary history is known), and whole genomes of methicillin‐resistant S taphylococcus aureus (to show how particular problems arise with real‐world data sets). We show that all of the standard tests of temporal signal are seriously misleading for data where temporal and genetic structures are confounded (i.e. where closely related sequences are more likely to have been sampled at similar times). This is not an artefact of genetic structure or tree shape per se , and can arise even when sequences have measurably evolved during the sampling period. More positively, we show that a ‘clustered permutation’ approach introduced by Duchêne et al . ( Molecular Biology and Evolution , 32 , 2015, 1895) can successfully correct for this artefact in all cases and introduce techniques for implementing this method with real data sets. The confounding of temporal and genetic structures may be difficult to avoid in practice, particularly for outbreaks of infectious disease, or when using ancient DNA . Therefore, we recommend the use of ‘clustered permutation’ for all analyses. The failure of the standard tests may explain why different methods of dating pathogen origins have reached such wildly different conclusions.

Full text

From PubMed Central, U.S. National Library of Medicine, as current on Oct 27, 2026. Paragraph numbers are ours, so an answer can point at one.

Introduction

Molecular dating uses evolutionary change between homologous DNA sequences to infer the time since their most recent common ancestor (t MRCA). If the genomes were sampled at similar times, then this inference requires external temporal information, such as a known rate of evolution, to calibrate the molecular clock. But if the genomes were sampled at sufficiently different times, then the sampling dates are all the temporal information required (Rambaut 2000; Drummond, Pybus & Rambaut 2003b; Drummond et al. 2003a). Such ‘dated‐tip’ methods have been particularly useful in the study of viral and bacterial pathogens and have been used to understand the origins and spread of diseases, as well as transmission pathways within a single outbreak (e.g. Smith et al. 2009; Didelot et al. 2012; McAdam et al. 2012; Gire et al. 2014).

Dated‐tip methods are only valid if there is temporal signal in the data. This will not be the case if the sampling period was too short for sufficient evolutionary change to occur or if evolutionary rates were too variable (Drummond, Pybus & Rambaut 2003b; Firth et al. 2010; Duchêne et al. 2015a). However, evolutionary rates are often unknown, and molecular dating methods will usually converge on an estimate whether or not temporal signal is present (Firth et al. 2010). As such, it is crucial to test the molecular data for temporal signal.

Several approaches have been used to test for temporal signal. The simplest is a linear regression of phylogenetic root‐to‐tip distance against sampling date (Buonagurio et al. 1986; Shankarappa et al. 1999; Korber et al. 2000; Drummond, Pybus & Rambaut 2003b). If sampling dates are sufficiently different, then more recently sampled sequences will have undergone substantially more evolutionary change than earlier sampled sequences, and this should create a strong positive correlation. This test obviously requires a rooted phylogeny, and when the root is unknown, it is common to estimate the root simultaneously with the regression, so as to maximize the model fit (Drummond et al. 2003a). Significance is not generally calculated, because root‐to‐tip distances are non‐independent, but Navascués, Depaulis & Emerson (2010) suggest using permutation, asking whether the correlation is stronger than expected if the sampling dates were assigned to sequences at random.

Linear regression is a crude method of molecular dating, but analogous tests can be used with more formal methods. Most commonly, the t MRCA or rate estimate from a Bayesian dated‐tip analysis is used as the test statistic. If more recently sampled sequences have undergone more molecular evolution, then the true sampling dates should yield a t MRCA that differs substantially from the equivalent estimates with the sampling dates randomly permuted over sequences (Ramsden, Holmes & Charleston 2009; e.g. Duffy & Holmes 2009; Firth et al. 2010; Fraile et al. 2011; Pagán & Holguín 2013; Duchêne, Holmes & Ho 2014b; Duchêne et al. 2015a).

Finally, a distinct approach uses model selection and compares the fit of models with the sampling dates included or excluded, thereby failing to take special account for any evolution that might have taken place during the sampling period (Rambaut 2000; Drummond, Pybus & Rambaut 2003b; Drummond et al. 2003a; Baele et al. 2012). Temporal signal is confirmed if the inclusion of the sampling dates improves the fit.

All of the approaches above are widely used, but it is not clear how well they identify temporal signal, especially if we define temporal signal as the ability of a data set to yield reliable date estimates. Previous studies have shown that dated‐tip methods can be unreliable not only for data with too short a sampling period or too variable an evolutionary rate, but also for data with strong population structure (Navascués & Emerson 2009) or imbalanced trees (Duchêne, Duchêne & Ho 2015b). Furthermore, Duchêne et al. (2015a) showed that the Bayesian permutation test gave false evidence of temporal signal for simulated data where the sampling period was too short, but where clusters of closely related sequences were sampled at the same time, that is where temporal and genetic structures were confounded. To solve this problem, they introduced a ‘clustered permutation approach’ where dates were randomly reassigned among clusters of sequences sampled on the same date.

Here, we investigate the performance of tests of temporal signal on a variety of simulated and real‐world structured data sets. We show that while structured data can generate accurate estimates of the t MRCA with dated‐tip methods, when temporal and genetic structures are confounded, estimates are consistently misleading, regardless of the level of temporal structure in the data. We further show that the standard tests of temporal signal fail to identify data sets that result in unreliable estimates when temporal and genetic structures are confounded. We demonstrate that the clustered permutation approach of Duchêne et al. (2015a) can be applied to both the regression and Bayesian tests for temporal signal, and that it successfully identifies those data sets that give reliable estimates in the presence of confounded genetic structure. Finally, through analysis of two sets of whole‐genome data from Staphylococcus aureus, with very different sampling periods, we develop methods of applying these tests to real data and show that confounding can arise naturally from clinical sampling practice, suggesting that the unreliable date estimates may be widespread.

Data Sets

Details of our simulated and real data sets are provided in the Supporting information.

Basic Dating Analyses

We estimated the t MRCA for all of our data sets using beast v1.8 (Drummond et al. 2012). In all cases, we used a constant population size coalescent prior for the node ages, and (except for Bayes factor calculations) the BEAUti v1.8 default priors for all other parameters (Drummond et al. 2012). After each run, convergence was assessed using tracer v1.6 (Rambaut et al. 2014) and burn‐in removed as required. For the t MRCA, we recorded the maximum a posteriori (MAP) estimate, estimated from the MCMC using the Venter mode estimator from the r package modeest (Venter 1967; Poncet 2012), and the 95% highest posterior density (HPD) interval.

For the simulated data sets, we fit the same evolutionary model that was used to simulate the data, namely the HKY+Γ substitution model and a strict molecular clock. For the reanalysis of the S. aureus data, we also used the HKY+Γ substitution model. For the data from Holden et al. (2013), we used the uncorrelated log‐normal relaxed molecular clock (replicating the published analysis), whereas for the data from Paterson et al. (2015) we used a strict clock due to the small number of variable sites.

Regression test

To regress phylogenetic root‐to‐tip distance against sampling date, we obtained crude root‐to‐tip distances from a neighbour‐joining tree estimated using a K80 nucleotide substitution model with the ape package in r (Paradis, Claude & Strimmer 2004). Following the path‐o‐gen software (Rambaut 2013), the root was fit simultaneously with the regression, so as to minimize the residual mean squares (see also Korber et al. 2000). Following the suggestion of Navascués, Depaulis & Emerson (2010), the significance of the regression was assessed by random permutation of the sampling dates over the sequences, using the correlation coefficient as the test statistic. For all reported results, we generated 1000 replicates of the data, with the sampling dates randomly permuted. The P‐value is the proportion of replicates with a test statistic greater than or equal to the true value. The null hypothesis is that a negligible amount of evolution took place between the sampling dates, so that the correlation observed can be attributed to stochastic variation in molecular branch length estimates and (when the root is not known independently) to our having rooted the tree to maximize clocklikeness.

Bayesian dating permutation tests

To test for temporal signal using Bayesian dating, each analysis was repeated 10 times, after randomly permuting the sampling dates across sequences (e.g. Ramsden, Holmes & Charleston 2009). We then asked whether the t MRCA estimate from the true data was outlying when compared with the estimates from the randomly permuted data. This is not standard hypothesis test, since each of the 11 estimates is associated with uncertainty, and therefore, P‐values were not calculated. We note that the choice of the t MRCA as a test statistic is somewhat arbitrary, and that other alternatives (such as mean rate) could also be used. Unless one or other statistic was of particular interest, statistics might be preferred whose posterior distributions are easier to estimate from the MCMC.

Clustered permutation tests

The permutation tests described above assume that the sampling dates are exchangeable under the null. This will not be true if closely related sequences were preferentially sampled at the same date. A heuristic approach to dealing with this artefact was introduced by Duchêne et al. (2015a). Their approach is to randomize dates over clusters of sequences, rather than individual sequences. Clusters are defined as monophyletic clades, which were sampled at the same time. If we have n clusters, then the maximum number of permutations of these clusters is n!, and if each sampling date is associated in more than one of the clusters, then the total number of unique permutations is n!∏idatesmi−1 where m i is the number of clusters associated with sampling date i. When this number is suitably small, it is easiest to generate all possible permutations. For example, in Fig. 1c,d, there were only 3! = 6 possible permutations, which made 1/6 the smallest possible P‐value for these extreme cases. For the simulated data, we identified single‐date clusters from a neighbour‐joining tree, rooted to minimize the residual mean squares of a linear regression of sampling time against root‐to‐tip distance (see Results for definitions for real data). All tests were implemented in r scripts (R Core Team 2014), which are provided in the Supporting information.

Tests of model fit

A final test of temporal signal is to compare some measure of model fit for phylogenetic analyses with or without sampling dates (Baele et al. 2012). In practice, for the ‘no dates’ model, to keep the two cases as similar as possible, we set all sequences to the most recent sampling date in the original data set. We compared two model comparison statistics. The AICM is computationally cheap and robust to specification of improper priors. It can also be transformed into a true hypothesis test, using Akaike weights (Burnham & Anderson 2002). To do this, when the ‘with dates’ model was preferred, the relative support for this model, equivalent to the P‐value, was calculated as w=1+e12ΔAICM−1, where ΔAICM is the improvement in the fit. AICM was estimated in tracer v1.6 (Rambaut et al. 2014), which was also used to check convergence.

To calculate Bayes factors, we used the path sampling approach with 100 steps, as implemented in beast v.2 (Baele et al. 2012; Bouckaert et al. 2014). The method relies on the specification of priors that are proper (integrating to unity), and not too diffuse (Baele et al. 2012). (This may be difficult for data sets where a priori plausible date or rate estimates span several orders of magnitude.) We set the mean rate prior to a gamma distribution with a shape parameter of 0·1 and a scale parameter of 1, the standard deviation of the rate prior to an exponential distribution with a mean of 1, the population size prior to an exponential distribution with a mean of 100, the HKY transition–transversion parameter prior to a gamma distribution with a shape parameter of 2 and a scale parameter of 1, and the between‐site rate gamma shape prior to an exponential distribution of mean 1.

Dating Artefacts with Simulated Data

To illustrate the performance of tests of temporal signal on genetically structured samples, we simulated molecular data sampled on three different dates, from a highly structured population, consisting of three distinct and equally related clades, whose most recent common ancestor lived 10 000 years before the present (ybp), evolving at a comparable rate to some bacteria and viruses (1·6 × 10−6 subs per site per year). We applied the standard tests of temporal signal to these simulated data and estimated their t MRCA (Fig. 1).

We first simulated data with a high degree of temporal structure, by selecting three sampling dates such that an average of 20 nucleotide substitutions per genome occurred between each sampling. We also assumed a ‘balanced’ sampling scheme, such that all three genetic clades were sampled equally thoroughly on all three dates. With this high temporal structure, and balanced sampling, the dating was a success. When correlating root‐to‐tip distance with sampling dates, all of the 1000 simulated data sets showed the signature of temporal signal (see Fig. S1a for a histogram of r‐values). Figure 1a shows a detailed analysis of a single typical replicate, with a permutation test, confirming that the correlation was unlikely to have arisen by chance (Fig. 1a, middle column; see also Table S1); indeed, for these simulated data, variation around the regression line must be attributed to stochastic variation in the substitution process, or to estimation error in the branch lengths. The intercept of the regression was also similar to the true t MRCA used to simulate the data. Bayesian molecular dating with beast (Drummond et al. 2012) also performed well (Fig. 1a, right‐hand column): the t MRCA estimate (red point) was accurate and precise, and also highly outlying when compared with replicate analyses with sampling dates randomly permuted (purple points).

We next simulated data with the same balanced sampling, but little temporal structure, that is with sampling dates that were so close that only 0·2 substitutions per genome were expected between them (Fig. 1b). In this case, t MRCA estimates were highly inaccurate, but tests of temporal signal correctly indicated that these estimates could not be trusted. In particular, none of the 1000 data sets gave high r‐values (Fig. S1b), and tests confirmed that similar results could be obtained after randomly permuting the sampling dates. Therefore, with balanced sampling (Fig. 1a,b), tests of temporal signal perform well.

Performance declined substantially when sampling was confounded with genetic structure, that is when each genetic clade was sampled on a different date (Fig. 1c,d). In these cases, estimates of the t MRCA were highly inaccurate, but tests of temporal signal wrongly indicated that the inaccurate dates could be trusted. These artefacts occurred both when there was high temporal structure (Fig. 1c), and when there was low temporal structure (Fig. 1d). Indeed, with low temporal structure, over a third of the simulated data sets showed a high correlation between sampling date and root‐to‐tip distance (Fig. S1d), and a typical data set gave strong evidence of temporal signal, despite yielding a wildly inaccurate estimate of the t MRCA: 51 ybp, as opposed to the true value of 10 000 ybp.

To show why confounding misleads molecular dating, Fig. 2 illustrates two sections of phylogeny with the same sampling period, but different levels of confounding. (a) will tend to give better results than (b) for two connected reasons. First, in (b) the sampling period constitutes a much smaller proportion of the lineages that connect sequences sampled at different times. Secondly, (a) contains two quasi‐independent opportunities to measure the evolutionary change between the sampling dates, while in (b), the measurements are clearly non‐independent. As such, Fig. 2 suggests that the failure of random permutation can be understood, intuitively, as an inflation of the true sample size, when there is confounding. For this reason, one way to correct for the artefact is to identify genetic clusters (monophyletic groups) in the data that share a sampling date, and then permute dates over these clusters, rather than over the individual sequences (Duchêne et al. 2015a). With this approach (a) would contain four clusters, but (b) would contain only two, and so a clustered permutation test will be less likely to reach significance.

When Duchêne et al.'s (2015a) method of clustered permutation was applied to our simulated data, performance remained good with balanced sampling (Fig. 1a,b: P clust for regression, blue points for the Bayesian analysis) and improved dramatically with confounded sampling (Fig. 1c,d). In particular, with confounded sampling, neither test of temporal signal reached significance, indicating – correctly – that both date estimates were unreliable.

Clustered permutation corrects for the confounding of genetic and temporal structure, but sometimes this confounding can arise from the evolutionary process itself, and not from sampling artefacts. Any evolutionary change in the genetic constitution of a population could lead to sequences sampled on the same date being more closely related to each other. A classic example is the ‘ladderized’ genealogy of influenza A, caused by regular selective sweeps (Grenfell et al. 2004), but the same effect could arise from genetic drift (Gray, Pybus & Salemi 2011). In either case, temporal and genetic structures are inherently confounded, and so clustered permutation becomes conservative. To explore the power of the clustered tests in this situation, we simulated ladderized genealogies with high temporal structure (Fig. S2). Results showed that the clustered permutation approach was still able to detect the temporal signal (an appreciable rate of false negatives arose only when the basal clade was monophyletic, and fewer than four clusters were simulated).

Dating Artefacts with Whole Genomes of Methicillin‐Resistant s. aureus

Figure 1 illustrates dating artefacts with extreme cases, but the same artefacts occur with more realistic data. In the Supporting information, we demonstrate this with simulations (Tables S1–S3, Figs S1 and S3), but it can also be observed with real‐world data.

To see this, we reanalysed 157 complete genomes of epidemic methicillin‐resistant S. aureus sequence type (ST) 22, sampled over a 17‐year period (Holden et al. 2013). In agreement with Holden et al. (2013), we estimated the t MRCA of these sequences as 1980, 28 years prior to the youngest sample (Fig. S4). Several lines of evidence suggest that this t MRCA is plausible. First, all tests indicated very strong temporal signal (Fig. 3, Table S4); secondly, the inferred rate of evolution is consistent with previous estimates from S. aureus (Weinert et al. 2012); and finally, this dating places the acquisition of fluoroquinolone resistance at the time and location where fluoroquinolone drugs were first tested in UK clinical trials (Holden et al. 2013).

We next re‐estimated the t MRCA after subsampling the S. aureus strains. These subsamples were chosen to transect the same root node and to retain the 17‐year sampling period (illustrated in Fig. S4a–f). With these constraints, we chose strains either at random (reproducing the ‘balanced’ sampling of Fig. 1a,b) or in clusters sampled in the same year (reproducing the ‘confounded’ sampling of Fig. 1c,d). In all cases, the balanced subsampling provided consistent estimates of the t MRCA (Fig. 3a, purple points), albeit with wider credible intervals, reflecting the reduced sample size. However, the confounded subsamples produced much younger dates (Fig. 3a, blue points). In addition, all six subsamples gave evidence of temporal signal using the standard tests. If we were to trust these standard tests, we might draw quite different conclusions about the evolution of antibiotic resistance in the UK.

The same applies when we analysed subsamples collected over a 3‐year period (Fig. S4g,h). Given evolutionary rates for these strains, fewer than 7 nucleotide substitutions per genome would be expected during this entire sampling period, and so this produces ‘low temporal structure’ data sets. For both data sets, the estimated t MRCA differed from its true value (as inferred from the complete data set; Fig. 3b, red dashed line). For the balanced subsample, all tests confirmed this lack of temporal signal, but the standard tests failed for the confounded subsample, resulting in false confidence in an inaccurate and deceptively precise estimate of the t MRCA (Fig. 3b).

As with the simulated data, these problems can be solved by using the clustered permutation approach of Duchêne et al. (2015a). If we define clusters as monophyletic groups sampled in same year, regression and Bayesian approaches both correctly identified the data sets that yielded inaccurate estimates of the t MRCA. However, for these data, there is something arbitrary about the choice to cluster by year (we might also have chosen to cluster by month). This highlights the need for a test of confounding that can be applied to real‐world data sets. An obvious choice is a Mantel test of the correlation between pairwise genetic distances and absolute differences in sampling dates. Applying this test to the S. aureus data successfully identified the confounding in all of the confounded data sets, and in one of the smallest balanced data sets (Fig. 3). We then repeated the Mantel test after clustering the data (using the average pairwise genetic between clusters, and the absolute difference between sampling years). This test confirmed that our choice to cluster sampling dates by year was sufficiently coarse‐grained to eliminate the signal of confounding in these data (Fig. 3).

Model Selection Approach

A test for temporal signal not considered so far, is to compare the fit of models with the sampling dates either included (‘with dates’) or ignored (‘no dates’) (Rambaut 2000; Drummond, Pybus & Rambaut 2003b; Drummond et al. 2003a; Baele et al. 2012). Various measures and estimators of model fit are available (Rambaut 2000; Suchard, Weiss & Sinsheimer 2003; Kitchen, Miyamoto & Mulligan 2008; Baele et al. 2012). We initially tried the AICM, an analogue of the Akaike Information Criterion, which is estimated from the MCMC (Raftery et al. 2007; Baele et al. 2012).

On simulated data, the AICM approach performed very well, showing strong support for the ‘with dates’ model whenever the t MRCA was well estimated, and weak or no support when the t MRCA was poorly estimated (Fig. 1, Table S1). However, for the real S. aureus data, only one subsample gave evidence of temporal signal, and this was a confounded subsample where the t MRCA estimate was extremely poor (Fig. 3; Table S4). We next calculated full Bayes factors, using path sampling (Baele et al. 2012; Bouckaert et al. 2014; Leaché et al. 2014). This had the opposite problem: all but one subsample yielded strong support for the ‘with dates’ model. As such, model selection led to false confidence in inaccurate estimates of the t MRCA.

The failure of this approach is initially surprising, since it makes no explicit assumptions about random sampling or exchangeability. Since the approach worked well on simulated data (which used a strict clock and known substitution process), this is probably explained by model inadequacy. Evolutionary models may be good enough to provide accurate estimates of the t MRCA, and yet sufficiently different from reality to render unreliable a comparison of model fit with and without sampling dates. It is also notable that the Bayes factor approach worked well when sampling was random, but not when sampling was confounded (Fig. 3; Table S4). This might be a failure analogous to ‘overfitting’, given the reduction in effective sample sizes in the confounded data sets (Fig. 2).

Application to Data from a Single Outbreak

Examples above used data that were subsampled in a contrived way, but the same artefacts can arise with complete data sets. To illustrate this, we analysed whole genomes of S. aureus ST22, from a single disease outbreak. These samples were obtained from a veterinary hospital over approximately 2 months, initially from a dog admitted to the clinic (141 isolates), and then from a staff member (34 isolates) involved in the dog's treatment (Paterson et al. 2015).

Dated‐tip analyses of these data placed the t MRCA of the dog strains on the day after the dog's admission to the hospital, and the closely related strains from the staff member at c. 12 weeks earlier (Fig. 4, for the dog samples, and Fig. S5, for the staff member samples, red points). Together, these estimates suggest a scenario in which the dog was infected in the hospital, possibly by a staff member with a long‐standing infection, and where transmission was likely associated with a strong bottleneck (since all of the genetic variation in the dog can be traced back to a single feasible transmission event).

Standard tests of temporal signal supported this scenario. For the dog samples, Mantel tests yielded no evidence of confounding of temporal and genetic structures (P = 0·88), and permutation tests of the Bayesian dates detected temporal signal (Fig. 4 purple points) even, weakly, with clustered permutation (Fig. 4, blue points). However, a combined analysis of all 175 isolates shows that this t MRCA estimate – and thus the epidemiological inference – is probably unreliable. In particular, the genealogies of the dog and staff samples are intermingled, implying that they share a most recent common ancestor (Fig. S6; Paterson et al. 2015).

What is wrong with the analysis above? The answer is clear from comparing a neighbour‐joining tree to the Maximum Clade Consensus (MCC) tree from the beast analyses (Fig. 4). The neighbour‐joining tree has very little resolution reflecting the low genetic diversity in these data and confirms that the level of confounding is weak. In contrast, the beast tree is fully resolved and contains very high levels of confounding (Mantel tests using patristic distances: P < 0·001; Fig. 4, and Table S5). This shows that, in the absence of phylogenetic signal, the dating algorithm has enhanced the confounding, clustering the sequences by date to improve the fit of its clock model. (We note that no such difference was found in data sets analysed in earlier sections, where the data contained much higher levels of genetic diversity.)

It is important to note that low levels of genetic diversity would not be a problem, were there not also some genuine confounding of temporal and genetic structures, for in the absence of any confounding, a random permutation approach would succeed. For these S. aureus data, weak confounding – undetected by the Mantel test – probably arose from the clinical sampling practice. In particular, different sets of anatomical sites of the dog were sampled on different dates (in part, as a consequence of the progression of the disease), and genetic structure was associated with these sites (Paterson et al. 2015). As a result, we find genetic structure between the earliest dog samples, and those taken on later dates (permutation test of Hudson's F st estimator: P < 0·001; Hudson, Slatkin & Maddison 1992), although not between the two later dates.

When phylogenetic resolution is low, there are two ways to test for temporal signal, which avoid the artefact described above. The first is to use the regression approach, with a phylogeny that was inferred without making any assumptions about molecular rates. The second is to use the clustered Bayesian dating permutation approach, but with clusters identified from the MCC tree (Fig. 4, green points). Both approaches found no temporal signal in our S. aureus data (from either the dog, or the staff member; Fig. S5), confirming that t MRCA estimates from these data cannot be trusted.

Discussion

Molecular dates obtained with ‘dated‐tip’ methods are reliable only if the sequence data exhibit temporal signal. As such, we cannot trust dates obtained from these methods unless we can also trust the tests for temporal signal.

We have shown that all of the standard tests of temporal signal can be severely misled for data sets where temporal and genetic structures are confounded, that is when closely related sequences are more likely to have been sampled at similar times. Our results show that the reliability of date estimates cannot be determined from the degree of genetic structure per se (data sets in Fig. 1a–d had equally high levels of structure), nor from the number of sequences sampled (Fig. 3a shows that subsamples of any size can yield both inaccurate and accurate estimates) and nor from the overall range of the sampling dates, or level of temporal structure (which was held constant across both Figs 1a,c and 3a). However, we have shown that when confounding is present, the clustered permutation approach of Duchêne et al. (2015a), can give good results, whether applied to linear regression or Bayesian dating, and to data with or without temporal structure.

We have also introduced some refinements to the approach of Duchêne et al. (2015a), which show how clustered permutation can be best applied to real‐world data. In particular, we have shown how a Mantel test, comparing genetic distance and difference in sampling dates, can identify data sets where confounding is present (Fig. 3). We have also shown how the same test can confirm whether a particular choice of clusters has successfully removed the confounding (this is particularly useful when samples were taken on a very large range of dates, as in the S. aureus data from Holden et al. (2013). Finally, we have shown that an additional problem can arise for data with low levels of phylogenetic resolution, when dating algorithms may enhance the true level of confounding. We have suggested that, to mitigate this problem, clusters should be chosen from the tree estimated in the dating analysis (Fig. 4).

The problem of confounding, discussed here, may explain some previously noted failures of the dated‐tip approach. For example, Navascués & Emerson (2009) showed that inaccurate estimates of the t MRCA could be obtained in structured populations when ancient and modern sequences came from different genetic clusters. Indeed, confounding is likely to be particularly severe when the temporal information comes from a small number of ancient DNA sequences. Similarly, Duchêne, Duchêne & Ho (2015b) showed that inaccurate results could be obtained when trees were highly imbalanced. Again, this might result from confounding, since imbalanced trees contain smaller clades, which are more likely to share a sampling date just by chance (this possibility is supported by simulations showing that unbalanced trees can give reliable results when sampling is balanced; Fig. S3f).

Finally, we have suggested that confounding is likely to be common when serially sampled‐pathogen genomes are used to study the course of a single outbreak. This is partly because confounding can arise naturally from clinical sampling practice. For example, different individuals will often be sampled at different times (Harris et al. 2013; Paterson et al. 2015), and these individuals will generally contain distinct populations of a pathogen, resulting from transmission barriers between individuals, and population bottlenecks during transmission events. The same also applies to different tissues within an individual (e.g. Sacristán et al. 2003; Lee et al. 2008; Paterson et al. 2015) and to different geographic locations (Holmes 2008). We have also shown that the confounding may be enhanced when little evolutionary change has taken place, which may often be the case during a single outbreak. Consistent with this prediction, we have presented data from an outbreak of S. aureus where standard tests provide support for date estimates – and thereby transmission scenarios – that are doubtful on other grounds (Paterson et al. 2015).

If confounding of temporal and genetic structures is common, then many dated‐tip analyses may need revisiting. A remarkably common finding in the study of pathogen evolution has been that plausible biogeographic scenarios imply much slower evolutionary rates (and so much older t MRCA), than are obtained from dated‐tip analyses of serially sampled genomes; often, these estimates differ by several orders of magnitude (Sharp & Simmonds 2011). We have shown that artefactual evidence of temporal signal often leads to false confidence in dates that bear no relation to the true age of divergence (see, e.g. Fig. 1d). As such, results reported here may explain some of the wilder disagreements about pathogen origins.

References 46

  1. 1.

    Baele, G., Lemey, P., Bedford, T., Rambaut, A., Suchard, M.A. & Alekseyenko, A.V. (2012 ) Improving the accuracy of demographic and molecular clock model comparison while accommodating phylogenetic uncertainty. Molecular Biology and Evolution, 29, 2157–2167.

    Not in our library10.1093/molbev/mss084

  2. 2.
  3. 3.

    Buonagurio, D.A., Nakada, S., Parvin, J.D., Krystal, M., Palese, P. & Fitch, W.M. (1986 ) Evolution of human influenza A viruses over 50 years: rapid, uniform rate of change in NS gene. Science, 232, 980–982.

    Not in our library10.1126/science.2939560

  4. 4.

    Burnham, K.P. & Anderson, D.R. (2002 ) Model Selection and Multimodel Inference: A Practical Information‐Theoretic Approach, 2nd edn Springer, New York, NY.

    Not in our library

  5. 5.
  6. 6.

    Drummond, A.J., Pybus, O.G. & Rambaut, A. (2003b ) Inference of viral evolutionary rates from molecular sequences. Advances in Parasitology, 54, 331–358.

    Not in our library10.1016/s0065-308x(03)54008-8

  7. 7.

    Drummond, A.J., Pybus, O.G., Rambaut, A., Forsberg, R. & Rodrigo, A.G. (2003a ) Measurably evolving populations. Trends in Ecology & Evolution, 18, 481–488.

    Not in our library

  8. 8.

    Drummond, A.J., Suchard, M.A., Xie, D. & Rambaut, A. (2012 ) Bayesian phylogenetics with BEAUti and the BEAST 1.7. Molecular Biology and Evolution, 29, 1969–1973.

    Not in our library10.1093/molbev/mss075

  9. 9.

    Duchêne, D., Duchêne, S. & Ho, S.Y.W. (2015b ) Tree imbalance causes a bias in phylogenetic estimation of evolutionary timescales using heterochronous sequences. Molecular Ecology Resources, 15, 785–794.

    Not in our library10.1111/1755-0998.12352

  10. 10.

    Duchêne, S., Holmes, E.C. & Ho, S.Y.W. (2014 ) Analyses of evolutionary dynamics in viruses are hindered by a time‐dependent bias in rate estimates. Proceedings of the Royal Society B, 281, 20140732.

    Not in our library10.1098/rspb.2014.0732

  11. 11.

    Duchêne, S., Duchêne, D., Holmes, E.C. & Ho, S.Y.W. (2015a ) The performance of the date‐randomisation test in phylogenetic analyses of time‐structured virus data. Molecular Biology and Evolution, 32, 1895–1906.

    Not in our library10.1093/molbev/msv056

  12. 12.

    Duffy, S. & Holmes, E.C. (2009 ) Validation of high rates of nucleotide substitution in geminiviruses: phylogenetic evidence from East African cassava mosaic viruses. Journal of General Virology, 90, 1539–1547.

    Not in our library10.1099/vir.0.009266-0

  13. 13.

    Firth, C., Kitchen, A., Shapiro, B., Suchard, M.A., Holmes, E.C. & Rambaut, A. (2010 ) Using time‐structured data to estimate evolutionary rates of double‐stranded DNA viruses. Molecular Biology and Evolution, 27, 2038–2051.

    Not in our library10.1093/molbev/msq088

  14. 14.

    Fraile, A., Pagán, I., Anastasio, G., Sáez, E. & García‐Arenal, F. (2011 ) Rapid genetic diversification and high fitness penalties associated with pathogenicity evolution in a plant virus. Molecular Biology and Evolution, 28, 1425–1437.

    Not in our library10.1093/molbev/msq327

  15. 15.

    Gire, S.K., Goba, A., Andersen, K.G., Sealfon, R.S.G., Park, D.J., Kanneh, L. et al (2014 ) Genomic surveillance elucidates Ebola virus origin and transmission during the 2014 outbreak. Science, 345, 1369–1372.

    Not in our library10.1126/science.1259657

  16. 16.

    Gray, R.R., Pybus, O.G. & Salemi, M. (2011 ) Measuring the temporal structure in serially‐sampled phylogenies. Methods in Ecology and Evolution, 2, 437–445.

    Not in our library10.1111/j.2041-210x.2011.00102.x

  17. 17.

    Grenfell, B.T., Pybus, O.G., Gog, J.R., Wood, J.L.N., Daly, J.M., Mumford, J.A. & Holmes, E.C. (2004 ) Unifying the epidemiological and evolutionary dynamics of pathogens. Science, 303, 327–332.

    Not in our library10.1126/science.1090727

  18. 18.
  19. 19.

    Holden, M.T.G., Hsu, L.‐Y., Kurt, K., Weinert, L.A., Mather, A.E., Harris, S.R. et al (2013 ) A genomic portrait of the emergence, evolution, and global spread of a methicillin‐resistant Staphylococcus aureus pandemic. Genome Research, 23, 653–664.

    Not in our library10.1101/gr.147710.112

  20. 20.

    Holmes, E.C. (2008 ) Evolutionary history and phylogeography of human viruses. Annual Review of Microbiology, 62, 307–328.

    Not in our library10.1146/annurev.micro.62.081307.162912

  21. 21.

    Hudson, R.R., Slatkin, M. & Maddison, W.P. (1992 ) Estimation of levels of gene flow from DNA sequence data. Genetics, 132, 583–589.

    Not in our library10.1093/genetics/132.2.583

  22. 22.

    Kass, R.E. & Raftery, A.E. (1995 ) Bayes factors. Journal of the American Statistical Association, 90, 773–795.

    Not in our library

  23. 23.

    Kitchen, A., Miyamoto, M.M. & Mulligan, C.J. (2008 ) Utility of DNA viruses for studying human host history: case study of JC virus. Molecular Phylogenetics and Evolution, 46, 673–682.

    Not in our library10.1016/j.ympev.2007.09.005

  24. 24.

    Korber, B., Muldoon, M., Theiler, J., Gao, F., Gupta, R., Lapedes, A., Hahn, B.H., Wolinsky, S. & Bhattacharya, T. (2000 ) Timing the ancestor of the HIV‐1 pandemic strains. Science, 288, 1789–1796.

    Not in our library10.1126/science.288.5472.1789

  25. 25.

    Leaché, A.D., Fujita, M.K., Minin, V.N. & Bouckaert, R.R. (2014 ) Species delimitation using genome‐wide SNP data. Systematic Biology, 63, 534–542.

    Not in our library10.1093/sysbio/syu018

  26. 26.

    Lee, H.Y., Perelson, A.S., Park, S.‐C. & Leitner, T. (2008 ) Dynamic correlation between intrahost HIV‐1 quasispecies evolution and disease progression. PLoS Computational Biology, 4, e1000240.

    Not in our library10.1371/journal.pcbi.1000240

  27. 27.

    McAdam, P.R., Templeton, K.E., Edwards, G.F., Holden, M.T.G., Feil, E.J., Aanensen, D.M. et al (2012 ) Molecular tracing of the emergence, adaptation, and transmission of hospital‐associated methicillin‐resistant Staphylococcus aureus. Proceedings of the National Academy of Sciences, 109, 9107–9112.

    Not in our library10.1073/pnas.1202869109

  28. 28.

    Navascués, M., Depaulis, F. & Emerson, B.C. (2010 ) Combining contemporary and ancient DNA in population genetic and phylogeographical studies. Molecular Ecology Resources, 10, 760–772.

    Not in our library10.1111/j.1755-0998.2010.02895.x

  29. 29.

    Navascués, M. & Emerson, B.C. (2009 ) Elevated substitution rate estimates from ancient DNA: model violation and bias of Bayesian methods. Molecular Ecology, 18, 4390–4397.

    Not in our library10.1111/j.1365-294x.2009.04333.x

  30. 30.

    Pagán, I. & Holguín, Á. (2013 ) Reconstructing the timing and dispersion routes of HIV‐1 subtype B epidemics in the Caribbean and Central America: a phylogenetic story. PLoS ONE, 8, e69218.

    Not in our library10.1371/journal.pone.0069218

  31. 31.

    Paradis, E., Claude, J. & Strimmer, K. (2004 ) APE: analyses of phylogenetics and evolution in R language. Bioinformatics, 20, 289–290.

    Not in our library10.1093/bioinformatics/btg412

  32. 32.
  33. 33.

    Poncet, P. (2012 ). Modeest: Mode Estimation. Available from: http://cran.r-project.org/web/packages/modeest/index.html.

    Not in our library

  34. 34.

    R Core Team (2014 ) R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria http://www.R-project.org.

    Not in our library

  35. 35.

    Raftery, A.E., Newton, M.A., Satagopan, J.M. & Krivitsky, P.N. (2007 ). Estimating the integrated likelihood via posterior simulation using the harmonic mean identity Bayesian Statistics 8 (eds Bernardo J.M., Bayarri M.J. Berger J.O., David A.P., Heckerman D., Smith A.F.M. & West M. ), pp. 371–416. Oxford University Press, Oxford, UK.

    Not in our library

  36. 36.

    Rambaut, A. (2000 ) Estimating the rate of molecular evolution: incorporating non‐contemporaneous sequences into maximum likelihood phylogenies. Bioinformatics, 16, 395–399.

    Not in our library10.1093/bioinformatics/16.4.395

  37. 37.

    Rambaut, A. (2013 ) Path‐O‐Gen v1.4. Available from http://tree.bio.ed.ac.uk/software/pathogen/.

    Not in our library

  38. 38.

    Rambaut, A., Suchard, M.A., Xie, D. & Drummond, A.J. (2014 ) Tracer v1.6. Available from http://beast.bio.ed.ac.uk/Tracer.

    Not in our library

  39. 39.

    Ramsden, C., Holmes, E.C. & Charleston, M.A. (2009 ) Hantavirus evolution in relation to its rodent and insectivore hosts: no evidence for codivergence. Molecular Biology and Evolution, 26, 143–153.

    Not in our library10.1093/molbev/msn234

  40. 40.

    Sacristán, S., Malpica, J.M., Fraile, A. & García‐Arenal, F. (2003 ) Estimation of population bottlenecks during systemic movement of Tobacco Mosaic Virus in tobacco plants. Journal of Virology, 77, 9906–9911.

    Not in our library10.1128/jvi.77.18.9906-9911.2003

All 46 references

Cited by papers we hold 8

Reads

Read by people on this page

None yet.

Checked or read by AI through naulon

None yet.

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.

Are you an author?

Is this your paper?

Claim it to add your note and be paid when agents cite it. Free.