The Approximate Bayesian Computation (ABC) approach has been used to infer demographic parameters for numerous species, including humans. However, most applications of ABC still use limited amounts of data, from a small number of loci, compared to the large amount of genome-wide population-genetic data which have become available in the last few years.
We evaluated the performance of the ABC approach for three 'population divergence' models - similar to the 'isolation with migration' model - when the data consists of several hundred thousand SNPs typed for multiple individuals by simulating data from known demographic models. The ABC approach was used to infer demographic parameters of interest and we compared the inferred values to the true parameter values that was used to generate hypothetical "observed" data. For all three case models, the ABC approach inferred most demographic parameters quite well with narrow credible intervals, for example, population divergence times and past population sizes, but some parameters were more difficult to infer, such as population sizes at present and migration rates. We compared the ability of different summary statistics to infer demographic parameters, including haplotype and LD based statistics, and found that the accuracy of the parameter estimates can be improved by combining summary statistics that capture different parts of information in the data. Furthermore, our results suggest that poor choices of prior distributions can in some circumstances be detected using ABC. Finally, increasing the amount of data beyond some hundred loci will substantially improve the accuracy of many parameter estimates using ABC.
We conclude that the ABC approach can accommodate realistic genome-wide population genetic data, which may be difficult to analyze with full likelihood approaches, and that the ABC can provide accurate and precise inference of demographic parameters from these data, suggesting that the ABC approach will be a useful tool for analyzing large genome-wide datasets.
In evolutionary biology and population genetics, several approaches for inferring demographic or genetic parameters are based on Bayesian statistical inference [1–3]. Bayesian statistics is a general framework based on Bayes' theorem that can be used to estimate unknown parameters. Bayesian inference uses the following relationship
where P(θ|D) is the conditional distribution of some parameter of interest (θ) given the data (D), P(θ) is the prior distribution of the parameter, and P(D|θ) is the probability of the data given the parameter (the likelihood function: L(θ) = P(D|θ). According to the expression above, the conditional distribution P(θ|D) of the parameter given the data, which is called the posterior distribution, is proportional to the prior distribution and the likelihood. For most practical cases in evolutionary biology and population genetics, the likelihood function is very difficult to compute because of the large amount of data and the potentially complex models, and exact approaches requiring evaluation of the full likelihood are often restricted to simple evolutionary models .
Approximate Bayesian Computation (ABC) can be used to make inference for complex models with high dimensional data . First, in order to overcome the difficulty in evaluating exact likelihoods, ABC approximates the likelihoods of the parameters based on a tolerance level (with respect to some metric) for the difference between observed and simulated data. As the tolerance level goes to zero, ABC produces a sample from the posterior distribution. Second, to overcome the difficulty in evaluating high dimensional data, ABC evaluates summary statistics that reduce the dimensionality of the data. The summary statistics are ideally chosen so that they capture as much information as possible from the data about the parameter(s) of interest. However, because only non-sufficient summary statistics exist for most complex models and parameters of interest, the effects of such statistics will be case-dependent, and the effect of mapping the data space to arbitrarily chosen non-sufficient summary statistics space is not well-known. Tavaré et al. (1997)  described a straightforward rejection-algorithm for approximate Bayesian inference, which was extended by Pritchard et al. (1999)  to allow some level of deviation between the observed and simulated data. In short, their algorithm proceeds as follow: Simulate a large number of datasets based on different values for some parameter of interest, where the parameter values are sampled from a prior distribution. Next, calculate summary statistics of simulated datasets, accept or reject parameter values on the basis of the difference between simulated summary statistics and the summary statistics of some observed data. Finally, the accepted parameter values represent an approximate sample from the posterior distribution of the parameter of interest. There are several more advanced versions of the basic rejection approach, such as local linear regression adjustment , non-linear feed forward neural networks , ABC with Markov chain Monte Carlo , ABC with sequential Monte Carlo .
Population divergence models, or 'isolation with migration' models, have been used extensively in order to describe properties of populations and species, and to explore increasingly complex demographic scenarios e.g. [10–18]. These models can often be good approximations of scenarios that involve populations splitting off from an ancestral population e.g. [13, 18], such as the colonization of islands or distant continents, or the domestication of livestock and crops. In recent years, ABC has also been used to infer demographic parameters of humans from genetic data. For example, Fagundes et al. (2007)  estimated several demographic and historical parameters using divergence models, such as the timing of modern humans' exodus from Africa and the time of colonization of the Americas, based on data from 50 nuclear loci sequenced in African, Asian and Native American samples. Similarly, Wegmann et al. (2009)  applied ABC with a Markov chain Monte Carlo approach to estimate divergence times and migration rates between three African populations based on 331 microsatellites. Bertorelle et al. (2010)  conducted a survey about ABC related publications since 2002. In their survey, they found that 43% publications used microsatellite markers as the source of genetic information, which was the most common source, and the remaining fraction was divided between nuclear and mitochondrial sequence data. The median value of the number of loci for STR and nuclear sequence data was 9 and 19, respectively. Bertorelle et al. (2010)  concluded that most applications of ABC still use limited amounts of data, often due to using a small number of loci, compared to the amount of genome-wide population-genetic data which has become available in the last few years [22–26]. Recently, Wollstein et al. (2010)  used an ABC approach to investigate the demographic history of Oceania based on approximately 1 million SNPs. Based on that data, and accounting for ascertainment bias, they could provide a more detailed picture of human history and the peopling of Oceania than has previously been painted. However, most studies that use ABC are based on a small number of markers (e.g. Bertorelle et al. (2010) ) leading to, in many cases, imprecise parameter estimation , and questions about of the power of ABC under some scenarios [29, 30].
In this article, we investigate the performance and power of the ABC approach when we have access to large amounts of genome-wide population-genetic data. We study the ABC approach with local linear regression adjustment for several population divergence models. Simulated data is generated under 'human-like' conditions and from a particular known demographic model (some 150,000 to 300,000 SNPs are generated). Three population divergence models with increasing complexity are investigated, and we compare estimation accuracy of particular parameters under the different models. The effect of the number of loci on the performance of the ABC approach is also investigated.
We investigate three different population divergence models. These models were chosen to be similar to commonly studied population models, such as the 'isolation with migration' model, and to represent an increasing complexity. In the first model (Figure 1A), an ancestral population with size NA was split into two sub-populations (population 1 and population 2) at time T before present (scaled by 4Ne generations, where Ne = 10,000). Sub-populations had a constant size of N1 = Ne and N2 = 0.5Ne, respectively (where NA = N1 + N2). Migration between the two sub-populations occurred at rate m12 (from population 1 to population 2) and m21 (from population 2 to population 1), where the migration rate m = 4NeM and M is the fraction of migrants per generation. In this model, we treated the parameters T, m12 and m21 as unknown and we attempted to infer their values based on simulated genetic data. The sub-population sizes N1 and N2 were assumed to be known for this case.
In the second model (Figure 1B), an ancestral population was split into two sub-populations with size N1' and N2' at time T. The size of the ancestral population was set to NA = N1' + N2'. Each sub-population grew exponentially starting at time T with different rates α1 and α2. At present, the size of each sub-population was N1 and N2. In this model, we assumed that there was no migration between populations. We aim to estimate past population sizes N1' and N2', and present population sizes N1 and N2. Since both past and present population sizes will be drawn from prior distributions for each proposed set of parameters, the growth rates α1 and α2 are fixed and can be computed by . The divergence time T was assumed to be known in this model (T = 0.1 × 4Ne = 4,000 generations).
The third model (Figure 1C) was a combination of model 1 and model 2, we treated all parameters as unknown, and we were interested in estimating all these seven parameters: divergence time T, migration rates m12 and m21, past population sizes N1' andN2', and present population sizes N1 and N2.
Population-genetic SNP data, comparable in size to human SNP-chip data or large scale re-sequencing data, was simulated using Hudson's ms program . We simulated 10,000 genome-regions each of size 100 kb, for a total of 200 chromosomes (200 haploid individuals or 100 diploid individuals), 100 chromosomes from each sub-population. The mutation rate (θ = 4Neμ) per genome-region was set to 5, the recombination rate (ρ = 4Ner) per genome-region was set to 40. By assuming an effective population size of Ne = 10,000, the mutation rate θ corresponded to μs = 1.25 × 10-9 per base pair per generation, and the recombination rate ρ corresponded to rs ≈ 1.00 × 10-8 per base pair per generation. The recombination rate r was chosen to match recombination rates estimated from large-scale genomic data and the mutation rate μ was chosen to correspond to an incomplete set of SNPs (which was lower than the value ~10-8 for human genome) , on the order of 1/8th of all SNPs in the region. Furthermore, SNPs with minor allele frequency less than or equal to 5% were removed in order to mimic ascertained SNPs. With these values of the parameters, one replicate of the simulated data resulted in a few hundred thousand SNPs. The 10,000 genome-regions were assumed to be independent of each other. The ms commands for generating data under the three models are provided in the Additional file 1.
ABC with local linear regression adjustment
To estimate demographic parameters, we used the ABC approach with local linear regression adjustment, introduced by Beaumont et al. (2002)  that also utilize smooth weighting for candidate parameters instead of only using a rejection algorithm (e.g. Pritchard et al. 1999) . The linear regression is an innovation that has been successful in reducing the computational load of ABC, but it can produce nonsense values (due to post-processing of sampled values) for the posterior distribution that fall outside the prior distribution. Parameter values not included in the prior distribution cannot appear in the posterior distribution in parametric models as a consequence of Bayes' theorem, and a transformation of accepted parameters vales  solves this issue so that only values that appear in the prior distribution can appear in the posterior distribution.
In detail, our ABC procedure can be described as follows:
Sample a set of candidate parameters, θi, from each of the prior distributions;
Simulate population-genetic data using the sampled parameter-values θi under a particular model;
Compute summary statistics from simulated data;
Compute Euclidean norm for the differences between the set of simulated summary statistics, and the set of observed summary statistics, , so that , where q is the number of summary statistics. All summary statistics were standardized before computing the Euclidean norm.
Select a fixed fraction of candidate parameter-sets that have the smallest values of and use the Epanechnikov kernel to weight the candidate parameter-sets. Adjust candidate parameters by using a local linear regression approach .
We generated 50,000 replicate simulated dataset for each model and choice of prior that were investigated, which corresponds to 500 million simulated genome-regions of size 100 kb. The tolerance level was set to 1% (except for the investigation of tolerance level). In order to assure that the estimated posterior distribution obtained by the local linear regression approach stayed within the bounds of the prior distribution, we transformed the values of the accepted parameters in the rejection step before the regression step . The obtained adjusted parameter-values are draws from the posterior distributions, and can be used as an approximation of the posterior distributions of the parameters of interest.
We used eight different classes of summary statistics for the ABC approach. All summary statistics were computed individually for the two sub-populations, except for FST, resulting in a total of 15 summary statistics. Many of the summary statistics were based on 'haplotypes' and the genetic data were assumed to be phased. We define a haplotype locus by the chunk of DNA that extends from the SNP position a along the genome to the SNP position a + w (for a particular window size w). A haplotype-allele is defined as the combination of variants at all SNPs within the window w for a particular chromosome (and for a particular haplotype locus) . The 8 different classes of summary statistics are:
(1) Haplotype heterozygosity (HHA)  of the entire genome-region (the window extended over the entire 100 kb genome-region). The statistic was computed from the frequency 100hi of each haplotype-allele i in a particular population,
where n is the number of sampled chromosomes.
(2) Average heterozygosity of 10 kb-haplotype-windows (HAW). For a window of size 10 kb, the haplotype heterozygosity in a particular window j was computed as
where 10hij is the frequency of the haplotype-allele i in the 10 kb window j. The window moves one SNP at the time, and the average haplotype heterozygosity of all windows is
where n is the number of sampled chromosomes, and S is the number of SNPs.
(3) The average heterozygosity of all segregating sites (HSS). The HSS statistic was computed from
where fij is the frequency of allele i for SNP j, n is the number of sampled chromosomes, and S is the number of SNPs.
(4) Linkage disequilibrium (LDR), measured as r2 . For each pair of SNPs that were between 9 and 11 kb apart, r2 was computed using
where j1 and j2 denote the frequency of allele 1 and allele 2 at SNP J and k1 and k2 denote the frequency of allele 1 and allele 2 at SNP K, and x11 denotes the frequency of the J1K1 haplotype. The average r2 is computed across all pairs of SNPs (that are located between 9 kb and 11 kb from each other) to get LDR.
(5) The number of distinct haplotype-alleles (NOA) per genome-region.
(6) The number of private haplotype-alleles in each sub-population (NPA) per genome-region.
(7) Tajima's D (TAD). Computed for all SNPs in each genome-region following .
(8) FST (FST). Computed for all SNPs in each genome-region using equation 5.3 in .
The summary statistics were computed for each of the two populations, except for FST, and all summary statistics were averaged across the 10,000 genome regions. We also tested to use the variances (across the genome regions) instead of the means in the ABC procedure, see discussion.
Comparison of population models
To generate simulated datasets that represent potentially empirical datasets, we fixed a particular true value of each parameter (Table 1) and simulated "observed" datasets from the particular model under consideration. We used these "observed" datasets to evaluate how well the ABC approach could recover the true parameter values. By this setup, we could compare the true parameter values to the inferred parameter values and evaluate the performance of the ABC approach under different conditions. The prior distributions of each parameter in the ABC framework are given in Table 1. Note that we scaled the values of T, m12, and m21 by 4Ne, where Ne was set to 10,000. We start by investigating single "observed" datasets to mimic the conditions of empirical studies, followed by investigating multiple "observed" datasets. An outline of the various investigations is given in Additional file 1: Table S1.
True values and prior distributions of each parameter of the 3 models
Prior distribution (uniform)
For the simple isolation with migration model 1, the parameter estimation turned out to be quite accurate. Table 2 gives the means and the 95% credible intervals of the posterior samples of T, m12 and m21, and Figure 2 shows the prior and the estimated posterior distributions for the same parameters. For the divergence time T, the mean of the posterior sample was 0.30% smaller than the true value, and the 95% credible interval was narrow. For the migration rate m21, the mean of the posterior sample was 5.46% smaller compared to a true value of 1 (one) and the 95% credible interval was [0.5033, 1.3935]. The estimate of the migration rate m12 turned out to be very close to the true value of m12 (only 0.99% greater than the true value), but its 95% credible interval was about as wide as for m21.
Summary of the posterior sample for each parameter in model 1
The true value, the mean of the posterior sample, the difference of the estimated mean value and the true value, and the 95% credible interval of the posterior sample are given for each parameter
For model 2, the means of the posterior samples of past population sizes were slightly closer to the true values than the means for the present population sizes, but the 95% credible intervals of N1' and N2' were much more narrow compared to 95% credible intervals of N1 and N2, indicating that present population sizes are more difficult to estimate. Table 3 shows the mean and the 95% credible interval of the posterior samples of the past population sizes (N1' and N2'), and the present population sizes (N1 and N2). Figure 3 shows the prior and the estimated posterior distributions for the same parameters.
Summary of the posterior sample for each parameter in model 2
The true value, the mean of the posterior sample, the difference of the estimated mean value and the true value, and the 95% credible interval of the posterior sample are given for each parameter
Model 3 - a combination of model 1 and model 2 - is more complex, but also more flexible than models 1 and 2. For model 3, we estimated seven parameters compared to the three and the four parameters in models 1 and 2, respectively. A summary of the posterior samples for the parameters in model 3 is given in Table 4 and the estimated posterior distributions are shown in Figure 4. For model 3, the divergence time and the two past population sizes were estimated quite well; the mean values of the posterior samples were close to true values and the 95% credible intervals were fairly narrow. The means of the posterior samples of the two migration rates were relatively far from the true values (17.27% and 16.44%) and the 95% credible intervals were also wide (see Table 4). The two present population sizes were somewhat poorly estimated (Table 4).
Summary of the posterior sample for each parameter in model 3
The true value, the mean of the posterior sample, the difference of the estimated mean value and the true value, and the 95% credible interval of the posterior sample are given for each parameter
We compared the three parameters in common between model 1 and model 3, and the four parameters in common between model 2 and model 3. Generally, the estimation of each parameter was more accurate under model 1 or model 2 compared to model 3; both the mean values and the 95% credible intervals of the posterior samples were more precise for model 1 and 2 compared to model 3. Especially the 95% credible intervals estimated in models 1 and 2 were much smaller compared to the 95% credible intervals in model 3. These observations were not surprising and reflect the notion that the more complex a model is, the less accurate will the parameter estimation be (given the same estimation conditions). However, the means of the posterior samples of T, N1', N2', were still quite close to the true values even for the complex model 3, but the migration rates and present population sizes were more difficult to estimate as illustrated by the wide credible intervals (Figure 4).
We generated 195 "observed" datasets for model 3 where the true past population size N1' ranged from 200 to 9,800, the true current population size N1 ranged from 11,000 to 198,000, the true migration rate m21 ranged from 0.1 to 4.9, and the true divergence time T ranged from 0.01 to 0.49 (the other parameters were set to the same values as above, see Table 4). These datasets were generated to investigate to what extent the observations from single "observed" datasets generalize to a wide range of true values for various parameters and multiple instances of estimating parameters using ABC. In most of cases, the ABC with local linear regression adjustment estimated all four parameters satisfactory (Figure 5), including the difficult current population size and the migration rate, albeit that the credible intervals were large. For the past population size and the divergence time, there were a few exceptional cases where the 95% credible intervals extended over almost the entire range of the prior (e.g. T = 0.26 and N1' = 5,800). For these cases, the set of summary statistics for accepted parameter-values included one or more extreme outlier, which in turn caused the local linear regression to produce a wide range of adjusted parameter-values since the normal least-square estimation for the regression model is non-robust to outliers .
We also investigated a range of tolerance levels to determine its impact on the accuracy of the parameter estimation. For each of the 49 "observed" datasets where the true T ranged from 0.01 to 0.49, we varied the tolerance level from 0.2% to 10%. For each tolerance level, the mean (across the 49 choices of the true value of T) difference between the true and the estimated T (mean of the posterior sample) was computed (Figure 6). The difference between the true and the estimated T decreased as the tolerance decreased (Pearson correlation: 0.61, p < 10-10). Furthermore, the width of the 95% credible region also decreased with decreasing tolerance levels (Pearson correlation: 0.82, p < 10-24, Figure 6). For comparison, if the use a standard rejection algorithm instead of ABC with local linear regression, the difference between the true and the estimated T turned out to be very similar, but the width of the 95% credible region was slightly smaller when using local linear regression. Hence, as long as the number of accepted replicate simulations was reasonable - in this case a hundred or greater - the parameter estimation using ABC benefits from a low tolerance levels.
Both mutation rates and recombination rates can vary across the genome, and in most practical ABC analyses the empirical data will come from various genome regions with potentially different underlying mutation and recombination rates. In order to explore the effect of using fixed mutation and recombination rates in the ABC procedure, we simulated "observed" datasets where the mutation rate or the recombination rate of each genome region was randomly drawn from a normal distribution [norm(θ, 0.2) or norm(ρ, 1)]. The ABC procedure uses fixed values for the mutation and the recombination rates (θ = 5 and ρ = 40). In the case that the mutation rate or the recombination rate of the ABC was similar to the mean of the distribution of the mutation rate or the recombination rate, the ABC estimates were not affected much (Table 5) compared to if the mutation and recombination rates were fixed for the "observed" data (Table 4). However, if the simulations in the ABC procedure used a mutation rate that was a third of the mean of the "observed" data or three times larger than the mean of the "observed" data, the ABC estimates were not very accurate (Table 5). If the simulations in the ABC procedure used a recombination rate that was half of the mean of the "observed" data the ABC estimates were also inaccurate, but if the ABC procedure used a recombination rate that was twice as large as the mean of the "observed" data, the ABC estimates were less affected and stayed reasonably accurate (Table 5).
The estimation of divergence time, migration rates, past population sizes and present population sizes in model 3 when the mutation rate or the recombination rate varies across the genome regions
Parameter (true value)
Varying mutation rate (θ = 4Neμ)
Varying recombination rate (ρ = 4Ner)
E[θ] = 5/3
E[θ] = 5
E[θ] = 5 × 3
E[ρ] = 40/2
E[ρ] = 40
E[ρ] = 40 × 2
For each "observed" dataset, we randomly draw a mutation rate or a recombination rate for each genome region from a normal distribution with parameter (E[θ], 0.2) or (E[ρ], 1). The ABC procedure uses fixed values for the mutation and the recombination rates, θ = 5 and ρ = 40. The means and 95% CIs are averaged over 50 replicate "observed" datasets. Compare with Table 4 which shows the ABC estimates when the "observed" data are generated from a model with fixed values for the mutation and the recombination rates
Choosing a poor prior
In order to evaluate how a poor choice of prior affects the inference based on the ABC approach with local linear regression adjustment, we set a number of true values of the divergence time T outside the prior distribution of (0, 0.5) for model 3. All other parameter settings of the model and the priors were the same as in Table 1. We repeated the ABC procedure to infer the parameter T for this case where the prior distribution does not cover the true parameter values. The posterior sample was limited to the range of the prior distribution and the mean of the posterior sample for each case hit the upper bound of the prior distribution (Table 6). For comparison, if the ABC procedure with local linear regression was implemented without the transformation step, the mean of the posterior samples extended outside the upper bound of the prior, and the 95% credible interval extended well beyond the bounds on the prior distribution (but note that such results violate Bayes' theorem; Table 6). These observations were indications that some model assumption was violated, such as choosing a prior distribution that does not cover the true parameter value. By changing the prior of T to (0.3, 0.8) for the case of the true T = 0.7, and repeating the ABC analysis (10,000 replicate simulations), the mean of the posterior sample (0.7274) was quite close to the true value, and the 95% interval [0.6350, 0.7946] was fairly narrow around the true value.
Estimation of divergence time T for model 3 in cases where the prior distribution does not encompass the true parameter value
The means and the 95% credible intervals of the posterior samples are given for the ABC estimate using regression and transformation, using regression but without transformation, and without using regression (i.e., only using rejection). See text for a detailed explanation of the different versions of the ABC approach
Comparison of summary statistics
We investigated the performance of each summary statistic, and combinations of summary statistics, for estimating the divergence time T. We investigated the complex model 3 by simulating 49 "observed" datasets from a set of known parameter values using the same approach as described above. The ABC with the local linear regression adjustment was used to infer the population divergence time T. The mean difference between the true and the estimated T, and the mean width of the 95% credibility interval of the posterior sample of T is shown in Figure 7 and Additional file 1: Table S2 for each summary statistic, for pairs of summary statistics, and for the combination of all summary statistics. We first noted that an accurate mean of the posterior sample (small deviation from the true parameter-value) also corresponded to a narrow credible interval (Pearson correlation: 0.95, p < 10-18). Moreover, pairs of summary statistics generally improved the accuracy of the parameter estimation compared to single summary statistics; the mean difference between true and estimated T was greater than 0.070 for all single summary statistics (mean difference across the 8 summary statistics equaled 0.110), whereas the mean difference was less than 0.070 for 68% of the pairs of summary statistics (mean difference across the 26 pairs of summary statistics equaled 0.055). However, there were pairs of summary statistics that performed poorly - at the level of single summary statistics - for example, pairs that include FST generally performed poorly, as well as pairs that included similar types of data, such as the number of distinct haplotype-alleles (NOA) and the number of private haplotype-alleles (NPA, Figure 7, Additional file 1: Table S2). The combination of all eight summary statistics estimated the divergence time T accurately (the mean difference was 0.0203 and the mean width of the 95%-credible interval was 0.1669), but several pairs of summary statistics performed at the same level. Although this comparison of summary statistics was by no means exhaustive, we noted that i) combining summary statistics generally provided more accurate inference, and ii) there was a large variation in performance across pairs of summary statistics. These two observations suggested that combining several summary statistics that capture different population-genetic phenomena may be a powerful approach for making accurate inferences at the same time as keeping the number of summary statistics low, both important features for any ABC investigation .
Increasing the number of loci
We used a simulation approach to investigate the impact of the number of loci on accuracy of the ABC estimation, in particular the accuracy of the divergence time estimate and the migration rate estimates. We simulated 147 "observed" dataset from model 1 (each true parameter was varied for 49 values, T = 0.01, 0.02, ..., 0.49; m12 = 0.1, 0.2, ..., 4.9; and m21 = 0.1, 0.2, ..., 4.9, and the other true parameters were set as in Table 1) for increasing numbers of loci (100; 500; 1,000; 2,000; 3,000; 4,000; 5,000; 6,000; 7,000; 8,000; 9,000 and 10,000 genome-regions) and used the ABC approach to infer the divergence time T and migration rates. For increasing numbers of loci, Figure 8 shows the mean difference (across 49 choices of true parameter values for each parameter) of the true value and the mean of the posterior sample and the width of the 95% credible interval for the divergence time T and the migration rate m21 (the results for m12 were very similar to m21). The mean values of the posterior samples rapidly approach the true parameter value when the number of loci increases from 100 to 1,000 and the width of the 95% credible intervals rapidly decrease until about 2,000 loci, and continue to decrease at a low rate for increasing numbers of loci.
From the comparison of the three different models, it was clear that the accuracy in the parameter estimates was lower for the more complex model 3 with seven unknown parameters compared to models 1 and 2, which have three and four unknown parameters. This observation was not surprising since the less complex models were nested models within model 3. More generally, by increasing the number of simulated data sets in the ABC procedure, the parameter estimation was improved (especially the 95% credible interval). For example, for model 3, five of the seven parameter estimates were substantially improved if 50,000 replicates were used instead of 10,000 replicates, and the remaining two parameter estimates (the two current population sizes) were very similar regardless of the number of replicates. This result confirms that we can overcome some of the difficulties in parameter estimation for complex models by increasing the number of simulation steps in the ABC procedure, but it will mainly decrease the Monte Carlo error and allow a reduction of the tolerance level. However, the number of replicate simulations can be a limiting factor for ABC analyses of large scale genome-wide data because of computing time. In our case, approximately 8-9 minutes of CPU time was needed to generate one simulated dataset (10,000 genome regions of size 100 kb) for model 3 using ms , which corresponds to about 7,000 computer hours for 50,000 simulated datasets.
Among the seven parameters in our models, the migration rates and present population sizes were the most difficult to estimate. A divergence model without migration and an island migration model may result in quite similar gene genealogies for sampled individuals and there will be little information contained in most types of summary statistics to distinguish the differences . Moreover, in a divergence model, the estimates of migration rates may depend on the divergence time since a model with large divergence time and large migration rates can generate gene genealogies that are similar to the gene genealogies of a model with short divergence time and small migration rates. However, under a scenario of divergence and gene flow, the variation in genealogical histories for different parts of the genome could in principle be used to separate migration rates and divergence times. To determine similarity between the "observed" data and the simulated data, we used the means of the summary statistics. Another option would be to use variance, quartiles (e.g. ), or a combination of different summaries of the distributions. We tested the performance of using the variances (instead of the means) of the summary statistics to infer the divergence time and the two migration rates in model 1 (true T = 0.1, m12 = 2.0, and m21 = 1.0). However, the precision of the parameter estimates were clearly more accurate based on means compared to using variances (0.1003 vs. 0.1008 for T, 1.9803 vs. 2.0915 for m12, and 0.9454 vs. 0.8234 for m21). If we use both the mean and the variance, the precision of the parameter estimates were quite close to the result based only on means, but with larger 95% credible intervals ([0.0952, 0.1063] vs. [0.0816 0.1218] for T, [1.6516, 2.1560] vs. [1.2458 3.0073] for m12, [0.5033, 1.3935] vs. [0.1575 1.6617] for m21). Note also that the number of summary statistics for the combined case is twice the number of summary statistics for the case based on means. The lower quality of the estimates may be related to increasing the dimensionality of the problem as the number of summary statistics increases when considering both means and variances .
In models 2 and 3, it is assumed that the population sizes grow exponentially and the populations spend a very short amount of time with a size close to the 'present population size', hence the populations are far from being at an equilibrium. The summary statistics that we used capture events over a long period of time, and during most of this time, the populations have much smaller sizes compared to the present population sizes. Therefore, little information about present population sizes was contained in the summary statistics, which could explain the difficulty in estimating present population sizes compared to past population sizes.
We investigated cases where the true parameter value was outside the range of the prior distribution (Table 6) in order to determine its effect on the parameter estimation and the potential warning signals to pay attention to. If we use the ABC approach with local linear regression adjustment including the transformation step, the posterior sample will be limited to the range of the prior distribution so the ABC practitioner needs to be observant of posterior distributions that are pushed close to the boundaries of the prior. For comparison, the ABC approach with local linear regression adjustment without a transformation step produce mean values of the posterior samples that were often fairly close to the true values despite that the range of the prior distribution did not overlap with the true value (but note that such results violate Bayes' theorem, see above). In many Bayesian analyses, when the prior distribution does not include the true value of the parameter in its support, the posterior sample might be skewed towards the true value indicating that something might be wrong with the choice of prior distribution. The ABC approach with local linear regression adjustment and transformation seem to preserve this property, which is reassuring. In practice, if the posterior distribution ends up close to a bound on the prior, we should adjust the range of prior distribution, so that the posterior is well within the prior distribution.
Huang et al. 2011  demonstrated increasing power for inferring divergence times with increasing numbers of loci, but limited their investigation to relatively small numbers of loci (< 100). We investigated much larger numbers of loci and found that the mean values of the posterior sample approach the true values when approx. 1,000 loci (or more) were used (Figure 8). The width of the 95% credible interval decreases rapidly as the number of loci increase from 100 to some 2,000, after which the decrease rate of the 95% width was lower. The same trends were observed for both the divergence time and migration rates (Figure 8). These results suggest that increasing the number of loci from around a hundred to several thousand improves the accuracy of parameters estimation using ABC. Although the greatest improvement appears for less than 2,000 loci, we note that model 1 is a relatively simple model, and for more complex models, the accuracy of the parameter estimation may continue to improve beyond 2,000 loci.
Both the mutation and the recombination rates are likely to vary across the genome. However, we assumed that the mutation and recombination rates did not vary along the genome, and they were fixed to a known value for the simulations used in the ABC. We further demonstrate that this assumption works well even if the mutation and the recombination rates vary around some mean values as long as these mean values are similar to the fixed values used in the ABC. To make the simulations in the ABC approach even more realistic, we could draw mutation and recombination rates for each genome-region from some distribution and potentially estimate the empirical mutation and recombination rates. Alternatively, the mutation and recombination rates could be treated as nuisance parameters that are only included to make the simulated data better resemble the empirical data.
To conclude, we find that increasing the amount of data from a few loci, or a few hundred loci, to thousands of loci can substantially improve the accuracy of parameter estimation using ABC. In contrast to many full-likelihood inference approaches, the ABC approach is well suited for analyzing large amounts of population genomic data, using for example haplotype-based summary statistics.
We are grateful for financial support provided by a Sven and Lilly Lawski's Graduate Student Scholarship to SL, the Swedish Research Council, and the Swedish Research Council Formas. The computations were performed on resources provided by Swedish National Infrastructure for Computing (SNIC) through Uppsala Multidisciplinary Centre for Advanced Computational Science (UPPMAX) under Project p2009042 and s00110-213. We also thank Martin Lascoux and three anonymous reviewers for helpful comments and suggestions.
Department of Evolutionary Biology, EBC, Uppsala University
Science for Life Laboratory, Uppsala University
Stephens M: Inference Under the Coalescent. In Handbook of Statistical Genetics. Third edition. Edited by: Balding DJ, Bishop M, Cannings C. Chichester, UK: John Wiley & Sons, Ltd; 2008:878–908.
Beaumont MA, Rannala B: The Bayesian revolution in genetics.Nat Rev Genet 2004, 5:251–261.PubMedView Article
Marjoram P, Molitor J, Plagnol V, Tavaré S: Markov chain Monte Carlo without likelihoods.Proc Natl Acad Sci USA 2003, 100:15324–15328.PubMedView Article
Csilléry K, Blum MG, Gaggiotti OE, François O: Approximate Bayesian Computation (ABC) in practice.Trends Ecol Evol 2010, 25:410–418.PubMedView Article
Tavare S, Balding DJ, Griffiths RC, Donnelly P: Inferring Coalescence Times From DNA Sequence Data.Genetics 1997, 145:505–518.PubMed
Pritchard JK, Seielstad MT, Perez-Lezaun A, Feldman MW: Population growth of human Y chromosomes: a study of Y chromosome microsatellites.Mol Biol Evol 1999, 16:1791–1798.PubMedView Article
Beaumont MA, Zhang W, Balding DJ: Approximate Bayesian Computation in Population Genetics.Genetics 2002, 162:2025–2035.PubMed
Blum M, François O: Non-linear regression models for Approximate Bayesian Computation.Stat Comput 2010, 20:63–73.View Article
Sisson SA, Fan Y, Tanaka MM: Sequential Monte Carlo without likelihoods.Proc Natl Acad Sci 2007, 104:1760–1765.PubMedView Article
Nielsen R, Wakeley J: Distinguishing Migration From Isolation: a Markov Chain Monte Carlo Approach.Genetics 2001, 158:885–896.PubMed
Rosenberg NA, Feldman MW: The relationship between coalescence times and population divergence times. In Modern Developments in Theoretical Population Genetics. Edited by: Slatkin M, Veuille M. Oxford: Oxford University Press; 2002:130–164.
Rosenberg NA: The shapes of neutral gene genealogies in two species: probabilities of monophyly, paraphyly, and polyphyly in a coalescent model.Evolution 2003, 57:1465–1477.PubMed
Hey J, Nielsen R: Multilocus Methods for Estimating Population Sizes, Migration Rates and Divergence Time, With Applications to the Divergence of Drosophila pseudoobscura and D. persimilis.Genetics 2004, 167:747–760.PubMedView Article
Hey J: On the Number of New World Founders: A Population Genetic Portrait of the Peopling of the Americas.PLoSBiol 2005, 3:e193.View Article
Jakobsson M, Hagenblad J, Tavaré S, Säll T, Halldén C, Lind-Halldén C, Nordborg M: A Unique Recent Origin of the Allotetraploid Species Arabidopsis suecica: evidence from Nuclear DNA Markers.Mol Biol Evol 2006, 23:1217–1231.PubMedView Article
Jakobsson M, Rosenberg NA: The probability distribution under a population divergence model of the number of genetic founding lineages of a population or species.Theor Popul Biol 2007, 71:502–523.PubMedView Article
Becquet C, Przeworski M: A new approach to estimate parameters of speciation models with application to apes.Genome Res 2007, 17:1505–1519.PubMedView Article
Hey J: Isolation with Migration Models for More Than Two Populations.Mol Biol Evol 2010, 27:905–920.PubMedView Article
Fagundes NJR, Ray N, Beaumont M, Neuenschwander S, Salzano FM, Bonatto SL, Excoffier L: Statistical evaluation of alternative models of human evolution.Proc Natl Acad Sci 2007, 104:17614–17619.PubMedView Article
Wegmann D, Leuenberger C, Excoffier L: Efficient Approximate Bayesian Computation Coupled With Markov Chain Monte Carlo Without Likelihood.Genetics 2009, 182:1207–1218.PubMedView Article
Bertorelle G, Benazzo A, Mona S: ABC as a flexible framework to estimate demography over space and time: some cons, many pros.Mol Ecol 2010, 19:2609–2625.PubMedView Article
The International HapMap 3 Consortium: Integrating common and rare genetic variation in diverse human populations.Nature 2010, 467:52–58.View Article
Jakobsson M, Scholz SW, Scheet P, Gibbs JR, VanLiere JM, Fung H, Szpiech ZA, Degnan JH, Wang K, Guerreiro R, Bras JM, Schymick JC, Hernandez DG, Traynor BJ, Simon-Sanchez J, Matarin M, Britton A, van de Leemput J, Rafferty I, Bucan M, Cann HM, Hardy JA, Rosenberg NA, Singleton AB: Genotype, haplotype and copy-number variation in worldwide human populations.Nature 2008, 451:998–1003.PubMedView Article
Li JZ, Absher DM, Tang H, Southwick AM, Casto AM, Ramachandran S, Cann HM, Barsh GS, Feldman M, Cavalli-Sforza LL, Myers RM: Worldwide Human Relationships Inferred from Genome-Wide Patterns of Variation.Science 2008, 319:1100–1104.PubMedView Article
Novembre J, Johnson T, Bryc K, Kutalik Z, Boyko AR, Auton A, Indap A, King KS, Bergmann S, Nelson MR, Stephens M, Bustamante CD: Genes mirror geography within Europe.Nature 2008, 456:98–101.PubMedView Article
Reich D, Thangaraj K, Patterson N, Price AL, Singh L: Reconstructing Indian population history.Nature 2009, 461:489–494.PubMedView Article
Wollstein A, Lao O, Becker C, Brauer S, Trent RJ, Nürnberg P, Stoneking M, Kayser M: Demographic History of Oceania Inferred from Genome-wide Data.Curr Biol 2010, 20:1983–1992.PubMedView Article
Huang W, Takebayashi N, Qi Y, Hickerson M: MTML-msBayes: Approximate Bayesian comparative phylogeographic inference from multiple taxa and multiple loci with rate heterogeneity.BMC Bioinformatics 2011, 12:1.PubMedView Article
Beaumont MA: Joint determination of topology, divergence time and immigration in population trees. In Simulations, Genetics and Human Prehistory. Edited by: Matsumura S, Forster P, Renfrew C. Cambridge, UK: McDonald Institute for Archaeological Research; 2008:135–154.
Blum MGB: Approximate Bayesian Computation: A Nonparametric Perspective.J Am Stat Assoc 2011, 105:1178–1187.View Article
Hudson RR: Generating samples under a Wright-Fisher neutral model of genetic variation.Bioinformatics 2002, 18:337–338.PubMedView Article
The 1000 Genomes Project Consortium: A map of human genome variation from population-scale sequencing.Nature 2010, 467:1061–1073.View Article
Hamilton G, Stoneking M, Excoffier L: Molecular analysis reveals tighter social regulation of immigration in patrilocal populations than in matrilocal populations.Proc Natl Acad Sci 2005, 102:7476–7480.PubMedView Article
Conrad DF, Jakobsson M, Coop G, Wen X, Wall JD, Rosenberg NA, Pritchard JK: A worldwide survey of haplotype variation and linkage disequilibrium in the human genome.Nat Genet 2006, 38:1251–1260.PubMedView Article
Hill WG, Robertson A: Linkage disequilibrium in finite populations.Theor Appl Genet 1968, 38:226–231.View Article
Tajima F: Statistical Method for Testing the Neutral Mutation Hypothesis by DNA Polymorphism.Genetics 1989, 123:585–595.PubMed
Weir BS: Genetic Data Analysis II. Sunderland, MA, USA: Sinauer Associates, Inc.; 1996:174.
Rousseeuw PJ: Least Median of Squares Regression.J Am Stat Assoc 1984, 79:871–880.
Blum MGB, Jakobsson M: Deep Divergences of Human Gene Trees and Models of Human Origins.Mol Biol Evol 2011, 28:889–898.PubMedView Article