 Research article
 Open
 Published:
Effect of genotype imputation on genomeenabled prediction of complex traits: an empirical study with mice data
BMC Geneticsvolume 15, Article number: 149 (2014)
Abstract
Background
Genotype imputation is an important tool for wholegenome prediction as it allows cost reduction of individual genotyping. However, benefits of genotype imputation have been evaluated mostly for linear additive genetic models. In this study we investigated the impact of employing imputed genotypes when using more elaborated models of phenotype prediction. Our hypothesis was that such models would be able to track genetic signals using the observed genotypes only, with no additional information to be gained from imputed genotypes.
Results
For the present study, an outbred mice population containing 1,904 individuals and genotypes for 1,809 preselected markers was used. The effect of imputation was evaluated for a linear model (the Bayesian LASSO  BL) and for semi and nonparametric models (Reproducing Kernel Hilbert spaces regressions – RKHS, and Bayesian Regularized Artificial Neural Networks – BRANN, respectively). The RKHS method had the best predictive accuracy. Genotype imputation had a similar impact on the effectiveness of BL and RKHS. BRANN predictions were, apparently, more sensitive to imputation errors. In scenarios where the masking rates were 75% and 50%, the genotype imputation was not beneficial. However, genotype imputation incorporated information about important markers and improved predictive ability, especially for body mass index (BMI), when genotype information was sparse (90% masking), and for body weight (BW) when the reference sample for imputation was weakly related to the target population.
Conclusions
In conclusion, genotype imputation is not always helpful for phenotype prediction, and so it should be considered in a casebycase basis. In summary, factors that can affect the usefulness of genotype imputation for prediction of yettobe observed traits are: the imputation accuracy itself, the structure of the population, the genetic architecture of the target trait and also the model used for phenotype prediction.
Background
Genomeenabled prediction of quantitative traits is a topic of current interest in genetic improvement of agricultural animal and plant species, as well as in preventive and personalized medicine in humans. In agriculture, it has been applied to prediction of genetic merit for breeding purposes [1] and to management decisions based on predicted phenotypes [2],[3]. In human medicine, it has been applied for example to prediction of risk to disease [4],[5]. The original idea was proposed by Meuwissen et al. [6] and involves the use of prediction models including thousands of Single Nucleotide Polymorphisms (SNPs) fitted simultaneously as predictor variables, generally using shrinkagebased estimation techniques (e.g. [7]). The implementation of such models involves two steps. First, a group of individuals having both phenotypic and genotypic information (generally referred to as reference sample) is used to train the model. Crossvalidation techniques can be used to compare different models. Secondly, the trained model is applied to a group of individuals with genotypic information only (the target sample), for prediction of their genetic merit or of their yettobeobserved phenotypes.
A commonly used technique in this field is genotype imputation. Genotype imputation can be employed to fill in missing data from the laboratory or allow merging data sets generated from different SNP chips. Genotype imputation has been proposed also to impute from genotypes scored with lowdensity chips to higher densities, as a way to reduce genotyping costs [3],[8],[9]. Other authors have proposed to use cosegregation information from chips built with evenly spaced lowdensity SNPs or SNPs selected by their estimated effects to track signals of high density SNP alleles [10]. Weigel et al. [11] showed that a lowdensity panel containing selected SNPs can retain most of the prediction ability of highdensity panels. Furthermore, in a later study, Weigel et al. [3] also showed that imputed genotypes can provide similar levels of predictive ability to those derived from high density genotypes in scenarios where a suitable reference population is available.
The benefit of imputing genotypes essentially depends on its imputation accuracy [3], which, in turn, depends on a number of factors including population structure [3],[12], and genetic architecture of the target trait [13]. Many studies have shown that currently available imputation methods and software give a satisfactory level of accuracy of uncovering unknown genotypes [8],[14][16]. Hence, imputation may provide a suitable alternative for reducing genotyping costs, and it has been suggested for commercial applications such as the prescreening of young bulls and heifers in dairy cattle [3]. Moreover, VanRaden et al. [17] reported that the reliability of genomic predictions can be improved at a lower cost by combining information from chips containing varied marker densities, to increase both the number of markers and animals included in genomebased evaluation.
So far, all studies conducted to evaluate the effect of genotype imputation on wholegenome prediction have assumed a linear relationship between phenotype and genotype, aimed at capturing additive genetic effects only. However, complex traits are known to be affected by complex gene effects and interactions [18]. For this reason, interest in non and semiparametric methods for prediction of complex traits using genomic information has been increasing. Such methods include Reproducing Kernel Hilbert Spaces (RKHS) regressions on markers [19][21] radial basis functions [22],[23], and artificial neural networks [24],[25]. Gianola et al. [24] argued that these nonparametric regressions can capture complex interactions and nonlinearities, which is not possible with Bayesian linear regressions commonly used in genomic prediction.
Recently, Heslot et al. [26] evaluated the prediction accuracy of several models including Bayesian regression methods and machine learning techniques. Their results indicated a slight superiority of nonlinear models for phenotype prediction in plants. As another example, Okut et al. [25] used Bayesian Regularized Neural Networks (BRANN) to predict body mass index (BMI) in mice using information on 798 SNPs, and obtained an overall correlation between observed and predicted data that varied between 0.25 and 0.3. Similar results were obtained by de los Campos et al. [27] using a Bayesian LASSO approach but using a panel that was 13 times larger, comprising 10,946 SNPs. PerezRodriguez et al. [28] compared linear and nonlinear models for genomeenabled prediction in wheat and showed that nonlinear models in general performed better. However, the author found that in this case the BRANN did not outperformed the BL. Lastly, Howard et al. [29] indicated a clear superiority of RKHS when predicting epistatic traits using simulation.
The objective of our study was to investigate the effect of genotype imputation in the context of wholegenome prediction of complex traits in mice using parametric, semiparametric and nonparametric models applied to different sizes of subsets of SNPs. Our underlying hypothesis was that more elaborated prediction models, such as those capable to accommodate nonadditive genetic effects, would not benefit significantly from genotype imputation for prediction of yettobeobserved phenotypes.
Results
Results indicated a good accuracy of imputation of unknown genotypes for all scenarios (Table 1). The lowest imputation accuracy (0.75) was for the scenario with approximately 90% of the genotypes masked and the reference panel was not related to the imputing set. Although Beagle software does not use pedigree information, a higher genetic relatedness among individuals in the reference panel and in the set containing missing genotypes can enhance imputation accuracy. The explanation is that similarity of linkage disequilibrium (LD) patterns between the set to be imputed and the reference panel serves as a basis for imputing the unknown genotypes. The most common error found was the switch between heterozygotes and homozygotes for the allele at higher frequency (about 65%).
Correlations between predicted and observed phenotypes in the testing set are shown in Tables 2 and 3 for body weight (BW) and body mass index (BMI), respectively. The distribution of individuals into training and testing sets affected the predictive ability of all models considered. A higher genetic relatedness between these two sets provided better prediction accuracy for BW. On the other hand, for BMI, the average correlation between predicted and observed phenotypes was higher for the across families layout. Therefore, information from closely related individuals for SNP effect estimation was beneficial for prediction of new phenotypes, at least for BW.
As expected, the predictive ability for BW was higher than for BMI, since the latter has a lower heritability. Differences on results for each trait are also probably due to differences between their underlying genetic architectures. As discussed by Legarra et al. [30], in this data set there is some confounding between family and cage effects since most animals allocated to the same cage were full sibs, so it is possible that the additive genetic effect is understated. For the present study however, it is reasonable to assume that this issue would impact the predictive ability of the different models considered in a similar way.
In general, the method with the best prediction results was RKHS using kernel averaging, and the worst was BRANN, probably due to overfitting. BRANN showed high correlation (above 0.9) between predicted and measured phenotype for the training sets (results not shown). Table 2, which describes results for BW, shows that imputation seemed to be beneficial for phenotype prediction when relatedness between reference and target samples was poorer, especially for BL and RKHS. Table 3, in contrast, shows a markedly noticeable benefit of imputation when the number of markers available in the testing set was low (201 SNPs) for the withinfamily layout when predicting BMI. Regarding the methods, imputation seemed to have similar impact on efficiency of BL and RKHS, whereas for BRANN it resulted in less robust predictions due to imputation error. In scenarios with good imputation accuracy and masking rates of 75% and 50%, the genotype imputation did not bring great benefit, as seen in Tables 2 and 3. However, when genotype information was sparse (90% masking rate – 201 observed genotypes) imputation could bring information about important markers to improve phenotypic prediction.
The results for predicted mean squared error (PMSE) are summarized in Tables 4 and 5 for BW and BMI, respectively. For BW, the lowest values of PMSE were found for predictions made within families with the full data set (1,809 SNPs). This agrees with the results obtained for predictive correlation described earlier. In general, higher masking rates resulted in a higher PMSE for BW and data containing imputed genotypes provided a better goodness of fit compared to the data with no genotype imputation when markers were masked. With BMI, however, the PMSE showed no changes according to genotype masking rates or genotype imputation for BL and RKHS models. Overall, BRANN had the highest PMSE values, in agreement with the results using correlation between observed and predicted phenotypes.
Discussion
Recently, some studies have investigated the predictive ability of models using subsets of SNPs, with and without imputation [8],[31],[32]. In general, predictive ability improved with imputed genotypes, such that many researchers recommend this strategy to decrease costs on genomic selection programs. However, most studies with genotype imputation in wholegenome predictions considered only linear models, such as ridge regression, Bayesian LASSO or GBLUP approaches [3],[8],[12] specifically suited to model additive genetic signals but not tailored to capture nonadditive genetic effects such as dominance and epistasis. The goal of our study was to explore if more elaborated models, such as semiparametric and nonparametric methods, could track genetic signals from lowdensity chips without the need of imputing to higher density chips.
The results obtained indicated that imputation of the missing genotypes was not always advantageous for phenotypic prediction. The benefit of imputing genotypes depended on the degree of relatedness between reference and target samples, genetic architecture of the trait, number of markers available in the original panel, and the method used to predict marker effects.
Weigel et al. [3] investigated the effect of imputation from a lowdensity chip to a 50K chip on the accuracy of direct genomic values in Jersey cattle using BL. They found that genotype imputation improved predictive ability in scenarios where imputation accuracy was high; otherwise, a reduced panel containing the original number of SNPs was preferred. In the same context, Mulder et al. [8] showed that due to the magnitude of imputation errors, the noise added by imputation can be greater than its benefit when predicting breeding values. Hence, only those SNPs with high imputation accuracy would have a positive effect on the reliability of direct genomic value predictions. In the present study, results also suggested that if imputation accuracy was low, the model containing only observed marker genotypes gave a better prediction than the imputed set. The correlation between predicted and measured BW within families using either a full data set containing 1,809 genotyped SNPs, or the full data set containing 90% imputed genotypes, or a reduced panel of marker genotypes (201 SNPs) was respectively 0.52, 0.42 and 0.50 using RKHS. This indicates that imputation brought no additional information to the model.
For scenarios with different masking rates the imputed testing set gave, on average, a 4% higher correlation. For BMI, the reduced testing sets (201, 453 or 905 SNPs) provided 89% of the predictive ability of their respective complete imputed testing sets and 78% of the predictive ability of the complete testing sets, averaged across all scenarios tested. So, in general, the results indicated that imputation can be useful for phenotypic prediction.
When comparing correlations for across and within families crossvalidation strategies, genotype imputation seemed to be more effective in improving prediction accuracy in cases where there was a weaker genetic relationship among individuals in the reference and testing data sets. Other studies regarding the role of within and acrossfamily information [30] also indicate the need of genotyping and phenotyping closely related individuals, in order to improve predictive ability. As such, this information is an important issue for designing genomeassisted breeding programs.
Regarding the models considered, it was expected that the nonparametric methods would give smaller differences between the complete set with imputed markers and the reduced panel. However, our results indicated that the effect of imputation was similar for BL and RKHS predictions. An exception was the case of BRANN, which was not able to cope with imputation errors and tended to give worse predictions for the complete testing set containing imputed markers. Therefore, it seems that imputation accuracy is a fundamental factor to be considered when using BRANN for predicting phenotypes. The imputation from 905 markers to the full panel (1,809 SNPs) tended to slightly improve prediction using BRANN perhaps due to the low imputation errors rates for these panels.
Another discussion, beyond the scope of this paper, is on differences between chips containing either equally spaced SNPs or SNPs preselected based on their estimated effects for genomeenabled prediction (e.g., [33]). The main advantage of the former is that it avoids the need of traitspecific lowdensity SNP panels and, in general, it has given reliability of genomic breeding values similar to the latter [13]. Comparing the results obtained with the available literature on genomic selection applied to this same data set, it was found that no important differences in predictive ability were observed when using the entire set of SNPs. For example, de los Campos [27] used 10,946 SNPs with a BL model and observed a rank correlation of 0.306 between phenotypic observations and genomic predictions for BMI. Here, we obtained almost 95% of this correlation using the same method but with only 1,809 evenly spaced SNPs. In addition, Okut et al. [25] reported a correlation between predictions and observations in the testing set of 0.18 for BMI using BRANN and 798 preselected markers. We obtained a correlation of 0.15 with the same model and 905 evenly spaced markers, which suggests that BRANN can work better using selected markers with larger effects.
Similar results were observed in terms of PMSE. Apparently, higher imputation errors caused higher values of PMSE, making the results from models using the reduced SNP panel better than those containing imputed marker genotypes.
The results of the present study can be generalized for different scenarios, regardless the number of SNPs and/or sample size of a particular study, based on the impact of imputation accuracy on the predictive quality of genomic models. Clearly, the predictive ability of a model not only depends on how well genotypes are imputed but also on the genetic architecture of the target trait and the breeding program design. Therefore, the general reasoning provided by the results of the present study is that the use of genotype imputation should the evaluated in a casebycase basis. For example, the use of imputed genotypes when employing the nonparametric method (BRANN, in this case) is not recommended given that this model tends to approximate the noise inserted by imputation errors.
Conclusions
Genotype imputation did not always improve the predictive ability of parametric and semiparametric models. For BW, genotype imputation improved predictive ability when there was a relatively low genetic relatedness between the reference panel and the target population set. For BMI, the use of genotype imputation was more beneficial when the genotype set was very sparse (201 SNPs), especially for BL and RKHS. In other scenarios, imputation just slightly improved or even deteriorated predictive ability; the latter happened in cases in which the genotype imputation had low accuracy. Lastly, BRANN seemed more sensitive to imputation errors; therefore the use of imputed genotypes with this model should be carefully evaluated when using neural networks.
Methods
Data
A publicly available dataset on mice (http://mus.well.ox.ac.uk/mouse/HS/) was used. This is a sample from an outbred mice population that descended from eight inbred strains created for finemapping QTL and highresolution wholegenome association analysis of quantitative traits [34]. The data set contains genotypic information from 1,904 fully pedigreed mice on 13,459 SNPs coded as 0, 1 and 2 as the number of copies of the more frequent allele. Traits such as weight, immunology, obesity and behavior, to name a few, are also available for a proportion of these animals. A full description of this mice population is in [35] and [36]. This data have also been utilized in genomicenabled prediction studies using Bayesian regression methods [2],[27],[30],[37] and neural networks [25].
In our analysis, only animals with both phenotypic and genotypic information were considered. Loci with a minor allele frequency lower than 0.05, a call rate lower than 95% or not in HardyWeinberg equilibrium (p<0.01) were discarded from the original dataset. The two traits, BW at ten weeks of age, and body mass index BMI were precorrected by fitting the following linear mixed model:
where y is the vector of observations on one of the measured phenotypes (BW or BMI); θ is an unknown vector of fixed effects of age, gender, month and cage density; c is a random vector of unknown cage effects; u is a random vector of unknown additive genetic effects; X , W and Z are the incidence matrices of fixed, random cage and additive genetic effects, respectively, and e is a vector of residual effects assumed to follow a multivariate normal distribution $\mathit{e}~N\left(\mathbf{0},\mathit{I}{\mathit{\sigma}}_{e}^{\mathbf{2}}\right)$, where ${\sigma}_{e}^{2}$ is the residual variance. The random additive genetic and cage effects were assumed independent from each other and with distributions $\mathit{u}~\mathit{N}\left(\mathbf{0},\mathit{A}{\mathit{\sigma}}_{\mathrm{u}}^{2}\right)$ and $\mathit{c}~\mathit{N}\left(\mathbf{0},\mathit{I}{\mathit{\sigma}}_{\mathrm{c}}^{2}\right)$, respectively, where A is the additive genetic relationship matrix, I is an identity matrix of appropriate order, and ${\mathrm{\sigma}}_{\mathrm{u}}^{2}$ and ${\mathrm{\sigma}}_{\mathrm{c}}^{2}$ are additive genetic and cage components of variance, respectively. The target response variable after correction was ${\mathbf{y}}^{\mathbf{*}}\mathbf{=}\mathbf{y}\mathbf{}\mathbf{X}\widehat{\mathbf{\theta}}\mathbf{}\mathbf{W}\widehat{\mathbf{c}}$, which presumably includes all types of genetic effects (additive, dominance and epistasis) as well as additional environmental effects not accounted for by the mixed model employed. From now on the precorrected phenotype y* will be simply referred to as y.
After data cleaning, 10,348 SNPs remained from which 1,809 equally spaced SNPs were selected and regarded as full genotyped data due to computational limitations on number of markers that can be fitted when using Bayesian Regularized Neural Networks. Then, subsets containing 905, 453 and 201 (50, 75 and 90% masking rates, respectively) equally spaced SNPs were taken from the full genotype set. In total, 1,881 and 1,823 individuals were included in the analysis of BW and BMI, respectively. For a crossvalidation (CV) model comparison, in each case, approximately 2/3 of the individuals were designated as training set (reference sample) and 1/3 as testing set (target sample) (See Table 6). Two CV scenarios were considered, denoted as “across” and “within” families as also applied by [30]. In the across families approach, whole families were randomly assigned to training and testing sets, whereas in the within families approach, individuals from each family were randomized to training and testing sets. Subsequently, phenotypic predictions were performed using the three methods (BL, RKHS and BRANN) for both traits and for data sets containing either the full genotype set or subsets (201, 453 or 905 SNPs), with or without genotype imputation. Details on the imputation approach and models considered are provided below.
Imputation
Testing sets containing 201, 453 and 905 SNPs were imputed to 1,809 SNPs using the Beagle software [38]. This software is based on Hidden Markov Models that cluster haplotypes at each locus. The clustering adapts to the amount of information available so that the number of clusters increases globally with sample size and locally with increasing linkage disequilibrium levels [14]. The training set, which contained 1,809 markers, was used as a reference sample for imputation of SNPs in the testing set. Imputation was carried out for both prediction scenarios (“across” and “within”) using only population structure and ignoring pedigree information. To check the global imputation accuracy, the imputed sets were compared with the full data set to calculate the percentage of correctly imputed genotypes.
Bayesian LASSO
Tibshirani [39] proposed a regression method called Least Angle Shrinkage Selection Operator (LASSO) that combines feature subset selection and shrinkage estimation. In this model, a penalty term proportional to the norm of regression coefficients is added to the optimization problem formula, allowing for variable selection and shrinkage of coefficients simultaneously. The optimization problem can be expressed as:
where $\sum _{i}{\left({y}_{i}{\mathit{x}}_{\mathrm{i}}\mathit{\text{'}}\mathit{\beta}\right)}^{2}$ is the residual sum of squares and $\lambda {\displaystyle \sum _{j}\Vert {\beta}_{j}\Vert}$ is the penalization factor, with x _{ i } and β representing the incidence and parameter vectors, respectively, and λ is a regularization parameter. A larger λ means stronger shrinkage and some β’s are even zeroed out.
A Bayesian version of the LASSO was proposed by [40], who described a Gibbs sampling implementation. In this Bayesian interpretation, the LASSO solution can be viewed as a conditioned posterior mode in a Bayesian model with Gaussian likelihood, $p\left(\mathit{y}\left\mathit{\beta},{\sigma}_{e}^{2})={\displaystyle {\prod}_{i=1}^{n}N({y}_{i}\left{\mathit{x}}_{\mathrm{i}}\mathit{\text{'}}\mathit{\beta},\right.}\right.{\sigma}_{e}^{2}\right)$ and a conditional (given λ) prior on β that is a product of p independent, zero mean, doubleexponential (DE) densities [40]. The doubleexponential (or Laplace) distribution has a convenient hierarchical representation as a mixture of scaled Gaussian densities (e.g., [41]), i.e.:
Convenient priors for the parameters of the Bayesian LASSO (BL) model have been suggested by [27] as:
where H is a set of hyperparameters. Here, $p(\mathit{\beta}\left{\sigma}_{\epsilon}^{2},{\mathit{\tau}}^{\mathbf{2}})=\right.{\displaystyle \prod _{j=1}^{p}N({\beta}_{j}\left0,{\tau}_{j}^{2}{\sigma}_{\epsilon}^{2})\right.}$ is the product of p normal densities with zero mean and variance ${\tau}_{j}^{2}{\sigma}_{\epsilon}^{2}$ relative to each marker effect j. Further $p\left({\sigma}_{\epsilon}^{2}d.f.,S\right)$ is a scaled inverted chisquare distribution ${\chi}^{2}\left({\sigma}_{\epsilon}^{2}d.f.,S\right)$ with d.f. degrees of freedom and scale parameter S; $exp\left({\tau}_{j}^{2}\lambda \right)$ is an exponential distribution, and p(λ ^{2}α _{1}, α _{2}) is a Gamma distribution with parameters α _{1} and α _{2}. The parameter λ, also called smoothing parameter, plays a central role in the model as it controls the tradeoff between goodness of fit and model complexity [39]. As its value approaches 0, the solution approximates a least squares solution; a large value of λ induces a sharper prior on β and, consequently, stronger shrinkage. Compared to Bayesian Ridge Regression, this model has the advantage of assigning a higher density to markers with zero effects, which seems biologically plausible [27].
The model was fitted to the training set in all scenarios considered. Inferences were based on a Gibbs sampling chain with 70,000 samples after a burnin of 5,000. The parameters of the prior distribution were S _{ ε } = d. f. _{ ε } = S _{ u } = d. f. _{ u } = 1, and α _{1} =1.2 and α _{2} = 10^{− 5}. The package BLR [42] developed for the R software was used for the analysis. Fitted models were then used to predict phenotypes in the testing set, and their predictive ability was assessed by the correlation between measured and predicted phenotypes, and by the PMSE.
Reproducing Kernel Hilbert spaces regression
The RKHS theory was introduced by Aronszajn [43] and has been applied in statistics and machine learning (e.g., Support Vector Machines) fields for many years; foundations are provided in [44]. This semiparametric approach was proposed by Gianola et al. [19],[45] for regressing phenotypes on genotypes. The RKHS method has the property of having an infinite space of functions for searching the dependency between input and target variables, and the space is defined by the measure of distance used (in this case the type of kernel), without any additional assumptions on gene action or functional form. The method can be seen as a combination of the classical additive genetic model with an unknown function of markers, which is inferred nonparametrically, and has the potential of capturing complex interactions without explicitly modeling them [45]. To map the relationship between inputs (genotypes) and targets (phenotypes), a collection of functions defined in a Hilbert space (say f ∈ H) is used, from which an element, $\widehat{f}$, is chosen based on some criterion (e.g. penalized residual sum of squares or posterior density) [20]. The optimization problem for obtaining the estimates of RKHS is:
where l(f, y) is a loss function representing a measure of goodness of fit; ${\Vert f\Vert}_{H}^{2}$ is the squared norm of f, related to model complexity, and λ controls the tradeoff between goodness of fit and model complexity.
According to the MooreAronszajn theorem [43], each RKHS is associated to a unique positive definite kernel. In RKHS, the markers are used to build a covariance or similarity matrix that measures distances between genotypes. Here, Cov(g _{ i }, g _{i `}) ~ K(x _{ i }, x _{i `}), with x _{ i } and x _{i `} representing vectors containing genotypes for the ith and i’th individuals, and K(.,.) is the Reproducing Kernel (RK) related to a positive definite function [20].
The Kernel matrix (K) employed here was a Gaussian kernel, i.e. $K\left({\mathbf{x}}_{\mathbf{i}}\mathbf{,}{\mathbf{x}}_{\mathbf{i}\mathbf{\text{'}}}\right)=exp\left\{h\times {d}_{i{i}^{\text{'}}}\right\}$, where h is a bandwidth parameter and ${d}_{ii\text{'}}={\displaystyle {\sum}_{k=1}^{p}{\left({x}_{ik}{x}_{i\text{'}k}\right)}^{2}}$ represents an element of the matrix of squared Euclidean distances among the individuals in the sample. The choice of h is a model selection issue and must consider the observed distribution of d _{ii’}. In this study we used “kernel averaging” (multikernel fitting) as an automatic way of choosing the kernel based on the sample median of d _{ii’}, as described by [46]. Hence, $h=a\times {q}_{0.5}^{1}$ in which a was −5, −1 and −1/5, and q _{0.5} is the sample median of d _{ii’}, for the three kernels used for kernel averaging. In this model, the genotypic values were the sum of three components, g = f _{1} + f _{2} + f _{3} , with $p\left({f}_{1},{f}_{2},{f}_{3}\left{\sigma}_{\alpha ,1}^{2}\right.,{\sigma}_{\alpha ,2}^{2},{\sigma}_{\alpha ,3}^{2}\right)=N\left({f}_{1}\left0,{K}_{1}\right.{\sigma}_{\alpha ,1}^{2}\right)N\left({f}_{2}\left0,{K}_{2}\right.{\sigma}_{\alpha ,2}^{2}\right)N\left({f}_{3}\left0,{K}_{3}\right.{\sigma}_{\alpha ,3}^{2}\right)$. The variance parameters for these components were treated as unknown and assigned identical and independent scaled inverse chisquare prior distributions with degrees of freedom and scale parameters equal to df = 5 and S =(var(y)/2 × (df − 2)), respectively. Posterior distribution samples were obtained with a Gibbs sampler as described by de los Campos et al. [20]. Inferences were based on 50,000 samples after 5,000 samples of burnin.
Bayesian regularized artificial neural networks
A Bayesian Regularized Artificial Neural Network (BRANN) is a feedforward network implemented with a maximum a posteriori approach in which the regularizer is the logarithm of the density of a prior distribution [47]. This model assigns a probability distribution to the network weights and biases, so that predictions are made in a Bayesian framework and generalization is improved over predictions made without Bayesian regularization. Details are in [48].
A basic feedforward network uses initial weights and biases and transforms input information (in this case, genotype codes) through each given connected neuron in the hidden layer using an activation function. Information is then sent to the neuron in the output layer using another activation (transformation) function generating the output or predicted value. Next, the results are backpropagated (nonlinear leastsquares) in order to update weights and biases using derivatives. Therefore, no assumptions about the relationship between genotypes (input) and phenotypes (target) are made in this model. After training, outputs are calculated as:
where ŷ _{ i } is the predicted phenotype for an individual and ${\underset{~}{x}}_{i}$ are the input genotypes; g and f are the activation functions for output and hidden layers, respectively; w _{ k } and w _{k,i} are the weights from neurons of the hidden to the output neuron, and from the input to the hidden neurons, respectively, and ${b}_{k}^{1}$ and b ^{2} are the biases of the two layers. Training is the process by which the weights are modified in light of the data while the network attempts to produce an optimal outcome [25]. After training, the network can then be used to predict unknown phenotypes from individuals with genotype information.
In BRANN, in addition to the loss function given by the sum of squared errors, a penalty to large weights is also included in order to have a smoother mapping (regularization). The objective function is:
where $\left(\right)close="">{E}_{D}(D$ is the sum of squares of residuals in which D is the data (input data and target variable), $\underset{~}{w}$ are the weights and M is the architecture of the neural network. Further, ${E}_{w}\left(\underset{~}{w}\leftM\right.\right)$ is known as weight decay which is calculated as the sum of squares of weights of the network, and α and γ are the regularization parameters that control the tradeoff between goodness of fit and smoothing.
The posterior distribution of w given α, γ, D and M is [49]:
where P(Dw, γ, M) is the likelihood function, P(wα, M) is the prior distribution on weights under the chosen architecture, and P(Dα, γ, M) is the normalization factor.
To assess overfitting, network architectures and number of epochs (iterations) were tested in a first step. A network containing 5 neurons in the hidden layer with a tangent sigmoid function and 1 neuron in the output layer with a linear function was used after such tests (Figure 1). The number of epochs was set to 30. Results were the average of 20 repetitions of the analysis with different randomly generated starting values. As an attempt to improve generalization, use of early stopping was tested for regularization, but Bayesian regularization worked better. The software MATLAB [50] was used for the analysis. The predictive ability was also assessed by correlation between estimated and measured phenotypes, and by PMSE, as it was for BL and RKHS.
Availability of supporting data
The data set supporting the results of this article is available in the http://gscan.well.ox.ac.uk/.
Abbreviations
 BMI:

Body mass index
 BL:

Bayesian LASSO
 BRANN:

Bayesian Regularized Artificial Neural Networks
 BW:

Body weight
 CV:

Crossvalidation
 LASSO:

Least angle shrinkage selection operator
 LD:

Linkage disequilibrium
 PMSE:

Prediction mean squared error
 RKHS:

Reproducing kernel Hilbert spaces regression
 SNP:

Single nucleotide polymorphism
References
 1.
Goddard ME, Hayes BJ: Genomic selection. J Anim Breed Genet. 2007, 124 (6): 323330. 10.1111/j.14390388.2007.00702.x.
 2.
Lee SH, van der Werf JH, Hayes BJ, Goddard ME, Visscher PM: Predicting unobserved phenotypes for complex traits from wholegenome SNP data. PLoS Genet. 2008, 4 (10): e100023110.1371/journal.pgen.1000231.
 3.
Weigel KA, De Los Campos G, Vazquez AI, Rosa GJM, Gianola D, Van Tassell CP: Accuracy of direct genomic values derived from imputed single nucleotide polymorphism genotypes in Jersey cattle. J Dairy Sci. 2010, 93 (11): 54235435. 10.3168/jds.20103149.
 4.
De Los Campos G, Gianola D, Allison DB: Predicting genetic predisposition in humans: the promise of wholegenome markers. Nat Rev Genet. 2010, 11 (12): 880886. 10.1038/nrg2898.
 5.
Vazquez AI, De Los Campos G, Klimentidis YC, Rosa GJ, Gianola D, Yi N, Allison DB: A comprehensive genetic approach for improving prediction of skin cancer risk in humans. Genetics. 2012, 192 (4): 14931502. 10.1534/genetics.112.141705.
 6.
Meuwissen TH, Hayes BJ, Goddard ME: Prediction of total genetic value using genomewide dense marker maps. Genetics. 2001, 157 (4): 18191829.
 7.
Gianola D: Priors in wholegenome regression: the Bayesian alphabet returns. Genetics. 2013, 194 (3): 573596. 10.1534/genetics.113.151753.
 8.
Mulder HA, Calus MPL, Druet T, Schrooten C: Imputation of genotypes with lowdensity chips and its effect on reliability of direct genomic values in Dutch Holstein cattle. J Dairy Sci. 2012, 95 (2): 876889. 10.3168/jds.20114490.
 9.
JimenezMontero JA, Gianola D, Weigel K, Alenda R, GonzalezRecio O: Assets of imputation to ultrahigh density for productive and functional traits. J Dairy Sci. 2013, 96 (9): 60476058. 10.3168/jds.20136793.
 10.
Habier D, Fernando RL, Dekkers JC: Genomic selection using lowdensity marker panels. Genetics. 2009, 182 (1): 343353. 10.1534/genetics.108.100289.
 11.
Weigel KA, De Los Campos G, GonzalezRecio O, Naya H, Wu XL, Long N, Rosa GJM, Gianola D: Predictive ability of direct genomic values for lifetime net merit of Holstein sires using selected subsets of single nucleotide polymorphism markers. J Dairy Sci. 2009, 92 (10): 52485257. 10.3168/jds.20092092.
 12.
Dassonneville R, Brondum RF, Druet T, Fritz S, Guillaume F, Guldbrandtsen B, Lund MS, Ducrocq V, Su G: Effect of imputing markers from a lowdensity chip on the reliability of genomic breeding values in Holstein populations. J Dairy Sci. 2011, 94 (7): 36793686. 10.3168/jds.20114299.
 13.
Moser G, Khatkar MS, Hayes BJ, Raadsma HW: Accuracy of direct genomic values in Holstein bulls and cows using subsets of SNP markers. Genet Sel Evol. 2010, 42: 3710.1186/129796864237.
 14.
Browning BL, Browning SR: A unified approach to genotype imputation and haplotypephase inference for large data sets of trios and unrelated individuals. Am J Hum Genet. 2009, 84 (2): 210223. 10.1016/j.ajhg.2009.01.005.
 15.
Calus MP, Veerkamp RF, Mulder HA: Imputation of missing single nucleotide polymorphism genotypes using a multivariate mixed model framework. J Anim Sci. 2011, 89 (7): 20422049. 10.2527/jas.20103297.
 16.
Sun CY, Wu XL, Weigel KA, Rosa GJM, Bauck S, Woodward BW, Schnabel RD, Taylor JF, Gianola D: An ensemblebased approach to imputation of moderatedensity genotypes for genomic selection with application to Angus cattle. Genet Res. 2012, 94 (3): 133150. 10.1017/S001667231200033X.
 17.
VanRaden PM, O'Connell JR, Wiggans GR, Weigel KA: Genomic evaluations with many more genotypes. Genet Sel Evol. 2011, 43: 1010.1186/129796864310.
 18.
Mackay TF: The genetic architecture of quantitative traits: lessons from Drosophila. Curr Opin Genet Dev. 2004, 14 (3): 253257. 10.1016/j.gde.2004.04.003.
 19.
Gianola D, van Kaam JB: Reproducing kernel hilbert spaces regression methods for genomic assisted prediction of quantitative traits. Genetics. 2008, 178 (4): 22892303. 10.1534/genetics.107.084285.
 20.
de Los CG, Gianola D, Rosa GJ: Reproducing kernel Hilbert spaces regression: a general framework for genetic evaluation. J Anim Sci. 2009, 87 (6): 18831887. 10.2527/jas.20081259.
 21.
De Los Campos G, Gianola D, Rosa GJ, Weigel KA, Crossa J: Semiparametric genomicenabled prediction of genetic values using reproducing kernel Hilbert spaces methods. Genet Res. 2010, 92 (4): 295308. 10.1017/S0016672310000285.
 22.
Long N, Gianola D, Rosa GJ, Weigel KA, Kranis A, GonzalezRecio O: Radial basis function regression methods for predicting quantitative traits using SNP markers. Genet Res. 2010, 92 (3): 209225. 10.1017/S0016672310000157.
 23.
GonzalezCamacho JM, de Los CG, Perez P, Gianola D, Cairns JE, Mahuku G, Babu R, Crossa J: Genomeenabled prediction of genetic values using radial basis function neural networks. Theor Appl Genet. 2012, 125 (4): 759771. 10.1007/s0012201218689.
 24.
Gianola D, Okut H, Weigel KA, Rosa GJ: Predicting complex quantitative traits with Bayesian neural networks: a case study with Jersey cows and wheat. BMC Genet. 2011, 12: 8710.1186/147121561287.
 25.
Okut H, Gianola D, Rosa GJ, Weigel KA: Prediction of body mass index in mice using dense molecular markers and a regularized neural network. Genet Res. 2011, 93 (3): 189201. 10.1017/S0016672310000662.
 26.
Heslot N, Yang HP, Sorrells ME, Jannink JL: Genomic selection in plant breeding: a comparison of models. Crop Sci. 2012, 52 (1): 146160. 10.2135/cropsci2011.06.0297.
 27.
De Los Campos G, Naya H, Gianola D, Crossa J, Legarra A, Manfredi E, Weigel K, Cotes JM: Predicting quantitative traits with regression models for dense molecular markers and pedigree. Genetics. 2009, 182 (1): 375385. 10.1534/genetics.109.101501.
 28.
PerezRodriguez P, Gianola D, GonzalezCamacho JM, Crossa J, Manes Y, Dreisigacker S: Comparison between linear and nonparametric regression models for genomeenabled prediction in wheat. G3. 2012, 2 (12): 15951605. 10.1534/g3.112.003665.
 29.
Howard R, Carriquiry AL, Beavis WD: Parametric and nonparametric statistical methods for genomic selection of traits with additive and epistatic genetic architectures. G3Genes Genomes Genetics. 2014, 4 (6): 10271046.
 30.
Legarra A, RobertGranie C, Manfredi E, Elsen JM: Performance of genomic selection in mice. Genetics. 2008, 180 (1): 611618. 10.1534/genetics.108.088575.
 31.
Berry DP, Kearney JF: Imputation of genotypes from low to highdensity genotyping platforms and implications for genomic selection. Animal. 2011, 5 (8): 11621169. 10.1017/S1751731111000309.
 32.
Daetwyler HD, Wiggans GR, Hayes BJ, Woolliams JA, Goddard ME: Imputation of missing genotypes from sparse to high density using longrange phasing. Genetics. 2011, 189 (1): 317327. 10.1534/genetics.111.128082.
 33.
Vazquez AI, Rosa GJ, Weigel KA, De Los Campos G, Gianola D, Allison DB: Predictive ability of subsets of single nucleotide polymorphisms with and without parent average in US Holsteins. J Dairy Sci. 2010, 93 (12): 59425949. 10.3168/jds.20103335.
 34.
Valdar W, Solberg LC, Gauguier D, Burnett S, Klenerman P, Cookson WO, Taylor MS, Rawlins JN, Mott R, Flint J: Genomewide genetic association of complex traits in heterogeneous stock mice. Nat Genet. 2006, 38 (8): 879887. 10.1038/ng1840.
 35.
Mott R: Finding the molecular basis of complex genetic variation in humans and mice. Philos Trans R Soc Lond B Biol Sci. 2006, 361 (1467): 393401. 10.1098/rstb.2005.1798.
 36.
Valdar W, Solberg LC, Gauguier D, Cookson WO, Rawlins JN, Mott R, Flint J: Genetic and environmental effects on complex traits in mice. Genetics. 2006, 174 (2): 959984. 10.1534/genetics.106.060004.
 37.
Usai MG, Goddard ME, Hayes BJ: LASSO with crossvalidation for genomic selection. Genet Res. 2009, 91 (6): 427436. 10.1017/S0016672309990334.
 38.
Browning BL, Browning SR: A fast, powerful method for detecting identity by descent. Am J Hum Genet. 2011, 88 (2): 173182. 10.1016/j.ajhg.2011.01.010.
 39.
Tibshirani R: Regression shrinkage and selection via the Lasso. J R Stat Soc Ser BMethodological. 1996, 58 (1): 267288.
 40.
Park T, Casella G: The Bayesian Lasso. J Am Stat Assoc. 2008, 103 (482): 681686. 10.1198/016214508000000337.
 41.
Rosa GJM, Padovani CR, Gianola D: Robust linear mixed models with normal/independent distributions and Bayesian MCMC implementation. Biom J. 2003, 45 (5): 573590. 10.1002/bimj.200390034.
 42.
Perez P, de Los CG, Crossa J, Gianola D: Genomicenabled prediction based on molecular markers and pedigree using the Bayesian linear regression package in R. Plant Genome. 2010, 3 (2): 106116. 10.3835/plantgenome2010.04.0005.
 43.
Aronszajn N: Introduction to the theory of Hilbert spaces. 1950, Reasearch sic Foundation, Stillwater, Okla
 44.
Wahba G: Society for Industrial and Applied Mathematics.: Spline models for observational data. CBMSNSF Regional Conference series in applied mathematics 59. 1990, Society for Industrial and Applied Mathematics (SIAM, 3600 Market Street, Floor 6, Philadelphia, PA 19104), Philadelphia, Pa, 1 electronic text (xii, 169 p.)
 45.
Gianola D, Fernando RL, Stella A: Genomicassisted prediction of genetic value with semiparametric procedures. Genetics. 2006, 173 (3): 17611776. 10.1534/genetics.105.049510.
 46.
Crossa J, Campos Gde L, Perez P, Gianola D, Burgueno J, Araus JL, Makumbi D, Singh RP, Dreisigacker S, Yan J, Arief V, Banziger M, Braun HJ: Prediction of genetic values of quantitative traits in plant breeding using pedigree and molecular markers. Genetics. 2010, 186 (2): 713724. 10.1534/genetics.110.118521.
 47.
Bishop CM: Pattern recognition and machine learning. 2006, Springer, New York
 48.
Mackay DJC: Bayesian Interpolation. Neural Comput. 1992, 4 (3): 415447. 10.1162/neco.1992.4.3.415.
 49.
MacKay DJC: Information theory, inference, and learning algorithms. 2003, Cambridge University Press, Cambridge, UK; New York
 50.
Demuth HB, Beale MH, MathWorks Inc: Neural network toolbox for use with MATLAB : user's guide. 2001, MathWorks, Natick, Mass
Acknowledgements
Financial support by the Wisconsin Agriculture Experiment Station, by COBBVantress, Inc. (Siloam Springs, AR) and by the National Council of Scientific and Technological Development (CNPq, Brazil) is acknowledged. We also would like to extend our thanks to The Welcome Trust Centre for Human Genetics for making the mice data available.
Author information
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
VF, HO, DG, MS and GR contributed to the concept, design, execution, and interpretation of this work. VF conducted the statistical analyses and drafted the first version of the manuscript. HO assisted with the neural network implementation. VF, HO, DG, MS and GR read and approved the final manuscript.
Authors’ original submitted files for images
Rights and permissions
About this article
Received
Accepted
Published
DOI
Keywords
 Genotype imputation
 Genomeenabled prediction
 Complex traits
 Nonlinear models