- Open Access
Application of the propensity score in a covariate-based linkage analysis of the Collaborative Study on the Genetics of Alcoholism
BMC Genetics volume 6, Article number: S33 (2005)
Covariate-based linkage analyses using a conditional logistic model as implemented in LODPAL can increase the power to detect linkage by minimizing disease heterogeneity. However, each additional covariate analyzed will increase the degrees of freedom for the linkage test, and therefore can also increase the type I error rate. Use of a propensity score (PS) has been shown to improve consistently the statistical power to detect linkage in simulation studies. Defined as the conditional probability of being affected given the observed covariate data, the PS collapses multiple covariates into a single variable. This study evaluates the performance of the PS to detect linkage evidence in a genome-wide linkage analysis of microsatellite marker data from the Collaborative Study on the Genetics of Alcoholism. Analytical methods included nonparametric linkage analysis without covariates, with one covariate at a time including multiple PS definitions, and with multiple covariates simultaneously that corresponded to the PS definitions. Several definitions of the PS were calculated, each with increasing number of covariates up to a maximum of five. To account for the potential inflation in the type I error rates, permutation based p-values were calculated.
Results suggest that the use of individual covariates may not necessarily increase the power to detect linkage. However the use of a PS can lead to an increase when compared to using all covariates simultaneously. Specifically, PS3, which combines age at interview, sex, and smoking status, resulted in the greatest number of significant markers identified. All methods consistently identified several chromosomal regions as significant, including loci on chromosome 2, 6, 7, and 12.
These results suggest that the use of a propensity score can increase the power to detect linkage for a complex disease such as alcoholism, especially when multiple important covariates can be used to predict risk and thereby minimize linkage heterogeneity. However, because the PS is calculated as a conditional probability of being affected, it does require the presence of observed covariate data on both affected and unaffected individuals, which may not always be available in real data sets.
Alcohol dependence has been shown to cluster in families. Multiple linkage analyses have been performed for phenotypes related to alcoholism, identifying phenotype-specific linkage evidence [1–5]. To increase the statistical power to detect linkage in the presence of heterogeneity, we explored the use of covariate-based linkage analysis based on a conditional logistic regression model [6, 7]. Because one degree of freedom is added to the statistical test for each additional covariate analyzed, we incorporated a propensity score (PS) to collapse multiple covariates into one variable and showed in simulation studies it consistently improved the statistical power of the linkage test [[8, 9], unpublished data, 2004]. Rosenbaum and Rubin  first described the PS in a causal inference analysis to control for multiple covariate effects that could potentially bias assessments of treatment effect outcomes when randomization experiments were not possible. In such a setting, the score is defined as the conditional probability of being assigned to a treatment group given the covariate data, and in practice, it can be estimated from the observed covariate data with a logistic model of the treatment group assignment based on the covariates. The PS used here is instead defined as the conditional probability of being affected given the observed covariate data in families, and its predicted value is then used as the single covariate in Olson's conditional logistic regression model . A covariate-based linkage analysis on the Collaborative Study on the Genetics of Alcoholism (COGA) microsatellite dataset was performed.
Study population and data collection
The study population consisted of families ascertained by the COGA. The COGA study and the data available for the Genetic Analysis Workshop 14 (GAW14) have been previously described in this issue. This study specifically uses the microsatellite genotype and covariate data that were released as part of GAW14.
Genome-wide linkage analysis using covariates
Covariate-based affected relative pair linkage analysis using single-point identity-by-descent (IBD) probabilities and a general conditional logistic model was performed as implemented in GENIBD and LODPAL of S.A.G.E. v4.6 [6, 7, 11] on the microsatellite genotype data across the entire genome. In LODPAL, all affected relative pairs are treated as independent observations, and a single covariate value is calculated for each affected relative pair as the sum of the covariate values for the two affected relatives in the pair. The trait selected was ALDX1, defined as alcoholism based on both the DSM-III-R  and the Feighner criteria . Covariates considered were age at interview (age_int), sex, maximum number of drinks (maxdrinks), smoking status (smoker), and ttth1, an electrophysiological measurement of brain activity. Additionally five different propensity scores were defined, and their corresponding regression coefficients are listed in Table 2. LOD scores were calculated by incorporating into the analysis no covariates, each covariate alone (including the different single covariate PS definitions), and all covariates simultaneously.
These PS values were derived from a logistic regression of affection status on the covariate data, using the model described below:
where xj = the jth covariate
The affection status was coded as 1 for affected and 0 for unaffected. This logistic regression was performed in STATA (v8.2)  on the entire dataset, and the predicted value of the probability of affection for each individual was used as the individual's PS corresponding to the set of observed underlying covariates. The presence of measured covariates on both affected and unaffected individuals is required, although only affected individuals are used in the linkage analysis itself.
Determination of significance and comparison of linkage evidence across analysis methods
Significance was determined by permutation testing. Affection status coupled with its covariate values was permuted within families generating 1,000 replicates, and single-point linkage analysis was performed on the observed data and on each replicate. The p-value of a test statistic was calculated as the proportion of permutations whose statistic was equal to or greater than the observed value. Two types of statistics were computed. The first was a LOD score for each marker. The second was the sum of LOD scores across all markers, selected to simultaneously capture multiple regions of significant linkage evidence. Because the statistics were compared to their reference permutation distribution in the calculation of the p-values for each method, the relative proportion of significant tests between methods is an indication of relative power.
Results and Discussion
Table 1 displays the overall p-value and the number of significant markers across the genome according to the analysis method used (set of covariates analyzed). Including individual covariates did not necessarily lead to more significant loci identified as linked, and could even result in fewer significant findings of linkage compared to analyses with no covariates. However including a propensity score (such as with PS1 and PS3) can greatly increase the number of significant linkage results. Additionally, including the PS (except for PS2) did result in more significant regions of possible linkage compared with its corresponding multiple covariates method.
These results suggest that incorporating multiple covariates together may be more productive than the use of individual covariates in linkage analysis of complex diseases. Specifically, age at interview, sex, and smoking status (PS3) appear to be important covariates that can be used to account for heterogeneity associated with alcoholism. The inclusion of PS3 in the linkage analysis led to both the most significant overall p-value as well as the largest number of different markers yielding some significant evidence for linkage. The most significant individual markers were GATA193 (p = 0.0044) on chromosome 17, D2S200, D6S477, and D15S644 (all three with p = 0.0078). In the logistic regression for PS3 (Table 2), the smoking variable resulted in the greatest odds ratios (OR of 5.33 ± 1.02) among any of the covariates used in defining a PS, and for PS1, the sex variable resulted in one of the lowest ORs (0.108 ± 0.019) of any covariates. For PS2 and PS5, which identified the smallest number of markers with significant linkage, approximately one-third of the ttth1 covariate data was missing. Thus, examining the values of the regression coefficients in the calculation of the PS and the goodness of fit of the logistic models may be a means to help define the most appropriate PS.
To examine whether the markers yielding significant evidence for linkage were consistent across the methods, Figure 1 displays a plot of the markers with LOD scores at the significance level of 0.05 (yellow) and 0.01 (red) for each analysis method. From bottom to top, the first level represents no covariates analyzed, the second level represents the methods with individual covariates analyzed, the third level represents all the PS methods, and the fourth level represents linkage analysis with the multiple covariates. Across these groups, several regions consistently provided significant linkage evidence regardless of the method of analysis, as defined as having at least eight methods resulting in significant evidence. These regions correspond to markers (with number of methods in parentheses) on: chromosome 2 (#47 D2S1790 (9), #48 D2S1331 (7), and #49 D2S373 (10)), chromosome 6 (#119 D6S1018 (8)), chromosome 7 (#162 D7S509 (15)), and chromosome 12 (#221 D12S1090 (8)). Evidence on chromosome 7 has been widely replicated in multiple studies [1–4]. However, the location of the red bars representing the most significant markers was not consistent across methods. It should be noted that with 1,000 permutations performed, the lowest empirical p-value that can be attained is p < 0.001, representing the situation in which none of replicate LOD scores was more extreme than the observed LOD score.
The incorporation of covariate information into a linkage analysis can potentially increase the power to detect linkage by identifying more loci with linkage evidence and also increased statistical linkage evidence for identified loci. Because the addition of each covariate into the analysis inflates the type I error rate in this likelihood model, it is important to use empirically derived p-values to determine significance. Having corrected for the inflation in the type I error rate, the use of a propensity score (except for PS2) compared with the use of all the covariate simultaneously does lead to the identification of more linked loci in this study. Even though several regions of significant linkage were consistent across the analysis methods, the location of the most significant regions was not consistent. Thus it is also important to emphasize that despite the power increase, the selection of covariates to include into the analysis method must be done carefully and the identification of the significant linkage regions can vary based on the covariates used. However, defining a PS that results in the covariates having the largest OR away from the null may be a means to identify important covariates for the PS, and the use of that PS may result in the greatest overall power gain to detect linkage.
Collaborative Study on the Genetics of Alcoholism
Genetic Analysis Workshop 14
Identity by descent
Reich T, Edenberg HJ, Goate A, Williams JT, Rice JP, Van Eerdewegh P, Foroud T, Hesselbrock V, Schuckit MA, Bucholz K, Porjesz B, Li T, Conneally PM, Nurnberger JI, Tischfield JA, Crowe RR, Cloninger CR, Wu W, Shears S, Carr K, Crose C, Willig C, Begleiter H: Genome-wide search for genes affecting the risk for alcohol dependence. Am J Med Genet. 1998, 81: 207-215. 10.1002/(SICI)1096-8628(19980508)81:3<207::AID-AJMG1>3.0.CO;2-T.
Reich T, Hinrichs A, Culverhouse R, Bierut L: Psychiatric genetics '99: genetic studies of alcoholism and substance dependence. Am J Hum Genet. 1999, 65: 599-605. 10.1086/302561.
Bergen AW, Yang XR, Bai Y, Beerman MB, Goldstein AM, Goldin LR: Genetic regions linked to alcohol consumption in the Framingham Heart Study. BMC Genetics. 2003, 4 (Suppl 1): S101-10.1186/1471-2156-4-S1-S101.
Ma JZ, Zhang D, Dupont RT, Dockter M, Elston RC, Li MD: Mapping susceptibility loci for alcohol consumption using number of grams of alcohol consumed per day as a phenotype measure. BMC Genetics. 2003, 4 (Suppl 1): S104-10.1186/1471-2156-4-S1-S104.
Hill SY, Shen S, Zerra N, Hoffman EK, Perlin M, Allan W: A genome wide search for alcoholism susceptibility genes. Am J Med Genet. 2004, 128B: 102-113. 10.1002/ajmg.b.30013.
Olson JM: A general conditional-logistic model for affected-relative-pair linkage studies. Am J Hum Genet. 1999, 65: 1760-1769. 10.1086/302662.
Goddard KA, Witte JS, Suarez BK, Catalona WJ, Olson JM: Model-free linkage analysis with covariates confirms linkage of prostate cancer to chromosomes 1 and 4. Am J Hum Genet. 2001, 68: 1197-1206. 10.1086/320103.
Doan BQ, Sorant AJM, Bailey-Wilson JE, YY Shugart: Power to detect linkage using covariates [abstract]. Genet Epidemiol. 2003, 25: 246-
Doan BQ, Sorant AJM, Frangakis CE, Bailey-Wilson JE, YY Shugart: Statistical properties of the propensity score as a single covariate in covariate-based linkage analysis [abstract]. Genet Epidemiol. 2004, 27: 267-
Rosenbaum PR, Rubin DB: The central role of the propensity score in observational studies for causal effects. Biometrika. 1983, 70: 41-55. 10.2307/2335942.
Statistical Solutions Ltd: S.A.G.E. Statistical Analysis for Genetic Epidemiology. 2004, Cork, Ireland
American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorders, revised. 1987, Washington, DC: American Psychiatric Association Press, 166-175. third
Feighner JP, Robins E, Guze SB, Woodruff RA, Winokur G, Munoz R: Diagnostic criteria for use in psychiatric research. Arch Gen Psychiatry. 1972, 26: 57-63.
StataCorp: STATAv8.2. 2003, College Station, Texas
The results of this paper were obtained by using the program package S.A.G.E., which is supported by a U.S. Public Health Service Resource Grant (RR03655) from the National Center for Research Resources. YYS is partially supported by an American Cancer Society grant IRG-58-005-40, NIH grant RO3 CA113240-01, and the Department of Epidemiology, JHBPSH. BQD is supported by a NHGRI pre-doctoral IRTA fellowship.
All authors participated in the discussions of the study design and statistical methodology and helped draft the manuscript. BQD performed the statistical analysis and CEF assisted with programming. All authors have read and approved the final manuscript.
About this article
Cite this article
Doan, B.Q., Frangakis, C.E., Shugart, Y.Y. et al. Application of the propensity score in a covariate-based linkage analysis of the Collaborative Study on the Genetics of Alcoholism. BMC Genet 6, S33 (2005) doi:10.1186/1471-2156-6-S1-S33
- Propensity Score
- Linkage Analysis
- Multiple Covariates
- Linkage Evidence
- Individual Covariates