- Open Access
© Kent. 2015
Published: 3 February 2016
New technologies for acquisition of genomic data, while offering unprecedented opportunities for genetic discovery, also impose severe burdens of interpretation andpenalties for multiple testing.
The Pathway-based Analyses Group of the Genetic Analysis Workshop 19 (GAW19) sought reduction of multiple-testing burden through various approaches to aggregation of highdimensional data in pathways informed by prior biological knowledge.
Experimental methods testedincluded the use of "synthetic pathways" (random sets of genes) to estimate power and false-positive error rate of methods applied to simulated data; data reduction via independent components analysis, single-nucleotide polymorphism (SNP)-SNP interaction, and use of gene sets to estimate genetic similarity; and general assessment of the efficacy of prior biological knowledge to reduce the dimensionality of complex genomic data.
The work of this group explored several promising approaches to managing high-dimensional data, with the caveat that these methods are necessarily constrained by the quality of external bioinformatic annotation.
The data provided for Genetic Analysis Workshop 19 (GAW19) offer extensive and complex genomic information (described fully in Blangero et al. ). These data included 2 Mexican American cohorts: a set of extended families providing longitudinal data on blood pressure (BP; up to 4 clinic visits per subject) and genomic data including haplotype-tagging single nucleotide polymorphisms (SNPs) and whole sequence data for odd-numbered autosomes, as well as gene expression profiles from the first clinic visit; and a separate set of unrelated individuals with BP and exome sequence data from a single clinic visit. The GAW19 organizers also provided 200 replicates of simulated BP data for both cohorts based on the real genotypes and a polygenic generating model using functional variants in genes chosen based on real associations between BP and gene expression phenotypes in the Type 2 Diabetes Genetic Exploration by Next-generation sequencing in Ethnic Samples (T2D-GENES) study (). This rich genomic resource serves as a sampler of the types of data now becoming available for many study cohorts as a result of rapid technological advances (and attendant decreased costs) in acquisition of genomic information.
Preselection of biological pathways believed to be relevant to the disease or phenotype of interest. The primary goals of this approach are to limit the number of genomic features, and therefore the multiple-testing burden, to those annotated to genes in the candidate pathways, and/or to confirm the prior biological hypotheses. An additional aim is to manage genetic heterogeneity: for example, different lineages may segregate variation in different genes in the same pathway that nonetheless yield similar biological effects. Without prior biological knowledge, this heterogeneity might be interpreted as noise rather than as concordant signal .
Gene enrichment tests of genomic features prioritized by evidence of association with the phenotype of interest to identify biological pathways a posteriori. The primary goal of this approach is to interpret the biological significance of findings from agnostic tests of association.
Both of these lines of investigation are constrained by existing biological knowledge (and by the curation strategies and quality of available bioinformatic databases).
Because pathway analysis is relatively new, methods for assigning genomic features to pathways and for testing the significance of these assignments in relation to phenotypes are still very much under development. This developmental fluidity was the context for this discussion group at GAW19.
Research teams participating in the pathway-based analyses group
Meta-expression: A methodology for the joint analysis of gene expression in biological pathways.
Massanet R, Fernández-Albert F, Ziyatdinov A, Soria JM, Perera A
Comparison of GWAS and exome sequence data sets from GAW19.
Blackburn AN, Almasy L
Network-guided interaction mining for blood pressure phenotype of unrelated individuals in GAW19.
Agne M, Auerbach J, Fan R, Lo S-H, Wang P, Zhang T
A variance component method for integrated pathway analysis of gene expression data.
Blangero J, Almasy L
Association of polymorphisms in the aldosterone-regulated sodium reabsorption pathway with blood pressure among Hispanics.
Tong L, Cooper RS
A hierarchical approach to SNP-set analysis: An evaluation of power and type 1 error of gene-based tests of association after pathway-based analysis.
Grinde K, Cook K, Green A, Tintle N
Prioritization strategies in enrichment analysis of gene expression data in GAW19 family-based study.
Fernández-Albert F, Vazquez-Santiago M, Soria JM, Perera-Lluna A
Summary of research approaches: Data used
Real (gene expression)
GWAS and exomic variants
DBP (first visit)
GWAS and exomic variants
DBP (first visit)
DBP (first visit)
GWAS and exomic variants
Simulatedb and real
DBP, SBP, HT, MAP
GWAS and exomic variants
Means across visits of DBP, SBP, HT, MAP
Summary of research approaches: Analytical strategies
Source of annotations/ biological significance
Annotated to BP genes and interactors
Ontology, protein-protein interaction
Gene Ontology, other (unspecified)
Independent components analysis, GWAS in GenABEL
Nonsynonymous or stop codon gain/loss
KEGG, Biocarta, Pathway Interaction Database, Reactome
SOLAR measured genotype association
Annotated to type 2 diabetes genes and interactors
Bespoke method to detect SNP-SNP interaction
Ariadne Pathway Studio 8.0
Empirical similarity matrices, variance decomposition
Annotated to genes in specific pathway
BP-related pathway of interest
SKAT, burden tests
Associated with BP
Linear mixed models
Results and discussion
An overriding motivation for employing pathway analysis was to reduce the multiple-testing burden by basing inferences on the combined effects of probes or variants. Most teams used external bioinformatic data to inform pathway construction (see Table 3). However, the use of pathways to clarify biological function or interpret association results, while highly relevant to future applications of these methods, was a secondary concern given the method-development focus of these studies. Of all the studies, Ziyatdinov came closest to this interpretive approach, using relationships in the data to recover the biological processes implicit in the simulation generating model.
Data selection; pathway assembly
All teams used the BP data (real or simulated) provided for GAW19, including systolic (SBP) and diastolic BP (DBP) and hypertension (HT) status. Several teams also calculated the derived phenotype mean arterial pressure (MAP) from these data as (2/3 DBP + 1/3 SBP). All teams using the simulated data chose not to be blind to the generating model (they “used the answers”), which allowed them to estimate power to detect “true” functional variants and associated gene expression phenotypes. Most teams also used the provided null trait Q1 to estimate type 1 error rate. A limitation of this use of the simulated data (as noted by a reviewer of an early draft of this report) is that evaluation of method performance is necessarily sensitive to the assumptions of the generating model.
Three teams (Brunel, Quillen, Ziyatdinov) focused on the gene expression probes, while the remaining teams considered single nucleotide variants (SNVs) drawn from the GWAS genotypes, exome sequence data, or both. Combined analysis of gene expression and association has been considered in previous GAWs (eg, Charlesworth et al. ), but only Brunel attempted this combination in a 2-step approach (data reduction of BP-related gene expression phenotypes followed by GWAS).
As noted, most teams made use of the simulated phenotypes as a basis for estimating power and type 1 error. Kos, Quillen, and Valcarcel constructed synthetic pathways (described more fully below) of gene expression probes (Quillen) or SNVs (Kos, Valcarcel) representing predetermined numbers of randomly chosen genes; these synthetic pathways were then characterized by the number of genes that contributed to the simulated phenotypes as a basis for measuring the effect of functional “dosage” on analytical power. One team (Tayo) focused on a single biological pathway with known relevance to hypertension (aldosterone-regulated sodium reabsorption), using both real and simulated BP phenotypes.
Kos, Quillen, and Valcarcel independently conceived of using sets of probes or variants annotated to randomly selected genes to define synthetic pathways (SPs) to test both the power and type 1 error of their proposed methods. SPs that represented genes used in the simulation generating model were, in Quillen’s terminology, “positive controls” to test the sensitivity of tests. SPs lacking such representation provided data on false positive rate, either in place of or supplementary to tests of the null trait Q1. All 3 teams used various metrics—for example, number of genes represented in each SP or number of generating-model genes represented—to further characterize the performance of their analytical approaches.
In addition to the dimensional reduction achieved by grouping probes or variants in pathways, some teams also filtered variants based on predicted function (eg, Kos).
Lo developed biological pathways nominally based on a hypothesis that hypertension could be related to undetected type 2 diabetes (this is known to have elevated prevalence in the Mexican American cohorts from which the GAW19 data were derived, but diabetes status was not reported as part of the provided data set). Pathway construction consisted of choosing a set of diabetes-related genes from the literature and then expanding these “seed” genes with publicly available gene interaction data. In the context of this workshop, this approach simply provided a biologically plausible way to construct pathways reflecting the number of genes and patterns of gene–gene interaction that might be encountered in a “real” study; this was tangential to the primary goal of characterizing performance of these investigators’ bespoke method for analyzing SNP-SNP interaction effects  (see below).
As noted, most pathways were user-defined, either based on numbers of genes (to test effects on power and specificity) or on prior biological information, rather than on empirical networks (eg, by weighted correlation networks) . This was consistent with the emphasis on methodological development, especially on data reduction and control of the burden of multiple testing. The known causal structure of the simulated data might have supported a test of the efficacy of an empirical networks approach to recover the generating model from patterns of SNV association, but no team attempted this.
The focus for methodological innovation in these studies was typically on the construction or definition of pathways. In general, established tools were used for relating pathway-defined probes or variants to the traits of interest, accounting for family data where appropriate: for example, variance components-based analyses implemented in SOLAR (Sequential Oligogenic Linkage Analysis Routines) , by Kos and Quillen; adaptation of SKAT (sequence kernel association test) by Valcarcel; burden tests ; GenABEL  by Brunel; and PLINK for unrelated data .
An exception to this pattern was the use by Lo of an analytical tool to detect gene interactions, previously developed by members of this team . In brief, this method involves comparing the joint effect of 2 SNPs on a trait to the marginal effect of each; a ratio of joint to marginal effects significantly greater than 1 (as assessed by permutation) is taken as evidence of SNP–SNP interaction effects on the phenotype . Using pairwise tests of SNPs annotated to genes in a pathway of interest (described above), these authors reported evidence of a joint effect of variants in GCK and PAX4 on hypertension (real data from the unrelated cohort). As noted by the anonymous reviewers of these authors’ report, the nature of this joint effect—whether due to in-sample LD, interaction between the gene products, or some other effect—needs additional investigation.
We now consider selected approaches in more detail. Taking replicate simulations of DBP as the trait of interest, Quillen analyzed the random effect of similarity in gene expression among related individuals, with the goal of identifying pathways for which coexpression accounted for a significant proportion of variance relative to modeling the random effect of kinship alone. This analysis compared the effect of 16 methods for computing similarity matrices from the expression data; of these, simple correlation and extended Jaccard distance  outperformed the others and greatly exceeded the performance of single-probe association as a consequence of reduced multiple testing. As expected, performance was dependent on the number of genes in the SPs that contributed by design to the simulated phenotypes .
Brunel developed pathways based on probes in the GAW19 data that were annotated to genes related to BP in Gene Ontology, or to genes related to these by published evidence of protein–protein interaction. They then used independent components analysis (ICA) to derive “meta-expression” phenotypes (ICA factors). Unfortunately, the use of phenotypes derived from the real gene expression data, rather than simulated data, prevented estimation of power and type 1 error rate, so it was not possible to determine if any increase in signal from data reduction could overcome the multiple-testing burden inherent in GWAS.
Single nucleotide variants
Valcarcel proposed 2-step association tests of a simulated BP phenotype that consisted of variant aggregation (via either SKAT or burden test) for all variants in a pathway, followed by gene-centric aggregation tests within pathways that passed a chosen significance threshold. Their pathways were synthetic (randomly chosen sets of specified numbers of genes with retention of pathways that contained at least 1 gene that was causal in the simulation). The 2-step approach was more powerful, with reasonable control of type 1 error, than a 1-step gene-centric approach because of the reduction in multiple testing by prescreening of pathways.
A primary focus in the Pathway-based Analyses Group was on managing the very large dimensionality of -omics data to increase analytical power. As noted in the Introduction, pathway analysis can also be employed for biological discovery, although this use was not focal for participants in this discussion group. Methodology for this sort of discovery is also in its infancy and would also be a worthy topic for future investigation, although provision of optimal simulation data for this purpose (eg, simulated gene expression data) would be a major challenge.
Because many pathway-based approaches, including the pathway construction carried out by participants in this group, are heavily dependent on bioinformatic databases, our group discussions frequently returned to concerns about the current state of these resources, no matter how well curated – including inaccuracies, difficulty of interpretation, and (inevitably) publication bias. This suggests a possible contradiction at the heart of pathway analysis (which, regrettably, we did not discuss): many of our studies used pathway aggregation to reduce the multiple-testing burden that hampers gene and variant discovery, yet pathway construction based on prior knowledge runs the risk of constraining the scope of discovery. A possible way out of this dilemma, as noted above, is to search for empirical networks that may reveal unexpected gene interactions and thus novel biological insight.
I am grateful to all of the Pathway-based Analyses Group members for their work and participation, and to Dr. Duncan Thomas and 2 anonymous reviewers for their careful reviews of the first draft of this paper. The Genetic Analysis Workshops are supported by National Institutes of Health (NIH) grant GM031575. My participation in GAW19 was supported by NIH grant DK084289.
This article has been published as part of BMC Genetics Volume 17 Supplement 2, 2016: Genetic Analysis Workshop 19: Sequence, Blood Pressure and Expression Data. Summary articles. The full contents of the supplement are available online at www.biomedcentral.com/bmcgenet/supplements/17/S2. Publication of the proceedings of Genetic Analysis Workshop 19 was supported by National Institutes of Health grant R01 GM031575.
- Blangero J, Teslovich TM, Sim X, Almeida MA, Jun G, Dyer TD, et al: Omics-squared: human genomic, transcriptomic and phenotypic data for Genetic Analysis Workshop 19. BMC Proc. 2015, 9 Suppl 8: S2-Google Scholar
- Wang K, Li M, Hakonarson H: Analysing biological pathways in genome-wide association studies. Nat Rev Genet. 2010, 11: 843-54. 10.1038/nrg2884.View ArticlePubMedGoogle Scholar
- Cantor RM, Lange K, Sinsheimer JS: Prioritizing GWAS results: a review of statistical methods and recommendations for their application. Am J Hum Genet. 2010, 86: 6-22. 10.1016/j.ajhg.2009.11.017.View ArticlePubMedPubMed CentralGoogle Scholar
- Basson J, Simino J, Rao DC: Between candidate genes and whole genomes: time for alternative approaches in blood pressure genetics. Curr Hypertens Rep. 2012, 14: 46-61. 10.1007/s11906-011-0241-8.View ArticlePubMedGoogle Scholar
- Charlesworth JC, Peralta JM, Drigalenko E, Göring HHH, Almasy L, Dyer TD, et al: Toward the identification of causal genes in complex diseases: a gene-centric joint test of significance combining genomic and transcriptomic data. BMC Proc. 2009, 3 (Suppl 7): S92-10.1186/1753-6561-3-s7-s92.View ArticlePubMedPubMed CentralGoogle Scholar
- Lo S, Chernoff H, Cong L, Ding Y, Zheng T: Discovering interactions among BRCA1 and other candidate genes associated with sporadic breast cancer. Proc Natl Acad Sci U S A. 2008, 105 (34): 12387-92. 10.1073/pnas.0805242105.View ArticlePubMedPubMed CentralGoogle Scholar
- Langfelder P, Horvath S: WGCNA: an R package for weighted correlation network analysis. BMC Bioinformatics. 2008, 9: 559-10.1186/1471-2105-9-559.View ArticlePubMedPubMed CentralGoogle Scholar
- Almasy L, Blangero J: Multipoint quantitative trait linkage analysis in general pedigrees. Am J Hum Genet. 1998, 62: 1198-211. 10.1086/301844.View ArticlePubMedPubMed CentralGoogle Scholar
- Valcarcel A, Grinde K, Cook K, Green A, Tintle N: A multi-step approach to SNP-set analysis: an evaluation of power and type I error of gene-based tests of association after pathway-based association tests. BMC Proc. 2015, 9 Suppl 8: S49-Google Scholar
- Aulchenko YS, de Koning DJ, Haley C: Genome-wide rapid association using mixed model and regression: a fast and simple method for genome-wide pedigree-based quantitative trait loci association analysis. Genetics. 2007, 77 (1): 577-85. 10.1534/genetics.107.075614.View ArticleGoogle Scholar
- Tayo BO, Tong L, Cooper RS: Association of polymorphisms in the aldosterone-regulated sodium reabsorption pathway with blood pressure among Hispanics. BMC Proc. 2015, 9 Suppl 8: S48-Google Scholar
- Strehl A, Ghosh J: Value-based customer grouping from large retail data-sets. Proceedings of the SPIE Conference on Data Mining and Knowledge Discovery, Orlando. 2000, 33-42.Google Scholar
- Quillen EE, Blangero J, Almasy L: A variance component method for integrated pathway analysis of gene expression data. BMC Proc. 2015, 9 Suppl 8: S47-Google Scholar
This article is published under license to BioMed Central Ltd. Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.