SNP Selection in genome‐wide and candidate gene studies via penalized logistic regression

Abstract

Penalized regression methods offer an attractive alternative to single marker testing in genetic association analysis. Penalized regression methods shrink down to zero the coefficient of markers that have little apparent effect on the trait of interest, resulting in a parsimonious subset of what we hope are true pertinent predictors. Here we explore the performance of penalization in selecting SNPs as predictors in genetic association studies. The strength of the penalty can be chosen either to select a good predictive model (via methods such as computationally expensive cross validation), through maximum likelihood‐based model selection criterion (such as the BIC), or to select a model that controls for type I error, as done here. We have investigated the performance of several penalized logistic regression approaches, simulating data under a variety of disease locus effect size and linkage disequilibrium patterns. We compared several penalties, including the elastic net, ridge, Lasso, MCP and the normal‐exponential‐γ shrinkage prior implemented in the hyperlasso software, to standard single locus analysis and simple forward stepwise regression. We examined how markers enter the model as penalties and P ‐value thresholds are varied, and report the sensitivity and specificity of each of the methods. Results show that penalized methods outperform single marker analysis, with the main difference being that penalized methods allow the simultaneous inclusion of a number of markers, and generally do not allow correlated variables to enter the model, producing a sparse model in which most of the identified explanatory markers are accounted for. Genet. Epidemiol . 34:879–891, 2010. © 2010 Wiley‐Liss, Inc.

Shown for reading. Its publisher allows quoting it, not republishing it.

References 46

1. 1.

   Barratt BJ, Payne F, Lowe CE, Hermann R, Healy BC, Harold D, Concannon P, Gharani N, McCarthy MI, Olavensen MG, McCormack R, Guja C, Ionescu-Tirgoviste C, Undlien DE, Ronningen KS, Gillespie KM, Tuomilehto-Wolf E, Tuomilehto J, Benett ST, Clayton DG. Remapping the insulin gene/IDDM2 locus in type 1 diabetes. Diabetes. 2004;53:1884-1889.

   Not in our library10.2337/diabetes.53.7.1884

2. 2.

   Breheny P, Huang J. 2008.

   Not in our library

3. 3.

   Breiman L. Better subset regression using the nonnegative garrote. Technometrics. 1995;37:373-384.

   Not in our library

4. 4.

   Breiman L. Bagging predictors. Mach Learn. 1996;24:123-140.

   Not in our library

5. 5.
   Fregene: Simulation of realistic sequence-level data in populations and ascertained samples · 2008

   Not checked
6. 6.

   Charoen P, Biernacka JM, Cordell HJ. Linkage and association analysis of GAW15 simulated data: fine-mapping of chromosome 6 region. BMC Proc. 2007;1:S23.

   Not in our library10.1186/1753-6561-1-s1-s23

7. 7.

   Cho S, Kim H, Oh S, Kim K, Park T. Elastic-net regularization approaches for genome-wide association studies of rheumatoid arthritis. BMC Proc. 2009;3:S25.

   Not in our library10.1186/1753-6561-3-s7-s25

8. 8.

   Cordell HJ, Clayton DG. A unified stepwise regression procedure for evaluating the relative effects of polymorphisms within a gene using case/control or family data: application to HLA in type 1 diabetes. Am J Hum Genet. 2002;70:124-141.

   Not in our library10.1086/338007

9. 9.

   Croiseau P, Cordell HJ. Analysis of North American rheumatoid arthritis consortium data using a penalized logistic regression approach. BMC Proc. 2009;3:S61.

   Not in our library10.1186/1753-6561-3-s7-s61

10. 10.

    Easton DF, Pooley KA, Dunning AM, Pharoah PD, Thompson D, Ballinger DG, Struewing JP, Morrison J, Field H, Luben R, Wareham N, Ahmed S, Healey CS, Bowman R, Meyer KB, Haiman CA, Kolonel LK, Henderson BE, Marchand LL, Brennan P, Sangrajrang S, Gaborieau V, Odefrey F, Shen CY, Wu PE, Wang HC, Eccles D, Evans DG, Peto J, Fletcher O, Johnson N, Seal S, Stratton MR, Rahman N, Chenevix-Trench G, Bojesen SE, Nordestgaard BG, Axelsson CK, Garcia-Closas M, Brinton L, Chanock S, Lissowska J, Peplonska B, Nevanlinna H, Fagerholm R, Eerola H, Kang D, Yoo KY, Noh DY, Ahn SH, Hunter DJ, Hankinson SE, Cox DG, Hall P, Wedren S, Liu J, Low YL, Bogdanova N, Schurmann P, Dork T, Tollenaar RA, Jacobi CE, Devilee P, Klijn JG, Sigurdson AJ, Doody MM, Alexander BH, Zhang J, Cox A, Brock IW, MacPherson G, Reed MW, Couch FJ, Goode EL, Olson JE, Meijers-Heijboer H, van den Ouweland A, Uitterlinden A, Rivadeneira F, Milne RL, Ribas G, Gonzalez-Neira A, Benitez J, Hopper JL, McCredie M, Southey M, Giles GG, Schroen C, Justenhoven C, Brauch H, Hamann U, Ko YD, Spurdle AB, Beesley J, Chen X, kConFab, AOCS Management Group, Mannermaa A, Kosma VM, Kataja V, Hartikainen J, Day NE, Cox DR, Ponder BA. Genome-wide association study identifies novel breast cancer susceptibility loci. Nature. 2007;447:1087-1093.

    Not in our library10.1038/nature05887

11. 11.

    Efron B, Hastie T, Johnstone I, Tibshirani R. Least angle regression. Ann Statist. 2004;32:407-451.

    Not in our library

12. 12.

    Fan J, Li R. Variable selection via nonconcave penalized likelihood and its oracle properties. J Am Statis Assoc. 2001;97:1348-1360.

    Not in our library

13. 13.

    Fellay J, Shianna KV, Ge D, Colombo S, Ledergerber B, Weale M, Zhang K, Gumbs C, Castagna A, Cossarizza A, Cozzi-Lepri A, Luca AD, Easterbrook P, Francioli P, Mallal S, Martinez-Picado J, Miro JM, Obel N, Smith JP, Wyniger J, Descombes P, Antonarakis SE, Letvin NL, McMichael AJ, Haynes BF, Telenti A, Goldstein DB. A whole-genome association study of major determinants for host control of HIV-1. Science. 2007;317:944-947.

    Not in our library10.1126/science.1143767

14. 14.

    Frayling TM, Timpson NJ, Weedon MN, Zeggini E, Freathy RM, Lindgren CM, Perry JR, Elliott KS, Lango H, Rayner NW, Shields B, Harries LW, Barrett JC, Ellard S, Groves CJ, Knight B, Patch AM, Ness AR, Ebrahim S, Lawlor DA, Ring SM, Ben-Shlomo Y, Jarvelin MR, Sovio U, Bennett AJ, Melzer D, Ferrucci L, Loos RJ, Barroso I, Wareham NJ, Karpe F, Owen KR, Cardon LR, Walker M, Hitman GA, Palmer CN, Doney AS, Morris AD, Smith GD, Hattersley AT, McCarthy MI. A common variant in the FTO gene is associated with body mass index and predisposes to childhood and adult obesity. Science. 2007;316:889-894.

    Not in our library10.1126/science.1141634

15. 15.

    Friedman J, Hastie T, Hofling H, Tibshirani R. Pathwise coordinate optimization. Ann Appl Statist. 2007;1:302-332.

    Not in our library

16. 16.

    Friedman J, Hastie T, Tibshirani R. Regularization paths for generalized linear models via coordinate descent. J Statist Software. 2010;33:1-22.

    Not in our library

17. 17.

    Genkin A, Lewis DD, Madigan D. Large-scale Bayesian logistic regression for text categorization. Technometrics. 2007;49:291-304.

    Not in our library

18. 18.

    Goeman JJ. L1 penalized estimation in the Cox proportional hazards model. Biom J. 2009;50:1-15.

    Not in our library10.1002/bimj.200900028

19. 19.

    Hastie T, Tibshirani R, Friedman J. The elements of statistical learning: data mining, inference and prediction. 2001.

    Not in our library

20. 20.

    Hesterberg T, Choi NH, Meier L, Fraley C. Least angle and l1 penalized regression: a review. Statist Surveys. 2008;2:61-93.

    Not in our library

21. 21.

    Hoerl AE, Kennard RW. Ridge regression: biased estimation for nonorthogonal problems. Technometrics. 1970;12:55-67.

    Not in our library

22. 22.

    Hoggart CJ, Chadeau-Hyam M, Clark TG, Lampariello R, Whittaker JC, Iorio MD, Balding DJ. Sequence-level population simulations over large genomic regions. Genetics. 2007;177:1725-1731.

    Not in our library10.1534/genetics.106.069088

23. 23.
    Simultaneous Analysis of All SNPs in Genome-Wide and Re-Sequencing Association Studies · 2008

    No notice
24. 24.

    James GM, Radchenko P. A generalized Dantzig selector with shrinkage tuning. Biometrika. 2009;96:323-337.

    Not in our library

25. 25.

    James GM, Radchenko P, Lv J. DASSO: connections between the Dantzig selector and lasso. J R Statis Soc Ser B. 2009;71:127-142.

    Not in our library

26. 26.

    Le Cessie S, van Houwelingen JC. Ridge estimators in logistic regression. Appl Statist. 1992;41:191-201.

    Not in our library

27. 27.

    Malo N, Libiger O, Schork NJ. Accommodating linkage disequilibrium in genetic-association analyses via ridge regression. Am J Hum Genet. 2008;82:375-385.

    Not in our library10.1016/j.ajhg.2007.10.012

28. 28.

    Marchini J, Howie B, Myers S, McVean G, Donnelly P. A new multipoint method for genome-wide association studies by imputation of genotypes. Nat Genet. 2007;39:906-913.

    Not in our library10.1038/ng2088

29. 29.

    Meier L, van de Geer S, Bühlmann P. The group lasso for logistic regression. J R Statis Soc Ser B. 2008;70:53-71.

    Not in our library

30. 30.

    Park T, Casella G. The Bayesian Lasso. J Am Statis Assoc. 2008;103:681-686.

    Not in our library

31. 31.

    Park MY, Hastie T. Penalized logistic regression for detecting gene interactions. Biostatistics. 2008;9:30-50.

    Not in our library10.1093/biostatistics/kxm010

32. 32.

    Plenge RM, Seielstad M, Padyukov L, Lee AT, Remmers EF, Ding B, Liew A, Khalili H, Chandrasekaran A, Davies LR, Li W, Tan AK, Bonnard C, Ong RT, Thalamuthu A, Pettersson S, Liu C, Tian C, Chen WV, Carulli JP, Beckman EM, Altshuler D, Alfredsson L, Criswell LA, Amos CI, Seldin MF, Kastner DL, Klareskog L, Gregersen PK. TRAF1-C5 as a risk locus for rheumatoid arthritis—a genomewide study. N Engl J Med. 2007;357:1199-1209.

    Not in our library10.1056/nejmoa073491

33. 33.

    Scott LJ, Mohlke KL, Bonnycastle LL, Willer CJ, Li Y, Duren WL, Erdos MR, Stringham HM, Chines PS, Jackson AU, Prokunina-Olsson L, Ding CJ, Swift AJ, Narisu N, Hu T, Pruim R, Xiao R, Li XY, Conneely KN, Riebow NL, Sprau AG, Tong M, White PP, Hetrick KN, Barnhart MW, Bark CW, Goldstein JL, Watkins L, Xiang F, Saramies J, Buchanan TA, Watanabe RM, Valle TT, Kinnunen L, Abecasis GR, Pugh EW, Doheny KF, Bergman RN, Tuomilehto J, Collins FS, Boehnke M. A genome-wide association study of type 2 diabetes in Finns detects multiple susceptibility variants. Science. 2007;316:1341-1345.

    Not in our library10.1126/science.1142382

34. 34.

    The International HapMap Project. Nature. 2003;426:789-796.

    Not in our library10.1038/nature02168

35. 35.

    Tibshirani R. Regression shrinkage via the lasso. J R Statis Soc. 1996;58:267-288.

    Not in our library

36. 36.

    Todd J, Walker N, Cooper J, Smyth D, Downes K, Plagnol V, Bailey R, Nejentsev S, Field S, Payne F, Lowe C, Szeszko J, Hafler J, Zeitels L, Yang J, Vella A, Nutland S, Stevens H, Schuilenburg H, Coleman G, Maisuria M, Meadows W, Smink L, Healy B, Burren O, Lam A, Ovington N, Allen J, Adlem E, Leung H, Wallace C, Howson J, Guja C, Ionescu-Tirgoviste C, Simmonds M, Heward J, Gough S, Dunger D, Wicker L, Clayton D. Robust associations of four new chromosome regions from genome-wide analyses of type 1 diabetes. Nat Genet. 2007;39:857-864.

    Not in our library10.1038/ng2068

37. 37.

    Ueda H, Howson JMM, Esposito L, Heward J, Snook H, Chamberlain G, Rainbow DB, Hunter KMD, Smith A, DiGenova G, Herr MH, Dahlman I, Payne F, Smyth D, Lowe C, Twells RCJ, Howlett S, Healy B, Smink LJ, Lam ACH, Cordell HJ, Walker NM, Bordin C, Hulme H, Motzo C, Cucca F, Hess JF, Metzker ML, Rogers J, Gregory S, Allahabadia A, Nithiyananthan R, Tuomilehto-Wolf E, Tuomilehto J, Bingley P, Gillespie KM, Undlien DE, Rnningen KS, Savage DA, Carson DJ, Maxwell AP, Patterson CC, Franklyn JA, Clayton DG, Peterson LB, Wicker LS, Todd JA, Gough SCL. Regulation of splicing of the T lymphocyte-inhibitory receptor CTLA-4 gene is associated with protection from autoimmune disease in humans and mice. Nature. 2003;423:506-511.

    Not in our library

38. 38.

    Genome-wide association study of 14,000 cases of seven common diseases and 3,000 shared controls. Nature. 2007;447:661-678.

    Not in our library10.1038/nature05911

39. 39.

    Wu TT, Lange K. Coordinate descent algorithms for lasso penalized regression. Ann Appl Statist. 2008;2:224-244.

    Not in our library

40. 40.

    Wu TT, Chen YF, Hastie T, Sobel E, Lange K. Genomewide association analysis by lasso penalized logistic regression. Bioinformatics. 2009;25:714-721.

    Not in our library10.1093/bioinformatics/btp041

Cited by papers we hold 5

• Iterative sure independence screening EM-Bayesian LASSO algorithm for multi-locus genome-wide association studies · 2017
  No notice
• Improving power and accuracy of genome-wide association studies via a multi-locus mixed linear model methodology · 2016
  No notice
• Selecting instruments for Mendelian randomization in the wake of genome-wide association studies · 2016
  No notice
• Evaluation of the lasso and the elastic net in genome-wide association studies · 2013
  No notice
• Significance testing in ridge regression for genetic data · 2011
  Not checked

Reads

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.