No retraction, correction or concern found when last checked on Oct 15, 2026.

Estimating psychological networks and their accuracy: A tutorial paper

Sacha Epskamp, Denny Borsboom, Eiko I. Fried

Behavior Research Methods · 2017

Abstract

Electronic supplementary material. The online version of this article (doi:10.3758/s13428-017-0862-1) contains supplementary material, which is available to authorized users.

Full text

Its licence does not allow us to show the full text. Read it at PubMed Central:

References 65

1.
American Psychiatric Association (2000). Diagnostic and Statistical Manual of Mental Disorders: DSM-IV-TR (4th ed., text rev.). Washington, DC, USA: American Psychiatric Association.
Not in our library
2.
Bache, S.M., & Wickham, H. (2014). magrittr: A Forward-Pipe Operator for R. R package version 1.5. https://CRAN.R-project.org/package=magrittr.
Not in our library
3.
Barzel B, Biham O. Quantifying the connectivity of a network: The network correlation function method. Physical Review E - Statistical, Nonlinear, and Soft Matter Physics. 2009;80(4):046104.
Not in our library10.1103/physreve.80.046104
4.
Bland JM, Altman DG. Multiple significance tests: the Bonferroni method. Bmj. 1995;310(6973):170.
Not in our library10.1136/bmj.310.6973.170
5.
Bollen KA, Stine RA. Bootstrapping goodness-of-fit measures in structural equation models. Sociological Methods & Research. 1992;21(2):205-229.
Not in our library10.1177/0049124192021002004
6.
Borsboom D, Cramer AOJ. Network analysis: an integrative approach to the structure of psychopathology. Annual Review of Clinical Psychology. 2013;9:91-121.
Not in our library10.1146/annurev-clinpsy-050212-185608
7.
The Network Structure of Symptoms of the Diagnostic and Statistical Manual of Mental Disorders · 2015
No notice
8.
Bringmann LF, Lemmens LH, Huibers MJ, Borsboom D, Tuerlinckx F. Revealing the dynamic network structure of the Beck depression inventory-II. Psychological Medicine. 2015;45(04):747-757.
Not in our library10.1017/s0033291714001809
9.
Chen J, Chen Z. Extended Bayesian information criteria for model selection with large model spaces. Biometrika. 2008;95(3):759-771.
Not in our library10.1093/biomet/asn034
10.
Chernick MR. Bootstrap methods: a guide for practitioners and researchers. 2011.
Not in our library
11.
Cohen J. Statistical power analysis for the behavioral sciences. 1977.
Not in our library
12.
Cohen J. The earth is round (p<0.05). American Psychologist. 1994;49(12):997-1003.
Not in our library10.1037/0003-066x.49.12.997
13.
Costantini, G., Epskamp, S., Borsboom, D., Perugini, M., Mõttus, R., Waldorp, L.J., & Cramer, A.O.J. (2015a). State of the aRt personality research: a tutorial on network analysis of personality data in R. Journal of Research in Personality, 54, 13–29.
Not in our library
14.
Costantini, G., Richetin, J., Borsboom, D., Fried, E.I., Rhemtulla, M., & Perugini, M. (2015b). Development of indirect measures of conscientiousness: combining a facets approach and network analysis. European Journal of Personality, 29(5), 548–567.
Not in our library
15.
Costenbader E, Valente TW. The stability of centrality measures when networks are sampled. Social Networks. 2003;25(4):283-307.
Not in our library10.1016/s0378-8733(03)00012-1
16.
Cramer AOJ, Sluis S, Noordhof A, Wichers M, Geschwind N, Aggen SH, Borsboom D. Dimensions of normal personality as networks in search of equilibrium: you can’t like parties if you don’t like people. European Journal of Personality. 2012;26(4):414-431.
Not in our library10.1002/per.1866
17.
Cramer, A.O.J., Waldorp, L., van der Maas, H., & Borsboom, D. (2010). Comorbidity: A Network Perspective. Behavioral and Brain Sciences, 33(2-3), 137–150.
Not in our library10.1017/s0140525x09991567
18.
Dalege, J., Borsboom, D., van Harreveld, F., van den Berg, H., Conner, M., & van der Maas, H.L.J. (2016). Toward a formalized account of attitudes: The Causal Attitude Network (CAN) model. Psychological Review, 123(1), 2–22.
Not in our library10.1037/a0039802
19.
Efron B. Bootstrap methods: another look at the jackknife. The Annals of Statistics. 1979;7(1):1-26.
Not in our library10.1214/aos/1176344552
20.
Epskamp, S., & Fried, E.I. (2016). A tutorial on estimating regularized partial correlation networks. arXiv:1607.01367.
Not in our library10.1037/met0000167
21.
Epskamp, S. (2014). IsingSampler: sampling methods and distribution functions for the Ising model. R package version 0.1.1. Retrieved from github.com/SachaEpskamp/ IsingSampler.
Not in our library
22.
Epskamp, S. (2016). Regularized Gaussian Psychological Networks: Brief Report on the Performance of Extended BIC Model Selection. arXiv:1606.05771.
Not in our library
23.
Epskamp, S., Rhemtulla, M., & Borsboom, D. (2016). Generalized network psychometrics: combining network and latent variable models. Psychometrika. in press.
Not in our library10.1007/s11336-017-9557-x
24.
Epskamp S, Cramer AO, Waldorp LJ, Schmittmann VD, Borsboom D. qgraph: Network visualizations of relationships in psychometric data. Journal of Statistical Software. 2012;48(4):1-18.
Not in our library10.18637/jss.v048.i04
25.
Foa EB, Riggs DS, Dancu CV, Rothbaum BO. Reliability and validity of a brief instrument for assessing post-traumatic stress disorder. Journal of Traumatic Stress. 1993;6(4):459-473.
Not in our library10.1002/jts.2490060405
26.
Forbush K, Siew C, Vitevitch M. Application of network analysis to identify interactive systems of eating disorder psychopathology. Psychological Medicine. 2016;46(12):2667-2677.
Not in our library10.1017/s003329171600012x
27.
Foygel R, Drton M. Extended Bayesian information criteria for Gaussian graphical models. Advances in Neural Information Processing Systems. 2010;23:20200-2028.
Not in our library
28.
Foygel Barber R, Drton M. High-dimensional Ising model selection with Bayesian information criteria. Electronic Journal of Statistics. 2015;9(1):5670-607.
Not in our library
29.
Fried EI, Bockting C, Arjadi R, Borsboom D, Amshoff M, Cramer OJ, Stroebe M. From loss to loneliness: The relationship between bereavement and depressive symptoms. Journal of Abnormal Psychology. 2015;124(2):256-265.
Not in our library10.1037/abn0000028
30.
Fried EI, Epskamp S, Nesse RM, Tuerlinckx F, Borsboom D. What are ‘good’ depression symptoms? Comparing the centrality of DSM and non-DSM symptoms of depression in a network analysis. Journal of Affective Disorders. 2016;189:314-320.
Not in our library10.1016/j.jad.2015.09.005
31.
Friedman, J.H., Hastie, T., & Tibshirani, R. (2014). Glasso: graphical lasso- estimation of Gaussian graphical models. R package version 1.8. Retrieved from https://CRAN.Rproject.org/package=glasso.
Not in our library
32.
Friedman JH, Hastie T, Tibshirani R. Sparse inverse covariance estimation with the graphical lasso. Biostatistics. 2008;9(3):432-441.
Not in our library10.1093/biostatistics/kxm045
33.
Genz, A., Bretz, F., Miwa, T., Mi, X., Leisch, F., Scheipl, F., & Hothorn, T. (2008). Mvtnorm: multivariate normal and t distributions. R package version 0.9-2. Retrieved from http://CRAN.R-project.org/package=mvtnorm.
Not in our library
34.
Gumbel EJ. La probabilité des hypotheses. Comptes Rendus de l’Academie des Sciences (Paris). 1939;209:645-647.
Not in our library
35.
Haslbeck, J.M.B., & Waldorp, L.J. (2016a). mgm: structure estimation for time-varying mixed graphical models in high-dimensional data. arXiv:1510.06871.
Not in our library
36.
Haslbeck, J.M.B., & Waldorp, L.J. (2016b). Structure estimation for mixed graphical models in high dimensional data. arXiv:1510.05677.
Not in our library
37.
Hastie, T., Tibshirani, R., & Wainwright, M. (2015). Statistical learning with sparsity: the lasso and generalizations. Boca Raton, FL, USA: CRC Press.
Not in our library
38.
Hien DA, Wells EA, Jiang H, Suarez-Morales L, Campbell AN, Cohen LR, Zhang Y, et al. Multisite randomized trial of behavioral interventions for women with co-occurring ptsd and substance use disorders. Journal of Consulting and Clinical Psychology. 2009;77(4):607-619.
Not in our library10.1037/a0016227
39.
Hyndman RJ, Fan Y. Sample quantiles in statistical packages. The American Statistician. 1996;50(4):361-365.
Not in our library
40.
Isvoranu, A.M., Borsboom, D., van Os, J., & Guloksuz, S. (2016). A Network Approach to Environmental Impact in Psychotic Disorders: Brief Theoretical Framework. Schizophrenia Bulletin, 42(4), 870–873.
Not in our library10.1093/schbul/sbw049
41.
Isvoranu, A.M., van Borkulo, C.D., Boyette, L., Wigman, J.T.W., Vinkers, C.H., Borsboom, D., & GROUP Investigators (2017). A Network Approach to Psychosis: Pathways between Childhood Trauma and Psychotic Symptoms. Schizophrenia bulletin, 43(1), 187–196.
Not in our library10.1093/schbul/sbw055
42.
Kolaczyk ED. Statistical analysis of network data. 2009.
Not in our library
43.
Koller, D., & Friedman, N. (2009). Probabilistic graphical models: principles and techniques. Cambridge, MA, USA: MIT Press.
Not in our library
44.
Kossakowski, J.J., Epskamp, S., Kieffer, J.M., van Borkulo, C.D., Rhemtulla, M., & Borsboom, D. (2015). The application of a network approach to health-related quality of life (HRQoL): introducing a new method for assessing HRQoL in healthy adults and cancer patient. Quality of Life Research, 25, 781–92.
Not in our library10.1007/s11136-015-1127-z
45.
Regularized estimation of large-scale gene association networks using graphical Gaussian models · 2009
No notice
46.
Lauritzen SL. Graphical models. 1996.
Not in our library
47.
Liu H, Han F, Yuan M, Lafferty JD, Wasserman L. High-dimensional semiparametric Gaussian copula graphical models. The Annals of Statistics. 2012;40(4):2293-2326.
Not in our library10.1214/12-aos1037
48.
MacCallum RC, Wegener DT, Uchino BN, Fabrigar LR. The problem of equivalent models in applications of covariance structure analysis. Psychological Bulletin. 1993;114(1):185-199.
Not in our library10.1037/0033-2909.114.1.185
49.
McNally RJ, Robinaugh DJ, Wu GW, Wang L, Deserno MK, Borsboom D. Mental disorders as causal systems a network approach to posttraumatic stress disorder. Clinical Psychological Science. 2015;3(6):836-849.
Not in our library10.1177/2167702614553230
50.
Newman MEJ. Analysis of weighted networks. Physical Review E. 2004;70(5):056131.
Not in our library10.1103/physreve.70.056131
51.
Newman, M.E.J. (2010). Networks: an introduction, Oxford University Press, Oxford.
Not in our library
52.
Estimating the reproducibility of psychological science · 2015
No notice
53.
Opsahl T, Agneessens F, Skvoretz J. Node centrality in weighted networks: generalizing degree and shortest paths. Social Networks. 2010;32(3):245-251.
Not in our library10.1016/j.socnet.2010.03.006
54.
Pearl, J. (2000). Causality: Models, Reasoning, and Inference. Cambridge: Cambridge University Press.
Not in our library
55.
Pötscher BM, Leeb H. On the distribution of penalized maximum likelihood estimators: the lasso, scad, and thresholding. Journal of Multivariate Analysis. 2009;100(9):2065-2082.
Not in our library10.1016/j.jmva.2009.06.010
56.
R Core Team (2016). R: a language and environment for statistical computing. R Foundation for Statistical Computing. Vienna, Austria. Retrieved from https://www.Rproject.org/.
Not in our library
57.
Rosseel Y. lavaan: an R package for structural equation modeling. Journal of Statistical Software. 2012;48(2):1-36.
Not in our library10.18637/jss.v048.i02
58.
Sporns O, Chialvo DR, Kaiser M, Hilgetag CC. Organization, development and function of complex brain networks. Trends in Cognitive Sciences. 2004;8(9):418-425.
Not in our library10.1016/j.tics.2004.07.008
59.
Tibshirani R. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society. Series B (Methodological). 1996;58:267-288.
Not in our library
60.
van Borkulo, C.D., Borsboom, D., Epskamp, S., Blanken, T.F., Boschloo, L., Schoevers, R.A., & Waldorp, L.J. (2014). A new method for constructing networks from binary data. Scientific Reports, 4(5918), 1–10.
Not in our library10.1038/srep05918
61.
van Borkulo, C.D., Boschloo, L., Borsboom, D., Penninx, B.W.J.H., Waldorp, L.J., & Schoevers, R.A. (2015). Association of Symptom Network Structure With the Course of Depression. JAMA Psychiatry, 72 (12), 1219–1226.
Not in our library10.1001/jamapsychiatry.2015.2079
62.
Wagenmakers E-J. A practical solution to the pervasive problems of p values. Psychonomic Bulletin & Review. 2007;14(5):779-804.
Not in our library10.3758/bf03194105
63.
Wasserman S, Faust K. Social network analysis: Methods and applications. 1994.
Not in our library
64.
Watts D, Strogatz S. Collective dynamics of small-world networks. Nature. 1998;393(6684):440-442.
Not in our library10.1038/30918
65.
Zhao, T., Li, X., Liu, H., Roeder, K., Lafferty, J., & Wasserman, L. (2015). Huge: high-dimensional undirected graph estimation. R package version 1.2.7. Retrieved from https://CRAN.R-project.org/package=huge.
Not in our library

Cited by papers we hold 18

Exploring the links between alexithymia and cognitive emotion regulation strategies in internet addiction: A network analysis model · 2022
Not checked
Análisis de Redes: una Alternativa a los Enfoques Clásicos de Evaluación de los Sistemas Educativos · 2022
Not checked
Network analysis of depressive and anxiety symptoms in adolescents during the later stage of the COVID-19 pandemic · 2022
No notice
Network structure of depression and anxiety symptoms in Chinese female nursing students · 2021
No notice
Structure and stability of symptoms in first episode psychosis: a longitudinal network approach · 2021
Not checked
Negative attitudes about facemasks during the COVID-19 pandemic: The dual importance of perceived ineffectiveness and psychological reactance · 2021
No notice
Socio-Emotional Competencies and School Performance in Adolescence: What Role for School Adjustment? · 2021
Not checked
Bridging late-life depression and chronic somatic diseases: a network analysis · 2021
Not checked
Psychometric Network Models from Time-Series and Panel Data · 2020
No notice
COVID stress syndrome: Concept, structure, and correlates · 2020
No notice
Changes in network centrality of psychopathology symptoms between the COVID-19 outbreak and after peak · 2020
No notice
Unravelling the complex nature of resilience factors and their changes between early and later adolescence · 2019
Not checked
Network Analysis of the Multidimensional Symptom Experience of Oncology · 2019
No notice
Network analysis: a brief overview and tutorial · 2018
No notice
Networks of Depression and Anxiety Symptoms Across Development · 2018
No notice
Estimating psychopathological networks: Be careful what you wish for · 2017
No notice
A Bayesian network analysis of posttraumatic stress disorder symptoms in adults reporting childhood sexual abuse · 2017
No notice
Mental disorders as networks of problems: a review of recent insights · 2016
No notice

Reads

Read by people on this page

None yet.

Checked or read by AI through naulon

None yet.

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.

Are you an author?

Is this your paper?

Claim it to add your note and be paid when agents cite it. Free.