How well do network models predict observations? On the importance of predictability in network models

Abstract

Network models are an increasingly popular way to abstract complex psychological phenomena. While studying the structure of network models has led to many important insights, little attention has been paid to how well they predict observations. This is despite the fact that predictability is crucial for judging the practical relevance of edges: for instance in clinical practice, predictability of a symptom indicates whether an intervention on that symptom through the symptom network is promising. We close this methodological gap by introducing nodewise predictability, which quantifies how well a given node can be predicted by all other nodes it is connected to in the network. In addition, we provide fully reproducible code examples of how to compute and visualize nodewise predictability both for cross-sectional and time series data.

Full text

Its licence does not allow us to show the full text. Read it at PubMed Central:

References 38

1. 1.

   Albert R, Barabasi AL. Statistical mechanics of complex networks. Reviews of Modern Physics. 2002;74(1):47.

   Not in our library10.1103/revmodphys.74.47

2. 2.

   Beard, C., Millner, A., Forgeard, M., Fried, E., Hsu, K., Treadway, M., Leonard, C., Kertz, S., & Björgvinsson, T. (2016). Network analysis of depression and anxiety symptom relationships in a psychiatric sample. Psychological Medicine, 1–11.

   Not in our library10.1017/s0033291716002300

3. 3.

   Borsboom, D., & Cramer, A. O. (2013). Network analysis: An integrative approach to the structure of psychopathology. Annual Review of Clinical Psychology, 9(1), 91–121. doi:10.1146/annurev-clinpsy-050212-185608.

   Not in our library10.1146/annurev-clinpsy-050212-185608

4. 4.
   The Network Structure of Symptoms of the Diagnostic and Statistical Manual of Mental Disorders · 2015

   No notice
5. 5.

   Breiman L, et al. Statistical modeling: The two cultures (with comments and a rejoinder by the author). Statistical Science. 2001;16(3):199-231.

   Not in our library10.1214/ss/1009213726

6. 6.
   A Network Approach to Psychopathology: New Insights into Clinical Longitudinal Data · 2013

   Corrected
7. 7.

   Byrne, B. M. (2013). Structural equation modeling with Mplus: Basic concepts, applications, and programming. Routledge.

   Not in our library

8. 8.

   Costantini G, Epskamp S, Borsboom D, Perugini M, Mõttus R, Waldorp LJ, Cramer AO. State of the art personality research: A tutorial on network analysis of personality data in R. Journal of Research in Personality. 2015;54:13-29.

   Not in our library10.1016/j.jrp.2014.07.003

9. 9.

   Cramer AO, Sluis S, Noordhof A, Wichers M, Geschwind N, Aggen SH, Kendler KS, Borsboom D. Dimensions of normal personality as networks in search of equilibrium: You can’t like parties if you don’t like people. European Journal of Personality. 2012;26(4):414-431.

   Not in our library10.1002/per.1866

10. 10.

    Cramer, A. O. J., Waldorp, L. J., van der Maas, H. L. J., & Borsboom, D. (2010). Comorbidity: A network perspective. Behavioral and Brain Sciences, 33, 137–193.

    Not in our library10.1017/s0140525x09991567

11. 11.

    Epskamp S, Cramer AO, Waldorp LJ, Schmittmann VD, Borsboom D, et al. qgraph: Network visualizations of relationships in psychometric data. Journal of Statistical Software. 2012;48(4):1-18.

    Not in our library10.18637/jss.v048.i04

12. 12.

    Epskamp, S., Rhemtulla, M., & Borsboom, D. (2016). Generalized network psychometrics: Combining network and latent variable models. arXiv:160509288.

    Not in our library10.1007/s11336-017-9557-x

13. 13.

    Foygel, R., & Drton, M. (2014). High-dimensional Ising model selection with Bayesian information criteria. arXiv:1403.3374.

    Not in our library

14. 14.

    Fried, E. I., & Cramer, A. O. J. (2016). Moving forward: Challenges and directions for psychopathological network theory and methodology. doi:10.17605/OSF.IO/BNEKP, http://osf.io/bnekp.

    Not in our library10.1177/1745691617705892

15. 15.

    Fried EI, Bockting C, Arjadi R, Borsboom D, Amshoff M, Cramer AO, Epskamp S, Tuerlinckx F, Carr D, Stroebe M. From loss to loneliness: The relationship between bereavement and depressive symptoms. Journal of Abnormal Psychology. 2015;124(2):256.

    Not in our library10.1037/abn0000028

16. 16.

    Fried EI, Epskamp S, Nesse RM, Tuerlinckx F, Borsboom D. What are ’good’ depression symptoms? Comparing the centrality of DSM and non-DSM symptoms of depression in a network analysis. Journal of Affective Disorders. 2016;189:314-320.

    Not in our library10.1016/j.jad.2015.09.005

17. 17.

    Friedman N, Linial M, Nachman I, Pe’er D. Using Bayesian networks to analyze expression data. Journal of Computational Biology. 2000;7(3–4):601-620.

    Not in our library10.1089/106652700750050961

18. 18.

    Fruchterman TM, Reingold EM. Graph drawing by force-directed placement. Software: Practice and experience. 1991;21(11):1129-1164.

    Not in our library

19. 19.

    Grömping, U. (2012). Estimators of relative importance in linear regression based on variance decomposition. The American Statistician.

    Not in our library

20. 20.

    Hamilton JD. Time Series analysis. 1994.

    Not in our library

21. 21.

    Haslbeck, J. M. B., & Fried, E. I. (2017). How predictable are symptoms in psychopathological networks? A reanalysis of 18 published datasets. Psychological Medicine. doi:10.1017/S0033291717001258.

    Not in our library10.1017/s0033291717001258

22. 22.

    Haslbeck, J. M. B., & Waldorp, L. J. (2015a). mgm: Structure estimation for time-varying mixed graphical models in high-dimensional data. arXiv:151006871.

    Not in our library

23. 23.

    Haslbeck, J. M. B., & Waldorp, L. J. (2015b). Structure estimation for mixed graphical models in high-dimensional data. arXiv:151005677.

    Not in our library

24. 24.

    Hastie, T., Tibshirani, R., & Wainwright, M. (2015). Statistical learning with sparsity: The lasso and generalizations. CRC Press.

    Not in our library

25. 25.

    Huang S, Li J, Sun L, Ye J, Fleisher A, Wu T, Chen K, Reiman E. Learning brain connectivity of Alzheimer’s disease by sparse inverse covariance estimation. NeuroImage. 2010;50(3):935-949.

    Not in our library10.1016/j.neuroimage.2009.12.120

26. 26.

    Kossakowski, J. J., Epskamp, S., Kieffer, J. M., van Borkulo, C. D., Rhemtulla, M., & Borsboom, D. (2016). The application of a network approach to health-related quality of life (HRQoL): Introducing a new method for assessing HRQoL in healthy adults and cancer patients. Quality of Life Research, 25(4), 781–792.

    Not in our library10.1007/s11136-015-1127-z

27. 27.

    Kossakowski, J. J., Groot, P. C., Haslbeck, J. M. B., Borsboom, D., & Wichers, M. (2016). Data from ’critical slowing down as a personalized early warning signal for depression’. Journal of Open Psychology Data (submitted).

    Not in our library10.1159/000441458

28. 28.

    McNally RJ, Robinaugh DJ, Wu GW, Wang L, Deserno MK, Borsboom D. Mental disorders as causal systems a network approach to posttraumatic stress disorder. Clinical Psychological Science. 2015;3(6):836-849.

    Not in our library10.1177/2167702614553230

29. 29.

    Meinshausen N, Bühlmann P. High-dimensional graphs and variable selection with the Lasso. The Annals of Statistics. 2006;34(3):1436-1462.

    Not in our library10.1214/009053606000000281

30. 30.

    Newman, M. (2010). Networks: An Introduction. Oxford University Press.

    Not in our library

31. 31.

    Pe ML, Kircanski K, Thompson RJ, Bringmann LF, Tuerlinckx F, Mestdagh M, Mata J, Jaeggi SM, Buschkuehl M, Jonides J, et al. Emotion-network density in major depressive disorder. Clinical Psychological Science. 2015;3(2):292-300.

    Not in our library10.1177/2167702614540645

32. 32.

    Pfaff B. Analysis of integrated and cointegrated time series with R. 2008.

    Not in our library

33. 33.

    Shulgin B, Stone L, Agur Z. Pulse vaccination strategy in the SIR epidemic model. Bulletin of Mathematical Biology. 1998;60(6):1123-1148.

    Not in our library10.1016/s0092-8240(98)90005-2

34. 34.

    Spirtes, P., Glymour, C. N., & Scheines, R. (2000). Causation, prediction, and search. MIT Press.

    Not in our library

35. 35.

    Wainwright MJ, Jordan MI. Graphical models, exponential families, and variational inference. Foundations and Trends in Machine Learning. 2008;1(1–2):1-305.

    Not in our library

36. 36.

    Wichers M, Groot PC, Psychosystems E, Group E, et al. Critical slowing down as a personalized early warning signal for depression. Psychotherapy and Psychosomatics. 2016;85(2):114-116.

    Not in our library10.1159/000441458

37. 37.

    Yang E, Baker Y, Ravikumar P, Allen G, Liu Z. Mixed Graphical Models via Exponential Families. Proceedings of the Seventeenth International Conference on Artificial Intelligence and Statistics. 2014;1042-1050.

    Not in our library

38. 38.

    Zhang B, Horvath S, et al. A general framework for weighted gene co-expression network analysis. Statistical Applications in Genetics and Molecular Biology. 2005;4(1):1128.

    Not in our library10.2202/1544-6115.1128

Cited by papers we hold 4

• Exploring the links between alexithymia and cognitive emotion regulation strategies in internet addiction: A network analysis model · 2022
  Not checked
• Network structure of depression and anxiety symptoms in Chinese female nursing students · 2021
  No notice
• Bridging late-life depression and chronic somatic diseases: a network analysis · 2021
  Not checked
• Visualizing Psychological Networks: A Tutorial in R · 2018
  No notice

Reads

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.