Skip to content
naulon

No retraction, correction or concern found when last checked on Oct 26, 2026.

Two decades of digital interventions for anxiety disorders: a systematic review and meta-analysis of treatment effectiveness

Darin Pauley, Pim Cuijpers, Davide Papola and 2 more

Psychological Medicine · 2021 · Meta-analysis

doi:10.1017/s0033291721001999

Abstract

Background. Digital interventions for anxiety disorders are a promising solution to address barriers to evidence-based treatment access. Precise and powerful estimates of digital intervention effectiveness for anxiety disorders are necessary for further adoption in practice. The present systematic review and meta-analysis examined the effectiveness of digital interventions across all anxiety disorders and specific to each disorder v. wait-list and care-as-usual controls.

Methods. A systematic search of bibliographic databases identified 15 030 abstracts from inception to 1 January 2020. Forty-seven randomized controlled trials (53 comparisons; 4958 participants) contributed to the meta-analysis. Subgroup analyses were conducted by an anxiety disorder, risk of bias, treatment support, recruitment, location and treatment adherence.

Results. A large, pooled effect size of g = 0.80 [95% Confidence Interval: 0.68–0.93] was found in favor of digital interventions. Moderate to large pooled effect sizes favoring digital interventions were found for generalized anxiety disorder (g = 0.62), mixed anxiety samples (g = 0.68), panic disorder with or without agoraphobia (g = 1.08) and social anxiety disorder (g = 0.76) subgroups. No subgroups were significantly different or related to the pooled effect size. Notably, the effects of guided interventions (g = 0.84) and unguided interventions (g = 0.64) were not significantly different. Supplemental analysis comparing digital and face-to-face interventions (9 comparisons; 683 participants) found no significant difference in effect [g = 0.14 favoring digital interventions; Confidence Interval: −0.01 to 0.30].

Conclusion. The precise and powerful estimates found further justify the application of digital interventions for anxiety disorders in place of wait-list or usual care.

Full text

From PubMed Central, U.S. National Library of Medicine, as current on Oct 26, 2026. Paragraph numbers are ours, so an answer can point at one.

Introduction

Anxiety disorders are considered among the most significant global health burdens (Gustavsson et al., ). These disorders, including generalized anxiety disorder (GAD), panic disorder with or without agoraphobia (PD/A), social anxiety disorder (SAD) and specific phobias (SP), are the world's most prevalent mental health disorders (Bandelow & Michaelis, ). As a result, anxiety disorders account for a substantial financial liability and an ever-pressing demand to increase access to evidence-based treatments (Gustavsson et al., ). It is reported that less than 20% of people facing anxiety disorders receive adequate treatment (Roberge et al.,; Teija et al., ).

Solving the need for access to evidence-based treatments for anxiety disorders is critically important. Common barriers to treatment access include the lack of qualified mental health professionals, time and travel inconvenience and the reluctance of people in need to seek treatment due to mental health stigmatization (Stefanopoulou, Lewis, Taylor, Broscombe, & Larkin, ). Digitally delivered interventions have the potential to resolve a variety of access constraints, through treatment self-guidance, patient privacy and convenience, reduction in therapist time commitment and overall cost of care provision (Stefanopoulou et al.,; Weightman, ). Although considerable advances have been made in the development and utilization of digital interventions over the past two decades (Hollis et al., ), adoption of these interventions in practice depends in large part on improving the precision of treatment effect estimates and practitioner confidence in expected benefits across treatment applications (Feijt, de Kort, Bongers, & Ijsselsteijn, ).

Valuable progress has been made to synthesize the evidence base for the effectiveness of digital interventions for anxiety disorders. Disorder specific meta-analyses are available for GAD (Richards, Richardson, Timulak, & McElvaney, ), SAD (Kampmann, Emmelkamp, & Morina, ) and PD/A (Stech, Lim, Upton, & Newby, ). Moreover, prior meta-analyses have synthesized the evidence base encompassing all anxiety disorders to provide overarching estimates of treatment effectiveness in addition to disorder-specific estimates (Andrews et al.,,; Cuijpers et al.,; Păsărelu, Andersson, Bergman Nordgren, & Dobrean, ). However, the dramatic increase in the volume and diversity of research since the last all-encompassing review that included studies published until September 2016 (Andrews et al., ) makes a current state assessment of the field essential. Studies published since September 2016 represent nearly the majority of randomized controlled trials (RCT) on the efficacy of digital interventions for anxiety disorders. Recent trials have included diverse intervention formats, such as unguided interventions (Ciuca, Berger, Crişan, & Miclea, ), group interventions (Schulz et al., ) and mobile-based interventions (Stolz et al., ). Finally, the Andrews et al. meta-analysis did not include studies with mixed anxiety disorder samples (Bell, Colhoun, Carter, & Frampton, ) or studies on interventions other than cognitive behavioral therapy, such as internet-delivered psychodynamic therapy (Andersson, Carlbring, & Furmark, ) or acceptance and commitment-based therapy (Ivanova et al., ).

The present systematic review and meta-analysis aimed to examine the effectiveness of digital interventions across all anxiety disorders and specific to each anxiety disorder in comparison to inactive control conditions. More precise and powerful estimates of effectiveness overall and specific to each disorder were expected to add precision to the evidence base, with an enlarged and more representative sample of studies, and provide further justification for the practical application of digital interventions.

Study sources, search and selection

A comprehensive anxiety literature database was used as the information source of the present meta-analysis and is registered at the open science framework (Papola, Barbui, Cuijpers, Karyotaki, & Sijbrandij, ). Development of the database began with a systematic search on 25 April 2019 and a subsequent update on 13 February 2020 by two independent researchers. A systematic search was conducted using a full range of terms related to the applicable interventions, disorders and outcomes. The full search string for the PubMed database search is provided in Other Supplementary Material, eAppendix 1. Published studies were searched from inception to 1 January 2020, using the following electronic databases: PubMed (MEDLINE), EMBASE, PsycINFO, and The Cochrane Central Register of Controlled Trials (CENTRAL). Reference tracking was also conducted on recent systematic reviews and meta-analyses of digital interventions across anxiety disorders and specific to certain disorder (Andrews et al.,,; Arnberg et al.,; Cuijpers et al.,; Kampmann et al.,; Newby, Twomey, Yuan Li, & Andrews,; Păsărelu et al.,; Richards et al.,; Stech et al.,; Stefanopoulou et al., )

Studies were included based on the following criteria: (1) participants age 18 or older, (2) clinician validated diagnosis of any primary anxiety disorder as defined by the diagnostic and statistical manual version 5 (American Psychiatric, ) including GAD, PD/A, SAD or SP, (3) use of a guided or unguided digital intervention conducted without any physical presence of a therapist or a requirement to participate outside of a personal setting of choice to treat anxiety disorder symptoms, (4) use of an inactive control comparison group such as wait-list control (WLC) or care-as-usual (CAU), (5) use of a customary RCT design and (6) publication in peer-reviewed journals, including advanced online publication. Control comparison groups were categorized as WLC if participants were put on a waiting list to receive the intervention after the intervention was received by the active intervention group, or CAU if participants received or had access to routine care and did not wait to receive the active intervention. In addition, studies that compared digital interventions to face-to-face psychotherapy were selected and extracted for supplemental analysis.

Types of outcome measures

The primary efficacy outcome was anxiety symptoms at the study endpoint, measured as effect size. One outcome measure was selected for each study, based on a pre-determined hierarchy of outcome instruments according to (1) most used and (2) most valid instrument. The hierarchy is available in Other Supplementary Material, eAppendix 2. If none of the outcomes in the pre-determined hierarchy were used in a given study, the primary outcome measure as defined by the study was used. All outcomes will refer to acute-phase treatment (study endpoint), which normally last two to six months.

Data extraction

Post-treatment outcome measure means, standard deviations and the number of participants randomized and eligible for analysis per condition were extracted from each study. In addition, descriptive data were extracted and coded as follows: (1) guided or unguided treatment, (2) mean number of treatment sessions completed, (3) treatment adherence as defined by the percentage of participants who completed all treatment sessions, (4) recruitment setting (community or clinical), and (5) continental location of study. Guided treatment was defined by the provision of support related to treatment content by a trained professional or para-professional, whereas unguided treatment did not include any treatment content-related guidance.

To assess study quality and risk of bias, data were extracted according to the Risk of Bias 2 (RoB 2) tool (Sterne et al., ). This risk of bias assessment entails the review and grading of five quality domains including (1) the randomization process, (2) deviations from the intended interventions, (3) missing outcome data, (4) measurement of the outcome and (5) selection of the reported outcome, resulting in a summary assessment of low, some concern or high risk of bias.

Data extraction decisions were assessed for quality and validity in comparison to a parallel independent study. Interrater reliability was calculated and reported using the interclass correlation coefficient (ICC) and Cohen's Kappa (Banerjee, Capozzoli, McSweeney, & Sinha,; Barnhart, Haber, & Lin,; Cohen, ). Agreement reliability was interpreted using ICC estimates as follows: poor if less than 0.5, moderate if between 0.5 and 0.75, good if between 0.75 and 0.9, and excellent if higher than 0.9 (Koo & Li, ). Agreement reliability was interpreted using Cohen's Kappa estimates as follows: none to slight if between 0.01 and 0.2, fair if between 0.21 and 0.4, moderate if between 0.41 and 0.6, substantial if between 0.61 and 0.8, and almost perfect if between 0.81 and 1.0 (McHugh, ).

Statistical analysis

Statistical analyses were completed using Comprehensive Meta-Analysis version 3 (CMA, ), following PRISMA guidelines (Moher, Liberati, Tetzlaff, & Altman, ) and standard guidance for meta-analysis (Cuijpers, ). Effect size indicates the scale score difference between treatment and control groups at post-treatment, and is calculated by subtracting the mean score of the treatment group from the mean score of the control group, divided by pooled standard deviation. The effect size was estimated as Hedges' g to correct for small sample size bias (Hedges & Olkin, ). To ease interpretation of effect size, corresponding numbers needed to treat (NNT; Gloster et al., ) figures were calculated according to the method provided by Kraemer and Kupfer (Kraemer & Kupfer, ), representing the number of persons requiring treatment in order to achieve one additional successful treatment outcome.

To account for multiple treatment arms within a study, a decision hierarchy was followed according to the guidance of Cochrane handbook for systematic reviews, hereafter referred to as Cochrane (Higgins, Green, & Cochrane, ). As recommended by Cochrane, to avoid multiple correlated comparisons and potential unit of analysis error, treatment groups were combined when possible (Higgins et al., ). RevMan software was used to combine treatment arms (RevMan, ) according to the Cochrane guidelines (Higgins et al., ). An exception to this method was used when treatment arms within a study compared guided and unguided support conditions. In these cases, treatment arms were kept separate in order to retain these comparisons for treatment support subgroup analysis, and the total control group was equally split across the guided and unguided treatment condition arms. According to Cochrane, this method is acceptable and creates sufficient independence between treatment arms to mitigate the unit of analysis error (Higgins et al., ).

When trials had missing standard deviation data, standard errors or confidence intervals (CI) were used to calculate standard deviations. When none of these data was available, standard deviations were imputed according to the method outlined by Furukawa et al. (Furukawa, Barbui, Cipriani, Brambilla, & Watanabe, ). In the present study, this method was only considered if (1) no standard deviation, standard error or CI data were available and (2) 10 or more comparable studies, using the same outcome instrument, could be used to generate a pooled standard deviation for imputation.

All meta-analyses were conducted in CMA using a random-effects pooling model. Heterogeneity was assessed by the I2 statistic and corresponding 95% CI (Ioannidis, Patsopoulos, & Evangelou, ), using the non-central chi-squared heterogi module from Stata (Orsini, Bottai, Higgins, & Buchan, ). I2 values of 25, 50, and 75% typically indicate low, medium, and high heterogeneity, respectively. Publication bias was assessed using Egger's test for funnel plot asymmetry and a funnel plot adjusted for publication bias according to the Duval and Tweedie trim-and-fill procedure (Duval & Tweedie,; Egger, Smith, Schneider, & Minder, ). In addition, an overall analysis of effect size was conducted after the exclusion of outlier studies. Outlier studies were those with a 95% CI for effect size which did not overlap with the 95% CI for the overall pooled effect size.

Subgroup analyses

A series of subgroup analyses were conducted to explore potential explanations of heterogeneity based on differences in relative effect sizes between subgroups and the relative relationship of each subgroup variable to the overall pooled effect size. The series included subgroup comparisons for (1) primary diagnosis of GAD, mixed anxiety samples, PD/A or SAD, (2) low, some concern and high risk of bias, (3) guided v. unguided interventions, (4) community v. clinical recruitment setting and (5) continental location of study, all as categorical variables, as well as (6) mean number of treatment sessions completed and (7) treatment adherence, as continuous variables. All subgroup analyses for categorical variables were conducted in CMA using the mixed-effects model, which pools studies within subgroups based on the random-effects model while testing significant differences between subgroups based on the fixed-effects model. All subgroup analyses for continuous variables were conducted using meta-regression.

Selection, inclusion and extraction

In total, 15 030 abstracts were identified. After the removal of 5606 duplicates, 9424 records remained for title and abstract or full-text screening. After screening, 1307 records were retained for inclusion in the database. All 1307 studies in the comprehensive anxiety database (Papola et al., ) were screened for inclusion. Reference tracking resulted in 14 additional studies for screening (Andrews et al.,,; Arnberg et al.,; Cuijpers et al.,; Kampmann et al.,; Newby et al.,; Păsărelu et al.,; Richards et al.,; Stech et al.,; Stefanopoulou et al., ). Following title and abstract review, 1176 studies were excluded for specific reasons, leaving 146 studies for full-text review. Following full-text review, 99 studies were excluded for specific reasons, leaving 47 studies for the present meta-analysis. Among the 47 included studies, seven studies had multiple trial arms which were merged for analysis (Berger, Boettcher, & Caspar,; Christensen et al.,; Oromendia, Orrego, Bonillo, & Molinuevo,; Richards, Klein, & Austin,; Robinson et al.,; Schulz et al.,; Stolz et al., ), according to the recommended method of Cochrane (Higgins et al., ). In four studies, the control group was equally split and shared between guided and unguided intervention arms (Ciuca et al.,; Ivanova et al.,; Paxling et al.,; Titov, Andrews, Choi, Schwencke, & Mahoney, ). Standard deviations were imputed for one study (Titov et al., ). The 47 studies resulted in 4958 participants (2808 treatment group and 2150 control group) and 53 comparisons quantified in analysis.

The selection process and exclusion rationales are provided in a PRISMA flowchart in Fig. 1 (Moher et al., ). The search also identified nine studies that compared the digital intervention to face-to-face psychotherapy, for supplemental analysis. References for all studies included are provided in Other Supplementary Material, eAppendix 3.

Interrater reliability of data extraction decisions ranged from good to perfect. The Cohen's Kappa for overall risk of bias judgements was perfect at 1.0, while ICC assessing agreement on each individual domain judgement was good to excellent at 0.88 [95% CI: 0.81–0.92]. Similarly, ICC assessing agreement on outcome and characteristics data was good at 0.81 [95% CI: 0.70–0.88].

Characteristics of included studies

Characteristics of the 53 comparisons analyzed are summarized in Table 1. The most represented primary diagnosis was SAD (20 comparisons; 1960 participants), followed by PD/A (15 comparisons; 837 participants), GAD (nine comparisons; 1203 participants) and mixed anxiety samples (nine comparisons, 958 participants). The control comparisons in all studies were categorized as WLC. Additional detail about the WLC condition was provided in 34% (n = 16) of studies, in which the WLC was described as having access to specific support provisions such as routine care (n = 5; 11%), attention control (n = 4; 9%) and online discussion forum (n = 7; 15%). Cognitive behavioral therapy was the most common digital intervention used in the 53 comparisons (n = 48; 90%), followed by acceptance and commitment therapy (n = 3; 6%), psychodynamic therapy (n = 1; 2%) and mindfulness-based therapy (n = 1; 2%). A guided intervention format was used in 42 (79%) comparisons as compared to an unguided format in 11 (21%). Recruitment was conducted in a community setting for 49 (92%) comparisons compared to 4 (8%) in a clinical setting. Regarding the continental location of study, 70% of comparisons were conducted in Europe (n = 37; Austria, Ireland, Denmark, Germany, Netherlands, Romania, Spain, Sweden, Switzerland), followed by 26% in Oceania (n = 14; Australia, New Zealand), 2% in North America (n = 1; Canada) and 2% across mixed continents (n = 1; Australia and Scotland). Finally, the mean number of treatment sessions completed was 5.8 across 43 comparisons with available data, while treatment adherence was 55.9% across 41 comparisons with available data.

Risk of bias

The risk of bias was judged to be ‘low’ in 6 (11%) study comparisons, ‘some concern’ in 34 (64%) study comparisons and ‘high’ in 13 (25%) study comparisons. The primary areas of concern were found within domain three and four, related to missing outcome data and measurement of outcomes respectively, where 5 (11%) of the studies were judged to be high risk in each domain.

Meta-analysis

The results for the meta-analysis of digital interventions v. inactive controls are summarized in Table 2 and a forest plot of effect sizes in Fig. 2. The overall effect size was g = 0.80 [95% CI: 0.68–0.93], corresponding with an NNT of 2.3. Heterogeneity was high [I2 = 75, 95% CI: 68–80]. The effect size for GAD comparisons alone (n = 9) was moderate at g = 0.62 [95% CI: 0.31–0.93] with high heterogeneity [I2 = 81, 95% CI: 61–88]. The effect size for mixed anxiety disorder comparisons alone (n = 9) was moderate at g = 0.68 [95% CI: 0.39–0.97] with high heterogeneity [I2 = 77, 95% CI: 51–87]. Regarding PD/A comparisons alone (n = 15), the effect size was large at g = 1.08 [95% CI: 0.77–1.39] with high heterogeneity [I2 = 76, 95% CI: 57–84]. Similarly, the effect size for SAD comparisons alone (n = 20) was large at g = 0.76 [95% CI: 0.62–0.91] with moderate heterogeneity [I2 = 53, 95% CI: 11–71].

An overall analysis of effect size was also conducted after removing nine outlier studies, resulting in a slightly higher overall effect size g = 0.82 [95% CI: 0.73–0.92] with considerably lower heterogeneity [I2 = 41, 95% CI: 9–58]. Egger's test for asymmetry was significant [Intercept: 3.34; 95% CI: 1.94–4.74; p < 0.000]. However, there was no indication of publication bias based on Duval and Tweedie's trim and fill procedure (2000), as no studies were recommended for imputation and no difference was found between the observed effect size and the effect size after adjustment for publication bias (g = 0.80). Publication bias is illustrated by funnel plot in Other Supplementary Material, eFigure 1.

In a supplemental analysis, nine comparisons (683 participants) were made between digital interventions v. face-to-face treatment groups. No difference was found between treatment conditions [g = 0.14 favoring digital interventions; 95% CI: −0.01 to 0.30]. Heterogeneity was low [I2 = 3, 95% CI: 0–56]. Characteristics of the nine comparisons analyzed are summarized in Other Supplementary Material, eTable 1.

Subgroup analyses

No significant differences between subgroups were found, including (1) risk of bias; (p = 0.819), (2) guided v. unguided treatment support (p = 0.177), (3) community v. clinical recruitment setting (p = 0.409), (4) continental location of study (p = 0.101), (5) mean number of treatment sessions completed as a continuous subgroup (p = 0.079) and (6) treatment adherence as a continuous subgroup (p = 0.215). An auxiliary subgroup analysis revealed no difference between WLC control comparison categories (p = 0.131). Results for subgroup analyses are provided in Table 2 and Other Supplementary Material, eTable 2.

Discussion

The present meta-analysis aimed to examine the effectiveness of digital interventions v. inactive controls across anxiety disorders and specific to each disorder. In result, a large, significant pooled effect size across all anxiety disorders (g = 0.80) was found. The results are in line with prior research and can be considered more precisely representative of anxiety disorder treatment effectiveness (Andrews et al.,,; Cuijpers et al.,; Păsărelu et al., ). First, Andrews et al. updated their prior meta-analysis of digital interventions (Andrews et al., ) while including major depression studies for 50% of the comparisons. Next, the Cuijpers et al. meta-analysis included post-traumatic stress disorder and obsessive−compulsive disorder studies, as well as studies on specific phobia treatment through interventions conducted in an office setting with a therapist or para-professional contact. Last, the Păsărelu et al. meta-analysis was limited to 14 comparisons (1513 participants) of transdiagnostic or tailored digital interventions. Therefore, the present meta-analysis with 53 comparisons and 4958 participants is considerably larger and specific to anxiety disorders as currently defined by the DSM-5 (American Psychiatric, ).

Moderate to large, significant effect sizes were also found specific to GAD (g = 0.62), mixed anxiety disorder samples (g = 0.68), SAD (g = 0.76) and PD/A (g = 1.08). The disorder-specific and mixed sample-specific findings align with prior research while adding value by updating the field (Andrews et al.,,; Arnberg et al.,; Cuijpers et al.,; Kampmann et al.,; Păsărelu et al.,; Richards et al.,; Stech et al., ) The estimate for SAD can be considered more precise and powerful based on 20 comparisons v. the 11 comparisons in Andrews et al. and 16 comparisons in Kampmann et al..

Differences in effect sizes across studies were not significantly related to the risk of bias, treatment support, recruitment setting, continental location of study, mean treatment sessions completed or treatment adherence. The results align with prior research on recruitment method and continental location (Păsărelu et al., ), while contrasting with Andrews et al. on the risk of bias. The difference could be explained by a mix of anxiety and depression trials in the Andrews et al. meta-analysis compared to the present meta-analysis on anxiety trials. This is the first time that trials comparing guided and unguided intervention arms to inactive control conditions have been meta-analyzed and reported as comparative subgroups. The results are consistent with several studies on the relative efficacy of guided and unguided interventions for anxiety disorders covering GAD, SAD and PD/A, as well as a prior Cochrane systematic review, all of which found no evidence of a difference between guided and unguided interventions (Berger et al.,; Ciuca et al.,; Dear et al.,,; Fogliati et al.,; Gershkovich, Herbert, Forman, Schumacher, & Fischer,; Ivanova et al.,; Olthuis, Watt, Bailey, Hayden, & Stewart,; Titov, Andrews, Choi, Schwencke, & Johnston, ). The non-significant finding is contrary to a prior systematic review, however, the results reported were based on a small mix of depression and anxiety studies rather than the subgroup of anxiety studies alone (Baumeister, Reichler, Munzinger, & Lin, ). Based on the large scale of anxiety-specific studies in the present meta-analysis, all subgroup findings and notably the guided v. unguided intervention findings can be considered robust and distinct.

No difference in effect was found between digital interventions and face-to-face interventions in supplemental analysis, strengthening prior research that also indicated digital interventions to be equally effective as face-to-face interventions in treating anxiety disorders (Andrews et al.,; Carlbring, Andersson, Cuijpers, Riper, & Hedman-Lagerlöf,; Cuijpers et al., ). Further research is required to advance these preliminary findings and firmly establish equivalence between the two treatment formats for each anxiety disorder in particular. Nonetheless, the results position digital interventions as a promising alternative to face-to-face treatment and underscore the potential to tailor care delivery models that suit the needs of patients and providers (Schuster, Topooco, Keller, Radvogin, & Laireiter, ).

Applying digital interventions in practice could address barriers to treatment access and affordability. Digital interventions could be offered as the first stage of care as an alternative to waiting periods or by treatment plan design, consistent with a stepped care model (Nordgreen et al.,; Stiles et al., ). This could benefit patients both in terms of the timeliness and the flexibility of care access, particularly advantageous for patients reluctant to seek treatment due to stigmatization or for patients in countries that lack sufficient care infrastructure. Furthermore, finding no evidence of a difference in effectiveness between guided and unguided treatments implies that digital interventions could be effectively facilitated by professionals and non-professionals alike or even self-administered. This could increase the volume of care resources, and if organized systematically such as in stepped care, enable therapists to more efficiently allocate valuable time and resources in such high demand. A study comparing a stepped care model to face-to-face therapy found that most patients who reached a response threshold did so before reaching the later stages of treatment requiring higher demand on therapist time and accessibility (Nordgreen et al., ). To highlight the promising cost−benefit, research suggests that the adoption of stepped care models alone could yield incremental cost-effective ratios over €1800 per disability-adjusted life year in comparison to CAU (Stiles et al., ). Finally, digital interventions could also be offered in the form of massive open online interventions (Ricardo et al., ), providing open-access, self-managed care as a valuable treatment strategy where healthcare systems lack the infrastructure to provide mental health services at scale, a common barrier in low- and middle-income countries (Cuijpers, Karyotaki, Reijnders, Purgato, & Barbui, ). Improving the balance and organization of treatment delivery could result in a considerable reduction in wait time, cost and overall disease burden (Chisholm et al.,; Cuijpers, Kleiboer, Karyotaki, & Riper, ).

Strengths and limitations

Notable strengths of the present meta-analysis include the magnitude of quantified comparisons giving the results power and precision, the systematic methodology used to search and select studies specific to anxiety disorders and the absence of observed publication bias.

Nonetheless, certain limitations must be acknowledged to cautiously interpret the results. Multiple factors may limit the generalizability of findings. First, the WLC, which is known to potentially inflate effects of treatment conditions (Furukawa et al.,; Guidi et al., ), was used for 100% of control condition comparisons. Limited information is monitored and provided to describe the WLC condition, such as the extent to which routine care was used during the waitlist period. Moreover, other potential influencing factors such as treatment history and medication use should be examined, although the studies reported no differences among these factors when analyzing treatment and control group demographics. Second, only 8% of studies recruited participants from the clinical setting. Third, 96% of trials were conducted in continental Europe or Oceania. Fourth, the present meta-analysis was limited to adult samples. Fifth, the findings are based only on outcome data at post-treatment. Finally, assessing the validity of data extraction decisions in comparison to a parallel independent study may not yield a complete resolution of discrepancies, although high interrater reliability estimates found provide strong evidence of data quality and validity. These limitations considered, the present meta-analysis adds substantial strength to the evidence base for digital interventions for anxiety disorders.

Conclusion

The findings of the present study inform several priorities for future research. First, future research is encouraged to prioritize study designs that improve the generalizability of findings, such as trials with diverse control comparison groups and sufficient monitoring of control condition provisions, pragmatic effectiveness trials, various care populations and geographic locations of study. Also, a critical future step could be to examine which digital intervention formats and components most significantly influence treatment outcomes, such as the type and frequency of support offered during guided or unguided treatment. This advancement is considered essential for shaping policy and clinical practice guidelines for psychological interventions (Cuijpers, Cristea, Karyotaki, Reijnders, & Hollon,; England, Butler, & Gonzalez, ). Network meta-analysis (NMA) and component NMA are promising methods that have already been used to link probable differences in effectiveness to treatment components and component combinations for the treatment of panic disorder (Pompoli et al., ). Finally, extending the present meta-analysis across all age groups could provide insight regarding the psychopathology of anxiety disorders across the lifespan relative to the effectiveness of treatment per age group.

In conclusion, the powerful and precise effectiveness estimates found in the present meta-analysis provide a consequential part of the evidence base that could further justify the adoption of digital interventions practice. Enabling the adoption of digital interventions in practice, through accurate and rigorous effectiveness findings, could shape clinical practice guidelines and make effective treatment more accessible, affordable and effective.

References 101

  1. 1.

    Allen, A. R., Newby, J. M., Mackenzie, A., Smith, J., Boulton, M., Loughnan, S. A., & Andrews, G. (2016 ). Internet cognitive-behavioural treatment for panic disorder: Randomised controlled trial and evidence of effectiveness in primary care. BJPsych Open, 2(2), 154–162. doi:.

    Not in our library10.1192/bjpo.bp.115.001826

  2. 2.

    American Psychiatric, A. (2013 ). Diagnostic and statistical manual of mental disorders: DSM-5 (5th ed.). Arlington, VA, Washington, D.C.: American Psychiatric Association.

    Not in our library

  3. 3.

    Andersson, G., Carlbring, P., & Furmark, T. (2012 ). Therapist experience and knowledge acquisition in internet-delivered CBT for social anxiety disorder: A randomized controlled trial. PLoS ONE, 7(5), e37411. doi:.

    Not in our library10.1371/journal.pone.0037411

  4. 4.

    Andersson, G., Carlbring, P., Holmstrom, A., Sparthan, E., Furmark, T., Nilsson-Ihrfelt, E., … Ekselius, L. (2006 ). Internet-based self-help with therapist feedback and in vivo group exposure for social phobia: A randomized controlled trial. Journal of Consulting and Clinical Psychology, 74(4), 677–686. doi:.

    Not in our library10.1037/0022-006x.74.4.677

  5. 5.

    Andrews, G., Basu, A., Cuijpers, P., Craske, M. G., McEvoy, P., English, C. L., & Newby, J. M. (2018 ). Computer therapy for the anxiety and depression disorders is effective, acceptable and practical health care: An updated meta-analysis. Journal of Anxiety Disorders, 55, 70–78. doi:.

    Not in our library10.1016/j.janxdis.2018.01.001

  6. 6.
  7. 7.
  8. 8.

    Bandelow, B., & Michaelis, S. (2015 ). Epidemiology of anxiety disorders in the 21st century. Dialogues in Clinical Neuroscience, 17(3), 327–335.

    Not in our library10.31887/dcns.2015.17.3/bbandelow

  9. 9.

    Banerjee, M., Capozzoli, M., McSweeney, L., & Sinha, D. (1999 ). Beyond kappa: A review of interrater agreement measures. The Canadian Journal of Statistics / La Revue Canadienne de Statistique, 27(1), 3–23.

    Not in our library

  10. 10.

    Barnhart, H. X., Haber, M. J., & Lin, L. I. (2007 ). An overview on assessing agreement with continuous measurements. Journal of Biopharmaceutical Statistics, 17(4), 529–569.

    Not in our library10.1080/10543400701376480

  11. 11.

    Baumeister, H., Reichler, L., Munzinger, M., & Lin, J. (2014 ). The impact of guidance on internet-based mental health interventions — A systematic review. Internet Interventions —The Application of Information Technology in Mental and Behavioural, 1(4), 205–215. doi:.

    Not in our library10.1016/j.invent.2014.08.003

  12. 12.

    Bell, C. J., Colhoun, H. C., Carter, F. A., & Frampton, C. M. (2012 ). Effectiveness of computerised cognitive behaviour therapy for anxiety disorders in secondary care. Australian and New Zealand Journal of Psychiatry, 46(7), 630–640. doi:.

    Not in our library10.1177/0004867412437345

  13. 13.

    Berger, T., Boettcher, J., & Caspar, F. (2014 ). Internet-based guided self-help for several anxiety disorders: A randomized controlled trial comparing a tailored with a standardized disorder-specific approach. Psychotherapy (Chic), 51(2), 207–219. doi:.

    Not in our library10.1037/a0032527

  14. 14.

    Berger, T., Caspar, F., Richardson, R., Kneubuhler, B., Sutter, D., & Andersson, G. (2011 ). Internet-based treatment of social phobia: A randomized controlled trial comparing unguided with two types of guided self-help. Behaviour Research and Therapy, 49(3), 158–169. doi:.

    Not in our library10.1016/j.brat.2010.12.007

  15. 15.

    Berger, T., Hohl, E., & Caspar, F. (2009 ). Internet-based treatment for social phobia: a randomized controlled trial. Journal of Clinical Psychology, 65(10), 1021–1035. doi:.

    Not in our library10.1002/jclp.20603

  16. 16.

    Berger, T., Urech, A., Krieger, T., Stolz, T., Schulz, A., Vincent, A., … Meyer, B. (2017 ). Effects of a transdiagnostic unguided Internet intervention ('velibra') for anxiety disorders in primary care: Results of a randomized controlled trial. Psychological Medicine, 47(1), 67–80. doi:.

    Not in our library10.1017/s0033291716002270

  17. 17.

    Boettcher, J., Astrom, V., Pahlsson, D., Schenstrom, O., Andersson, G., & Carlbring, P. (2014 ). Internet-based mindfulness treatment for anxiety disorders: a randomized controlled trial. Behavior Therapy, 45(2), 241–253. doi:.

    Not in our library10.1016/j.beth.2013.11.003

  18. 18.

    Botella, C., Gallego, M. J., Garcia-Palacios, A., Guillen, V., Banos, R. M., Quero, S., … Alcaniz, M. (2010 ). An Internet-based self-help treatment for fear of public speaking: A controlled trial. Cyberpsychology, Behavior, and Social Networking, 13(4), 407–421. doi:.

    Not in our library10.1089/cyber.2009.0224

  19. 19.

    Carlbring, P., Andersson, G., Cuijpers, P., Riper, H., & Hedman-Lagerlöf, E. (2018 ). Internet-based vs. Face-to-face cognitive behavior therapy for psychiatric and somatic disorders: An updated systematic review and meta-analysis. Cognitive Behaviour Therapy, 47(1), 1–18. doi:.

    Not in our library10.1080/16506073.2017.1401115

  20. 20.

    Carlbring, P., Bohman, S, Brunt, S, Buhrman, M., Westling, B. E., Ekselius, L., & Andersson, G. (2006 ). Remote treatment of panic disorder: A randomized trial of internet-based cognitive behavior therapy supplemented with telephone calls. American Journal of Psychiatry, 163(12), 2119–2125. doi:.

    Not in our library10.1176/ajp.2006.163.12.2119

  21. 21.

    Carlbring, P., Gunnarsdottir, M., Hedensjo, L., Andersson, G., Ekselius, L., Furmark, T. (2007 ). Treatment of social phobia: randomised trial of internet-delivered cognitive-behavioural therapy with telephone support. The British Journal of Psychiatry, 190(2), 123–128. doi:.

    Not in our library10.1192/bjp.bp.105.020107

  22. 22.

    Carlbring, P., Maurin, L., Törngren, C., Linna, E., Eriksson, T., Sparthan, E., … Andersson, G. (2011 ). Individually-tailored, Internet-based treatment for anxiety disorders: A randomized controlled trial. Behaviour Research and Therapy, 49(1), 18–24. doi:.

    Not in our library10.1016/j.brat.2010.10.002

  23. 23.

    Carlbring, P., Westling, B. E., Ljungstrand, P., Ekselius, L., & Andersson, G. (2001 ). Treatment of panic disorder via the Internet: A randomized trial of a self-help program. Behavior Therapy, 32(4), 751–764. doi:.

    Not in our library10.1016/s0005-7894(01)80019-8

  24. 24.

    Chisholm, D., Sweeny, K., Sheehan, P., Rasmussen, B., Smit, F., Cuijpers, P., & Saxena, S. (2016 ). Scaling-up treatment of depression and anxiety: A global return on investment analysis. The Lancet Psychiatry, 3(5), 415–424. doi:.

    Not in our library10.1016/s2215-0366(16)30024-4

  25. 25.
  26. 26.

    Ciuca, A. M., Berger, T., Crişan, L. G., & Miclea, M. (2018 ). Internet-based treatment for panic disorder: A three-arm randomized controlled trial comparing guided (via real-time video sessions) with unguided self-help treatment and a waitlist control. PAXPD study results. Journal of Anxiety Disorders, 56, 43–55. doi:.

    Not in our library10.1016/j.janxdis.2018.03.009

  27. 27.

    CMA (2016 ). Comprehensive Meta-Analysis Software; [Internet; cited 30 July, 2020]. Available from: https://Meta-analysis.com

    Not in our library

  28. 28.

    Cohen, J. (1968 ). Weighted kappa: Nominal scale agreement with provision for scaled disagreement or partial credit. Psychological Bulletin, 70(4), 213–220.

    Not in our library10.1037/h0026256

  29. 29.

    Cuijpers, P. (2016 ). Meta-analyses in mental health research: A practical guide.

    Not in our library

  30. 30.

    Cuijpers, P., Cristea, I. A., Karyotaki, E., Reijnders, M., & Hollon, S. D. (2019 ). Component studies of psychological treatments of adult depression: A systematic review and meta-analysis. Psychotherapy Research, 29(1), 15–29. doi:.

    Not in our library10.1080/10503307.2017.1395922

  31. 31.

    Cuijpers, P., Karyotaki, E., Reijnders, M., Purgato, M., & Barbui, C. (2018 ). Psychotherapies for depression in low- and middle-income countries: A meta-analysis. World Psychiatry, 17(1), 90–101. doi:.

    Not in our library10.1002/wps.20493

  32. 32.

    Cuijpers, P., Kleiboer, A., Karyotaki, E., & Riper, H. (2017 ). Internet and mobile interventions for depression: Opportunities and challenges. Depression and Anxiety, 34(7), 596–602. doi:.

    Not in our library10.1002/da.22641

  33. 33.

    Cuijpers, P., Marks, I., van Straten, A., Cavanagh, K., Gega, L., & Andersson, G. (2009 ). Computer-aided psychotherapy for anxiety disorders: A meta-analytic review. Cognitive Behaviour Therapy, 38(2), 66–82.

    Not in our library10.1080/16506070802694776

  34. 34.

    Dahlin, M., Andersson, G., Magnusson, K., Johansson, T., Sjogren, J., Hakansson, A., … Carlbring, P. (2016 ). Internet-delivered acceptance-based behaviour therapy for generalized anxiety disorder: A randomized controlled trial. Behaviour Research and Therapy, 77, 86–95. doi:.

    Not in our library10.1016/j.brat.2015.12.007

  35. 35.

    Dear, B. F., Staples, L. G., Terides, M. D., Fogliati, V. J., Sheehan, J., Johnston, L., … Titov, N. (2016 ). Transdiagnostic versus disorder-specific and clinician-guided versus self-guided internet-delivered treatment for social anxiety disorder and comorbid disorders: A randomized controlled trial. Journal of Anxiety Disorders, 42, 30–44. doi:.

    Not in our library10.1016/j.janxdis.2016.05.004

  36. 36.

    Dear, B. F., Staples, L. G., Terides, M. D., Karin, E., Zou, J., Johnston, L., … Titov, N. (2015 ). Transdiagnostic versus disorder-specific and clinician-guided versus self-guided internet-delivered treatment for generalized anxiety disorder and comorbid disorders: A randomized controlled trial. Journal of Anxiety Disorders, 36, 63–77. doi:.

    Not in our library10.1016/j.janxdis.2015.09.003

  37. 37.

    Duval, S., & Tweedie, R. (2000 ). Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56(2), 455–463.

    Not in our library10.1111/j.0006-341x.2000.00455.x

  38. 38.

    Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997 ). Bias in meta-analysis detected by a simple, graphical test. BMJ: British Medical Journal, 315(7109), 629–634.

    Not in our library10.1136/bmj.315.7109.629

  39. 39.

    England, M. J., Butler, A. S., & Gonzalez, M. L. (2015 ). Psychosocial interventions for mental and substance use disorders: A framework for establishing evidence-based standards. In IOM (Ed.), C. o. D. E.-B. S. f. P. I. f. M. Institute of Medicine, Disorders (pp. 57–69). Washington, D.C: The National Academies Press.

    Not in our library

  40. 40.

    Feijt, M. A., de Kort, Y. A. W., Bongers, I. M. B., & Ijsselsteijn, W. A. (2018 ). Perceived drivers and barriers to the adoption of eMental health by psychologists: The construction of the levels of adoption of eMental health model. Journal of Medical Internet Research (JMIR), 20(4), e153, 113.

    Not in our library10.2196/jmir.9485

All 101 references

Reads

Read by people on this page

None yet.

Checked or read by AI through naulon

None yet.

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.

Are you an author?

Is this your paper?

Claim it to add your note and be paid when agents cite it. Free.