No retraction, correction or concern found when last checked on Oct 24, 2026.
Effectiveness of an Internet- and App-Based Intervention for College Students With Elevated Stress: Randomized Controlled Trial
Mathias Harrer, Sophia Helen Adam, Rebecca Jessica Fleischmann and 8 more
Journal of Medical Internet Research · 2018 · Randomised trial
Abstract
Background. Mental health problems are highly prevalent among college students. Most students with poor mental health, however, do not receive professional help. Internet-based self-help formats may increase the utilization of treatment.
Objective. The aim of this randomized controlled trial was to evaluate the efficacy of an internet-based, app-supported stress management intervention for college students.
Methods. College students (n=150) with elevated levels of stress (Perceived Stress Scale 4-item version, PSS-4 ≥8) were randomly assigned to either an internet- and mobile-based stress intervention group with feedback on demand or a waitlist control group. Self-report data were assessed at baseline, posttreatment (7 weeks), and 3-month follow-up. The primary outcome was perceived stress posttreatment (PSS-4). Secondary outcomes included mental health outcomes, modifiable risk and protective factors, and college-related outcomes. Subgroup analyses were conducted in students with clinically relevant symptoms of depression (Center for Epidemiological Studies’ Depression Scale >17).
Results. A total of 106 participants (76.8%) indicated that they were first-time help-seekers, and 77.3% (intervention group: 58/75; waitlist control group: 58/75) showed clinically relevant depressive symptoms at baseline. Findings indicated significant effects of the intervention compared with the waitlist control group for stress (d=0.69; 95% CI 0.36-1.02), anxiety (d=0.76; 95% CI 0.43-1.09), depression (d=0.63; 95% CI 0.30-0.96), college-related productivity (d=0.33; 95% CI 0.01-0.65), academic work impairment (d=0.34; 95% CI 0.01-0.66), and other outcomes after 7 weeks (posttreatment). Response rates for stress symptoms were significantly higher for the intervention group (69%, 52/75) compared with the waitlist control group (35%, 26/75, P<.001; number needed to treat=2.89, 95% CI 2.01-5.08) at posttest (7 weeks). Effects were sustained at 3-month follow-up, and similar findings emerged in students with symptoms of depression.
Conclusions. Internet- and mobile-based interventions could be an effective and cost-effective approach to reduce consequences of college-related stress and might potentially attract students with clinically relevant depression who would not otherwise seek help.
Trial Registration. German Clinical Trial Register DRKS00010212; http://www.drks.de/drks_web/navigate.do? navigationId=trial.HTML&TRIAL_ID=DRKS00010212 (Archived by WebCite at http://www.webcitation.org/6w55Ewhjd)
Full text
From PubMed Central, U.S. National Library of Medicine, as current on Oct 24, 2026. Paragraph numbers are ours, so an answer can point at one.
Background
Between 25% and 50% of college students meet the criteria for at least one mental health disorder in a given year. Data suggest that mental disorders account for about half the disease burden of young adults in developed countries and are associated with a range of negative consequences, including lowered academic performance and college attrition.
Despite the availability of effective treatment, only 1 in 5 students with mental disorders receives minimally adequate treatment. Reasons for this treatment gap include attitudinal barriers such as stigma and a preference for self-help.
Internet- and mobile-based interventions might help to increase the utilization of psychological interventions, as they can be easily accessed, allow for high scalability, and can be provided at a low cost. Internet-based interventions may also be suitable for college student populations, with research indicating that preference for help-seeking through the internet is higher among younger and well-educated individuals. There is meta-analytic evidence suggesting the efficacy of internet interventions for a range of conditions and populations, including college students, with effect sizes of technology-delivered interventions ranging from standardized mean difference (SMD) of 0.42 to 0.43 for depression, 0.30 to 0.56 for anxiety, and 0.73 to 0.82 for stress. However, the few results for internet and mobile-based interventions targeting stress in students are conflicting in terms of their effectiveness, warranting further research.
A recent meta-analysis suggests that intervention effects are considerably higher in indicated compared with general student populations, stressing the importance of developing suitable intervention approaches for at-risk students. Internet-based interventions which are labeled to improve stress coping skills, as opposed to focusing on reducing symptoms of mental disorders, could represent a promising way to reach such burdened individuals. In an Australian investigation among severely distressed college students, 55.7% indicated that they were quite or very likely to use an internet-delivered program to seek help. A significant association between heightened stress levels and positive attitudes toward internet intervention usage has also been found in a German general population sample.
If proven to be effective, internet- and mobile-based approaches could provide a feasible instrument to help avert the onset of more severe stress-related mental health concerns in at-risk college students. More research is therefore required to corroborate results on the effectiveness of internet- and mobile-based stress interventions and assess the potential of such interventions to reach and be effective in burdened students who already show symptoms of mental illness such as depression. Facing the deleterious effects of poor mental health on academic functioning, it is also important to assess whether such interventions may have an impact on important college-related outcomes such as academic self-efficacy and impairment.
Objectives
The aim of this study is thus to evaluate the effectiveness of an internet- and mobile-based intervention targeting university students with heightened stress levels. We hypothesized the internet intervention to be more effective in reducing symptoms of stress compared with a waitlist control group (WCG). It was furthermore assumed that more students participating in the intervention compared with the WCG would show a reliable change in perceived stress outcomes and attain close to symptom-free status. The second objective of this study was to investigate the hypothesized positive effect of the intervention on further mental health outcomes, modifiable risk and protective factors, and college-related outcomes compared with the WCG. Finally, our aim was to explore intervention participants’ adherence to, and acceptance of, the intervention.
Methods
This study was carried out as part of the WHO World Mental Health International College Student project. The WHO World Mental Health International College Student project aims to obtain accurate cross-national information on the prevalence, incidence, and correlates of mental, substance, and behavioral problems among college students worldwide, to describe patterns of service use and unmet need for treatment, to investigate the associations of these disorders with academic functioning, and to evaluate the effects of a wide range of preventive and clinical interventions on student mental health, functioning, and academic performance.
Design
A 2-armed randomized controlled trial was conducted with 150 participants, comparing an internet and app-based intervention with feedback on demand (StudiCare Stress) to a waitlist control group (WCG). Both conditions had full access to treatment as usual (TAU). The sample size allowed to detect effect sizes of d=0.41 with a power (1− β) of 0.80 with alpha of.05 and was based on a meta-analysis on internet-based interventions for college students, which reported an SMD of 0.73 for stress but lower effects for depression outcomes (SMD=0.43). A sample size of 150 was therefore chosen to also detect significant changes for secondary outcomes in this study such as depression.
Assessments took place at baseline (T1), posttreatment (T2; 7 weeks), and 3 months after baseline (T3; see Figure 1). Self-report data were collected using a Web-based assessment tool (Advanced Encryption Standard, 256-bit encryption). All procedures involved in the study were consistent with the generally accepted standards of ethical practice. The study was approved by the University of Erlangen-Nuremberg ethics committee (Erlangen, Germany; 322_15 B). The trial is registered in the German Clinical Trials Register (DRKS00010212). This study describes the main effectiveness analysis of the intervention; we also assessed moderator and mediator variables, which are listed in the trial registration (see Multimedia Appendix 1) and will be analyzed and reported in due length elsewhere.
Participants
Inclusion criteria were (1) elevated levels of perceived stress (Perceived Stress Scale 4-item version, PSS-4≥8; representing a level of stress one SD=2.92 above the mean of 4.49 in a large student sample), (2) enrollment in a German-speaking university at the beginning of the training, (3) age ≥18 years, (4) internet access, (5) willingness to provide self-report data at all assessment points, and (6) informed consent. Exclusion criteria were (1) self-reported diagnosis of dissociative symptoms or psychosis in the past or (2) considerable risk for suicide (Beck Depression Inventory item 9 >1; “I feel I would be better off dead” or “I would kill myself if I had the chance”). Individuals showing an elevated risk for suicide were given detailed information about treatment options and were asked to see a physician or psychiatrist as soon as possible.
Recruitment
Participants were recruited via university press reports, student counseling services, and social media platforms. Potential participants declared interest in partaking in the study by filling out a Web-based registration form on the study website.
Assessment of Eligibility and Randomization
Individuals who declared interest in participating received an information letter along with an informed consent sheet and were asked to provide an email address for their intervention platform profile. Applicants were informed that withdrawal from the study was possible at any time, did not go along with any negative consequences, and all collected case data could be deleted on request during the study. Interested participants were asked to complete the written informed consent form and fill out the Web-based screening questionnaire.
Individuals meeting all the inclusion and none of the exclusion criteria were invited to fill out the baseline assessment. After completion, individuals were randomly allocated to either the IG or the WCG. Randomization took place at a ratio of 1:1 and a block size of 2 using an automated computer-based random integer generator (Randlist, Datinf GmbH, Tübingen, Germany) and was performed by a researcher not otherwise involved in the study. Participants could not be blinded to study conditions; yet, during the randomization process, the allocation was concealed from participants, researchers involved in recruitment, and e-coaches.
Intervention Condition
The framework for StudiCare Stress was derived from GET.ON Stress, a Web-based stress management intervention for employees. Changes in form and therapeutic content were made to tailor the intervention to university students’ needs.
The intervention is based on cognitive-behavioral and third-wave techniques and aligns with Lazarus’ transactional model of stress in differentiating between problem-focused and emotion regulation–focused coping. For problem-focused coping, cognitive-behavioral problem-solving strategies are applied to reduce and eliminate modifiable stressors. Emotion regulation refers to the processes through which individuals monitor, evaluate, modify, and thus control emotions to reach relevant needs or goals and has been shown to be influential in reducing various symptoms of mental illness. Elective modules integrated at the end of session 2 to 7 could be chosen based on individual need and interest, covering student-specific topics: social support, rumination and worrying, time management, procrastination, test anxiety, sleep, motivation, nutrition and exercise, and dealing with writer’s block and concentration.
The intervention comprised 8 main modules. Completing 1 module took 30 to 90 min, and participants were advised to complete at least one and a maximum of 2 modules per week. Thus, the intervention was intended to be completed in about 5 to 7 weeks (see Multimedia Appendix 2 for a detailed description of the modules).
Strong emphasis was put on the transfer of acquired knowledge, strategies, and techniques into the students’ daily life through homework assignments. A personal diary app could be downloaded by participants to keep track of mood fluctuations, monitor factors contributing to their stress levels and reflect on intervention elements they could implement into their daily life. The diary app was introduced in module 1 as an adjunct to the main sessions and contained standardized free-text fields, rating scales, and gave the opportunity to add a photo to the entry (see Textbox 1). Participants were also provided with a PDF version of the diary and were instructed to monitor their mood 2 to 3 times each week, using either the app or a printout of the PDF for their entries.
In addition, before beginning with the intervention, participants could request automatic daily messages containing short motivational prompts and ultrabrief training exercises via SMS (short message service), aimed at facilitating transfer of learned strategies into daily life routine. Messages were prescheduled to roughly mirror content and exercises provided through the progression of the intervention.
Participants were guided by an eCoach, a trained student in a master’s program in psychology. Contact between the eCoach and intervention participants was solely established online, and there were no face-to-face meetings. An adherence-focused guidance concept in accordance with the human accountability model was applied, which has been shown to be noninferior to intensive guidance while minimizing human resources (; for a detailed description see). Guidance consisted of 3 parts: (1) monitoring adherence (sending up to 3 reminders when a module was not completed during 1 week through the internal platform messaging system and via email), (2) checking the intervention platform back-end for participants who had completed a new module to unlock the next module and send standardized motivational messages through the platform, and (3) providing feedback on demand. When requesting help, participants received feedback within 48 hours.
The feedback reflected the participants’ individual questions and problems and gave positive reinforcement. Feedback on demand was available for each participant from module 1 until completion of the booster session and was given via the internal messaging system of the training platform. Only few participants (5%, 4/75) requested individual feedback, resulting in 5 content feedbacks for the entire sample. In total, the eCoach sent 289 reminders (3.85 reminders per participant).
Control Condition
Students assigned to the waitlist control condition (WCG) completed the same assessments at T1, T2, and T3 as the intervention condition, but were not given access to the intervention until 3 months after randomization. Yet, they had full access to TAU offered by routine health care.
How do you feel today? (Emoticons: Happy–Sad–Anxious–Angry)
How stressed out do you feel today? (Rating scale 1-10)
Describe what happened today. (Free text)
Were you able to identify any things contributing to your stress levels today? (Free text)
Are there any techniques you previously learned that you may be able to apply? (Free text)
Do you want to add a photo to your entry? (Upload button)
Primary Outcome Measure
The primary outcome was perceived stress as measured by the PSS-4. The PSS-4 assesses the degree to which individuals evaluate their lives as stressful, especially regarding how uncontrollable and overloading relevant aspects of life are perceived. The PSS-4 comprises 4 items (Item 1: “How often have you felt you were unable to control the important things in your life?”; Item 2: “How often have you felt confident about your ability to handle your personal problems?”; Item 3: “How often have you felt that things were going your way?”; Item 4: “How often have you felt difficulties were piling up so high that you could not overcome them?”), yielding a score between 0 and 16. Participants rated their level of perceived stress within the last 2 weeks on a 5-point Likert scale (0= never; 4= very often). A two-factor structure has been commonly found for the PSS, with positively framed items representing perceived coping self-efficacy and negative items reflecting hopelessness, the latter being a strong predictor for depression. Higher scores on the PSS have shown to have good predictive validity for several adverse health outcomes. Despite its brevity, the PSS-4 has been found to have acceptable to good psychometric properties. The scale has a good level of internal consistency in this study as indicated by a Cronbach alpha of.83.
Secondary Outcome Measures
Unless otherwise specified, all outcomes were measured for a retrospective time frame of 2 weeks. All measures were administered in German. When no German translation was available, scales were translated independently by two of the researchers (MH and SHA), who then compared and discussed the translations to resolve disagreement.
Mental Health
To examine effects of the stress intervention on symptoms of common mental disorders, we included mental health outcomes associated with elevated distress in college students, including depression (short German form of the Center for Epidemiological Studies’ Depression Scale, CES-D; 15 items, scale 0-3, range 0-45) and state anxiety (Spielberger State-Trait Anxiety Inventory; 6 items, scale 1-4, range 6-24; at the moment). General well-being as an overall marker of mental health was assessed by the WHO-Five Well-Being Index (WHO-5; 5 items, scale 0-6, range 0-30), and emotional exhaustion using the Maslach Burnout Inventory-student version (; 5 items, scale 1-6, range 5-30).
Risk and Protective Factors
Following measures for established risk and protective factors were assessed to investigate the intervention’s effect on individual resources and vulnerabilities related to the development and proliferation of mental illness: dysfunctional perfectionism (Revised Almost Perfect Scale; translated; 8 items, scale 1-7, range 8-56), resilience (Connor-Davidson Resilience Scale short form; translated; 2 items, scale 0-4, range 0-8), self-compassion (Self-Compassion Scale; 12 items, scale 1-5, range 12-60), and self-esteem (Rosenberg Self-Esteem Scale; 10 items, scale 1-4, range 10-40).
College-Related Outcomes
To evaluate presenteeism and loss of productivity, the Presenteeism Scale for Students’(; translated) subscale for work impairment (Work Impairment Scale; 10 items, scale 1-5, range 10-50) was administered. Productivity losses were assessed by an adaption of the Presenteeism Scale for Students’ work output scale, investigating the current percentage to which participants were able to reach their usual academic productivity. Productivity could be rated on a visual analog scale ranging from 0%= completely unproductive to 100%= full productivity. Academic self-efficacy was measured by the academic self-efficacy scale (Wirkstud; 7 items, scale 1-4, range 7-28), and academic worrying using the Academic Worrying Questionnaire (; translated; 10 items, scale 0-4, range 0-40).
Additional Measures
Additional questionnaires assessed demographic variables, prior contact with professional health providers, and satisfaction with the intervention (IG only; Client Satisfaction Questionnaire, adapted to the web context, CSQ-8; 8 items, scale 1-4). Treatment credibility and expectancies were measured at baseline by the Credibility and Expectancy Questionnaire (; translated; 4 items, scale 1-5, range 4-20, 2 items, 0%-100%). Participants in the IG could give feedback on each modules’ usefulness (1= not useful at all, 5= very useful), complexity (1= very complex, 5= very easy), and duration until termination (1= less than ½ hour, 5= more than 1½ hours) on a 5-point Likert or 4-point scale, respectively.
Main Effectiveness Evaluation
All results are reported according to the Consolidated Standards of Reporting Trials statement (; see Multimedia Appendix 3). Analyses based on the intention-to-treat (ITT) principle were conducted, with missing data imputed using a Markov chain Monte Carlo multivariate imputation algorithm (multiple imputation functions in IBM SPSS 23; IBM Corp, Armonk, NY, USA) with 100 estimations per missing and all variables set as predictors for imputation. Imputed datasets were then aggregated to obtain 1 imputed dataset.
The hypothesized superiority of the internet intervention was tested with regard to (1) change in participants’ perceived stress and secondary outcomes from baseline (T1) to post intervention (T2) and 3-month follow-up (T3), (2) the number of participants with treatment response, (3) the number of students achieving close to symptom-free status, and (4) the amount of participants who experienced symptom deterioration.
Differences in change of perceived stress between study arms were assessed using univariate analysis of covariance (ANCOVA) with scores at baseline as covariate to control for varying degrees of baseline scores. Effect sizes (Cohen's d) were calculated based on the imputed dataset for between-group differences, using the pooled IG and WCG SD. To calculate 95% CIs, the formula by Rosnow and Rosenthal was used. According to Cohen, d=0.2 can be considered a small effect, d=0.5 a medium and d=0.8 a large effect. A significance level of.05 (2-sided) was used for all analyses.
To ascertain the number of participants attaining a reliable improvement in stress symptomatology, participants were coded as responders or nonresponders according to the Reliable Change Index. Accordingly, response was attained when participants’ scores on the PSS-4 differed more than −2.17 points from baseline to T2 and T3, respectively. Furthermore, the numbers needed to treat (NNT) to achieve 1 additional treatment response were calculated. Negative effects of the intervention were evaluated by the number of participants with reliable symptom deterioration concerning perceived stress through the Reliable Change Index. Participants were defined as symptom-free when scoring more than 2 SDs below the mean at baseline for the full sample (PSS-4 ≤7.29).
Subgroup Analysis
To estimate the interventions’ efficacy in a clinical population, a subgroup analysis was conducted including only participants with a score of >17 on the CES-D short form at baseline and following the same procedure as the main analysis. A score of 18 has been shown to be a valid cut-off in indicating a high probability of clinical depression. Participants were classified as responders if they showed reliable change in depressive symptoms according to the Reliable Change Index.
Study Completer Analysis
Completer analysis based on the sample of participants who provided data at all 3 assessment points was conducted additionally as a sensitivity analysis.
Process Evaluation
Descriptive statistics were used for process evaluation. To assess overall user satisfaction across various domains, item data provided by the CSQ-8 was examined individually. Acceptance of intervention modules was analyzed using the module feedback of the IG. Adherence was assessed by analyzing intervention completion rates tracked within the intervention platform. Finally, we analyzed the proportion of participants who accessed the diary app and requested automated short messages via SMS.
Results
Recruitment for the study started on May 9, 2016. The last follow-ups were completed on January 30, 2017.
Participants
The study flow can be found in Figure 1. Participants who were lost to follow-up at T2, T3, or both assessments did not differ significantly from participants who adhered to the protocol on any baseline characteristic (all P>.05). Table 1 summarizes detailed baseline characteristics of study participants. The majority (76.8%, 106/138) of the participants indicated that they had not consulted a physician, psychotherapist, or counselor for their health-related problems and may thus be considered first-time help-seekers. Descriptive data including all 3 assessment points for all outcomes is depicted in Table 2. Both study arms did not differ significantly (all P>.05) on any characteristic at baseline.
Changes in Perceived Stress
As hypothesized, the ANCOVA controlling for baseline scores revealed a significant effect for perceived stress at posttest (F1,147=19.70, P<.001) and at 3-month follow-up (F1,147=15.10, P<.001; see Table 3), with moderate to large effect sizes at both T2 (d=0.69; 95% CI 0.36-1.02) and T3 (d=0.57; 95% CI 0.24-0.89).
Treatment Response for Perceived Stress
Chi-squared tests revealed that significantly more participants in the IG (69%, 52/75) were classified as responders compared with the WCG (35%, 26/75) at posttest (χ21=18.1, P<.001), resulting in an NNT of 2.89 (95% CI 2.01-5.08). At 3-month follow-up, 55 of 75 participants in the IG (73%) and 33 of 75 in the WCG (44%) were coded as responders (χ21=13.3, P<.001) which equals an NNT of 3.41 (95% CI 2.25-7.00).
Symptom-Free Status for Perceived Stress
Symptom-free status was achieved by significantly (χ21=6.7, P=.01) more participants in the IG ( 44%, 33/75) compared with the WCG (24%, 18/75) at T2, and at T3 (IG: 53%, 40/75; WCG: 35%, 26/75) with χ21=5.3 (P=.02), resulting in an NNT of 5 (T2; 95% CI 2.87-19.31) and 5.36 (T3; 95% CI 2.92-32.66), respectively.
Symptom Deterioration for Perceived Stress
Only a small proportion of participants experienced symptom deterioration. Fewer participants’ stress symptomatology deteriorated in the IG (0%, 0/75) compared with the WCG, where 7 of 75 (9%) participants’ symptoms deteriorated (χ21=7.3, P<.001; NNT=10.58, 95% CI 6.19-44.18) at T2. Symptom deterioration did not differ at T3, with 1 case of 75 participants (1%) in the IG and 3 of 75 (4%) in the WCG (χ21=1.0, P=.31).
Secondary Outcome Analysis
Table 3 summarizes the results of the ITT analyses for the secondary outcomes. ANCOVAs revealed significant effects (P<.05) in favor of the IG for the majority of outcomes at both assessment points, with effect sizes ranging from d=0.33 (95% CI 0.01-0.65) for productivity (T2) to d=0.82 (95% CI 0.49-1.15) for emotional exhaustion (T2). No statistically significant effect was found for perfectionism (F1,147=0.38, P=.53) at T2, but at T3 (P<.001). Resilience (T2: F1,147=1.69, P=.17; T3: F1,147=2.94, P=.08), self-compassion (T2: F1,147=2.97, P=.09; T3: F1,147=1.46, P=.23), and self-esteem (T2: F1,147=0.15, P=.70; T3: F1,147=1.36, P=.25) did not differ significantly between both study arms at both assessment points.
Subgroup Analysis
More than three-fourths of the participants (77.3%; IG: 58/75; WCG: 58/75) showed symptoms above the cut-off for clinically relevant symptoms of depression at baseline. Between-group effect sizes for depression in this subgroup were moderate to large, both for T2 (d=0.67, 95% CI 0.34-1.00) and T3 (d=0.73, 95% CI 0.40-1.06). Treatment response was achieved by 36 (62%; T2) and 33 of 58 participants (57%, T3) in the IG compared with 14 of 58 participants (24%; T2 and T3) in the WCG, resulting in an NNT to achieve one additional treatment response in the IG compared with the WCG of 2.64 (95% CI 1.83-4.70) for T2 (χ21=17.0, P<.001) and 3.05 for T3 (95% CI 2.02-6.28, χ21=12.9, P<.001).
Completer Analysis
The results of the completer analyses were similar to the ITT analyses, with moderate to large between-group effect sizes for the primary outcome at T2 (IG: mean=6.72, SD 2.86; WCG: mean=9.32, SD 3.16; F1,88=18.60, P<.001; d=0.85, 95% CI 0.44-1.27) and T3 (IG: mean=6.41, SD 2.84; WCG: mean=8.65, SD 3.43; F1,88=13.41, P<.001; d=0.69, 95% CI 0.29-1.10). In contrast to the main analysis, however, resilience had increased significantly in the IG compared with the WCG at T2 (F1,88=8.56, P=.004; d=0.46, 95% CI 0.06-0.86).
Adherence to the Intervention
On average, participants in the IG completed 5.05 modules (SD 2.78), which equals 72.1% of the intervention. Participants completed optional add-on modules in the majority (82.1%) of sessions in which they were available. Most participants completed rumination & worrying (59%, 44/75), whereas only 8 of the 75 participants completed social support (11%). In all, 46 of the 75 participants in the IG (61%) downloaded and logged into the diary app at least once. Activation of the automated SMS messages was requested by 4 of 75 participants in the IG (5%) during the study.
Client Satisfaction
Overall client satisfaction with the intervention was high (see Table 4).
Perceived Usefulness, Difficulty, and Duration of Sessions
Most participants described the 8 treatment modules as useful and not overly complex (see Multimedia Appendix 4). Reported session duration was high, with participants having spent the most time on module 6 (Self-compassion; 28% spending more than 1 hour 30 min, 10/36).
Principal Findings
Results of this study indicate moderate to large intergroup effects for the reduction of perceived stress and other relevant health- and college-related outcomes, as well as substantial effects in individuals with clinically relevant symptoms of depression, which were highly prevalent in our recruited sample. No significant effects were found for self-compassion, perfectionism (T2), resilience, and self-esteem.
The benefits of this intervention were larger than those found in previous trials evaluating internet-based stress interventions in college students, albeit somewhat smaller than the reported overall effect of technology-delivered skill training interventions on perceived stress, and comparable to internet-based stress interventions in general, as reported in a recent meta-analysis, with a pooled standardized mean difference of d=0.64 (95% CI 0.50-0.79; perceived stress) in guided internet- and mobile-based interventions. The study further contributes to current literature by showing that targeting perceived stress in students does not only result in better mental health–related outcomes and well-being but can also have a substantial beneficial impact on college-related outcomes which, to the best of our knowledge, have not been investigated so far.
Participants’ adherence to the intervention was satisfying, and the intervention was well accepted among the large majority of students. Participant feedback on the length of specific modules, however, suggests that participants may have spent more time than anticipated on some of the modules. This may indicate that some modules could be shortened to attempt to further improve adherence. Whether shortening might, in fact, result in higher adherence to the intervention, however, is not fully clear. Earlier research has reported higher adherence rates for shorter interventions, albeit focusing on the number of modules used. Whether this effect also holds true for the length of specific modules remains unknown. Shortening some of the modules might potentially optimize adherence but may also compromise the intervention’s overall efficacy due to less potentially beneficial information or techniques being conveyed and trained. It has been argued that various ways in which participants prioritize provided content may lead to positive outcomes, and the ability to progress through interventions at one’s own pace might represent a key asset of internet-delivered treatment. Qualitative interviews conducted with participants of this intervention suggest that the elective mini-modules for various student-relevant topics were very well accepted. Providing larger amounts of content in a flexible way, allowing participants to tailor the intervention to their specific needs, could, therefore, be a promising approach to optimize intervention usage patterns. However, research is warranted to test whether this might further increase adherence.
Limitations
This study has some limitations. First, women were overrepresented in the study sample, as frequently seen in preventive interventions. Second, study dropout in the IG at 3-month follow-up was relatively high and larger in the IG. Albeit being a common limitation in clinical trial research, and with differential dropout rates having been reported before for internet-based stress intervention trials in tertiary education students, this restricts the generalizability of our findings on long-term effects. Attrition analysis, however, did not result in any significant baseline differences between dropout and nondropout cases, which may be an indicator that results were not overly biased due to unequal dropout. Third, because of ethical reasons, participants had full access to treatment-as-usual. Thus, we cannot rule out potential cointervention effects due to utilization of health services. Finally, because of feasibility and ethical reasons, such as not denying one half of the sample access to the intervention they sought after, participants in the IG of this study were compared with a WCG to assess effects of the training. The influence of treatment and change expectancies have been discussed as an artifact in clinical evaluation trials using WCGs because they potentially discourage participants with delayed access to treatment to initiate health-related behavior changes, and thus lead to accentuate effects.
Most college students with depression do not seek treatment through conventional health care channels, and attitudinal barriers, such as fear of stigmatization, have been shown to have a large impact on treatment utilization. As our findings indicate that (1) a large number of students in this sample did not use conventional treatment options before, (2) the majority of students who were willing to use this intervention reported clinically significant symptoms of depression, and (3) among this group, the treatment response was favorable; future studies should explore whether internet-delivered stress interventions, labeled as providing “support for coping with academic stress,” might potentially attract students with symptoms of depression who would not use formal mental health treatment and whether they can reduce the incidence of depressive disorders. Future studies should thus investigate the utility of internet and mobile-based interventions in affected students, that is, with symptoms of major depression, as an indicated preventative or early intervention approach to narrow the treatment gap and improve academic functioning.
Conclusions
In conclusion, internet- and mobile-based interventions could be an acceptable, effective, and potentially cost-effective approach to reduce the negative consequences associated with college-related stress.
References 77
- 1.
Auerbach RP, Alonso J, Axinn WG, Cuijpers P, Ebert DD, Green JG, Hwang I, Kessler RC, Liu H, Mortier P, Nock MK, Pinder-Amaker S, Sampson NA, Aguilar-Gaxiola S, Al-Hamzawi A, Andrade LH, Benjet C, Caldas-de-Almeida JM, Demyttenaere K, Florescu S, de Girolamo G, Gureje O, Haro JM, Karam EG, Kiejna A, Kovess-Masfety V, Lee S, McGrath JJ, O'Neill S, Pennell BE, Scott K, Ten HM, Torres Y, Zaslavsky AM, Zarkov Z, Bruffaerts R. Mental disorders among college students in the World Health Organization World Mental Health Surveys. Psychol Med. 2016;46(14):2955-2970.
Not in our library10.1017/s0033291716001665
- 2.
Blanco C, Okuda M, Wright C, Hasin DS, Grant BF, Liu S, Olfson M. Mental health of college students and their non-college-attending peers: results from the National Epidemiologic Study on Alcohol and Related Conditions. Arch Gen Psychiatry. 2008;65(12):1429-37.
Not in our library10.1001/archpsyc.65.12.1429
- 3.
World Health Organization. The Global Burden of Disease: 2004 update. 2008.
Not in our library
- 4.
Bruffaerts R, Mortier P, Kiekens G, Auerbach RP, Cuijpers P, Demyttenaere K, Green JG, Nock MK, Kessler RC. Mental health problems in college freshmen: prevalence and academic functioning. J Affect Disord. 2018;225:97-103.
Not in our library10.1016/j.jad.2017.07.044
- 5.
Breslau J, Lane M, Sampson N, Kessler RC. Mental disorders and subsequent educational attainment in a US national sample. J Psychiatr Res. 2008;42(9):708-16.
Not in our library10.1016/j.jpsychires.2008.01.016
- 6.
- 7.
Eisenberg D, Downs MF, Golberstein E, Zivin K. Stigma and help seeking for mental health among college students. Med Care Res Rev. 2009;66(5):522-41.
Not in our library10.1177/1077558709335173
- 8.
- 9.
Ebert DD, Gollwitzer M, Riper H, Cuijpers P, Baumeister H, Berking M. For whom does it work? Moderators of outcome on the effect of a transdiagnostic internet-based maintenance treatment after inpatient psychotherapy: randomized controlled trial. J Med Internet Res. 2013;15(10):e191.
Not in our library10.2196/jmir.2511
- 10.
Buntrock C, Berking M, Smit F, Lehr D, Nobis S, Riper H, Cuijpers P, Ebert D. Preventing depression in adults with subthreshold depression: health-economic evaluation alongside a pragmatic randomized controlled trial of a web-based intervention. J Med Internet Res. 2017;19(1):e5.
Not in our library10.2196/jmir.6587
- 11.
Chan JK, Farrer LM, Gulliver A, Bennett K, Griffiths KM. University students' views on the perceived benefits and drawbacks of seeking help for mental health problems on the Internet: a qualitative study. JMIR Hum Factors. 2016;3(1):e3.
Not in our library10.2196/humanfactors.4765
- 12.
Batterham PJ, Calear AL. Preferences for Internet-based mental health interventions in an adult online sample: findings from an online community survey. JMIR Ment Health. 2017;4(2):e26.
Not in our library10.2196/mental.7722
- 13.
Königbauer J, Letsch J, Doebler P, Ebert D, Baumeister H. Internet- and mobile-based depression interventions for people with diagnosed depression: a systematic review and meta-analysis. J Affect Disord. 2017;223:28-40.
Not in our library10.1016/j.jad.2017.07.021
- 14.
- 15.
Välimäki M, Anttila K, Anttila M, Lahti M. Web-based interventions supporting adolescents and young people with depressive symptoms: systematic review and meta-analysis. JMIR Mhealth Uhealth. 2017;5(12):e180.
Not in our library10.2196/mhealth.8624
- 16.
- 17.
- 18.
Conley CS, Durlak JA, Shapiro JB, Kirsch AC, Zahniser E. A meta-analysis of the impact of universal and indicated preventive technology-delivered interventions for higher education students. Prev Sci. 2016;17(6):659-78.
Not in our library10.1007/s11121-016-0662-3
- 19.
Hintz S, Frazier PA, Meredith L. Evaluating an online stress management intervention for college students. J Couns Psychol. 2015;62(2):137-47.
Not in our library10.1037/cou0000014
- 20.
Chiauzzi E, Brevard J, Thum C, Decembrele S, Lord S. MyStudentBody-Stress: an online stress management intervention for college students. J Health Commun. 2008;13(6):555-72.
Not in our library10.1080/10810730802281668
- 21.
Ryan ML, Shochet IM, Stallman HM. Universal online interventions might engage psychologically distressed university students who are unlikely to seek formal help. Adv Ment Health. 2010;9(1):73-83.
Not in our library10.5172/jamh.9.1.73
- 22.
Apolinário-Hagen J, Vehreschild V, Alkoudmani RM. Current views and perspectives on e-mental health: an exploratory survey study for understanding public attitudes toward Internet-based psychotherapy in Germany. JMIR Ment Health. 2017;4(1):e8.
Not in our library10.2196/mental.6375
- 23.
Auerbach RP, Benjet C, Bruffaerts R, Cuijpers P, Ebert DD, Kessler RC. Harvard Medical School Department of Health Care Policy. 2017.
Not in our library
- 24.
Deutsches Register Klinischer Studien [German Clinical Trials Register]. DRKS. 2016.
Not in our library
- 25.
Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. J Health Soc Behav. 1983;24(4):385-96.
Not in our library
- 26.
Ebert DD, Lehr D, Smit F, Zarski AC, Riper H, Heber E, Cuijpers P, Berking M. Efficacy and cost-effectiveness of minimal guided and unguided internet-based mobile supported stress-management in employees with occupational stress: a three-armed randomised controlled trial. BMC Public Health. 2014;14:807.
Not in our library10.1186/1471-2458-14-807
- 27.
Lazarus RS, Folkman S. Stress, Appraisal, and Coping. 1984.
Not in our library
- 28.
Berking M, Ebert D, Cuijpers P, Hofmann SG. Emotion regulation skills training enhances the efficacy of inpatient cognitive behavioral therapy for major depressive disorder: a randomized controlled trial. Psychother Psychosom. 2013;82(4):234-45.
Not in our library10.1159/000348448
- 29.
- 30.
Schueller SM, Tomasino KN, Mohr DC. Integrating human support into behavioral intervention technologies: the efficiency model of support. Clin Psychol Sci Pract. 2016;24(1):27-45.
Not in our library10.1111/cpsp.12173
- 31.
Zarski AC, Lehr D, Berking M, Riper H, Cuijpers P, Ebert DD. Adherence to Internet-based mobile-supported stress management: a pooled analysis of individual participant data from three randomized controlled trials. J Med Internet Res. 2016;18(6):e146.
Not in our library10.2196/jmir.4493
- 32.
Nielsen MG, Ørnbøl E, Vestergaard M, Bech P, Larsen FB, Lasgaard M, Christensen KS. The construct validity of the Perceived Stress Scale. J Psychosom Res. 2016;84:22-30.
Not in our library10.1016/j.jpsychores.2016.03.009
- 33.
Denovan A, Dagnall N, Dhingra K, Grogan S. Evaluating the Perceived Stress Scale among UK university students: implications for stress measurement and management. Stud High Educ. 2017;1-14.
Not in our library10.1080/03075079.2017.1340445
- 34.
Reis D, Lehr D, Heber E, Ebert DD. The German version of the Perceived Stress Scale (PSS-10): evaluation of dimensionality, validity, and measurement invariance with exploratory and confirmatory bifactor modeling. Assessment. 2017;1073191117715731.
Not in our library10.1177/1073191117715731
- 35.
Lee E. Review of the psychometric evidence of the Perceived Stress Scale. Asian Nurs Res (Korean Soc Nurs Sci). 2012;6(4):121-7.
Not in our library10.1016/j.anr.2012.08.004
- 36.
Hewitt PL, Flett GL, Mosher SW. The Perceived Stress Scale: factor structure and relation to depression symptoms in a psychiatric sample. J Psychopathol Behav Assess. 1992;14(3):247-257.
Not in our library10.1007/bf00962631
- 37.
Pbert L, Doerfler LA, DeCosimo D. An evaluation of the perceived stress scale in two clinical populations. J Psychopathol Behav Assess. 1992;14(4):363-375.
Not in our library10.1007/bf00960780
- 38.
- 39.
Warttig SL, Forshaw MJ, South J, White AK. New, normative, English-sample data for the Short Form Perceived Stress Scale (PSS-4). J Health Psychol. 2013;18(12):1617-28.
Not in our library10.1177/1359105313508346
- 40.
Mitchell AM, Crane PA, Kim Y. Perceived stress in survivors of suicide: psychometric properties of the Perceived Stress Scale. Res Nurs Health. 2008;31(6):576-85.
Not in our library10.1002/nur.20284
- 41.
Hautzinger M, Bailer M, Hofmeister D, Keller F. Center for Epidemiological Studies Depression Scale (CES-D; Radloff, L. S., 1977) - German adaption. Psychiatr Prax. 2012;39(6):302-304.
Not in our library10.1055/s-0032-1326702
- 42.
Marteau TM, Bekker H. The development of a six-item short-form of the state scale of the Spielberger State-Trait Anxiety Inventory (STAI). Br J Clin Psychol. 1992;31 ( Pt 3):301-6.
Not in our library10.1111/j.2044-8260.1992.tb00997.x
- 43.
Andrews B, Wilding JM. The relation of depression and anxiety to life-stress and achievement in students. Br J Psychol. 2004;95(Pt 4):509-21.
Not in our library10.1348/0007126042369802
- 44.
Brähler E, Mühlan H, Albani C, Schmidt S. Teststatistische Prüfung und Normierung der deutschen Versionen des EUROHIS-QOL Lebensqualität-Index und des WHO-5 Wohlbefindens-Index [Test statistic testing and standardization of the German versions of the EUROHIS-QOL quality of life index and the WHO-5 well-being index]. Diagn. 2007;53(2):83-96.
Not in our library10.1026/0012-1924.53.2.83
- 45.
Gumz A, Erices R, Brähler E, Zenger M. [Factorial structure and psychometric criteria of the German translation of the Maslach Burnout Inventory--Student Version by Schaufeli et al. (MBI-SS)]. Psychother Psychosom Med Psychol. 2013;63(2):77-84.
Not in our library10.1055/s-0032-1323695
- 46.
Smith MM, Saklofske DH, Yan G, Sherry SB. Does perfectionism predict depression, anxiety, stress, and life satisfaction after controlling for neuroticism? J Individ Differ. 2017;38(2):63-70.
Not in our library10.1027/1614-0001/a000223
- 47.
Slaney RB, Rice KG, Mobley M, Trippi J, Ashby JS. The revised almost perfect scale. Meas Eval Couns Dev. 2001;34(3):130-145.
Not in our library
- 48.
Galatzer-Levy IR, Burton CL, Bonanno GA. Coping flexibility, potentially traumatic life events, and resilience: a prospective study of college student adjustment. J Soc Clin Psychol. 2012;31(6):542-567.
Not in our library10.1521/jscp.2012.31.6.542
- 49.
Connor KM, Davidson JR. Development of a new resilience scale: the Connor-Davidson Resilience Scale (CD-RISC). Depress Anxiety. 2003;18(2):76-82.
Not in our library10.1002/da.10113
- 50.
Neff KD, Rude SS, Kirkpatrick KL. An examination of self-compassion in relation to positive psychological functioning and personality traits. J Res Pers. 2007;41(4):908-916.
Not in our library10.1016/j.jrp.2006.08.002
- 51.
- 52.
Hupfeld J, Ruffieux N. Validierung einer deutschen Version der Self-Compassion Scale (SCS-D) [Validation of a German version of the Self-Compassion Scale (SCS-D)]. Z Klin Psychol Psychother. 2011;40(2):115-123.
Not in our library10.1026/1616-3443/a000088
- 53.
Thoits PA, Aneshensel CS, Phelan JC, Bierman A. Self, identity, stress, and mental health. Handbook of the Sociology of Mental Health. 2013;357-377.
Not in our library
- 54.
Ferring D, Filipp SH. Messung des selbstwertgefühls: befunde zu reliabilität, validität und stabilität der Rosenberg-Skala [Measurement of self-esteem: findings on reliability, validity, and stability of the Rosenberg Scale]. Diagn. 1996;42(3):284-92.
Not in our library
- 55.
Matsushita M, Adachi H, Arakida M, Namura I, Takahashi Y, Miyata M, Kumano-go T, Yamamura S, Shigedo Y, Suganuma N, Mikami A, Moriyama T, Sugita Y. Presenteeism in college students: reliability and validity of the Presenteeism Scale for students. Qual Life Res. 2011;20(3):439-46.
Not in our library10.1007/s11136-010-9763-9
- 56.
Jerusalem M, Schwarzer R. Selbstwirksamkeit. Skalen zur Befindlichkeit und Persönlichkeit [Self-Efficacy. Scales for Mental State and Personality]. 1986.
Not in our library
- 57.
Wolitzky-Taylor K. University of Texas at Austin. 2009.
Not in our library
- 58.
- 59.
Devilly GJ, Borkovec TD. Psychometric properties of the credibility/expectancy questionnaire. J Behav Ther Exp Psychiatry. 2000;31(2):73-86.
Not in our library10.1016/s0005-7916(00)00012-4
- 60.
Altman DG, Schulz KF, Moher D, Egger M, Davidoff F, Elbourne D, Gtzsche PC, Lang T. The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Ann Intern Med. 2001;134(8):663-694.
Not in our library10.7326/0003-4819-134-8-200104170-00012
- 61.
Leonhart R. [Estimating effect sizes in clinical trials]. Rehabilitation (Stuttg). 2004;43(4):241-6.
Not in our library10.1055/s-2004-828293
- 62.
Rosnow RL, Rosenthal R, Nezu AM, Nezu CM. Assessing the effect size of outcome research. Evidence-Based Outcome Research: A Practical Guide to Conducting Randomized Controlled Trials for Psychosocial Interventions. 2008.
Not in our library
- 63.
Cohen J. Statistical Power Analysis for the Behavioral Sciences, 2nd edition. 1988.
Not in our library
- 64.
Jacobson NS, Truax P. Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. J Consult Clin Psychol. 1991;59(1):12-9.
Not in our library10.1037//0022-006x.59.1.12
- 65.
Lehr D, Hillert A, Schmitz E, Sosnowsky N. Screening depressiver Störungen mittels Allgemeiner Depressions-Skala (ADS-K) und State-Trait Depressions Scales (STDS-T) [Screening of depressive disorders using the General Depression Scale (ADS-K) and State-Trait Depression Scales (STDS-T)]. Diagn. 2008;54(2):61-70.
Not in our library10.1026/0012-1924.54.2.61
- 66.
- 67.
- 68.
Richards D, Timulak L, O'Brien E, Hayes C, Vigano N, Sharry J, Doherty G. A randomized controlled trial of an internet-delivered treatment: its potential as a low-intensity community intervention for adults with symptoms of depression. Behav Res Ther. 2015;75:20-31.
Not in our library10.1016/j.brat.2015.10.005
- 69.
- 70.
Farrer L, Gulliver A, Chan JK, Bennett K, Griffiths KM. A virtual mental health clinic for university students: a qualitative study of end-user service needs and priorities. JMIR Ment Health. 2015;2(1):e2.
Not in our library10.2196/mental.3890
- 71.
Eysenbach G. The law of attrition. J Med Internet Res. 2005;7(1):e11.
Not in our library10.2196/jmir.7.1.e11
- 72.
Cavanagh K, Strauss C, Cicconi F, Griffiths N, Wyper A, Jones F. A randomised controlled trial of a brief online mindfulness-based intervention. Behav Res Ther. 2013;51(9):573-8.
Not in our library10.1016/j.brat.2013.06.003
- 73.
Frazier P, Meredith L, Greer C, Paulsen JA, Howard K, Dietz LR, Qin K. Randomized controlled trial evaluating the effectiveness of a web-based stress management program among community college students. Anxiety Stress Coping. 2015;28(5):576-86.
Not in our library10.1080/10615806.2014.987666
- 74.
Bell ML, Kenward MG, Fairclough DL, Horton NJ. Differential dropout and bias in randomised controlled trials: when it matters and when it may not. Br Med J. 2013;346:e8668.
Not in our library10.1136/bmj.e8668
- 75.
Mohr DC, Ho J, Hart TL, Baron KG, Berendsen M, Beckner V, Cai X, Cuijpers P, Spring B, Kinsinger SW, Schroder KE, Duffecy J. Control condition design and implementation features in controlled trials: a meta-analysis of trials evaluating psychotherapy for depression. Transl Behav Med. 2014;4(4):407-23.
Not in our library10.1007/s13142-014-0262-3
- 76.
Hunt J, Eisenberg D. Mental health problems and help-seeking behavior among college students. J Adolesc Health. 2010;46(1):3-10.
Not in our library10.1016/j.jadohealth.2009.08.008
- 77.
Andrade LH, Alonso J, Mneimneh Z, Wells JE, Al-Hamzawi A, Borges G, Bromet E, Bruffaerts R, de Girolamo G, de Graaf R, Florescu S, Gureje O, Hinkov HR, Hu C, Huang Y, Hwang I, Jin R, Karam EG, Kovess-Masfety V, Levinson D, Matschinger H, O'Neill S, Posada-Villa J, Sagar R, Sampson NA, Sasu C, Stein DJ, Takeshima T, Viana MC, Xavier M, Kessler RC. Barriers to mental health treatment: results from the WHO World Mental Health surveys. Psychol Med. 2014;44(6):1303-17.
Not in our library10.1017/s0033291713001943
Cited by papers we hold 3
- Mapping virtual platforms to estimate the population size of men who have sex with men (MSM) who use internet to find sexual partners: implications to enhance HIV prevention among MSM in Kenya [version 1; peer review: 2 approved] · 2020Not checked
- Sources of Stress and Their Associations With Mental Disorders Among College Students: Results of the World Health Organization World Mental Health Surveys International College Student Initiative · 2020No notice
- Digital Mental Health Interventions for Depression, Anxiety, and Enhancement of Psychological Well-Being Among College Students: Systematic Review · 2019No notice
Reads
Read by people on this page
None yet.
Checked or read by AI through naulon
None yet.
A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.
Are you an author?
Is this your paper?
Claim it to add your note and be paid when agents cite it. Free.