The Effect of Physical Activity Interventions Comprising Wearables and Smartphone Applications on Physical Activity: a Systematic Review and Meta-analysis

1Interventions promoting physical activity may be enhanced if wearable devices, such as activity trackers, and smartphone applications are incorporated because effective behaviour change techniques can easily be integrated into wearables and smartphone applications.By exploring the factors influencing sustainability, adherence and long-term effectiveness, wearables and smartphone apps can be improved to increase effectiveness and optimize impact on public health.

2Interventions promoting physical activity may be enhanced if wearable devices, such as activity trackers, and smartphone applications are incorporated because effective behaviour change techniques can easily be integrated into wearables and smartphone applications.

3By exploring the factors influencing sustainability, adherence and long-term effectiveness, wearables and smartphone apps can be improved to increase effectiveness and optimize impact on public health.

4Physical inactivity or low physical activity levels are an increasing problem worldwide. Around 31% of the world’s population is classified as physically inactive, meaning that they are not meeting the physical activity (PA) recommendations. Also, time spent in sedentary behaviour, defined as any waking behaviour while in a sitting, reclining or lying posture, is increased. Physically inactive and sedentary people are at increased risk for non-communicable diseases such as cardiovascular disease, type 2 diabetes, some types of cancer and several other diseases and premature death. It is estimated that inactivity is associated with a 20 to 30% increased mortality risk.

5Increase in levels of physical activity holds the greatest potential to reduce premature death and to extend the lifespan. High levels of moderate intensity physical activity (i.e. about 60 to 75 min per day) even seem to eliminate the increased risk of death associated with sedentary behaviour. Therefore, stimulating physical activity gives potential for preventing a further increase in non-communicable diseases and premature death.

6It is a challenge to reach physically inactive people and to promote and maintain physical activity behaviour change. Several techniques are proposed for changing physical activity behaviour. For example, self-monitoring of behaviour is an important and effective technique, especially when combined with at least one of the following behavioural change techniques: prompt intention formation, prompt specific goal setting, provide feedback on performance and prompt review of behavioural goals.

7A meta-analysis including studies between January 2000 and August 2007 using pedometers showed a moderate positive effect on physical activity levels in adults and children. Compared to control groups, the intervention group increased on average by 2000 steps per day. Another meta-analysis showed that Internet-delivered interventions, which are able to use different behavioural change techniques (e.g. providing information on consequences of behaviour, prompt barrier identification, relapse prevention and goal setting), were effective in producing small but significant increases in physical activity (d = 0.24, 95% CI = 0.09 to 0.38).

8Advances in the device and smartphone technology, such as activity trackers and physical activity smartphone applications, have led to an exciting opportunity for delivering physical activity interventions. In 2017, worldwide, there were over 2.3 billion smartphone users and more than 250,000 lifestyle apps available in the Google Play store. Sophisticated wearable devices (wearables) provide an easy and attractive way to self-monitor physical activity. Likewise, advances in smartphone applications make it possible to use a combination of different behaviour change techniques to promote physical activity behaviour.

9A previous systematic review from Coughlin et al. showed promising results of smartphone apps in promoting physical activity, but the results were based on a combination of few randomized controlled trial and qualitative studies. Schoeppe et al. found significant improvements in the physical activity of smartphone apps promoting physical activity in order to prevent non-communicable diseases in the intervention groups compared to the controls; however, no meta-analysis was performed. Studies included in these reviews were published between April 2007 and October 2014. Here, we summarize the findings of more recent randomized controlled trials and performed meta-analyses evaluating the effectiveness of physical activity interventions using wearables and smartphone applications to promote physical activity in adult populations compared to a control group.

10We conducted this review and reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. This review was registered in the PROSPERO register of systematic reviews (CRD42015026529).

11In August 2017, we searched on titles and abstracts in PubMed, EMBASE and the Cochrane Central Register of Controlled Trials (CENTRAL; 2008 to 2017). For the intervention, ‘mobile devices that promote physical activity’, we searched on the following MeSH terms or keywords: ‘Mobile applications OR Cell Phones OR Actigraphy’. We combined these with MeSH terms or keywords for the outcome ‘physical activity’: ‘Exercise OR Motor Activity’. We supplemented the keywords with searching in title/abstract using several synonyms of the intervention and outcome. The complete search strategy for all databases is available in the Appendix. We additionally searched the reference list of relevant reviews/studies.

12Studies were eligible for inclusion when they were randomized controlled trials (RCTs), conducted in adults, assessing wearables and/or smartphone- and/or tablet-based applications stimulating physical activity. Primary outcomes were time spent in (moderate-to-vigorous) physical activity, either objectively measured through pedometer or accelerometer data or subjectively measured by self-report questionnaires, and objectively measured daily step count.

13Studies were excluded when the article was published before 2008 (introduction of the smartphone), the physical activity intervention comprised a minor part of a combined programme, or when the intervention was Internet-based and not accessible by smartphone. Control groups were excluded when they were offered the same application.

14First, the title and abstract of the search yield were independently screened by four authors (RG, EM, EO, AM). Of potentially eligible studies, the definite selection was based on a full-text copy of the study, also independently screened by three authors (RG, EM, AM). Disagreement was resolved by consensus or by consulting a third author (EM or AM).

15Three authors independently extracted the data from each of the included studies (RG, EM, EO). Discrepancies were resolved by consensus or consulting a third author (AM). We documented study characteristics (including year, author, study design), characteristics of the study population, components of the intervention (way of promoting physical activity, intervention duration) and outcomes on physical activity (including measures of physical activity, timing of measurements, statistical analysis, results). The five behaviour change techniques that were associated with the greatest effectiveness were documented as well, that is, self-monitoring of physical activity, prompt intention formation (i.e. motivating to decide to act or set a goal, e.g. ‘I will take more exercise next week’), prompt specific goal setting (i.e. making a detailed planning of what to do), review of behavioural goals (i.e. reviewing and reconsidering previously set goals) and feedback on performance.

16When a trial included more intervention arms, the intervention arm using a wearable and smartphone application combined with the fewest additional intervention components was compared with the control arm. Supplementary material or the website of the study, wearable or smartphone application was consulted when characteristics of the intervention were not described sufficiently. In case of missing data, we contacted the corresponding authors.

17The risk of bias of each included study was assessed by three independent authors (RG, EM, EO). We used the Cochrane risk of bias tool, consisting of six domains. Each domain was scored as low, unclear or high risk of bias. Disagreement about the risk of bias assessments was resolved by consensus or consulting the third author. An overall classification of low, unclear or high risk of bias in each study was based on the combination of the domains.

18The following domains were assessed:Sequence generation: Was the method used to generate the allocation sequence appropriate to produce comparable groups? If the method was not described, the risk of bias was rated as unclear.Allocation sequence concealment: Was the method used to conceal the allocation sequence appropriate to prevent the allocation being known in advance of, or during, enrolment? If the method was not described, the risk of bias was rated as unclear.Blinding of outcome assessment: How subjective or objective was the outcome assessment? Objectively measured physical activity outcomes were rated as low risk of bias, and subjective outcomes were rated as high risk of bias. Unblinded physical activity assessments were less likely to be biased when objectively measured.Incomplete outcome data: Were incomplete outcome data adequately addressed? Were attrition (drop-out) and exclusions from the analysis reported? Was the analysis an intention-to-treat analysis or were missing data imputed appropriately?Selective outcome reporting: Were outcomes prespecified in a study protocol or trial registration and reported as specified? If outcomes were not prespecified elsewhere, the risk of bias was rated as unclear.Other potential threats to validity: When baseline differences between study groups were present, were these accounted for in the analysis? Were there other sources of bias, not previously mentioned?

19Sequence generation: Was the method used to generate the allocation sequence appropriate to produce comparable groups? If the method was not described, the risk of bias was rated as unclear.

20Allocation sequence concealment: Was the method used to conceal the allocation sequence appropriate to prevent the allocation being known in advance of, or during, enrolment? If the method was not described, the risk of bias was rated as unclear.

21Blinding of outcome assessment: How subjective or objective was the outcome assessment? Objectively measured physical activity outcomes were rated as low risk of bias, and subjective outcomes were rated as high risk of bias. Unblinded physical activity assessments were less likely to be biased when objectively measured.

22Incomplete outcome data: Were incomplete outcome data adequately addressed? Were attrition (drop-out) and exclusions from the analysis reported? Was the analysis an intention-to-treat analysis or were missing data imputed appropriately?

23Selective outcome reporting: Were outcomes prespecified in a study protocol or trial registration and reported as specified? If outcomes were not prespecified elsewhere, the risk of bias was rated as unclear.

24Other potential threats to validity: When baseline differences between study groups were present, were these accounted for in the analysis? Were there other sources of bias, not previously mentioned?

25We decided to exclude the item blinding of participants because this is not feasible in these types of studies. However, we were aware that this shortcoming can lead to performance bias. The risk of bias assessment for blinding of outcome assessment was based on the method of outcome assessment (objective or subjective) and is already taken into account in the meta-analyses.

26To investigate publication bias, we assessed funnel plots by visual inspection for asymmetry. In a funnel plot, the treatment effect is plotted against a measure of precision. When a publication is less likely for smaller and hence less precise studies failing to detect a significant effect, the funnel plot may be asymmetrical.

27The primary outcome was time spent in (moderate-to-vigorous) physical activity in minutes per day and mean number of steps per day. Outcomes in minutes per week were converted to minutes per day divided by 7. When change scores from baseline to post-intervention were not available, outcome scores post-intervention were described. Intervention effects were assessed by comparing the difference in physical activity level between the intervention and control group. We used random-effects models, grouped by the method of assessing physical activity (objectively or subjectively) and type of outcome (moderate-to-vigorous) physical activity or daily step count. Standardized mean differences (SMD) with a 95% confidence interval were calculated since different measurement instruments were used (Review Manager (RevMan), version 5.3). A standardized mean difference of 0.2 represents a small effect, 0.5 a moderate effect and 0.8 a large effect. Statistical heterogeneity was assessed by examining the forest plots and calculating I2. The I2 statistic described the percentage of variability across studies that is due to heterogeneity rather than chance. I2 values of 25, 50 and 75 were upper limits for low, moderate and high heterogeneity, respectively. Studies reporting multiple outcomes (e.g. objectively as well as subjectively measured) could be included in more than one meta-analysis.

28Subgroup analysis was performed to explore clinical heterogeneity and subgroup effects, i.e. healthy versus diseased study populations and shorter (than 14 weeks) versus longer (than 14 weeks) intervention duration. Additional analyses were performed to test the robustness of the results by removing studies with an unclear or high risk of bias.

29Of the 10,318 unique articles screened on title and abstract, 81 full-text articles were assessed for eligibility (see Fig. 1). Finally, 18 studies were included in this review.

30Table 1 presents the characteristics of the included studies and interventions. The included studies involved 2734 participants from different populations. Twelve studies included healthy adults, also including inactive and/or overweight, whereas four studies were conducted in patients with (chronic) diseases, one study in participants with an elevated risk of cardiovascular disease and another study included stroke survivors. In all studies, except one, physical activity was promoted through a smartphone or tablet application. The application was, in most studies, supported by a pedometer or accelerometer. In the other study, physical activity was promoted by an accelerometer which could be synchronized with an online dashboard.

31In all studies, the application included self-monitoring as a behaviour change technique. Also, in all studies except one, goal setting was included. Approximately two thirds of the studies used setting of individualized physical activity goals as a behaviour change technique, whereas the other studies used general goals (e.g. at least 150 min physical activity of at least moderate intensity or 10,000 steps per day). In almost all studies except four, reviewing and reconsidering previously set behavioural goals was included in the application. Furthermore, all studies except one included prompt intention formation, and all studies included feedback on the performance except for one study.

32Other intervention components in addition to the application were among others an introduction through a presentation, booklet or education visit and counselling, in-person, by telephone or in a group session. The duration of the intervention ranged from 4 weeks to 12 months. Control groups differed across studies, varying from usual care and waiting list to some form of education through a presentation, booklet or education visit.

33Table 2 gives an overview of the measurement of the outcome (i.e. level of physical activity). Most studies measured physical activity objectively with an external accelerometer or pedometer or with a smartphone’s inbuilt accelerometer or pedometer. Four studies subjectively measured physical activity using a questionnaire. Most studies reported their results in mean minutes of physical activity per day or daily step count. Other reported outcomes were mean hours of physical activity per week, mean minutes of physical activity per week, kilocalorie per day and metabolic equivalent of task (MET) per day. Eleven studies reported a change in physical activity level between the baseline and the end of the intervention, and seven studies reported post-treatment physical activity level.

34Figures 2 and 3 show the risk of bias assessment of the 18 included studies. Three studies did not describe the method of randomization and were rated as an unclear risk of bias. Two studies were at high risk of selection bias caused by the method of sequence generation. Harries et al. listed participants in the order of recruitment, and each third participant was allocated to one of the three groups. Paul et al. assigned the first eight participants to the intervention group, then four to the control group, eight to the intervention group and the final four to the control group.

35Allocation concealment was rated as a low risk of bias in seven studies because the concealment of allocation was likely due to the use of concealed envelopes or an independent or blinded investigator. Three studies were rated as high risk of bias for allocation concealment. One study used quasi-random assignment, and two studies allocated participants based on the order of recruitment. Eight studies had an unclear risk of bias because the method of allocation was not described.

36Four studies subjectively measured physical activity and were rated as a high risk of detection bias for blinding of outcome. The other studies used objectively measured physical activity outcomes and were rated as low risk of bias.

37Attrition rates were reported in all studies. Four studies were rated as a high risk of bias on incomplete outcome data because of high drop-out

38One study was assessed as having a high risk of bias for selective outcome reporting because the outcome measures were not reported in detail in the paper.

39Another potential bias was identified in two studies. In one study, 28% of the intervention completers used another weight loss intervention in addition to the intervention, and the second study was not registered in a trial registry.

40Six studies were classified as having a low risk of bias, six studies were classified as having an unclear risk of bias and six studies had a high risk of bias rating.

41We performed multiple meta-analyses since studies used different types of outcomes (i.e. moderate-to-vigorous physical activity or daily step count) and different methods of assessing physical activity (i.e. objectively and subjectively measured) and reported either change scores or outcome scores post-intervention and analysis including either studies with a low, unclear or high risk of bias or studies with only a low risk of bias. As a result, the number of studies was relatively low in each meta-analysis (< 10 studies), and we could not properly assess the funnel plots of publication bias.

42Six studies objectively measured physical activity and reported changes from baseline to post-intervention (Fig. 4). The random-effects meta-analysis showed an improvement in intervention groups compared to the control group; however, high statistical heterogeneity was detected (SMD = 0.43, 95% CI = 0.03 to 0.82; I2 = 85%). When excluding the two studies with an unclear or high risk of bias, a significant improvement was found in the intervention groups with no statistical heterogeneity (SMD = 0.49, 95% CI = 0.30 to 0.68; I2 = 0%).

43A change from baseline to post-intervention in subjectively measured physical activity was reported in three studies (Fig. 4). The random-effects meta-analysis showed no significant differences in physical activity level (SMD = 0.19, 95% CI = − 0.18 to 0.57; I2 = 62%).

44For change in daily step count from baseline to the end of the intervention as reported in seven studies, a significant improvement was found for intervention groups compared to control groups (SMD = 0.51, 95% CI = 0.12 to 0.91; I2 = 90%; Fig. 5). However, a high statistical heterogeneity was observed. When excluding the four studies with an unclear or high risk of bias, daily step count significantly improved in the intervention group compared to control with no statistical heterogeneity between studies (SMD = 0.67, 95% CI = 0.48 to 0.86; I2 = 0%).

45A random-effects meta-analysis including six studies demonstrated a significant improvement in daily step count post-intervention in intervention groups compared to control groups (SMD = 0.33, 95% CI = 0.11 to 0.54; I2 = 29%; Fig. 5). Moderate statistical heterogeneity was observed.

46Three studies reported other outcomes than (moderate-to-vigorous) physical activity in minutes or daily step count (Fig. 6). Reported outcomes were stepping time per day in minutes, kilocalories per day and METs per day. In all studies, no significant effect of the intervention was found in physical activity.

47No differences were found between healthy and diseased study populations (daily step count) and between interventions with an intervention duration shorter than 14 weeks and studies with a longer intervention duration (objectively measured physical activity).

48This systematic review and meta-analysis showed that exercise interventions comprising wearables and smartphone applications were effective in promoting physical activity in adults. A moderate effect was found for objectively measured change in (moderate-to-vigorous) physical activity, and a moderate-to-large effect was found for change in daily step count. No significant effect was found for subjectively measured change in (moderate-to-vigorous) physical activity.

49The results of this review are consistent with previous systematic reviews showing promising results of smartphone application in promoting physical activity; however, the results in these systematic reviews were based on a combination of randomized controlled trials and qualitative studies and no meta-analysis was performed. The current review included only randomized controlled trials and adds to the existing literature by conducting a meta-analysis. In addition, the above-mentioned systematic reviews targeted populations representative for the general population (i.e. patients with chronic disease were excluded). We included studies with different target populations, e.g. healthy adults, overweight or inactive adults, chronically diseased adults or older age groups.

50Considerable statistical heterogeneity was detected between studies. Statistical heterogeneity between studies was removed when including only studies with a low risk of bias in the meta-analysis. Although also the number of studies was reduced in the ‘low risk of bias’ meta-analyses, analyses were still based on more than 400 subjects, implying sufficient power. Besides the differences in study quality, variation in study populations may explain the statistical heterogeneity. For example, previous research showed that more sedentary or inactive adults may benefit more from an intervention promoting physical activity than already active adults. In the same way, one might expect that patients with chronic disease may benefit more from an intervention promoting physical activity than healthy adults because of perceived barriers to exercise, e.g. disease-related fatigue. Subgroup analysis did not show a differential effect for healthy or diseased adults, probably because of the small number of studies included in this analysis.

51Studies also varied in number and combination of included intervention components and behaviour change techniques. Promotion of physical activity through a smartphone application in combination with a wearable is in most studies accompanied by other intervention components, such as counselling sessions. Hence, no conclusions could be drawn about the isolated effect of wearables and smartphone applications on physical activity. Schoeppe et al. showed that only offering a smartphone application is less effective than offering a smartphone application with additional intervention components. As a result, compared to only offering a wearable and smartphone application, intervention effects may be larger when the intervention is accompanied with other intervention components. Furthermore, goal setting is one of the most important behaviour change techniques to increase physical activity. In most studies, physical activity goals were individualized, which may be more effective in promoting physical activity compared to general physical activity goals. Other sources of heterogeneity might be variation in intervention duration and differences between control groups across studies, ranging from usual care to having a physical activity goal.

52Variation in intervention characteristics (e.g. intervention components and duration) may be associated with the target population. Based on the results of this review, we could not draw conclusions on the optimal combination of intervention characteristics per target population. Future studies should therefore explore which (combination of) elements are effective in different populations by using for example factorial or Sequential Multiple Assignment Randomized Trial (SMART) designs.

53It is still a challenge to reach healthy but physically inactive people and achieve a behaviour change. Efforts have been undertaken to reach this population since physical inactivity is a key risk factor for developing different (chronic) diseases and premature death. A promising strategy to foster motivation for physical activity is using the motivational power of games. For instance, mobile exergames as Pokémon GO, an augmented reality game in which players have to catch Pokémon (pocket monsters) that appear as virtual creatures in real places, appeared promising to reach a broad range of inactive people. First studies showed an increase in physical activity and more inactive populations were reached. However, physical activity decreased again within a few weeks indicating that people stopped playing. Future intervention studies should evaluate the potential added value of utilizing gaming strategies in smartphone applications in order to promote physical activity and to maintain change in physical activity level in the long term.

54Most studies in this review focused on results directly post-intervention. Therefore, we could not obtain an insight into the sustainability of increased physical activity levels. Further research should include long-term follow-up assessments. Also, it would be interesting to obtain more insight into adherence to the use of wearables and smartphone applications and factors influencing adherence, e.g. personal preferences for apps and behaviour change techniques. Greater adherence may mediate the effect of the intervention on physical activity. With more information on sustainability, adherence and long-term effectiveness, wearables and smartphone apps could be designed that are most effective in promoting physical activity to optimize impact on public health. In this review, it was not possible to study the effectiveness of each behaviour change technique since they co-occur with other intervention characteristics and behaviour change techniques.

55Lastly, we focused on the effect of physical activity. In future research, it would be interesting to focus on other outcomes as well, for example, quality of life and mood.

56To conclude, a physical activity intervention comprising a wearable and/or smartphone application is promising in promoting physical activity in adult populations. Most interventions also included other intervention components which might support the effects. Wearables and smartphone applications are likely to bring more opportunities in delivering tailored and effective interventions to increase physical activity.