Exploring the mechanisms of weight loss in the SHED-IT intervention for overweight men: a mediation analysis

Abstract

Background

Statistical mediation analysis can be used to improve the design of obesity prevention and treatment programs by identifying the possible mechanisms through which an intervention achieved its effects. The aim of this study was to identify mediators of weight loss in an Internet-based weight-loss program specifically designed for overweight men.

Methods

The Self-Help, Exercise and Diet using Information Technology (SHED-IT) program was a 3-month randomized controlled trial (Internet-based intervention group vs information only control group) that was implemented in 2007 with baseline and 6-month follow-up assessment of weight, physical activity and dietary behaviors. Intention-to-treat and per-protocol mediation analyses were conducted using a product-of-coefficients test.

Results

Participants (N = 65) were overweight and obese male academic (n = 10) and non-academic (n = 27) staff and students (n = 28) from the University of Newcastle, Australia. Mean (SD) age = 35.9 (11.1) years and mean (SD) BMI = 30.6 (2.8). In the intention-to-treat analysis, both groups lost weight, but relative to the control group, the intervention did not have a statistically significant 'total effect' on weight, τ = -.507, p = .716 (95% CI = -3.277 to 2.263). In the per-protocol analysis, the intervention had a statistically significant 'total effect' on weight, τ = -4.487, p < .05 (95% CI = -8.208 to -.765). The intervention did not have a statistically significant effect on any of the hypothesized mediators and none of the behavioral variables mediated weight loss in the SHED-IT program. Although participants in the intervention group reduced their fat intake over the study period, the changes did not satisfy the criteria for mediation.

Conclusion

Few studies have examined the mediators of weight loss in obesity treatment interventions. While none of the hypothesized mediators satisfied the criteria for mediation in the current study, there was some evidence to suggest that overweight men in the SHED-IT intervention reduced their fat intake over the study period. Future obesity treatment and prevention programs should explore behavioral mediators of weight loss using appropriate statistical methods.

Trial Registration

Australian New Zealand Clinical Trials Registry No: ANZCTRN12607000481471.

Background

Obesity is a major cause of preventable death and is associated with substantial direct and indirect health care costs [1]. While the relative contribution of physical inactivity and poor nutrition to obesity prevalence is controversial [2], it is irrefutable that the obesity pandemic is a product of widespread energy imbalance [3]. The treatment of obesity is problematic and weight loss interventions generally result in modest effects [4]. The lack of success in interventions may be due to limitations in study design and intervention components, program implementation, effect moderation and measurement issues [5].

Statistical mediation analysis can be used to improve the design of future interventions by identifying the possible mechanisms through which an existing intervention achieved its effects [6, 7]. Mediation analyses provide information regarding the effectiveness of various intervention components and such information can be used to tailor interventions for specific groups. Furthermore, mediation analyses allow researchers to develop more parsimonious interventions by eliminating less important components and emphasizing others. In its simplest form (Figure 1), mediation analysis involves adding a hypothesized mediating variable (e.g. physical activity) to the regression equation including one independent (e.g. intervention condition) and one dependent variable (e.g. weight loss) [8]. While intervention studies often report their effect on potential mediators, few studies have used mediation analysis to determine if changes in the hypothesized mediators were responsible for changes in the primary outcome. For example, previous weight loss interventions have evaluated their impact on the physical activity levels of their participants [9, 10]. Other studies have used change score correlations to examine the relationship between changes in weight and changes in physical activity [11, 12]. However, neither of these two approaches conclusively establishes whether weight loss could be attributed to increases in physical activity.

Figure 1

Overview of mediation analysis.

In mediation hypotheses, it is assumed that the inclusion of a mediating variable (e.g. physical activity) will reduce the magnitude of the relationship between the independent (i.e. treatment condition) and dependent variables (e.g. weight loss) [13]. Mediation analyses have been used in a number of studies to evaluate the theoretical framework of physical activity and dietary interventions, but most have only assessed psychosocial constructs (e.g. self-efficacy) [7, 14, 15]. Similarly, mediation analyses in weight loss interventions have generally focused on psychosocial mediators [16, 17], which helps to determine the construct validity of an intervention. Mediation analyses have been recommended to improve the design of obesity prevention trials [18, 19] and we suggest that obesity treatment interventions may similarly benefit from mediation analyses.

The primary aim of this study was to identify behavioral mediators of weight loss in an Internet-based intervention for overweight men. The Self-Help, Exercise and Diet using Information Technology (SHED-IT) program was an Internet-based weight loss program designed specifically for men. The trial was registered: Australian New Zealand Clinical Trials Registry No: ANZCTRN12607000481471.

Methods

Study design and sample size

SHED-IT was an assessor-blinded randomized controlled trial (RCT) that adhered to the CONSORT protocol [20]. Overweight or obese (BMI between 25 and 37 kg/m²) male staff (academic and non-academic) and students aged 18 to 60 years were recruited from the University of Newcastle from advertisements placed on University notice boards and the University website in late August 2007. Participants were blind to group allocation at baseline assessment and assessors were blinded to treatment allocation at all time points. Based on 80% power to detect a 3.0-kg difference among groups as significant (P < .05, two-sided), a sample size of 18 participants for each group was needed. Assuming a 20% attrition rate, a total sample of 45 subjects was required. Participants were randomly allocated to one of two groups: an Internet-based weight-loss group or an information only control group using a computer-based random number-producing algorithm.

Intervention details

The SHED-IT (Internet) intervention involved one face-to-face session followed by three months of online support. Participants attended an introductory session (75 minutes) led by one of the male researchers in September 2007. A detailed description of the study design, intervention components and major findings have been published elsewhere [21]. The first 60 minutes of the information session focused on the modification of diet and physical activity habits and behavior change strategies including self-monitoring, goal setting and social support, based on Bandura's Social Cognitive Theory [22]. The second part of the session (15 minutes) focused on how to use the free study website http://www.calorieking.com.au.

The control group attended one information session which was identical to the intervention group, but without the 15 minute description of the online component. The same male researcher delivered the information session. Separate sessions were conducted for intervention and control participants to avoid contamination between study arms. All participants were provided with an information booklet focusing on key behavioral strategies to achieve a healthy weight. The key behavioral strategies were as follows: (i) learn to read food labels, (ii) keep a healthy lifestyle diary, (iii) plan your meals, (iv) reduce your junk food snacks, (v) reduce your portion sizes, (vi) beware of beverages, (vii) surf the (hunger) urge, (viii) every step counts and (ix) tilt the balance with physical activity.

Outcomes

Outcome measures were obtained from participants at baseline (September, 2007), 3-months (December, 2007) and 6-months (March, 2008) after the start of treatment. Baseline and 6-month data are presented in this paper. The 3- and 6-month study results are reported elsewhere [21]. Measurements were taken at the University of Newcastle (New South Wales, Australia) using the same instruments and the same trained assessors at each time point. Baseline assessments were taken 1-2 weeks before the information session. Details of age, occupation and socioeconomic status (SES) were also collected. SES was based on postal code of residence [23]. The primary outcome was change in body weight (kg and percent change from baseline). Weight was measured in light clothing without shoes to 0.1 kg, using CH-150 kp digital scales (A + D Mercury Pty Ltd, Australia). Secondary outcome measures of diet and physical activity were assessed. Dietary behavior was measured using the Dietary Questionnaire for Epidemiological Studies (DQES) Version 2 Food Frequency Questionnaire (FFQ) from the Cancer Council of Victoria [24]. The FFQ provides an estimate of daily energy, macronutrient intake, average meal portion size, total kilojoule intake and alcohol consumption. FFQ scores were computed using NUTTAB 1995, a food composition database of Australian foods (Australian Government Publishing Service, Canberra) with software developed by the Cancer Council of Victoria. The development of the DQES (13) and its use in a cohort of over 40000 adults (>17000 men) have been reported previously (14). The validity and reliability of the FFQ has been examined in a number of studies [25–27]. A recent study found that all of the nutrient estimates from the FFQ were within ± 20% of the estimates produced from the mean of the 3-day weighed food records in adults [27]. Another study found that the FFQ could be used to rank subjects according to their likely plasma n-3, DHA, and n-6 fatty acid intake and the ratio of n-6: n-3 fatty acids.

Yamax SW700 pedometers (Yamax Corporation, Kumamoto City, Japan) were used to provide an objective measure of physical activity. At baseline assessments, participants were instructed on how to attach the pedometers (at the waist on the right hand side) and asked to remove the pedometers only when sleeping, when the pedometer might get wet (e.g. swimming, showering) or during contact sports. At the end of the day participants were instructed to record their steps and reset their pedometers to zero. If the participants forgot to wear their pedometers or removed their pedometers for more than 2 hours during the day, participants were instructed to leave their log sheet blank. Once they had completed seven days of monitoring, participants were instructed to place the pedometer and record sheet in the prepaid envelope provided and return to the research team. Physical activity variability was explored using intraclass correlation coefficients (ICCs).

Analysis

The data were analyzed with SPSS^® version 16.0 (SPSS Inc., Chicago, IL). Last observation carried forward was used for missing data (i.e. baseline or 3-month scores carried forward). Both intention-to-treat and planned per-protocol mediation analyses were conducted. Of the 34 participants assigned to the Internet group, 14 (41.2%) complied well with treatment, defined as seven weeks of submission of daily eating and exercise diaries (n > 50) and weekly check-ins (n > 12) over the 3-month period. In the per-protocol mediation analysis, the 'compliers' were compared to the control group. Measures of change in weight from baseline to 6-month posttest were computed by regressing the posttest values onto their baseline values to create residualized weight change indices [28, 29]. Using residualized change scores addresses the issue of regression to the mean [30] and accounts for the possibility that men classified as obese at baseline have more weight to lose than overweight participants. The same process was used for hypothesized mediators (e.g. physical activity, fat intake).

A product-of-coefficients test was used to assess mediation in the SHED-IT intervention because it has good statistical power in small samples [31–33] and can be used to establish mediation even in the absence of a statistically significant intervention effect [34]. Asymmetric confidence intervals were used to test the significance of the product of coefficients tests as they are more accurate than normal confidence limits [35]. Single mediator models were tested using ordinary least squares regression. The mediators assessed in this study were based on the SHED-IT weight loss tips and included the following: physical activity, portion size, total energy intake, alcohol intake and fat intake. To determine whether each variable mediated weight loss, the following regression models were calculated. First, the 'total effect' of the intervention on weight, controlling for baseline was examined (τ). Second, the effect of the intervention on hypothesized mediators was assessed (α). In the third step, treatment and hypothesized mediators were both entered into a regression model predicting weight (β). The mediated effect was calculated by multiplying α and β. In the final step, asymmetric confidence intervals were used to test the significance of the product of coefficients (αβ) using Mackinnon et al.'s PRODCLIN program [36]. If zero is outside the confidence interval, then the mediated effect is statistically significant [34].

Results

Baseline data

Measurements were obtained for 83% of the sample at 6-months (n = 54). There was no difference in follow-up rates between the Internet and control groups at 6-months (χ² = .03, df = 1, P = .87). There were no significant differences in baseline characteristics between those lost to follow-up and those retained at 6-months for age, weight or any of the secondary outcomes (p > .05). Table 1 presents baseline characteristics of the sample highlighting no difference by group. The age range was 19 to 59 years and comprised 43% students, 41.5% non-academic staff and 15.4% academic staff. Of the study participants, 62 (95%) completed a usable FFQ at baseline, 54 (83%) at 3-months and 53 (82%) at 6-months. Fifty nine (91%) provided step counts at baseline, 50 (77%) at 3-months and 39 (60%) at 6-months. Last observation carried forward was imputed for missing values. Baseline and posttest scores are reported in Table 2. The mean weight was 99.1 kg (12.8) and 52.3% of the sample were obese (BMI>30). The intraclass correlation coefficient (ICC) (95% confidence intervals) for mean steps/day was 0.82 (0.74 to 0.88) for seven days.

Table 1 Baseline characteristics of men randomized to the control and Internet groups

Table 2 Specific values for pretest and posttest scores in the SHED-IT study

Intention-to-treat mediation analyses

Both groups lost weight, but relative to the control group, the Internet intervention did not have a statistically significant 'total effect' on weight, τ = -.507, p = .716 (95% CI = -3.277 to 2.263). The relationships between treatment and hypothesized mediators are reported in Table 3. The effects of hypothesized mediators on weight are reported in Table 4. The intervention did not have a statistically significant effect on any of the hypothesized mediators and none of the mediators were significantly associated with weight. Consequently, none of the hypothesized mediators satisfied the criteria for mediation. Mediated effects and asymmetric confidence intervals are reported in Table 5.

Table 3 Effect of treatment condition on hypothesized mediators (α)

Table 4 Effect of hypothesized mediators on weight controlling for treatment allocation (β)

Table 5 Mediated effect and asymmetric confidence intervals (αβ)

Per-protocol mediation analysis

In the per-protocol analysis, the Internet intervention had a statistically significant 'total effect' on weight, τ = -4.487, p < .05 (95% CI = -8.208 to -.765). Relationships between mediators, treatment and outcome variables are reported in Tables 3 and 4. Similar to the intention-to-treat analysis results, the intervention did not have a statistically significant effect on any of the hypothesized mediators and none of the mediators satisfied the criteria for mediation (Table 5).

Discussion

Few studies have examined potential mediators of weight loss in obesity treatment interventions and this is the first study to explore behavioral mediators in an intervention for overweight men. A product-of-coefficients test was used to assess mediation in the current study because it can be used to establish mediation in small samples, even in the absence of a statistically significant intervention effect [31–34]. In the current study, none of the hypothesized behavioral variables satisfied the criteria for mediation. While this finding is discouraging, it is important for obesity treatment and prevention trials to perform and report mediation analyses even in the presence of null findings [7]. Mediation analyses can help identify sources of methodological or substantive problems [7] and thus improve the design of future interventions.

Estimates of total energy intake decreased by almost 3,000 kJ over the study period, but did not satisfy the criteria for mediation. This suggests that reductions in intake may have contributed to weight loss or that energy intake was confounded by misreporting. In a previous on-line intervention for overweight adults [12], changes in dietary intake were related to weight loss in the behavior therapy and education groups at 3- and 6-months, respectively. In the current study, men in the intervention group reduced their fat in-take, but the reductions did not satisfy the criteria for mediation. Findings from previous weight loss interventions have been mixed. A recent Internet-based intervention had a modest effect on weight loss (-1.3 kg) and no effect on fat intake in a sample of overweight adults [37]. Another study involving overweight African American adolescent girls and their parents [16] found that reductions in fat intake partially mediated changes in BMI among parents in the study. Future versions of the SHED-IT intervention may benefit from revised behavioral messages that include reducing fat intake. Furthermore, tailored feedback focusing on strategies to reduce fat intake may improve weight loss among overweight men.

Although the SHED-IT intervention was a minimal contact program and did not include a delivered physical activity component, increasing lifestyle physical activity was one of the key SHED-IT aims and the intervention included two weight loss tips focusing on the promotion of physical activity (i.e. every step counts and tilt the balance with physical activity). However, changes in physical activity were not related to weight loss in both intention-to-treat and per-protocol analyses, as participants in both groups increased their physical activity over the study period [21]. Previous Internet-based interventions have found that changes in physical activity were related to weight loss among overweight women [11] and overweight adults [12]. The use of unsealed pedometers in the assessment of physical activity may have confounded the results and provided inaccurate and or inflated step counts, particularly at baseline. Pedometers have been successfully used in a number of interventions to increase physical activity using self-monitoring strategies with adults [38], children and adolescents [39]. The basic premise of self-monitoring with pedometers is that the daily step counts act as a reminder of the amount of activity completed by the individual and this in turn, encourages the individual to increase their physical activity.

Participants in the intervention reduced their alcohol intake over the study period, but these changes were not related to weight loss in the intention-to-treat or per-protocol analyses. An important aspect of mediation analysis is that it enables researchers to identify if changes in an intermediary variable contributed to changes in the dependent variable of interest. Studies that fail to use mediation analyses may incorrectly attribute weight loss to unrelated or less important behaviors.

In the current study we did not directly assess the participants' self-monitoring of physical activity and eating at baseline and posttest. However, in the per-protocol analysis, participants who adhered to the on-line tracking component of the intervention were more successful in losing weight compared to non-compliers. Self-management strategies such as goal setting and self-monitoring are important for successful weight loss and maintenance of weight loss [40], so it is not surprising that interventions which facilitate higher rates of self-monitoring result in improved behavior change outcomes [41]. For example, in a study involving overweight adults, Tate and colleagues [42] found that login rates were significantly correlated with weight change in their e-counseling intervention (r = -.47, p = .003) and their basic Internet intervention (r = -.61, p < .001). The identification of techniques to enhance the attractiveness of self-monitoring strategies in on-line weight loss programs should be a research priority.

This study has some limitations that should be noted. First, the study did not include a true control and both groups significantly reduced their weight over the study period. Consequently, the results of our mediation analysis were confounded by the significant reductions in weight experienced by the control group. While the control group received only one information session and booklet focused on weight loss strategies, there were no statistically significant differences in weight loss between intervention and control groups after 6-months. Second, the study lacked statistical power to detect small mediation effects in the study sample and hence a type 2 error may have occurred. Although traditional methods to evaluate mediation, such as the Baron-Kenny method [43] have low statistical power and require large samples, simulation studies have demonstrated that various other tests of mediation can establish statistically significant mediation effects in smaller samples [32, 44]. Third, the current study found only small changes in portion size and these were identified in both the intervention and control groups. There was only a small range of portion sizes reported and future studies may benefit from the inclusion of a more detailed measure of portion size. Fourth, it is possible that some diffusion of treatment may have occurred, as both control and intervention participants were staff and students from the University of Newcastle. Finally, the study did not assess all of the potential weight loss mediators, including 'surf the urge', 'plan your meals' and 'reduce your junk food snacks'. It is possible that the SHED-IT intervention impacted upon these behaviors which in turn contributed to the participants' weight loss.

Conclusion

Although previous studies have examined psychosocial mediators of weight loss in interventions [16], this is the first study to assess behavioral mediators in an intervention for overweight men. Like many obesity prevention and treatment programs, the SHED-IT intervention was based on key behavioral messages related to weight loss and maintenance. The identification of behavioral mediators of weight loss can be used to develop an evidence base of effective weight loss strategies in specific target groups. Further study of psychosocial and behavioral mediators within weight loss studies may help to refine effective intervention components to enhance weight loss outcomes.