Skip to main content

Initial insights into the impact and implementation of Creating Active Schools in Bradford, UK

Abstract

Background

Few whole-school physical activity programmes integrate implementation science frameworks within the design, delivery, and evaluation. As a result, knowledge of the key factors that support implementation at scale is lacking. The Creating Active Schools (CAS) programme was co-designed and is underpinned by the Capability, Opportunity, Motivation and Behaviour (COM-B) model and the Consolidated Framework for Implementation Research (CFIR). The study aims to understand the initial impact and implementation of CAS in Bradford over 9 months using McKay’s et al.’s (2019) implementation evaluation roadmap.

Methods

Focus groups and interviews were conducted with school staff (n = 30, schools = 25), CAS Champions (n = 9), and the CAS strategic lead (n = 1). Qualitative data were analysed both inductively and deductively. The deductive analysis involved coding data into a priori themes based on McKay et al’s implementation evaluation roadmap, using a codebook approach to thematic analysis. The inductive analysis included producing initial codes and reviewing themes before finalising.

Results

Identified themes aligned into three categories: (i) key ingredients for successful adoption and implementation of CAS, (ii) CAS implementation: challenges and solutions, and (iv) the perceived effectiveness of CAS at the school level. This included the willingness of schools to adopt and implement whole-school approaches when they are perceived as high quality and aligned with current school values. The programme implementation processes were seen as supportive; schools identified and valued the step-change approach to implementing CAS long-term. Formal and informal communities of practice provided “safe spaces” for cross-school support. Conversely, challenges persisted with gaining broader reach within schools, school staff’s self-competence and shifting school culture around physical activity. This resulted in varied uptake between and within schools.

Conclusions

This study provides novel insights into the implementation of CAS, with outcomes aligning to the adoption, reach, and sustainability. Successful implementation of CAS was underpinned by determinants including acceptability, intervention complexity, school culture and school stakeholders’ perceived self-efficacy. The combination of McKay’s evaluation roadmap and CFIR establishes a rigorous approach for evaluating activity promotion programmes underpinned by behavioural and implementation science. Resultantly this study offers originality and progression in understanding the implementation and effectiveness of whole-school approaches to physical activity.

Background

Children’s physical activity levels remain consistently low, with 60% not meeting global recommendations [1,2,3]. Deepening health inequality, levels of inactivity are higher in areas of high deprivation and diverse ethnic minority communities - especially of South Asian heritage [4, 5]. Schools are seen as a key setting within which to intervene to increase children’s physical activity levels [6]. Yet, recent review-level evidence suggests that previous school-based physical activity interventions only achieved small, unsustained improvements [7,8,9]. Of further concern, positive effects observed in efficacy and effectiveness trials often diminish - known as a voltage drop [10] - as programmes scale for broader implementation and effectiveness [11, 12].

UK and international guidance promotes whole-school approaches as a “best investment” to tackle childhood inactivity due to engaging a large number of diverse children over an extended period [13,14,15,16]. However, there is a lack of understanding of what constitutes a whole-school physical activity approach [17], programmes failing to recognise schools as complex adaptive systems [17] and taking a context specific approach [18], limited multi-stakeholder input in programme design [19] and poor use of implementation theory within programme design, delivery and evaluation [20]. Resultantly, programmes often focus on providing single or multi-component opportunities for children to be physically active [21, 22], and fail to address the higher-level systems issues such as policy, environments and the role of different stakeholder groups. Integrating implementation science frameworks within the development of whole-school approaches reinforces the importance of moving beyond addressing school stakeholders’ delivery of physical activity to also consider higher-level system factors [23].

The Creating Active Schools (CAS) framework [17] responded to calls for the co-production of school-based activity promotion programmes [19] by involving nine stakeholder groups in the initial design process. The framework informed the rigorous development of the CAS programme, embedding behavioural [24] and implementation science [25, 26] in the design, delivery and evaluation of a programme focussed on organisational and cultural change for physical activity in schools [27]. The CAS programme is underpinned by the Consolidated Framework for Implementation Research (CFIR), a conceptual framework that organises implementation domains across five domains: (i) characteristics of individuals (school stakeholders), (ii) inner setting (schools), (iii) outer setting (beyond the school), (iv) intervention characteristics, and (v) implementation processes [25]. Despite preliminary evidence on the effectiveness of CAS [27], little is known about the determinants that influence initial implementation. Moreover, while CFIR is widely adopted in healthcare research [28,29,30,31], there has only been a limited use within whole-school physical activity and wellness programmes [32, 33].

This study was designed to address these issues through an evaluation of CAS implementation, guided by the recent implementation evaluation roadmap [34] which provides a minimum data set of indicators to rigorously evaluate school-based physical activity programme implementation [26, 34]. The framework establishes a “common language” for five implementation outcomes – defined as the effects of deliberate actions to implement and scale up an intervention [35] – and 10 implementation determinants – referring to the range of contextual factors that influence implementation and scale-up in schools [36]. Evaluating CAS implementation using a rigorous framework provides a valuable scientific contribution to the implementation science field related to whole-school physical activity; with a specific contribution to schools in deprived communities. The study aims to understand the initial impact and implementation of CAS and to address three key objectives:

  1. 1.

    To establish the implementation processes and practices in schools that have adopted CAS.

  2. 2.

    To identify the key innovation characteristics of CAS that are related to successful school adoption and implementation outcomes.

  3. 3.

    To assess initial perceptions of CAS and its impact on enhancing policy, stakeholder behaviour, environments, and opportunities to facilitate whole-school physical activity provision.

Methods

Intervention

CAS programme implementation in Bradford began in September 2021. The programme focuses on schools assets (e.g., facilities, environments, staff, capacity) to promote behaviour change using the COM-B framework [24] across four areas: (i) policy, (ii) environments, (iii) stakeholders, and (iv) opportunities (Fig. 1). For further programme details refer to Helme et al., [27]. The programme was developed by a CAS strategic lead based in Bradford with the continuous support of the CAS national team (Yorkshire Sport Foundation, University of Bradford, and Bradford Institute for Health Research). Schools in Bradford (n = 57) were recruited through three delivery models, all of which provided different amenities and funding opportunities (see Fig. 2).

Fig. 1
figure 1

Creating Active Schools Framework

Fig. 2
figure 2

CAS Delivery Model in Bradford

The CAS national team recruited locality leads (CAS Champions; n = 11) from local schools and public health teams to support schools to implement CAS. They onboarded schools to the programme and supported them through the four-stage CAS process, trained in-school CAS leads and developed inter-school communities of practice (CoP). CAS Champions received two days of training provided by the CAS national team and regular support via webinars and face-to-face meetings with the Bradford CAS strategic lead throughout the year.

Once recruited, schools took part in the four-stage annual CAS cycle (see 27). In brief, this included (i) in-school CAS leads completing the profiling tool to assess current whole-school physical activity provision, (ii) in-school CAS leads completing a Planning for Change document using the APEASE quality assurance criteria [37] to identify evidence-informed initiatives, (iii) CAS Champions supporting the implementation of individual and collective school initiatives, and (iv) schools evaluating initial impact to inform the next annual cycle. Further school-based support was provided via termly formal CoP for all schools, which included networking opportunities, sharing case studies and bespoke professional development.

Design

This study used a qualitative descriptive design [38] involving semi-structured focus groups and interviews to gather contextually rich data and understand the diversity of experiences associated with CAS participation. Ethical clearance was granted by the University of Bradford Research and Innovation Services (reference = E926).

Selection and recruitment

To gain multiple perspectives on CAS implementation in Bradford, recruitment took part in two phases. Phase one included inviting in-school CAS leads, teachers, and members of school senior leadership teams (SLT) that were attending the 2022 summer CoP (June 2022; n = 25). Phase two involved inviting the CAS Strategic Lead (n = 1), Living Well CAS Champions (n = 3) and Join Us Move Play (JU:MP) CAS Champions (n = 8) who were attending the CAS Champion summer training day (July 2022). Written consent was gained before any focus groups commenced.

Data collection

Phase one took place during the 2022 CAS Summer CoP, whereby six focus groups were conducted with attending school staff (n = 30) from 25 (out of 57) Bradford-based CAS schools. Phase two took place during the CAS Champion training day (July 2022), whereby three focus groups took place with attending CAS Champions (n = 9). In addition, a semi-structured interview was conducted with the CAS strategic lead. One of three authors led the focus groups and the interview (JLM, AC, ZH). No prior relationships existed between interviewers and interviewees. All discussions were audio recorded and lasted between 36 and 67 min (M = 53 min).

The semi-structured interview and focus group guides were ordered into three sections: (i) adoption and attrition, (ii) effectiveness, and (iii) implementation (supplementary file 1). Recordings were transcribed verbatim by the first author and re-checked for accuracy before anonymisation.

Data analysis

Analysis incorporated both a data-driven inductive approach using codebook thematic analysis [39] and a deductive approach guided by a priori themes based on McKay et al’s [34] implementation evaluation roadmap. We amended the adoption construct as the definition in McKay et al’s [34] did not align with the CAS programme (see Table 1).

Table 1 Overarching themes, descriptions, and subthemes

Once transcribed, transcripts were read and reread to become familiar with the breadth and depth of the data and to generate preliminary coding ideas and notes. A coding template was generated in Microsoft Excel with rows representing a priori themes. JLM led the analysis, supported by AC, OT, and EY. Data were copied into the matrix from transcripts and referenced, allowing the source to be traced and the process to be examined and replicated. Analytic memos were produced to capture impressions and early interpretations. If new codes were proposed that fell outside of, or disagreed with, the agreed coding frame, then they were revised by the four researchers and transcripts were re-read considering the new structure. Codes were collected under the a priori themes before comparing coding clusters together. Coding was hierarchical with variation in a given theme being coded under sub-themes. For example, within the ‘Complexity’ theme, we identified the sub-themes of ‘Multiple health-based projects in Bradford causing perplexity’, ‘Initial bewilderment alleviated over time’ and ‘CAS Champion support increasing clarity for school staff’. Trustworthiness was maximised by conducting checks of agreement in interpretation through double coding (AC, OT, EY) and verifying different coders found relevant text using code descriptions. Interpretations were openly discussed and challenged by critically probing for explanations to achieve a final consensus. Additionally, the inclusion of supporting quotations from the range of participants that were interviewed enhanced trustworthiness [40].

Results

Participants consisted of a CAS strategic lead, CAS champions, SLTs, teachers, and wider school staff (see Table 2). Twenty-two of the 30 school stakeholders adopted the role of ‘in-school CAS lead’. Of which, 14 (64%) were a Physical Education (PE) lead (and a class teacher), PE teacher or coach, four (18%) were class teachers, three (14%) were SLT and one (4%) was also a Special Educational Needs and Disabilities (SEND) lead.

Table 2 Summary of participants by stakeholder group

Data were coded across all of the 15 a priori themes. One additional theme was identified around the perceived effectiveness of CAS (Table 1). Due to the magnitude of the data, we decided to not include sub-themes that were specifically related to the geographical context of the Bradford locality and which fell outside of the scope of this study. A more comprehensive summary of themes, sub-themes, example quotes, and alignment with CFIR is presented in supplementary file 2. Themes are presented below aligning with the study’s objectives: (i) key ingredients for successful adoption and implementation of CAS, (ii) CAS implementation: challenges and solutions (iv) the perceived effectiveness of CAS at the school level. To facilitate understanding, key themes are presented in bold, with sub-themes identified by superscript numbers within the text (Table 1).

Key ingredients for successful adoption and implementation of CAS

Many school stakeholders referred to the CAS ethos when discussing their decision to adopt. CAS was perceived to align with, and address, existing school priorities and/or concerns over pupils’ health (1.1), for example:

“I know my head was very passionate about it because of the obesity levels obviously in Bradford and specifically the report coming out about life expectancy. I think that was the main driving force for us.” P20, PE Lead

Similarly, many schools highlighted that CAS complimented existing school development plans and could help alleviate Bradford’s stark health inequalities by promoting more physical activity opportunities(1.2). CAS was seen as compatible, meeting an identified need in school, and contributing to the school vision(10.1). CAS Champions felt using local Bradford data on health, obesity and inactivity was a compelling approach to get schools on board:

I think health statistics are really good and obesity statistics, particularly in our district in Bradford, have been the most heroine to our schools….Because studies from America are great when they show the importance of physical activity. But like getting real-life Bradford data has been the most empowering so far” P2, CAS Champion

School staff were aware of broader (community-based) projects in Bradford and felt CAS was complimentary, adding value as part of a systems-based approach “bringing together the community better, hearing a bit more about the wider impact of how we’re making children more active” (P24, Teacher)(6.3, 10.2). Some schools admitted the financial incentive piqued their initial interest(1.3). This was a driver for adoption within many schools, although not all, as some school stakeholders commented on the need for evidence-based decision-making to ensure that they were “actually doing it the right way around” (P32). Not all eligible schools adopted CAS, and Champions suggested that SLTs within the schools didn’t feel they needed additional support for physical activity provision(1.4) and could not see the value of what CAS had to offer(10.3). For example, P2 said schools not engaging typically felt they could “do it themselves or they already feel that they’re active enough” (CAS Champion).

Schools identified CAS as an acceptable programme, with anticipation of the benefits to the school and enthusiasm to get started (7.1). In-school CAS leads were eager to talk to their Champions to share their progress and plan future training and CPD opportunities. General satisfaction with the CAS programme was consistently mentioned by many(13.1), for example: “Creating Active Schools has been fantastic” (P19, PE Lead). The formal CoP and encompassing networking opportunities provided by the CAS team were consistently praised(13.3). Staff felt the formal CoPs provided opportunities to reflect on progress and connect with other schools. This resulted in the development of CoPs with reciprocal school visits and mutual support.

CAS Champions and strategic lead support were consistently praised by school staff(13.2). This included providing support with CAS documents (e.g. the Planning for Change document), arranging visits to other schools to observe practices and changes in provision due to CAS, and providing CPD opportunities for staff to promote wider school buy-in(7.2). The initial complexity of the programme and how it was operationalised was alleviated over time due to the support and flexibility of the Champions(14.2, 14.3):

“I just want to say that I wouldn’t have been able to do it without my CAS Champion with me. I’d still be just looking at this, so confused. He’s been really helpful.” P21, Teacher

This tied into the adaptability of CAS to increase usability. School staff highlighted the flexibility of the CAS framework to find “what works for your school” (P37) and the support from the CAS team to simplify aspects of the CAS programme(8.1, 8.2). P23 said, “P1’s really good and he changed all the planning documents and made it very simple into a clear action plan that we chose”.

School staff were aware that implementation of CAS required an iterative step-by-step approach to promote sustainability from the outset and embed CAS into the heart of the school. This meant that in-school CAS leads and other school staff were committed to taking the necessary time to make informed decisions about implementing changes and spending money(5.1). For example, P20 said, “it is a really slow process, it doesn’t need to be immediate, it is gradual, it’s sustainable” (PE Lead). This awareness came hand-in-hand with the knowledge that CAS was facilitating a whole-school physical activity culture shift (12.1):

“It’s a culture change, but it’s not a small culture change if you want to do this properly, it’s a massive culture change for the whole-school, for every member of staff that’s in there, for the children, for everyone, and it is a big deal and that’s a difficult thing to have to get everyone on board with immediately. I think because you’ve so many things given to teachers all the time that come and go that are not sustainable” P39, PE Lead

CAS implementation: challenges and solutions

There was limited visibility and reach of CAS in schools, identified by school staff, senior leaders, and CAS Champions(3.1). P13 said: “Well, I think my school… if you said CAS they might not know what you meant” (PE Lead). To increase the reach of CAS, some in-school CAS leads reported that CAS-related training opportunities helped(3.2). One school established a working group to help share responsibility and maintain momentum:

“If you give it to a select group of people who are going to focus on it every year, all year….. next year, when those teachers move to a different year group, like our year six teachers go to year four, they can pass it on to the new teacher, and so on.“ P17, PE Lead

For some participants, the existing school culture meant CAS was often perceived as synonymous with PE and sports (12.5). This was demonstrated by SLTs typically delegating the in-school CAS role to their PE lead(12.4). Furthermore, there were misconceptions about physical activity and how it may replace PE time, rather than providing additional opportunities, for example, P1 said, “we’re at risk of lowering physical activity behaviours in terms of accelerometer measurement because we’re going from 2 PE sessions to a PE session and active enrichment” (CAS strategic lead).

Senior leaders and school staff shared concerns about their ability to prioritise CAS and demands of accountability associated with other curriculum areas as defined by Ofsted(6.4). Schools focussing on core subjects believed they had less capacity to implement CAS compared to schools that “have got their maths and English right… have a little bit more wiggle room”(P3, CAS Champion). Similarly, in-school CAS leads highlighted feasibility concerns over implementing CAS due to their lack of time and competing demands(9.1). For some, there was a sense of not taking full responsibility as they expressed wanting more contact from their Champions to prompt action.

The impact of COVID-19 presented both opportunities and challenges(6.1) to implementation. Some staff members felt CAS-related activities “did grind to a bit of a halt because of Covid” (P20, PE lead). Conversely, CAS Champions observed improvements in engagement with some schools, for example: “Because of COVID, we’re just in a better place and we’ve got better relationships, we know which schools are our best schools to work with and that want to work with us” (P2, CAS Champion).

While SLT support for CAS was seen to leverage whole-school buy-in to the programme(12.3), participants expressed difficulties with wider staff buy-in(12.6). P7 explained SLTs have a significant influence on establishing school culture and supporting change: “I think SLT are big drivers for any change in a primary school, I think they sometimes underestimate what a big impact they have across their school” (P7, CAS Champion). Challenges included perceived capacity concerns, a lack of interest in physical activity and difficulties in making changes to their daily routine to incorporate CAS. For example:

“I think they think, this is too overwhelming, you want me to go outdoors, you want me to stop what I’m supposed to be doing and do something completely different and be more active and how am I supposed to do that? I think it’s a lot of training and just educating them that this is a positive thing, it’s not adding to workload, it might make it a little bit easier.“ P22, PE Lead

Some school staff reported a mindset shift during implementation(12.7). This included an increase in knowledge and understanding of physical activity and CAS. Staff’s perceived self-efficacy was improved, typically due to CAS-related training increasing their confidence(15.1). For example, P13 said, “One of the Year 3 teachers, she said, oh it was just brilliant, like the orienteering training and then to give her the confidence” (PE Lead). There was an initial apprehension of CAS and the perceived programme complexity for both SLT and in-school CAS leads. Attending the first CoP was initially overwhelming due to the limited understanding of what CAS entailed and who else was involved, but over time this was alleviated(14.2). The organised networking opportunities helped staff feel at ease when they realised other school staff were also getting to grips with what the programme entailed. In-school CAS leads that got involved later in the academic year did not share this confusion. Similarly, the administrative tasks (e.g. profiling tool) were seen as “quite labour intensive let’s say particularly at the beginning, but it is useful” (P29, SLT). However, with hindsight, staff benefitted from the clarity it provided to their current physical activity provision which allowed them to effectively action plan(13.4).

At the locality level, there was variability among CAS Champions’ perceived self-efficacy about the role(15.2). This was highlighted by the strategic lead due to their differing backgrounds and skill sets. Due to time pressures, there were limited opportunities for CAS Champion training before school implementation began(6.6). The need for future training to better equip the Champions and provide parity in the type of support they could provide was acknowledged. This included additional training to support Champions in checking and challenging schools to ensure fidelity and integrity with the profiling tool and Planning for Change document(4.1).

CAS Champions reflected that in-school CAS leads needed autonomy to make decisions, particularly to ensure that any changes made due to CAS would be feasible(9.2). Where in-school CAS leads were unsupported or unable to galvanise commitment from wider school staff, CAS Champions highlighted that implementation was limited. Similarly, in-school CAS leads in some schools felt that without SLT support, their ability to create change was limited(13.2). Finally, there were concerns over how staff turnover may negatively impact CAS implementation(6.5). Drawing on past project experience, P35 said: “I’ve been involved in a few [projects] over the years in Bradford and that happened, something comes out and it’s amazing and then the person that leads it goes and then it’s not… no one does it anymore.” (SLT). Some staff had concerns about how to alleviate this as well as upskilling and training new staff each academic year. Similarly, SLT felt that sustainability was reliant on the continuation of CAS champion support (5.2). Conversely, a school that had amended its school development plan and school priorities were not as concerned with the CAS lead stating “I know it’ll carry on at that school anyway so I don’t need to be there. I’m probably the man on the ground doing it, I know that [the head is] in the background doing it…” (P40, Coach).

Perceived effectiveness of CAS at the school level

The perceived effectiveness theme included positive changes across all four aspects of the CAS framework: school policy(16.1), the school environment(16.2), school-based stakeholders(16.3), and increases in physical activity opportunities(16.4). This included – in some schools – changes to school policies and development plans, as P18 highlighted “So, we got written into school improvement plan that we would look at physical activity and the physical activity had to improve” (PE Lead). Those on board with CAS as a sustainable approach to whole-school physical activity wanted to see more systemic changes taking place(12.1, 16.1). That said, some staff members were disappointed to not see policy changes in their schools(12.2). Influencing stakeholders and empowering school staff resulted in schools accessing additional funds which positively impact the environment:

“By working with the staff as stakeholders, we’ve then been able to address the environment. So, for example, one of our schools has just a concrete playground. But because we worked with lunchtime staff there, we empowered them, we encouraged the play at lunchtimes, they’ve now got £50k worth of outdoor grants to build up their outdoor space” P2, CAS Champion

There was a clear emphasis on increasing physical activity opportunities across most schools and Champions felt the same, often wanting to focus on policy but ending up discussing opportunities(16.4). These ranged from “active travel” (P40, Health & Wellbeing Coach) to “active enrichment” (P23, SLT) and new afterschool clubs that were “not football or cricket, it’s archery and nature and Jujitsu and fencing, sports they don’t normally do” (P21, Teacher). School staff discussed the perceived impact on children’s physical activity levels and classroom behaviour(16.5). One school used digital devices to track changes in steps, and another started to see behaviour benefits from incorporating movement breaks within the timetable to help “reset” the children.

Discussion

This study used both the implementation evaluation roadmap [34] and CFIR [25] to provide insights into determinants that influenced the locality-based implementation of a whole-school programme focussed on creating organisational and cultural change for physical activity. CAS is the first whole-school physical activity approach that is informed by a co-developed framework [17], underpinned by both behavioural and implementation science. Findings demonstrated the willingness of schools to adopt and implement a whole-school approach when perceived as high quality and aligned with current school values. In contrast, schools identified challenges with wider school buy-in, shifting school culture and building staff competence. The CAS approach was perceived in a supportive light due to focusing on small incremental changes that were sustained over time, rather than short-term fads. Formal and informal CoPs provided “safe spaces” for support and developing new physical activity practices. The support structure of using CAS Champions and in-school CAS leads facilitated the change process across schools. Challenges remained with achieving wider reach within some schools, resulting in varied implementation. While some schools managed to facilitate policy-level changes, the majority of schools focussed on physical activity opportunities. To reflect the use of implementation science in the design of the CAS programme and promote transferability of the findings across whole-school physical activity research, the key findings are discussed in relation to the CFIR domains [25].

Aligned to the characteristics of individuals, participating school staff were enthusiastic to adopt CAS. Similar to previous research, wider staff buy-in was challenging due to a perceived lack of time and capacity [41, 42], rather than dissatisfaction with the programme. These findings suggest school stakeholders’ lacked readiness for change, which may be indicative of wider school culture. To broaden engagement, the diffusion of innovation curve suggests a need to demonstrate the value of CAS and increase programme support to engage early and late adopters [43]. That said, in-school CAS leads highlighted an improvement in their colleagues’ self-efficacy after attending CAS training. Positive changes in teacher and wider school staff behaviour to adopt and implement CAS were also observed within the same population in a complementary study focussed on assessing organisational change in physical activity [27]. Combined, there is a need for future whole-school physical activity programmes to broaden initial training beyond in-school leads. The challenge persists in how to deliver this at scale with a potential need for online programmes which have demonstrated effectiveness in previous school-based physical activity programmes [33].

Aligned with the inner setting, CAS was embraced by school SLTs and in-school leads after nine months. Similar to previous work, where SLTs were proactive in programme implementation, greater reach was achieved [44]. Given the focus on the initial nine months of the programme, we would expect broader reach to occur as time progresses due to the development of in-school CAS working groups, CAS training in school and increased opportunities for wider staff to attend CoPs. Essential to the implementation process was the assignment of the in-school CAS lead to a middle or senior leader. This was to prevent the conflation of physical activity and PE and to ensure higher-system support to facilitate the structural changes required as part of the CAS programme. Even so, 64% of the sample were PE leads, which may lead to the disengagement of wider-school staff due to CAS being seen as the “PE leads’ job”. Therefore, future programmes should develop strategies to overcome this issue if whole-school leadership for physical activity is to align with existing PE leadership. This issue links to a broader debate and the need to differentiate PE, school sports and physical activity at all levels of the school system [45].

Financial incentives encouraged SLT to adopt CAS, which aligns with CFIRs outer setting construct. Following initial uptake, SLT quickly understood the ethos of CAS focusing on sustainable changes towards whole school physical activity, which was demonstrated in the adoption reasons quickly moving away from the initial financial interest. Our findings align with a school-based physical activity initiative in Ireland where adoption was also incentivised through rewards [46]. While incentives positively influenced initial buy-in, a concurrent CAS evaluation identified no differences in programme effects between schools with and without financial incentives [27]. Concerning intervention characteristics, other adoption reasons aligned with schools perceiving CAS as a professional development programme that met their needs and priorities around enhancing children’s health outcomes. Specifically, the use of local obesity and premature mortality data enhanced CAS adoption. While data with statistical power and larger sample sizes offers rigour within the research world, producing and/or identifying local data may be of greater benefit to increase adoption rates and in-school buy-in. Linked to the intervention characteristics (e.g. relative advantage, cost), for some, adoption was initially fuelled by incentives, yet as time progressed, recognition that CAS could genuinely create systemic change for physical activity influenced sustained implementation.

Similar to previous work, the CAS implementation processes were valued by schools as they were able to trial strategies and take a step-change approach [47], making small sustainable gains each academic year. This was supported by schools showing an appetite to commit to CAS long-term, given their appreciation of CAS as a system change approach, demonstrating a positive culture within the inner setting. Similarly, the SWITCH wellness intervention - underpinned by implementation science - reported a shift in school culture, with schools sharing their plans to continue the programme despite experiencing challenges [32]. Combined, these findings support a need to move beyond single and multi-component approaches [22] to programmes that address higher system factors (e.g. such as policy and environments) that are characteristic of whole-school approaches.

The formal networking opportunities - as part of the characteristics of the intervention - were essential for providing programme and peer-to-peer support and reducing perceived programme complexity. Within and between schools informal CoPs emerged to support staff to implement physical activity opportunities and implement higher-level systems change. As seen in previous research, this support offers an effective and sustainable way to continuously learn from one another [48]. CAS Champions provided the greatest influence at the school level through their relationships with in-school CAS leads and by brokering school-to-school opportunities to share learning. Similarly, previous research has highlighted the need for practitioners to engage in a CoP [49,50,51] to help share passion and enthusiasm for the whole-school approach with peers in a supportive environment [52].

Future recommendations

Analysis using the CFIR [30] and the implementation evaluation roadmap [34] provides an integrated understanding of implementation determinants across the different school-based domains; providing valuable insights for future research and practice. While incentivisation was important to some schools for initial buy-in, the perception of the programme as a professional and comprehensive approach to creating effective systemic change, promoted ongoing engagement. Future research is needed to better understand the implementation determinants of whole-school physical activity approaches across wider contexts, both within and beyond the UK, to gain broader insights. Further, essential work is required on how to reduce the initial intervention burden and perceived complexity of whole-school approaches, which, in turn, may increase the reach within schools. This can be achieved by understanding how we can support school stakeholders who have initial apathy or resistance to physical activity.

Strengths and weaknesses

The current study is the first of its kind to use the implementation evaluation roadmap [34] framework to understand implementation determinants within a whole-school physical activity programme. Moreover the use of CFIR (as a determinant framework) and the implementation evaluation roadmap (as an implementation evaluation framework) provided a comprehensive approach to examining implementation concepts and constructs. Such an approach has been advocated when conducting population health intervention research [53]. Some limitations should also be noted. While CAS is designed as a multi-year programme, the implementation evaluation has taken place for the initial nine months where adoption and sustainability considerations were high. Additional investigation is warranted to track changes to implementation outcomes and determinants over the intended scope of the program. As data collection took place at a formal CoP, the sample was limited to schools that may have been engaged in CAS at a deeper level. Our sample did not include schools that decided not to adopt. Despite this, CAS Champions were involved in the initial recruitment and were, therefore, able to report on schools that did not adopt CAS. Furthermore, while we spoke to one-to-two representatives per school, which has produced insights at the whole-school level, speaking to more in-school staff may garner greater insights at the stakeholder level. Finally, the current project offers contextual findings based on the implementation of CAS in the Bradford locality. Bradford was chosen as it is one of the more diverse and poorly resourced areas of the UK, which provides a challenging environment for adoption. Despite this advantage, Bradford also represents a narrow setting and investigating additional localities will support wider dissemination across differing contexts.

Conclusion

The present study reveals novel insights on the implementation of CAS, specifically aligned to adoption, reach and sustainability. The success of CAS implementation in promoting a positive cultural change for physical activity was determined by programme acceptability, intervention complexity, school culture and school stakeholders’ perceived self-efficacy. Drawing on the implementation evaluation roadmap [34] and CFIR [25] established a rigorous method to evaluate a programme underpinned by behavioural and implementation science; progressing the current understanding of whole-school approaches to physical activity. Replicating these methods in similar whole-school approaches to physical activity would improve comparisons in the field and help bridge the gap in understanding the voltage drop in effectiveness when scaling up interventions from efficacy.

Data availability

Summarised data generated and analysed during this study are included in this published article and its supplementary information files.

Abbreviations

CAS:

Creating Active Schools

CFIR:

Consolidated Framework for Implementation Research

CoP:

Communities of practice

References

  1. Aubert S, Barnes JD, Demchenko I, Hawthorne M, Abdeta C, Abi Nader P, et al. Global matrix 4.0 physical activity report card grades for children and adolescents: results and analyses from 57 countries. J Phys Act Health. 2022 Nov;19(1):700–28.

  2. Bull FC, Al-Ansari SS, Biddle S, Borodulin K, Buman MP, Cardon G, et al. World Health Organization 2020 guidelines on physical activity and sedentary behaviour. Br J Sports Med. 2020 Dec;54(24):1451–62.

  3. Sport England. Active Lives Children and Young People Survey: Academic year 2021-22 [Internet]. Sport England; 2022 Dec [cited 2022 Dec 21] p. 1–51. Available from: https://www.sportengland.org/research-and-data/data/active-lives?section=access_the_reports.

  4. Eyre ELJ, Duncan MJ. The Impact of Ethnicity on Objectively Measured Physical Activity in Children. Navia B, Frestedt J, editors. ISRN Obes. 2013 Jan 22;2013:757431.

  5. Love R, Adams J, Atkin A, van Sluijs E. Socioeconomic and ethnic differences in children’s vigorous intensity physical activity: a cross-sectional analysis of the UK Millennium Cohort Study. BMJ Open. 2019 May 1;9(5):e027627.

  6. Anderssen SA. Promoting healthy weight in school children: what does the HEIA study teach us about effective interventions? Br J Sports Med. 2013;47(8):469.

    Article  PubMed  Google Scholar 

  7. Love R, Adams J, Sluijs EMF. Are school-based physical activity interventions effective and equitable? A meta‐analysis of cluster randomized controlled trials with accelerometer‐assessed activity. Obes Rev. 2019 Jun;20(6):859–70.

  8. Neil-Sztramko SE, Caldwell H, Dobbins M. School-based physical activity programs for promoting physical activity and fitness in children and adolescents aged 6 to 18. Cochrane Database Syst Rev. 2021;23(9):CD007651.

    Google Scholar 

  9. Metcalf B, Henley W, Wilkin T. Effectiveness of intervention on physical activity of children: systematic review and meta-analysis of controlled trials with objectively measured outcomes (EarlyBird 54). BMJ. 2012 Sep;27(sep27 1):e5888–8.

  10. Chambers DA, Glasgow RE, Stange KC. The dynamic sustainability framework:addressing the paradox of sustainment amid ongoing change. Implement Sci. 2013;8(1):117.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Lane C, McCrabb S, Nathan N, Naylor PJ, Bauman A, Milat A, et al. How effective are physical activity interventions when they are scaled-up: a systematic review. Int J Behav Nutr Phys Act. 2021 Dec;18(1):16.

  12. Beets MW, Weaver RG, Ioannidis JPA, Geraci M, Brazendale K, Decker L, et al. Identification and evaluation of risk of generalizability biases in pilot versus efficacy/effectiveness trials: a systematic review and meta-analysis. Int J Behav Nutr Phys Act. 2020 Dec;17(1):19.

  13. World Health Organization. Promoting physical activity through schools: a toolkit [Internet]. Geneva: World Health Organization. ; 2021 [cited 2022 Nov 30]. Available from: https://apps.who.int/iris/handle/10665/350836.

  14. World Health Organization. Global action plan on physical activity 2018–2030: more active people for a healthier world. Geneva; 2018.

  15. Public Health England.,. What Works in Schools and Colleges to Increase Physical Activity? A resource for head teachers, college principals, staff working in education settings, directors of public health, Active Partnerships and wider partners [Internet]. Public Health England; 2020 Mar [cited 2022 Dec 21]. Available from: https://www.gov.uk/government/publications/what-works-in-schools-to-increase-physical-activity-briefing.

  16. Milton K, Cavill N, Chalkley A, Foster C, Gomersall S, Hagstromer M, et al. Eight Investments that work for physical activity. J Phys Act Health. 2021 Jun;18(1):625–30.

  17. Daly-Smith A, Quarmby T, Archbold VSJ, Corrigan N, Wilson D, Resaland GK, et al. Using a multi-stakeholder experience-based design process to co-develop the creating active schools Framework. Int J Behav Nutr Phys Act. 2020 Dec;17(1):13.

  18. Jago R, Salway R, House D, Beets M, Lubans DR, Woods C et al. Rethinking children’s physical activity interventions at school: a new context-specific approach. Front Public Health 2023 Apr 13;11:1149883.

  19. Rütten A, Frahsa A, Abel T, Bergmann M, de Leeuw E, Hunter D, et al. Co-producing active lifestyles as whole-system-approach: theory, intervention and knowledge-to-action implications. Health Promot Int. 2019 Feb;34(1):47–59.

  20. Cassar S, Salmon J, Timperio A, Naylor PJ, van Nassau F, Contardo Ayala AM, et al. Adoption, implementation and sustainability of school-based physical activity and sedentary behaviour interventions in real-world settings: a systematic review. Int J Behav Nutr Phys Activity. 2019;16(1):120.

    Article  Google Scholar 

  21. Tibbitts B, Willis K, Reid T, Sebire SJ, Campbell R, Kipping RR, et al. Considerations for individual-level Versus Whole-School Physical Activity Interventions: Stakeholder Perspectives. Int J Environ Res Public Health. 2021 Jul;18(14):7628.

  22. Jones G, Longbon K, Williams S. Exploring the acceptability and feasibility of a whole school approach to physical activity in UK primary schools: a qualitative approach. BMC Public Health 2022 Nov 30;22(1):2236.

  23. McLoughlin GM, Burgeson C, Papa J, Moore JB. Opportunities for policy implementation and advocacy. J Phys Educ Recreation Dance. 2022;93(5):43–50.

    Article  Google Scholar 

  24. Michie S, van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011 Dec;6(1):42.

  25. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009 Dec;4(1):50.

  26. Brownson RC, Colditz GA, Proctor EK. Dissemination and implementation research in Health: translating Science to Practice. Second ed. Oxford University Press; 2018.

  27. Helme ZE, Morris JL, Nichols J, Chalkley AE, Bingham DD, McLoughlin GM et al. Assessing the impacts of creating active schools on Organisational Culture for Physical Activity. Int J Env Res Public Health. 2022.

  28. Fernandez ME, Walker TJ, Weiner BJ, Calo WA, Liang S, Risendal B, et al. Developing measures to assess constructs from the Inner setting domain of the Consolidated Framework for implementation research. Implement Sci. 2018 Dec;13(1):52.

  29. Soi C, Gimbel S, Chilundo B, Muchanga V, Matsinhe L, Sherr K. Human papillomavirus vaccine delivery in Mozambique: identification of implementation performance drivers using the Consolidated Framework for implementation research (CFIR). Implement Sci. 2018 Dec;13(1):151.

  30. Damschroder LJ, Lowery JC. Evaluation of a large-scale weight management program using the consolidated framework for implementation research (CFIR). Implement Sci. 2013 Dec;8(1):51.

  31. Kirk MA, Kelley C, Yankey N, Birken SA, Abadie B, Damschroder L. A systematic review of the use of the Consolidated Framework for implementation research. Implement Sci 2016 May 17;11(1):72.

  32. McLoughlin GM, Sweeney R, Liechty L, Lee JA, Rosenkranz RR, Welk GJ. Evaluation of a Large-Scale School Wellness intervention through the Consolidated Framework for implementation research (CFIR): implications for dissemination and sustainability. Front Health Serv. 2022 Apr;28:2:881639.

  33. Lubans DR, Sanders T, Noetel M, Parker P, McKay H, Morgan P et al. Scale-up of the Internet-based Professional Learning to help teachers promote Activity in Youth (iPLAY) intervention: a hybrid type 3 implementation-effectiveness trial. Int J Behav Nutr Phys Act. 2022 Dec 1;19(1):141.

  34. McKay H, Naylor PJ, Lau E, Gray SM, Wolfenden L, Milat A, et al. Implementation and scale-up of physical activity and behavioural nutrition interventions: an evaluation roadmap. Int J Behav Nutr Phys Act. 2019 Dec;16(1):102.

  35. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, Measurement Challenges, and Research Agenda. Adm Policy Ment Health Ment Health Serv Res. 2011 Mar;38(2):65–76.

  36. Durlak JA, DuPre ED. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41(3–4):327–50.

    Article  PubMed  Google Scholar 

  37. Michie S, Atkins L, Gainforth HL. Changing Behaviour to Improve Clinical Practice and Policy. Dias PC, Gonçalves A, Azevedo Â, Lobo F, editors. Novos Desafios Novas Competências Contrib Atuais Psicol. 2016 Dec 22;41–60.

  38. Sandelowski M. Whatever happened to qualitative description? Res Nurs Health. 2000 Aug;23(4):334–40.

  39. Roberts K, Dowell A, Nie JB. Attempting rigour and replicability in thematic analysis of qualitative research data; a case study of codebook development. BMC Med Res Methodol. 2019 Dec;19(1):66.

  40. Cote L, Turgeon J. Appraising qualitative research articles in medicine and medical education. Med Teach. 2005;27:71–5.

    Article  PubMed  Google Scholar 

  41. Naylor PJ, Nettlefold L, Race D, Hoy C, Ashe MC, Wharf Higgins J, et al. Implementation of school based physical activity interventions: a systematic review. Prev Med. 2015 Mar;72:95–115.

  42. Schaap R, Bessems K, Otten R, Kremers S, van Nassau F. Measuring implementation fidelity of school-based obesity prevention programmes: a systematic review. Int J Behav Nutr Phys Act. 2018 Dec;15(1):75.

  43. Rogers EM. To diffusion of innovation curve. 4th ed. New York: Free Press; 1995. (Diffusion of innovations).

    Google Scholar 

  44. Shoesmith A, Hall A, Wolfenden L, Shelton RC, Powell BJ, Brown H, et al. Barriers and facilitators influencing the sustainment of health behaviour interventions in schools and childcare services: a systematic review. Implement Sci. 2021 Dec;16(1):62.

  45. Cale L. Physical education’s journey on the road to health. Sport Educ Soc. 2021;26(5):486–99.

    Article  Google Scholar 

  46. Belton S, Britton Ú, Murtagh E, Meegan S, Duff C, McGann J. Ten years of ‘Flying the flag’: an overview and retrospective consideration of the active School Flag Physical Activity Initiative for Children—Design. Volume 16. Children: Development & Evaluation; 2020 Dec. p. 300. 12.

  47. Cook CR, Lyon AR, Locke J, Waltz T, Powell BJ. Adapting a compilation of implementation strategies to Advance School-Based implementation research and practice. Prev Sci. 2019 Aug;20(6):914–35.

  48. Goodyear VA, Casey A. Innovation with change: developing a community of practice to help teachers move beyond the ‘honeymoon’ of pedagogical renovation. Phys Educ Sport Pedagogy. 2015 Mar;20(4):186–203.

  49. Lave J, Wenger E, Wenger E. Situated learning: legitimate peripheral participation. 1st ed. Cambridge: Cambridge University Press; 1991.

    Book  Google Scholar 

  50. Castelli DM, Canteio EE, Nicksic HM. Preparing educators to promote and provide physical activity in schools. Am J Lifestyle Med. 2013;7:324–32.

    Article  Google Scholar 

  51. Webster CA, Beets M, Weaver R, Vazou S, Russ L. Rethinking recommendations for implementing comprehensive school physical activity programs: a partnership model. Quest. 2015;67:185–202.

    Article  Google Scholar 

  52. Daly-Smith A, Quarmby T, Archbold VSJ, Routen AC, Morris JL, Gammon C, et al. Implementing physically active learning: future directions for research, policy, and practice. J Sport Health Sci. 2020 Jan;9(1):41–9.

  53. Moore GF, Evans RE. What theory, for whom and in which context? Reflections on the application of theory in the development and evaluation of complex population health interventions. SSM Popul Health. 2017;3:132–5.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

We would like to thank the participating CAS schools, school staff, CAS Champions and CAS national lead for their support and cooperation during the study. We would also like to thank the Yorkshire Sport Foundation and Bradford Teaching Hospital Foundation Trust for the time they have invested in the development and delivery of the Creating Active Schools Programme.

Funding

As detailed in the paper, the implementation of the CAS programme is supported by the Bradford District Metropolitan Council via the Living Well Programme and Sport England’s Local Delivery Pilot Bradford; weblink: https://www.sportengland.org/campaigns-and-our-work/local-delivery. This study was funded through the Higher Education Innovation Fund (UKRI), granted via an internal application process at the University of Bradford. In addition, the time for ADS and ZH was funded via Sport England’s Local Delivery Pilot in Bradford. The views expressed in this publication are those of the authors and not those of the funders. The funders had no role in the study design, data collection, analysis, interpretation of data, and writing of this manuscript.

Author information

Authors and Affiliations

Authors

Contributions

JLM, ADS, AC, GM, and JB conceived the idea of the project. JLM and ADS led the design, secured funding, and drafted the initial manuscript. JLM, AC, ZH and ADS facilitated data collection. JLM, AC, OT, and EY conducted the data analysis and wrote the results. All authors contributed to reviewing and editing the manuscript and have approved the final version.

Corresponding author

Correspondence to Jade L. Morris.

Ethics declarations

Ethics approval and consent to participate

Ethical clearance was granted by the University of Bradford Research and Innovation Services (reference = E926). All participants gave consent to participate in the study.

Consent for publication

Not applicable.

Competing interests

The intellectual property for the Creating Active Schools programme is co-owned between the Yorkshire Sport Foundation (YSF), The University of Bradford and the Bradford Institute for Health Research (BIHR). The YSF is the lead delivery partner for the programme. The University of Bradford and BIHR support the evidence-based development and evaluation of the programme. The CAS programme is funded through fees paid to YSF by localities who opt into the programme. The programme is run on a non-profit basis with any surplus reinvested into the development of further assets and programme support.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Morris, J.L., Chalkley, A.E., Helme, Z.E. et al. Initial insights into the impact and implementation of Creating Active Schools in Bradford, UK. Int J Behav Nutr Phys Act 20, 80 (2023). https://0-doi-org.brum.beds.ac.uk/10.1186/s12966-023-01485-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12966-023-01485-3

Keywords