Table 2 Details of data collected and analysed to assess and understand fidelity of intervention delivery
Method of data collection | Data collected from or by | Number completed | Response rate | Data collection timeframe | Data collected | Data collection format |
|---|---|---|---|---|---|---|
Phase 1 | ||||||
Teacher training observations | Observing 43 teachers from 29 intervention schools and 2 trainers. (44 teachers were invited to the training but one was unable to attend.) | n = 5 | 100 % of sessions observed | During training sessions | Details on venue, number of trainers present, number of participants, gender | Pro forma layout |
Sessions ran September 2011- January 2012 | Delivery and content of training | Free form text | ||||
Teacher engagement and understanding | Free form text | |||||
Questions or issues raised by teachers | Free form text | |||||
Detailed description of activities | Free form text | |||||
Reflection on the observation process | Free form text | |||||
Teacher training evaluation questionnaire | Teachers | n = 43 | 100 % | Completed at the end of training session | Whether they felt confident that they had enough knowledge to teach the nutrition and physical activity sessions successfully | 5 point scale: strongly agree, agree, don’t know, disagree, strongly disagree |
Whether they felt confident to teach the lessons according to the plans | 5 point scale as above | |||||
Whether they felt they needed more information in order to teach the lessons | 5 point scale as above | |||||
Whether they were confident at fitting all 16 lessons into the allotted time frame | 5 point scale as above | |||||
Indicating 3 key messages of AFLY5 | Free text | |||||
Indicating how useful the day was in terms of preparing for AFLY5 | 3 points: Very useful, useful in places, not useful | |||||
Space for comments if selected ‘not useful’ | ||||||
Phase 2 | ||||||
Lesson observations | Observing 30 lessons being taught in 24 of the 29 schools delivering AFLY5 | n = 30 | 24 out of 30 (80 %) schools had at least one lesson observed | November 2011 to April 2012 | Details of lessons including: number of children, gender, teacher identity code | Pro forma layout |
Observation of the general behaviour of children | 3 point scale: good, acceptable, poor | |||||
Observation of the level of interest and enthusiasm displayed by the children | 3 point scale: high, indifferent, low | |||||
15/16 (94Â %) lessons observed at least once | ||||||
Whether delivery of key outcomes of lesson were met | Yes/no | |||||
Whether resources provided were used | Yes/no | |||||
Whether homework was handed out | Yes/no | |||||
11/16 (69Â %) observed twice | ||||||
More detailed notes including:   ·layout of room   ·children’s behaviour and engagement   ·suitability of content for the ability of the group   ·aspects of the lesson that worked well/less well | Free form text | |||||
Teacher intervention delivery logs | 44 teachers in the 29 schools delivering AFLY5 | n = 44 | 100 % for data on total number of lessons delivered | September 2011- July 2012 | Teachers involved with delivery of AFLY5 | Pro forma table |
Their position in the school (e.g. Newly Qualified, Support Staff, Managerial Scale etc.) | ||||||
39 out of 44 teachers (89Â %) provided partial data on all other aspects of log | ||||||
Whether they attended the AFLY5 training | Yes/no | |||||
Information requested per lesson:   ·Who taught the lesson   ·Date taught   ·Number of children present | Pro forma table | |||||
Amount of time spent preparing for the lesson | Pro forma table recorded in minutes | |||||
Amount of time spent delivering the lesson | ||||||
Whether any other resources were required. | Yes/no options | |||||
 If so, what and how much did they cost | Pro forma table recorded in pounds | |||||
Whether there were any difficulties with the lesson | Yes/no | |||||
 If so, what | Free form text | |||||
Whether any amendments were required | Yes/no | |||||
 If so, what | Free form text | |||||
What they would have been teaching instead of AFLY5 | Free form text | |||||
Who would have led this lesson | Free form text | |||||
Whether there was more or less preparation for AFLY5 than usual lessons | 3 point scale: more, less, same | |||||
Whether the homeworks were handed out | Yes/no | |||||
How many were completed | Free form text | |||||
The quality of homeworks | 3 point scale: good, fair, poor | |||||
  ·teacher’s understanding of subject area   ·delivery style of teacher   ·input from other staff members   ·if the lesson was taught according to the plan   ·reflections on the research process |  | |||||
Any extra comments on both a per lesson basis, as well as at the end of the log | Free form text | |||||
Phase 3 | ||||||
Interviews | 20 teachers from 15 of the 29 schools delivering AFLY5 | n = 20 | 20 out of 44 teachers (45 %) | October 2012 to April 2013 | Semi structured interview questions on the following topics:   ·What contributes to a healthy lifestyle both generally and for children   ·Teaching health promotion in schools   ·Whether they were involved with any health promotion projects   ·Whether school-based health promotion education is effective in changing children’s behaviour  *Their experience of teaching AFLY5 | Audio recording/transcript |
  Teachers | ||||||
|  | Face to face = 14/20 (70 %) | |||||
Mean length of interview = 32 min | ||||||
Range = 17–57 min | ||||||
Phone = 6/20 (30 %) | ||||||
Mean length of interview = 35 min | ||||||
Range = 28–42 min | ||||||
  Parents | Parents from the purposive sample of 6 schools delivering AFLY5 | n = 14 (one interview had two parents present so counted as two for number of participants but as one when calculating mean/range of interview time) | 14 out of 18 (78 %) | October 2012 to April 2013 | Semi structured interview questions on the following topics:   ·What contributes to a healthy lifestyle both generally and for children   ·Whether they were aware of their children taking part in healthy lifestyles lessons at school   ·Whether their child had bought home any homeworks or information relating to healthy lifestyles | Audio recording/transcript |
Face to face = 7/14 (50 %) | ||||||
Mean length of interview = 39 min | ||||||
Range = 28–52 min | ||||||
Phone = 7/14 (50 %) | ||||||
Mean length of interview = 40 min | ||||||
Range = 23–53 min | ||||||