Skip to main content

Validity, reliability, and calibration of the physical activity unit 7 item screener (PAU-7S) at population scale

Abstract

Background

Validation of self-reported tools, such as physical activity (PA) questionnaires, is crucial. The aim of this study was to determine test-retest reliability, internal consistency, and the concurrent, construct, and predictive validity of the short semi-quantitative Physical Activity Unit 7 item Screener (PAU-7S), using accelerometry as the reference measurement. The effect of linear calibration on PAU-7S validity was tested.

Methods

A randomized sample of 321 healthy children aged 8–16 years (149 boys, 172 girls) from the nationwide representative PASOS study completed the PAU-7S before and after wearing an accelerometer for at least 7 consecutive days. Weight, height, and waist circumference were measured. Cronbach alpha was calculated for internal consistency. Test-retest reliability was determined by intra-class correlation (ICC). Concurrent validity was assessed by ICC and Spearman correlation coefficient between moderate to vigorous PA (MVPA) derived by the PAU-7S and by accelerometer. Concordance between both methods was analyzed by absolute agreement, weighted kappa, and Bland-Altman statistics. Multiple linear regression models were fitted for construct validity and predictive validity was determined by leave-one-out cross-validation.

Results

The PAU-7S overestimated MVPA by 18%, compared to accelerometers (106.5 ± 77.0 vs 95.2 ± 33.2 min/day, respectively). A Cronbach alpha of 0.76 showed an acceptable internal consistency of the PAU-7S. Test-retest reliability was good (ICC 0.71 p < 0.001). Spearman correlation and ICC coefficients of MVPA derived by the PAU-7S and accelerometers increased from 0.31 to 0.62 and 0.20 to 0.62, respectively, after calibration of the PAU-7S. Between-methods concordance improved from a weighted kappa of 0.24 to 0.50 after calibration. A slight reduction in ICC, from 0.62 to 0.60, yielded good predictive validity. Multiple linear regression models showed an inverse association of MVPA with standardized body mass index (β − 0.162; p < 0.077) and waist to height ratio (β − 0.010; p < 0.014). All validity dimensions were somewhat stronger in boys compared to girls.

Conclusion

The PAU-7S shows a good test-retest reliability and acceptable internal consistency. All dimensions of validity increased from poor/fair to moderate/good after calibration. The PAU-7S is a valid instrument for measuring MVPA in children and adolescents.

Trial registration

Trial registration number ISRCTN34251612.

Introduction

Physical activity (PA) is associated with favorable mental and physical health in children and adolescents [1,2,3]. The World Health Organization (WHO) recommends at least 60 min per day of moderate and vigorous physical activity (MVPA) for children aged 5 to 17 years [4]. This recommendation is shared by most European countries, including Spain [5].

Measurement of daily PA is paramount to identify children not meeting current recommendations and implement intervention programs aimed to promote PA that can engage this at-risk population. However, the measurement of true PA is challenging. Objective methods to measure PA, such as accelerometry, are difficult to implement in large-scale epidemiological studies and time-limited settings due to economic and logistic burdens [6, 7]. Additionally, PA measurement by accelerometers has several limitations making it difficult to compare data between studies [8]. In comparison, the administration of PA questionnaires is a cheaper and more feasible method, albeit less accurate, to meet the challenge of measuring PA in children and adolescents. These questionnaires vary in their design and structure (e.g., recorded periods of PA range from 1 day to 1 year) [7] and have been validated in specific population subgroups, which limits the transferability of results. Additionally, most questionnaires for children and adolescents include qualitative questions, ask for details about PA frequencies, and are generally too complex for use in time-limited settings such as the pediatrician’s daily practice [7]. Several short quantitative PA questionnaires are available but were validated in specific populations [9,10,11,12], which limits their use in other populations. Furthermore, these questionnaires are limited for cross-nation comparison of PA. Therefore, brief PA questionnaires are needed to readily identify children not meeting the WHO PA recommendations and assist in PA counseling [13]. For this reason we developed the Physical Activity Unit 7-day Screener (PAU-7S), a brief PA questionnaire developed to measure PA in children and adolescents.

PA questionnaires are generally developed specifically for each study population and research aim due to the impact of ethnicity, culture, behavior, and biology on PA (7). Therefore, the validity of PA questionnaires beyond the target study population is limited. Furthermore, measurement error of self-reported data is a concern. The available calibrated questionnaire-derived PA data, although scant, show promising results [11, 14,15,16,17,18].

The aim of the present study was to determine the reliability and the concurrent, construct, and predictive validity of PAU-7S in a randomized, nationally representative subsample of the PASOS study of children and adolescents aged 8 to 16 years. Additionally, we evaluated the effect of linear regression calibration on each of the three dimensions of PAU-7S validity.

Methods

Participants

This validation study was performed within the frame of a nationwide representative study of Physical Activity, Sedentarism, lifestyles and Obesity in Spanish youth (PASOS). The methodology of the PASOS study has been described in detail elsewhere [19]. In brief, a representative sample from 22 school groups of 4508 children aged 8–16 years and their parents were invited, of whom 3817 agreed to participate (84.7% response rate).

Of this study population, a randomized sample of 389 (10.2%) children and adolescents was invited to participate in the validation study and 369 (94.9% response rate) agreed to participate. For test-retest reliability analysis, 321 participants completed PAU-7S questionnaires at baseline and after 1 week of wearing an accelerometer. After excluding 17 participants with missing or invalid accelerometer data, 304 participants were included in the validity analysis. Participants did not receive any compensation for their participation. The study protocol was approved by the Ethics Committee CEIm Fundació Sant Joan de Déu, Spain (Approval number: PIC-171-18). Parental written informed consent was obtained.

Development and administration of the PAU-7S

The development of the PAU-7S involved three strategies: (i) review of validated PA questionnaires for children; (ii) consulting PA experts from the IMIM-Hospital del Mar Research Institute; (iii) analysis of PA data of the Thao-POIBC [20] and EnKid [21] studies to identify activities that explain the variability of PA in children and young adolescents.

The resulting 7-day PA questionnaire was designed to measure regular PA in a typical week. Most PA questionnaires commonly used with children focus on this timeframe because they show good weekly recall [22]. The PAU-7S questionnaire design considered the usual opportunities to do PA during the day. The online questionnaire included 6 main questions about the previous week: 1. How many days did you go for a walk? 2. How many days were you engaged in active play during recess time? 3. How many days were you engaged in active play during free time after school or during the weekend? 4. How many days did you have Physical Education (PE) class at school? 5. How many days did you play a team sport? (for example: soccer, basket, handball, hockey, and water polo). 6. How many days did you play individual sports? (for example: track and field, eurythmics, dance-ballet, tennis, judo-karate-taekwondo, roller-skating, swimming). For each question, the answering options were presented as a table showing each day with spaces where the children would mark if they spent (i) less than 30 min on the activity that day; (ii) 30 min to one hour; (iii) one hour to one hour and a half; or (iv) more than one hour and a half. Children had to select an option before progressing through the online system. For the second and fourth questions, which ask about physical activity during school time, response options were only shown from Monday to Friday; question 4 did not include time options because a PE class lasts 45 min in Spain. Additionally, two qualitative items were included i) Are any of these sports aquatic activities? (Yes/No) and ii) Were you sick during the past week or did anything prevent you from doing your usual physical activities? The first item was a sub-question of item 5 (How many days did you play a team sport?) and item 6 (How many days did you play individual sports?) The qualitative questions were not used to calculate MVPA.

The PAU-7S was administered the first day the accelerometer was worn and 9 days later, when the accelerometer was taken off by trained personnel. MVPA was calculated based on the sum of all activities, with the exception of walking.

Physical activity measured by accelerometry

PA was measured by the “Actigraph GT3X+” accelerometer (ActiGraph, Pensacola FL- USA), allocating at least 7 days from April to June 2019 for each of the 22 randomized school groups. Children were asked to wear the accelerometer for at least 1 week except while bathing or swimming. The accelerometers were placed on the wrist for the non-dominant hand with a bracelet. The accelerometer data collection protocol was followed by all field workers. A common training session was carried out to ensure the homogeneity of this procedure. The Troiano et al. method [23] was used to identify the time that accelerometers were not worn: periods of 60 min (or more) of zero values were discarded. Data from the accelerometers were considered valid if the accelerometer was worn for at least 4 days with at least 1 weekend day and for at least 10 h between 8 a.m. and 10 p.m. each day. The sampling period was set to 5 epochs (100 Hz) and the outcome was expressed as minutes per day. Chandler et al. cut-off points [24] were used to translate acceleration counts into minutes per week of sedentary, light, moderate, and vigorous PA.

The Actigraph data were downloaded using the software provided by the manufacturer (version 6.0, Actigraph, Pensacola, Florida) and imported into SPSS v21 (IBM, Chicago, IL) for data processing and screening. R package 4.0.2 accelerator (www.datahunter.es) was used to identify wear-time between 8 a.m. and 10 p.m.

Anthropometric variables

Weight, height, and waist circumferences (WC) measurements were taken by trained personnel, with the children in light clothing, without shoes. The measurements were performed using an electronic SECA 899 scale (recorded to the nearest 100 g), a portable SECA 217 stadiometer (to the nearest 1 mm), and a flexible, non-stretch SECA 201 metric tape (to the nearest 1 mm), respectively. WC was measured in the narrowest zone between the lower costal rib and iliac crest, in the supine decubitus and horizontal positions. BMI z-score was computed using age and sex-specific reference values from the WHO [25]. Waist to-height ratio (WHtR) was calculated.

Data collection procedure

Following anthropometric and initial weight, height, and WC measurements, participants completed the first PAU-7S during a group session in the computer room at school (1st PAU-7S). Upon questionnaire completion, they received an accelerometer and verbal instructions on its use. Nine days later, participants again completed the questionnaire (2nd PAU-7S).

Statistical analysis

Participant characteristics were described as mean, standard deviation (SD), and median (inter-quartile range), as appropriate. Distribution of continuous variables between boys and girls were compared using the Student t test for normally distributed variables or Mann-Whitney U test otherwise. Proportion comparisons for categorical variables were assessed using chi-square test. Non-normally distributed variables were log-transformed to achieve normality.

Internal consistency of the PAU-7S questionnaire was tested by Cronbach alpha. Test-retest reliability between PAU-7S-derived basal and 1-week MVPA data was assessed by intra-class correlation coefficients (ICC).

The relative validity of the PAU-7S was assessed by Pearson correlation coefficients comparing MVPA derived by the PAU-7S (test method) to that shown by the accelerometers (criterion standard for validity). Pearson correlation coefficients were classified as follows: > 0.8, very good; 0.61–0.80, good; 0.41–0.60, moderate; 0.21–0.40, fair; and < =0.20, weak [26]. Although the two measurements might be highly correlated, substantial differences between them could exist across the range of values; therefore, we determined absolute agreement between the two measurements by cross-classification and the kappa statistic of tercile distribution of MVPA for both measurements. Concordance between the PAU-7S measurements of MVPA was assessed by kappa values as follows: > 0.8, almost perfect agreement; 0.61–0.80, substantial agreement; 0.41–0.60, moderate agreement; 0.21–0.40, fair agreement; and < =0.20, slight agreement (24).

We further assessed agreement between the two measurements using the original Bland–Altman method [27] and a modified version published by Ludbrook [28]. Both methods calculate the mean of differences between the two measurements and regress it against the mean obtained with each measurement. The method by Ludbrook assumes a possible bias as a function of the mean of each participant and computes the confidence limits accordingly. A mean proportional agreement of 100% between measurements would signify complete agreement; a mean difference of 0 would show complete disagreement between the methods. In addition, we analyzed possible variations in the level of agreement between methods to assess proportional bias. For this purpose, we fitted linear regression models, with the mean instrument differences of MVPA derived by the PAU-7S and accelerometers (MVPA_PAU-7S – MVPA-accelerometers)) as the dependent variable and the mean score of both ((MVPA_PAU-7S + MVPA_accelerometer) / 2)) as the independent variable.

Energy balance is the ratio between energy intake and energy expenditure. Energy expenditure increases with PA [29, 30], which might compensate for excessive energy and its effect on weight gain. Therefore, we hypothesized that a valid construct of the PAU-7S would be inversely associated with body mass index (BMI) and WC. Multiple linear regression models adjusted for sex and age, with anthropometric variables as the outcome and MVPA derived by the PAU-7S as the exposure, were fitted to test construct validity of the PAU-7S. All models were tested for multicollinearity.

To reduce measurement error of the PAU-7S, we performed linear calibration according to Rosner et al. [31]. MVPA derived by accelerometers was regressed against MVPA obtained by the PAU-7S with sex, age, and weight as co-variables. The final calibrated model (MVPA_PAU-7S_calibrated) was as follows: MVPA_PAU-7S_calibrated =183.788 (intercept) + (− 6.374*age) + (1.437*sex) + (0.080* MVPA_PAU-7S) + (− 0.436*weight).

The predictive capacity of the calibration equation was assessed by leave-one-out cross-validation. This iterative procedure predicts the response value of each individual from the model fitted by the rest of the sample. The classification system of interaction between the PAU-7S-derived MVPA, sex, and age was tested.

The Statistical Package for the Social Sciences statistical software package version 21.0 (SPSS Inc., Chicago, IL, USA) was used for all statistical analyses with the exception of leave-one-out cross-validation. This analysis was performed using R package 4.0.2. Differences were considered significant if p < 0.05.

Results

Characteristics of the study population are reported in Table 1. Girls were slightly older, with a higher BMI, compared to boys. At baseline, boys reported higher total PA and MVPA and more minutes spent in team sports and active play outside of school, compared to girls. There was no significant interaction between MVPA derived by the PAU-7S, sex, and age. The comparison of the general characteristics between participants of the validation study (n = 323) and those of the remaining PASOS cohort (n = 3496) revealed no significant differences with the exception of age. Participants in the validation study were somewhat younger (12.3 ± 2.2 years) than the remaining participants of the PASOS cohort (12.6 ± 2.4) (Supplementary Table 1). No significant difference between the sample with accelerometer data (n = 304) and the sample for reliability analysis (n = 321) was found.

Table 1 Characteristics of the study populationa

The PAU-7S showed good test-retest repeatability for total PA and MVPA in both boys and girls (Table 2). The repeatability of each PA activity ranged from moderate to good.

Table 2 Test-retest repeatabilitya of physical activity (PA) recorded by PAU-7S at baseline and after 1 weekb

The Cronbach alpha of 0.76 indicated acceptable internal consistency of the PAU-7S, with a slightly better result in girls than in boys (Table 3). The noncalibrated PAU-7S significantly overestimated MVPA (by 18%) compared to the criterion standard for validity; furthermore, this discrepancy significantly increased (β coefficient 0.428 (0.379;0.478) with higher levels of MVPA (Table 3 and Fig. 1). Overestimation of MVPA was somewhat greater in boys than in girls (Table 3) and in adolescents compared to children (Supplementary Table 2). Table 3 also shows Pearson correlation coefficients between methods, indicating the capacity of the PAU-7S to rank levels of MVPA in children. Pearson coefficients between MVPA derived by the PAU-7S and by accelerometers revealed a fair concurrent validity of the PAU-7S overall as well as separately for boys and girls and for children and adolescents (Supplementary Table 2.

Table 3 Correlation coefficients and between-method agreement of moderate to vigorous physical activity (MVPA) measurements derived by the Physical Activity Unit 7 item screener, noncalibrated and calibrated, and the reference method (accelerometer)
Fig. 1
figure 1

Bland-Altman plot for the agreement of moderate-to-vigorous physical activity (MVPA) derived from the un-calibrated Physical Activity Unit 7 item Screener (PAU-7S) and the accelerometer (N = 301)

The absolute agreement of the PAU-7S as measured by correct cross-classification of tercile distribution of MVPA by the two methods was 46.7% for the entire population; somewhat higher values were observed for boys (48.2%) compared to girls (45.2%) (Table 3). Additional kappa statistics, which account for agreement by chance, showed fair concordance between the two methods, with the identical kappa value in boys and girls (k = 0.24) (Table 3).

Multiple linear regression models adjusted for sex and age revealed an inverse association of MVPA derived by PAU-7S with WHtR (p = 0.014) and standardized BMI (zBMI) (p = 0.077), as shown in Table 4. Calibration models showed a significant collinearity. Therefore, age and sex were excluded from the final model.

Table 4 Multiple linear regressiona of the association between PAU-7S-derived moderate to vigorous physical activity and anthropometric markers of body fat

Concurrent validity considerably improved after linear calibration of the PAU-7S (Table 3). Pearson and ICC coefficients increased to 0.62 for both of these dimensions, with similar results in both boys and girls. The concordance between methods as measured by absolute agreement and kappa statistic improved to 59.2% and 0.50, respectively. The regression coefficients of the MVPA association with zBMI and WHtR slightly increased after calibration of the PAU-7S (Table 4).

The mean agreement between MVPA reported by accelerometers (criterion standard for validity) is shown in Figs. 2 and 3 and the non-calibrated and calibrated PAU-7S data in Figs. 4 and 5. The non-calibrated PAU7s shows a significantly overestimation of MVPA and a significant proportional bias. The predicted difference in MVPA between the PAU7s and accelerometers increased by 0.428 (p < 0–05) and 1.9 * 10− 6 (p > 0.05) min/d per each minute of the mean MVPA obtained by both methods, for the non-calibrated and calibrated PAU7s, respectively. This fact indicates that the calibration of the questionnaire eliminated the proportional bias.

Fig. 2
figure 2

Bland-Altman plot for the agreement of moderate-to-vigorous physical activity (MVPA) derived from the calibrated Physical Activity Unit 7 item Screener (PAU-7S) and the accelerometer (N = 301)

Fig. 3
figure 3

Bland-Altman plot according to Ludbrook (28) for the agreement of moderate-to-vigorous physical activity (MVPA) derived from the un-calibrated Physical Activity Unit 7 item Screener (PAU-7S) and the accelerometer (N = 301)

Fig. 4
figure 4

Bland-Altman plot according to Ludbrook (28) for the agreement of moderate-to-vigorous physical activity (MVPA) derived from the calibrated Physical Activity Unit 7 item Screener (PAU-7S) and the accelerometer (N = 301)

Cross-validation analysis of the predictive validity of the PAU-7S showed a slight reduction of Pearson and ICC coefficients from the original validation sample to the test sample from 0.62 (95% CI 0.54;0.67) to 0.60 (95% CI 0.55;0.0.69) and from 0.62 (95% CI 0.55;0.0.69) to 0.60 (95% CI 0.53;0.67).

Discussion

The PAU-7S showed a good test-retest reliability and acceptable internal consistency. The questionnaire fairly ranked children according to levels of MVPA, with slightly better results in boys and adolescents compared to girls. Most importantly, although the noncalibrated PAU-7S overestimated MVPA, especially at higher levels of activity, linear calibration meaningfully increased the concurrent and construct validity of the questionnaire.

In general, the ability of PA questionnaires to adequately measure PA in children and adolescents is modest at best [32, 33]. Although objective measurement of PA by accelerometry is an option, it is not always feasible due to economic and logistical burdens, and accelerometer-derived data lack information on context and type of activity (7).

The consistency of participant responses across the items of the PAU-7S was determined by Cronbach alpha. In general, all the questionnaire items are supposed to reflect the same underlying construct, and therefore should be correlated with each others [34]. The internal consistency of the PAU-7S is within an acceptable range (Cronbach alpha =0.76) [35] and comparable to that of other PA questionnaires used in youth [36, 37]. Test-retest reliability for total PA and MVPA derived by the PAU-7S was good overall and not meaningfully different between boys and girls. The observed ICC for MVPA was lower than that of the Spanish adaptation of the Physical Activity Questionnaire for Children (PAQ-C) [37]. However, the nearly perfect test-retest repeatability (ICC 0.96) of the PAQ-C is likely due to the short timeframe for the second administration of the questionnaire, within 6 h of baseline. A recently published work in 712 Spanish children and adolescents showed a good test-retest reliability for the Spanish version of the Youth Activity Profile (YAP) questionnaire [38]. The YAP questionnaire was administered 2 weeks apart, yielding an ICC of 0.66 and 0.72 in children and adolescents, respectively. The ICC of the test-retest reliability of the PAU-7S after 9 days is comparable to that found by Martínez-Gómez and colleagues for the Spanish version of the PAQ-A (for adolescents), administered with a 1-week retest timeframe [36]. Furthermore, the PAU-7S showed considerably better test-retest reliability compared to the short form (7 items) of the International Physical Activity Questionnaire (IPAQ; IPAQ-SF) administered in Norwegian adolescents [39].

In the noncalibrated PAU-7S data, MVPA was overestimated by 11.4 min per day in comparison to accelerometer-derived MVPA. This is considerably lower than the IPAQ-A overestimation by 39.8 min of MVPA in Spanish adolescents [40]. Furthermore, the IPAQ-SF overestimates MVPA in a range from 36 to 173% in five studies, whereas one study reports an underestimation of 28% [41].

The Spearman correlation of 0.31 for concurrent validity in the present study falls within the range reported for most PA questionnaires for youth [22, 33]; we would note that few PA questionnaires for children and adolescents have been validated in the Spanish population (33,34,37,39,40). However, the information yield by most of these questionnaires is limited due to the few PA domains included, as several ask only one question about out-of-school sport activities, or total PA during the day, or yield data for a qualitative comparison of PA level with that of other children (37). The concurrent validity of the PAQ-A and PAQ-C administered in Spanish adolescents and children, respectively, ranged from fair to moderate (31,34,37). The highest concurrent validity (r = 0.54) was found for the adapted version of the Assessment of Physical Activity Levels Questionnaire (APALQ) among Spanish adolescents [10]. The Patient-Centered Assessment and Counselling for Exercise Plus Nutrition (PACE+) is a two-item PA questionnaire developed to estimate compliance with the PA-Guidelines for youth (1). The 60-min MVPA composite of the PACE+ showed fair to moderate validity for girls and boys, respectively, when compared to accelerometer-derived MVPA.

In most of the previously published studies, determination of the validity of the questionnaires used was limited to the assessment of concurrent validity by Spearman or Pearson correlation coefficients. This analysis can yield insights into the capacity of a questionnaire to rank children according to PA levels (e.g., low, medium, or high) but cannot assess absolute agreement between the PA questionnaire and the criterion standard of validity. In the present study, we found a somewhat lower ICC of MVPA between methods compared to that reported by Martín-Bello and colleagues [40] for the IPAQ-A. The absolute agreement of 46.7% correctly classified adolescents according to tercile classification of MVPA by our questionnaire and by accelerometer-derived MVPA, in addition to a kappa value of 0.24; this indicates a fair agreement for the non-calibrated PAU-7S. Furthermore, the Bland-Altman plot revealed a significant bias across the range of MVPA estimates between questionnaire and accelerometer data, showing an increasing measurement error at higher levels of MVPA on the PAU-7S.

Relatively few studies have addressed this issue for self-reported PA assessment in children (11–16). In our study, Pearson and Spearman correlation coefficients increased to 0.63 and 0.62, respectively, after calibration of PAU-7S-derived MVPA estimates. Absolute agreement between methods was moderate (kappa = 0.50) for calibrated estimates of MVPA. Furthermore, the beta coefficient of the association between MVPA derived by the PAU-7S and the WHtR and zBMI score increased from − 0.010 to − 2.46 and from − 0.162 to − 5.850, respectively. This finding indicates a considerable improvement of the construct validity of the PAU-7S after calibration. Finally, the predictive validity of the calibrated PAU-7S data was good, according to cross-validation with an independent internal sample. These results clearly show that linear calibration of MVPA derived by the PAU-7S strongly improved all validity dimensions tested. This finding is in line with the scarce evidence from other PA questionnaire calibration studies in children (11,12,14–16). Saint-Maurice and colleagues found a reasonable ability of the PAQ-C and PAQ-A calibration algorithm to estimate group-level estimates of accelerometer activity (15). Similar results were reported for the YAP questionnaires (14), the Global Physical Activity Questionnaire (12), and the Previous Day Physical Activity Recall (11) calibration algorithm.

The main strength of the present study is the population-based design, which permits generalization of the results to other Spanish populations of children aged 8–16 years. The inclusion of multiple dimensions of validity –concurrent, construct, and predictive– also can be considered a strength of this study. The short length of the PAU-7S makes it ideal for time-limited settings such as primary care centres and for large epidemiological studies or those that attempt to evaluate a long list of indicators. In addition, it will be useful for monitoring national PA data and for comparison with other countries. Finally, these results provide evidence that calibration can improve the validity of PA questionnaires for children and adolescents. This study also has two limitations that must be noted. Accelerometers are not sensitive to PA such as cycling or aquatics (7), and measurement error of self-reported data is an inherent limitation of questionnaires. Furthermore, the PAU-7S includes only 6 general questions about physical activities, which allows only a rough overview of the PA pattern and of METs spent in physical activities. For example, METs of sport activities are specific for each sport but the PAU-7S asks globally for time spent in team and individual sport activities. Therefore, the PAU-7S contribution to calculating the corresponding METs of these activities is limited. Hence, it should not be used when a more exact estimation of METs is the purpose of the study. Furthermore, a single administration of the PAU-7S will not accurately reveal seasonal variation in physical activities.

Conclusion

The PAU-7S is a valid instrument for the measurement of physical activity in Spanish children and adolescents aged 8 to 16 years. The questionnaire is an adequate instrument for a general estimation of PA, especially in time-limited settings such as primary care and in epidemiological surveys with a large sample size or with many measures of other health indicators where the administration of accelerometers is not feasible. The calibration of this questionnaire meaningfully decreased measurement error and thereby increased its validity. Further studies are needed to shed light on the external validity of the PAU-7S.

Availability of data and materials

The dataset from the current analysis is not publicly but is available from the corresponding author upon reasonable request.

References

  1. Joan Poitras V, Ellen Gray C, Borghese MM, Carson V, Chaput J-P, Janssen I, et al. Systematic review of the relationships between objectively measured physical activity and health indicators in school-aged children and youth 1. [cited 2020 Nov 25]; Available from: http://nrcresearchpress.com/doi/suppl/10.1139/apnm-2015-0663.

  2. Hillman CH, McDonald KM, Logan NE. A Review of the Effects of Physical Activity on Cognition and Brain Health across Children and Adolescence. Nestle Nutr Inst Workshop Ser [Internet]. Nestle Nutr Inst Workshop Ser; 2020 [cited 2020 Nov 25]. p. 1–11. Available from: https://pubmed.ncbi.nlm.nih.gov/33161407/

  3. Whooten R, Kerem L, Stanley T. Physical activity in adolescents and children and relationship to metabolic health [Internet]. Curr. Opin. Endocrinol. Diabetes Obes. Lippincott Williams and Wilkins; 2019 [cited 2020 Oct 26]. p. 25–31. Available from: https://pubmed.ncbi.nlm.nih.gov/30507695/

  4. Global recommendations on physical activity for health [Internet]. [cited 2020 Nov 25]. Available from: https://www.who.int/publications/i/item/9789241599979

  5. Parrish AM, Tremblay MS, Carson S, Veldman SLC, Cliff D, Vella S, et al. Comparing and assessing physical activity guidelines for children and adolescents: A systematic literature review and analysis [Internet]. Int. J. Behav. Nutr. Phys. Act. BioMed Central; 2020 [cited 2020 Oct 26]. p. 16. Available from: https://0-ijbnpa-biomedcentral-com.brum.beds.ac.uk/articles/10.1186/s12966-020-0914-2

  6. Lobelo F, Rohm Young D, Sallis R, Garber MD, Billinger SA, Duperly J, et al. Routine Assessment and Promotion of Physical Activity in Healthcare Settings: A Scientific Statement From the American Heart Association. Circulation [Internet]. NLM (Medline); 2018 [cited 2020 Oct 26];137:e495–522. Available from: http://circ.ahajournals.org

  7. Warren JM, Ekelund U, Besson H, Mezzani A, Geladas N, Vanhees L. Assessment of physical activity - A review of methodologies with reference to epidemiological research: A report of the exercise physiology section of the European Association of Cardiovascular Prevention and Rehabilitation [Internet]. Eur. J. Cardiovasc. Prev. Rehabil. SAGE Publications Inc.; 2010 [cited 2020 Oct 26]. p. 127–39. Available from: https://pubmed.ncbi.nlm.nih.gov/20215971/

  8. Migueles JH, Cadenas-Sanchez C, Tudor-Locke C, Löf M, Esteban-Cornejo I, Molina-Garcia P, et al. Comparability of published cut-points for the assessment of physical activity: implications for data harmonization. Scand J Med Sci Sports. 2019;29:566–74.

    PubMed  Google Scholar 

  9. Prochaska JJ, Sallis JF, Long B. A Physical Activity Screening Measure for Use With Adolescents in Primary Care. Arch Pediatr Adolesc Med. 2001.

  10. Zaragoza Casterad J, Generelo E, Aznar S, Abarca-Sos A, Julián JA, Mota J. Validation of a short physical activity recall questionnaire completed by Spanish adolescents. Eur J Sport Sci. 2012;12(3):283–91. https://0-doi-org.brum.beds.ac.uk/10.1080/17461391.2011.566357.

    Article  Google Scholar 

  11. Saint-Maurice PF, Welk GJ. Validity and calibration of the youth activity profile. PLoS One. 2015;10:1–16.

    Article  Google Scholar 

  12. Rääsk T, Maëstu J, Lätt E, Jürimäe J, Jürimäe T, Vainik U, et al. Comparison of IPAQ-SF and two other physical activity questionnaires with accelerometer in adolescent boys. PLoS One. 2017;12:1–14.

    Article  Google Scholar 

  13. Pate RR, Hillman CH, Janz KF, Katzmarzyk PT, Powell KE, Torres A, et al. Physical Activity and Health in Children Younger than 6 Years: A Systematic Review [Internet]. Med. Sci. Sports Exerc. Lippincott Williams and Wilkins; 2019 [cited 2020 Oct 26]. p. 1282–91. Available from: https://pubmed.ncbi.nlm.nih.gov/31095085/

  14. Tucker JM, Welk G, Nusser SM, Beyler NK, Dzewaltowski D. Estimating minutes of physical activity from the previous day physical activity recall: validation of a prediction equation. J Phys Act Health. 2011;8(1):71–8. https://0-doi-org.brum.beds.ac.uk/10.1123/jpah.8.1.71.

    Article  PubMed  Google Scholar 

  15. Metcalf KM, Baquero BI, Coronado Garcia ML, Francis SL, Janz KF, Laroche HH, et al. Calibration of the global physical activity questionnaire to Accelerometry measured physical activity and sedentary behavior. BMC Public Health BMC Public Health. 2018;18:1–10.

    Article  Google Scholar 

  16. Saint-Maurice PF, Kim Y, Hibbing P, Oh AY, Perna FM, Welk GJ. Calibration and Validation of the Youth Activity Profile: The FLASHE Study. Am J Prev Med [Internet]. Elsevier Inc.; 2017;52:880–7. Available from: https://0-doi-org.brum.beds.ac.uk/10.1016/j.amepre.2016.12.010

  17. Saint-Maurice PF, Welk GJ, Beyler NK, Bartee RT, Heelan KA. Calibration of self-report tools for physical activity research: the physica........................................................l activity questionnaire (PAQ). BMC Public Health. 2014;14:1–9.

    Article  Google Scholar 

  18. Fairclough SJ, Christian DL, Saint-Maurice PF, Hibbing PR, Noonan RJ, Welk GJ, et al. Calibration and validation of the youth activity profile as a physical activity and sedentary behaviour surveillance tool for english youth. Int J Environ Res Public Health. 2019;16(19). https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph16193711.

  19. Gómez SF, Homs C, Wärnberg J, Medrano M, Gonzalez-Gross M, Gusi N, et al. Study protocol of a population-based cohort investigating physical activity, Sedentarism, lifestyles and obesity in Spanish youth: the PASOS study. BMJ Open. 2020;10:1–6.

    Article  Google Scholar 

  20. Gomez SF, Casas R, Palomo VT, Pujol AM, Fíto M, Schröder H. Study protocol: effects of the THAO-child health intervention program on the prevention of childhood obesity - the POIBC study [internet]. 2014. Available from: http://0-www-biomedcentral-com.brum.beds.ac.uk/1471-2431/14/215

  21. Serra Majem L, Ribas Barba L, Aranceta Bartrina J, Pérez Rodrigo C, Saavedra Santana P, Peña Quintana L. Childhood and adolescent obesity in Spain. Results of the enKid study (1998-2000). Med Clin (Barc) [Internet]. Ediciones Doyma, S.L.; 2003 [cited 2020 Nov 25];121:725–32. Available from: https://pubmed.ncbi.nlm.nih.gov/14678693/

  22. Chinapaw MJM, Mokkink LB, Van Poppel MNM, Van Mechelen W, Terwee CB. Physical activity questionnaires for youth: a systematic review of measurement properties. Sports Med. 2010;40(7):539–63. https://0-doi-org.brum.beds.ac.uk/10.2165/11530770-000000000-00000.

    Article  PubMed  Google Scholar 

  23. Troiano RP, Berrigan D, Dodd KW, Mâsse LC, Tilert T, Mcdowell M. Physical activity in the United States measured by accelerometer. Med Sci Sports Exerc [Internet]. Med Sci Sports Exerc; 2008 [cited 2020 Nov 25];40:181–8. Available from: https://pubmed.ncbi.nlm.nih.gov/18091006/

  24. Chandler JL, Brazendale K, Beets MW, Mealing BA. Classification of physical activity intensities using a wrist-worn accelerometer in 8-12-year-old children. Pediatr Obes. 2016;11(2):120–7. https://0-doi-org.brum.beds.ac.uk/10.1111/ijpo.12033.

    Article  CAS  PubMed  Google Scholar 

  25. De Onis M, Onyango AW, Borghi E, Siyam A, Nishida C, Siekmann J. Development of a WHO growth reference for school-aged children and adolescents. Bull World Health Organ. 2007;85(09):660–7. https://0-doi-org.brum.beds.ac.uk/10.2471/BLT.07.043497.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Akoglu H. User’s guide to correlation coefficients [Internet]. Turkish J. Emerg. Med. Emergency Medicine Association of Turkey; 2018 [cited 2020 Nov 12]. p. 91–3. Available from: /pmc/articles/PMC6107969/?report=abstract.

  27. Altman DG, Bland JM. Measurement in medicine: the analysis of method comparison studies. Stat. 1983;32:307.

    Google Scholar 

  28. Ludbrook J. Confidence in Altman-Bland plots: A critical review of the method of differences [Internet]. Clin. Exp. Pharmacol. Physiol. Clin Exp Pharmacol Physiol; 2010 [cited 2021 Jun 25]. p. 143–9. Available from: https://pubmed.ncbi.nlm.nih.gov/19719745/

  29. Corder K, Van Sluijs EMF, Wright A, Whincup P, Wareham NJ, Ekelund U. Is it possible to assess free-living physical activity and energy expenditure in young people by self-report? Am J Clin Nutr. 2009;89(3):862–70. https://0-doi-org.brum.beds.ac.uk/10.3945/ajcn.2008.26739.

    Article  CAS  PubMed  Google Scholar 

  30. Shook RP. Obesity and energy balance: What is the role of physical activity? [Internet]. Expert Rev. Endocrinol. Metab. Taylor and Francis Ltd; 2016 [cited 2020 Nov 13]. p. 511–20. Available from: https://pubmed.ncbi.nlm.nih.gov/30058919/

  31. Rosner B, Willett WC, Spiegelman D. Correction of logistic regression relative risk estimates and confidence intervals for systematic within-person measurement error. Stat Med [Internet]. Stat Med; 1989 [cited 2020 Nov 4];8:1051–69. Available from: https://pubmed.ncbi.nlm.nih.gov/2799131/

  32. Hidding LM, Chinapaw MJM, van Poppel MNM, Mokkink LB, Altenburg TM. An Updated Systematic Review of Childhood Physical Activity Questionnaires [Internet]. Sport. Med. Springer International Publishing; 2018. Available from: https://0-doi-org.brum.beds.ac.uk/10.1007/s40279-018-0987-0, 48, 12, 2797, 2842.

  33. Helmerhorst HJF, Brage S, Warren J, Besson H, Ekelund U. A systematic review of reliability and objective criterion-related validity of physical activity questionnaires. Int J Behav Nutr Phys Act. 2012;9(1):103. https://0-doi-org.brum.beds.ac.uk/10.1186/1479-5868-9-103.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Price RJ, Chiang I-CA. Reliability and Validity of Measurement Scales. Physiotherapy Theory and Practice, 2012, 28(3), 188–197.

  35. Using and Interpreting Cronbach’s Alpha | University of Virginia Library Research Data Services + Sciences [Internet]. [cited 2020 Nov 26]. Available from: https://data.library.virginia.edu/using-and-interpreting-cronbachs-alpha/

  36. Martínez-Gómez D, Martínez-De-Haro V, Del-Campo J, Zapatera B, Welk GJ, Villagra A, et al. Validez de cuatro cuestionarios para valorar la actividad física en adolescentes españoles. Gac Sanit. 2009;23:512–7.

  37. Benítez-Porres J, López-Fernández I, Raya JF, Álvarez Carnero S, Alvero-Cruz JR, Álvarez CE. Reliability and validity of the PAQ-C questionnaire to assess physical activity in children. J Sch Health. 2016;86(9):677–85. https://0-doi-org.brum.beds.ac.uk/10.1111/josh.12418.

    Article  PubMed  Google Scholar 

  38. Segura-Díaz JM, Barranco-Ruiz Y, Saucedo-Araujo RG, Aranda-Balboa MJ, Cadenas-Sanchez C, Migueles JH, et al. Feasibility and reliability of the Spanish version of the youth activity profile questionnaire (YAP-Spain) in children and adolescents. J sports Sci [internet]. Routledge; 2020;00:1–7. Available from: https://0-doi-org.brum.beds.ac.uk/10.1080/02640414.2020.1847488, 2021.

  39. Rangul V, Holmen TL, Kurtze N, Cuypers K, Midthjell K. Reliability and validity of two frequently used self-administered physical activity questionnaires in adolescents. BMC Med Res Methodol. 2008;8:1–10.

    Article  Google Scholar 

  40. Mart C, Casaj JA. Validación de los cuestionarios PAQ-C e IPAQ-A en niños/as en edad escolar. Cult Cienc y Deport. 2020;15:177–87.

    Article  Google Scholar 

  41. Lee PH, Macfarlane DJ, Lam T, Stewart SM. Validity of the international physical activity questionnaire short form. Int J Behav Nutr Phys Act. 2011;8:1–11.

    Article  Google Scholar 

Download references

Acknowledgements

We thank the staff, pupils, parents, schools and municipalities for their participation, enthusiasm, and support. We appreciate the English revision by Elaine M Lilly, PhD.

Funding

PASOS study has been funded mainly by Fundación PROBITAS and Gasol Foundation. Additional funds were received from the Barça Foundation, Banco Santander, Grupo IFA, Viena and Fundación Deporte Jóven, grant of support to research groups number 35/2011 (Balearic Islands Gov) and EU COST Action CA16112. J.A.T. and M.M.B. are funded by the official funding agency for biomedical research of the Spanish government, Institute of Health Carlos III (ISCIII), which is cofunded by the 333 European Regional Development Fund (CIBEROBN CB12/03/30038). PASOS has the institutional support of Spain’s Ministry of Education and Vocational Training, the Ministry of Health, Consumption and Social Welfare through the Spanish Agency for Food Safety and Nutrition (ASEAN), the High Commission against Child Poverty, the High Sports Council, the General College of Professional Associations of Physical Education and Sports, and the Departments of Education and/or Health and/or Sports of Spain’s 17 autonomous regions. The CIBERESP and the CIBEROBN are initiatives of the Institute of Health Carlos III, Madrid, Spain.

Author information

Authors and Affiliations

Authors

Contributions

HS and SFG developed the questionnaire and designed the study. IS, HS and JW performed the statistical analysis. HS interpreted the data and wrote the first draft. All authors defined the strategy to deploy the PASOS study protocol. SFG, CH, and MS provided funding. All authors with the exception of HS collected data. All authors critically reviewed and edited the manuscript and provided final approval for the submitted version.

Corresponding authors

Correspondence to Helmut Schröder or Santiago F. Gómez.

Ethics declarations

Ethics approval and consent to participate

The study protocol was approved by the Ethics Committee CEIm Fundació Sant Joan de Déu, Spain (Approval number: PIC-171-18). Parental written informed consent was obtained.

Consent for publication

Not applicable.

Competing interests

Non declared. The funders had no role in the analysis or interpretation of the data of this study.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1 Supplementary Table 1.

Characteristics of the validation study participants and the remaining participants of the population-based PASOS cohort.

Additional file 2 Supplementary Table 2.

Correlation coefficients and between-method agreement of moderate to vigorous physical activity measurements derived by the Physical Activity Unit 7-item screener, noncalibrated and calibrated, and the reference method (accelerometer), stratified by age.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Schröder, H., Subirana, I., Wärnberg, J. et al. Validity, reliability, and calibration of the physical activity unit 7 item screener (PAU-7S) at population scale. Int J Behav Nutr Phys Act 18, 98 (2021). https://0-doi-org.brum.beds.ac.uk/10.1186/s12966-021-01169-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12966-021-01169-w

Keywords