Skip to main content
Download PDF
Download ePub

International evaluation of the Microscale Audit of Pedestrian Streetscapes (MAPS) Global instrument: comparative assessment between local and remote online observers

International Journal of Behavioral Nutrition and Physical Activity volume 18, Article number: 84 (2021) Cite this article

Abstract

Objectives

The use of online imagery by non-local observers to conduct remote, centralized collection of streetscape audit data in international studies has the potential to enhance efficiency of collection and comparability of such data for research on built environments and health. The objectives of the study were to measure (1) the consistency in responses between local in-field observers and non-local remote online observers and (2) the reliability between in-country online observers and non-local remote online observers using the Microscale Audit of Pedestrian Streetscapes Global tool to characterize pedestrian-related features along streets in five countries.

Methods

Consistency and inter-rater reliability were analyzed between local and non-local observers on a pooled database of 200 routes in five study regions (Melbourne, Australia; Ghent, Belgium; Curitiba, Brazil; Hong Kong, China; and Valencia, Spain) for microscale environmental feature subscales and item-level variables using the intraclass correlation coefficient (ICC).

Results

A local in-field versus remote online comparison had an ICC of 0.75 (95 % CI: 0.68–0.80) for the grand total score. An ICC of 0.91 (95 % CI: 0.88–0.93) was found for the local online versus remote online comparison. Positive subscales yielded stronger results in comparison to negative subscales, except for the similarly poor-performing positive aesthetics/social characteristics.

Conclusions

This study demonstrated remote audits of microscale built environments using online imagery had good reliability with local in-field audits and excellent reliability with local online audits. Results generally supported remote online environmental audits as comparable to local online audits. This identification of low-cost and efficient data acquisition methods is important for expanding research on microscale built environments and physical activity globally.

Introduction

Greater international attention is being paid to the role the built environment has on physical activity, obesity, and cardiometabolic health [1, 2]. The link between the built environment and physical activity has been well-established using macroscale environmental factors such as street connectivity, land use mix, net-residential density, and composite walkability indices [3,4,5,6,7,8]. Hundreds of studies to date have been conducted documenting both associations [9] and causal impacts of improvements to the walking environment on utilitarian physical activity [10].

There is a growing awareness that changes to microscale features that enhance the pedestrian walking environment may promote increased physical activity, especially utilitarian physical activity, and are less costly than larger neighborhood and regional scale infrastructure investments [11,12,13]. Microscale environmental features comprise detailed design characteristics (both quantity and quality) along street block faces or segments (e.g., street amenities like benches and bicycle racks, presence of trees, building setbacks), sidewalks, intersection configuration (e.g., curbs, crosswalks, signalization), types of land use (e.g., residential, commercial, industrial) and traits of the local social environment (e.g., litter, graffiti, and landscaping maintenance) [12]. Observational audits have been a reliable method to gather detailed information on the presence and quality of micro-environment features believed to be relevant for travel behavior, including mode choice, which are not generally available in Geographic Information System (GIS) data furnished by planning agencies [14,15,16]. In-field data collection requires significant resources to have observers on-site, with staff time encompassing the largest cost. Expenses may also include travel to and from the site, lodging, survey equipment, and transportation between audit locations. In-field data collection may also be adversely impacted by local environmental conditions, such as high crime, traffic-related safety conditions or air pollution, and unfavorable weather conditions, including inclement weather and extreme heat or cold. These expenses and local conditions can limit the scale of research on microscale built environments globally [17].

To overcome many of these limitations, researchers have used free online resources to perform “virtual audits” [17]. Large quantities of public data are available that are suitable to evaluate the built environment through omnidirectional imagery and photogrammetric image interpretation, such as Google Earth and Street View (Google, Inc., Mountain View, CA) and Bing Streetside (Microsoft, Redmond, WA). The imagery made available through these data tools has emerged in the last decade as a viable alternative when auditing general land-use and transportation physical environment characteristics, as well as fine-grain measurements or observing qualitative characteristics, such as sidewalk quality, street furniture, crossing amenities, and curb quality [18,19,20,21,22,23,24]. The more recent release of high-definition imagery, coupled with the expansion of coverage to cities around the world, has made online tools and imagery more feasible for use of virtual environmental audits in international studies [16, 25, 26].

The Microscale Audit of Pedestrian Streetscapes (MAPS) is one of several observational tools used to systematically measure microscale built environment features [11, 12, 17, 27]. The MAPS instrument was originally developed in the United States for in-field audits by observers who physically traveled to site locations and performed the audit by walking each route. The MAPS tool has undergone several iterations for different purposes, including creating MAPS-Abbreviated for use in academic research and MAPS-Mini designed to be used by practitioners [17, 28, 29]. The present study implemented the MAPS-Global version, which was developed for international use to represent diverse environments worldwide [11, 16]. While traditionally used as an in-field audit tool, for this study the MAPS-Global audits were completed using both in-field and virtual methods. Zhu et al. and Phillips et al. in the United States, and Vanwolleghem et al. in Belgium have performed studies to test the inter-rater reliability of the MAPS tool using data collected online and found relatively high levels of consistency between observers [16, 17, 30].

Cain et al. also studied the inter-rater reliability of the MAPS-Global tool for local in-field observers in multiple countries [11]. For international studies, local observations require the training of multiple teams of observers who are overseen by different supervisors. These methods have the potential to reduce the comparability of results across countries. An alternative is a centralized data collection that would be remote from most study sites. Possible limitations of this approach include online imagery from different time periods, an inability to read signage (due to clarity of image or language barriers) that identify commercial establishments and a lack of knowledge of some features’ local meaning.

To the knowledge of the authors, there appears to be no study that compares observed microscale environmental conditions recorded by local (in-country) observers and remote (out of country) observers. The purpose of the present study was to (1) determine consistency in responses of micro-environment observations between local in-field observers and remote online observers, and (2) to measure the reliability of local online observers and remote online observers using the MAPS-Global tool to characterize the pedestrian-related microscale characteristics along streets. The former evaluates the level of correspondence between survey data acquired using two different methods, while the latter examines the same data collected using the same method but by observers with and without local knowledge. Figure 1 provides a conceptual model for the analysis workflow, which applied a systematic training protocol to all observer groups and developed two core comparison databases to analyze the study aims. The study evaluated the validation of public access online resources, specifically Google Earth and Google Street View, as a consistent and reliable method for implementing a virtual MAPS-Global data acquisition without requiring prior knowledge of the local environment.

Fig. 1
figure 1

Conceptual model illustrating the development of MAPS-Global databases used to analyze the two study aims

Full size image

Methods

Residential Addresses

This study used cross-sectional microscale built environment data primarily acquired as part of the International Physical Activity and Environment Network (IPEN) Adolescent study. This international study of adolescents, ages 12 to 16 years, was conducted in 15 countries to ensure a broad range of environments and to maximize variation in participant characteristics. A common research design and methodology, with objective and self-reported measures of physical activity and the built environment, was used to increase intra-regional and inter-country comparability. The principal goal of the study was to evaluate associations of built and social environment features with physical activity, sedentary behavior, and weight status, and then use the evidence to inform evidence-based, international physical activity policies and interventions to mitigate obesity and other chronic diseases in adolescents [31, 32]. Participant recruitment at each study site was stratified by socioeconomic status and location-based walkability, which have been described in detail in other publications [3, 4, 8, 33,34,35,36,37,38].

For the present study, data were collected from five cities involved in the IPEN Adolescent study: (1) Melbourne, Australia, (2) Ghent, Belgium, (3) Curitiba, Brazil, (4) Hong Kong, China, and (5) Valencia, Spain. Study sites were selected based on each research institution’s access to resources to undertake the microscale built environment inventory, availability of local expertise and support staff to implement the data acquisition, and willingness to participate. MAPS-Global data were collected by local (in-country) observers using both in-field and online resources, as well as remote (outside of the country, all in the U.S.) observers using only online resources. Data collection took place between November 2014 and June 2015. The dataset from these five sites included the home location neighborhood for 40 adolescents participating in the larger IPEN Adolescent study in each of four countries (Belgium, Brazil, China, and Spain) and 40 residential addresses selected at random from within Statistical Area Level 1 (smallest known census unit due to participant privacy restrictions) across walkability and income areas of Melbourne, Australia. The present study had a total sample of 200 targeted address locations.

MAPS-Global Instrument

Investigators from each site utilized the MAPS-Global observational audit tool to gather the microscale built environment features required for the evaluation. Local and remote observers were provided uniform training manuals, materials, and webinar presentations prepared in English, and all observers practiced and completed sample routes. Each observer also completed a certification requirement for the MAPS-Global tool. More detailed descriptions of the development and design characteristics of the MAPS tool and the certification requirements have been published elsewhere [11, 12, 27].

The MAPS-Global observation tool is designed to capture a range of pedestrian- and bicycle-oriented environment features for defined areas within an international context. The instrument contains a total of 120 items across four sections: (1) the route section tracks land use characteristics and features along the entire route defined by an origin/destination pair; (2) microscale characteristics at the segment level evaluate block faces between intersections; (3) the crossings section collects intersection information; (4) the cul-de-sac section tracks dead-end or cul-de-sac features. The route and cul-de-sac sections of the tool capture built environment characteristics on both sides of the street. In contrast, the segment and crossing sections mainly assess attributes on one side of the street, simulating environmental exposure between home and a nearby destination. The presence of mid-block pedestrian crossings was identified at the segment level of the MAPS-Global instrument. Although data were acquired for cul-de-sacs, due to the low frequency of occurrence in the sample, with some study areas not having any, they were omitted from the analyses. Destinations and land use, streetscapes, aesthetics, and social characteristics expected to be generally consistent throughout the route (e.g., posted speed limits, social environment, and aesthetics) were obtained through the route section. Segment-level measures that evaluate characteristics that were more likely to change throughout the route included sidewalk characteristics, buffers with streets, trees, building configurations, crosswalk presence, traffic signals, and walk signs. An average MAPS-Global route for this study contained 3.2 segment sections and 2.3 crossing sections. When reporting at the route level, the mean value for each variable in these sections was used for routes with multiple segments and crossings.

Route Selection & Data Acquisition

Residential addresses are a widely investigated location for quantifying built environment exposure within the physical activity literature; thus a residential address point was selected as the most suitable origin for assessment of microscale environments [39, 40]. The microscale environment was observed over a 400 to 725 m (0.25 to 0.45 mile) network distance route along the road network accessible by pedestrians from the residential address toward the nearest identified commercial “cluster” containing at least three businesses within close proximity [12]. The shortest walkable routes along the street network were manually digitized and measured in Google Earth from the origin address points to the nearest commercial cluster for 33 of the 40 MAPS-Global routes per study site.

Online observers used satellite imagery and Google Street View multi-view panoramic road imagery in Google Earth to ensure data were collected for the same route by multiple raters. The vintage of road imagery used for the inventory varied by site depending on availability and update frequency, but was aligned as closely as possible to the time frame of the IPEN Adolescent study. Most of the imagery utilized for the data acquisition by region comprised the following: (1) Melbourne (2014), (2) Ghent (2013), (3) Curitiba (2014), Hong Kong (2011), and Valencia (2014). If the route reached the destination before the minimum distance was reached, additional route segments were added beyond the destination until the minimum threshold (400 m) was surpassed. The average route required 20 min to complete for both in-field and online acquisition methods, however, completion time did vary based on route distance and complexity. Secondarily, single road segment routes located at commercial cluster destinations with crossings at either end (i.e., commercial “blocks”) were also surveyed for a randomly selected sample of seven address locations for each country to provide a wider breadth of environmental features in commercial areas (Table 1). These commercial blocks were determined using satellite imagery and point of interest commercial location information from Google Earth of the closest street network commercial cluster to the address points. A total of 200 routes comprising 649 segments and 459 crossings were collected in the pooled dataset. In each country, 33 residential routes and seven commercial blocks were surveyed, yielding 165 residential routes and 35 commercial blocks for the five-country data set.

Table 1 MAPS-Global sample sizes by country and survey component
Full size table

Three groups of raters (two local groups for each country and one remote group in the U.S.) recorded microscale built environment data for selected routes using the MAPS-Global instrument. Among the local groups, one used in-field data collection tools, while the other used only online resources. The remote group in the U.S. consisted of two auditors who surveyed all 200 routes online. The local, in-field observers completed the audit using paper surveys, recording observations by pen as they walked the route. Recorded survey forms were then manually entered into a Microsoft Access database in preparation for analysis. For the local and remote groups virtually completing the inventory, Google Earth was used for mapping, route information, aerial imagery, and Google Street View was used for street-level point-of-view imagery. Data were collected independently by in-country and remote observers with no contact or awareness of each other’s results. Each online-rater utilized a dual-monitor workstation to facilitate simultaneous visualization of the microscale environment by virtually walking the route while entering MAPS-Global responses into a database. Data entry raters and project coordinators performed a systematic review of databases for missing values, valid values, and logical consistency among answers. Any rare missing sections or erroneous entries identified were returned to the original observers for review and were resolved before data aggregation and merging into a pooled database was performed. The analyses presented in this study were performed on the pooled database of routes (n = 200) in five study regions. By using the pooled database, the analysis allows for a reasonably large sample from which to compute inter-rater reliability and level of consistency; however, it does not offer an opportunity to examine how countries compared with one another

Instrument Scoring & Subscales

A pooled analysis was performed using MAPS-Global data from all countries together. Variables designed to evaluate similar microscale environmental features were grouped into subscales. This methodology follows the process described in other MAPS and MAPS-Global studies [11, 12, 27]. Briefly, a tiered scoring system was created to summarize item-level variables into subscales at multiple aggregation levels to develop positive and negative valence scores derived from the expected effect of presence, absence, and quality of microscale features on physical activity. For instance, the sum of land uses and destinations supportive of activity-friendly environments, such as mixed-use buildings, access to shops, services, restaurants, and entertainment, were hypothesized to be positively associated with physical activity. In contrast, the presence of physical and social disorder, such as buildings and landscapes not being maintained, littering, and graffiti, was hypothesized to be negatively associated [27]. Cross-domain scores were also computed by summing item-level scores from across all four sections of the instrument to calculate three primary measures of interest: (1) pedestrian infrastructure, (2) pedestrian design, and (3) bicycle facilities. Lastly, overall positive association and negative association scores were produced for segments (positive valence segment scores minus negative valence segments scores) and crossings (positive valence crossing scores minus negative valence crossing scores). Overall meta positive and negative scores were calculated by summing each of the respective positive and negative valence scores from each section (segments and crossings). The overall grand score was derived by subtracting the overall meta negative score from the overall meta positive score.

Statistical Analyses

The intraclass correlation coefficient (ICC) statistic was used to quantify the level of consistency between MAPS-Global scores derived from the remote (non-local) online assessments with the local in-field assessments and the inter-rater reliability between MAPS-Global scores derived from the local and remote online assessment [41, 42]. Detailed reviews of the analysis methods used for estimating consistency between assessment modes have been published in similar IPEN-focused studies [11, 12, 17, 27, 30]. ICCs were computed using a one-way random model for average measures with a 95 % confidence interval using IBM SPSS Version 21 (IBM Corporation, Armonk, NY) “Reliability Analysis” module [12, 43]. Cicchetti’s ICC numerical ranges and descriptors were used for test-retest reliability for this study: “excellent” (ICC ≥ 0.75), “good” (ICC = 0.60–0.74), “fair” (ICC = 0.40–0.59) and “poor” (ICC < 0.40) [12, 43, 44].

Results

In-Country In-Field vs. Remote Online

This section discusses the pooled sample results for the local in-field observers versus remote online observers. The following section reviews the local online observers versus remote online observers. Table 2 shows the ICCs for the local in-field versus remote online comparison. The table includes upper and lower limits for 95 % confidence intervals and descriptive statistics for key MAPS-Global variables comprising route, segment, crossing section measures, section subscales, cross-domain subscales, valence, and grand scores. Descriptive statistics specify the number of individual items included and the range of potential scores for each subscale, central tendency for each subscale, and the frequency and percentage of zero values for each subscale. 

Table 2 MAPS-Global item-level and subscale levels of consistency and descriptive statistics for in-country in-field observers versus remote online observers
Full size table

The overall grand score had an ICC of 0.75 (95 % confidence interval: 0.68–0.80). Positive subscales performed much better than negative subscales. The exceptions were positive aesthetics/social characteristics (ICC = 0.09), overpass (ICC = 0.02), informal path or shortcut (ICC = 0.07), and hawkers/shops (ICC = -0.03), which performed poorly. Positive subscales for destinations and land-use components (ICC = 0.69) from the route section, as well as positive crossing subscales (ICC = 0.82) and positive street segment subscales (ICC = 0.76), also performed well, producing an acceptable ICC of 0.60 for the overall positive valence score. Among individual-item MAPS-Global components, building height-setback from the street and intersection controls performed the strongest with ICC values of 0.84 and 0.82, respectively. Sidewalks (ICC = 0.76) and streetscape characteristics (ICC = 0.66) also provided ICC values in the “good” to “excellent” range. The positive cross-domain subscales all performed well, with ICC values in the “good” to “excellent” range. Pedestrian design yielded a high ICC at 0.82. Bicycle facilities also yielded a relatively high ICC of 0.73, despite a majority of observed routes not including these features.

In-Country Online vs. Remote Online

Table 3 shows ICC results and descriptive statistics for the local online versus remote online comparisons. The overall grand score had an ICC of 0.91 (95 % confidence interval: 0.88–0.93). Similar to the local in-field versus remote online analysis, positive subscales yielded stronger results in comparison to negative subscales, except for the similarly poor-performing positive aesthetics/social characteristics (ICC = 0.21), overpass (ICC = 0.24), and hawkers (street vendors)/shops (ICC = 0.002) variables. Positive subscales for destinations and land-use components (ICC = 0.92) from the route section, as well as positive crossing subscales (ICC = 0.75) and positive street segment subscales (ICC = 0.71), also performed well, producing an acceptable overall positive valence score of 0.64. Among individual-level MAPS-Global components, count of shops (ICC = 0.89), restaurants (ICC = 0.85), and institutional-services (ICC = 0.84) from the destination and land use section, and crosswalk amenities (ICC = 0.81) from the crossing section performed the strongest. With an ICC of 0.75, building height-setback also provided ICC values in the “excellent” range. Positive subscales such as intersection control and signage (ICC = 0.72), building height-road width ratio (ICC = 0.63), sidewalk (ICC = 0.62), and public recreation (ICC = 0.60) also performed well, yielding ICCs in the “good” range. The positive cross-domain subscales performed well in the “good” to “excellent” range with bicycle facilities showing a relatively high ICC of 0.80, and pedestrian design and pedestrian infrastructure performing well with ICCs of 0.74 and 0.65, respectively.

Table 3 MAPS-Global item-level and subscale inter-rater reliability and descriptive statistics for in-country online observers versus remote online observers
Full size table

Discussion

This study measured (1) the consistency in responses between local in-field observers and non-local remote online observers and (2) the reliability between in-country online observers and non-local remote online observers using the MAPS-Global tool for walking routes from residential addresses to the nearest commercial cluster in five countries: Australia, Belgium, Brazil, China, and Spain. The ICCs of the two comparison analyses showed relatively high consistency among observers. Moderately stronger results were observed for the local online and remote online sample (ICC grand score = 0.91) versus the local in-field and remote online data collection analysis (ICC grand score = 0.75). This pattern indicates a higher consistency among raters using a similar methodology and images to review when applying the MAPS-Global tool. The online method did not result in any substantial loss in accurately completing any of the items in the tool, compared to the in-field method.

Despite the systematic application of the MAPS-Global instrument for both in-field and online observers, inherent differences in data acquisition methods present a potential for variability in the resulting audit scores. Possible discrepancies in observations were also anticipated between local and non-local observers. Local observers were more familiar with the local environment, read the local language (useful when using signage to discern features), and were more accustomed to local facilities, services, and businesses than non-locals. As a result of these expected causes of variability among the data, steps were taken to ensure consistent training and certification for observers. Survey teams from each country participated in training presentations, completed practice audits in groups and independently, and achieved consistency in responses to become certified. Although some observers may have had previous experience with data collection using MAPS-Global or another version of MAPS, both local and remote observers all received a consistent level of training to complete the certification requirements. Local observers may or may not have been directly familiar with the routes they completed. In contrast, remote observers did not know the route areas, nor necessarily the written language used in each region. Therefore, a noteworthy finding of the study was that remote observers could accurately complete the survey assessment using online imagery while not being familiar with microscale environment features in other languages, such as street signs, names of businesses, or civic services, storefront advertising, and transit stops.

Positive subscales for destinations and land-use components from the route section and positive crossing/intersection subscales and positive subscales for street segment subscales showed the strongest levels of alignment between each observer for both analyses. Similar to the results found by Cain et al., both positive and negative aesthetics and social characteristics had low ICC scores for both comparisons, which may reflect the fact that these characteristics often unintentionally introduce more subjectivity in observer responses [11]. Aesthetics and social characteristics have continued to remain part of the MAPS-Global instrument and other MAPS versions because of the sustained interest in having these types of measures available for analysis. Nevertheless, caution is warranted when interpreting the results of these variables. Interestingly, there were some notable differences between the two analyses regarding subscale ICC values. When comparing scoring responses for individual positive subscales, the crossing/intersection sections had the highest consistency levels between local in-field observes and remote online observers. In contrast, the destination and land use section was most reliable for scores between local online and remote online. These differences suggest that, in addition to the level of familiarity with the local environment, the method of data collection (i.e., in-field vs. online) may influence the reliability of subscales.

While cross-domain subscales and positive subscales for destination and land use, streetscape characteristics, crossing/intersections, and street segments were reliable, negative subscales for these sections were not. The negative subscales tended to comprise fewer items, limiting variability in general and the strength of the ICC. In fact, with only a few exceptions, in each section of the tool, microscale features with limited occurrence tended to produce lower ICC values than more commonly observed features. For example, among age-restricted bars, liquor stores, and private recreation, all had relatively low frequencies (null range: 96.4-74.1 %) and performed poorly (ICC range: 0.39–0.04). Weak ICC values were also observed for the presence of overpasses in the crossing section and pedestrian infrastructure, informal paths, and hawkers in the segment section, the latter two items rarely being present. Despite the relatively poorer performance of these features, these less frequently occurring microscale features can have important impacts on the pedestrian environment, though perhaps only in areas where they are more common, which could be low-income countries. These items should continue to be captured as part of the tool, even if that requires increased caution when interpreting their presence.

When using MAPS-Global in international studies, online observations are recommended so long as online imagery quality, currency, and extent are sufficiently high to perform the inventory accurately. Despite some variation in image currency between study sites (2011–2014), all imagery was available in high-definition and provided no barriers to observers’ accurate interpretation. There were some rare instances of image obstruction of features by large vehicles, construction sites, or areas where imagery from all travel lanes was not available. These issues were overcome through further navigation of the route to nearby or adjacent streets or observing features from different angles within the Street View interface. Other tools within the Google Earth software, such as satellite imagery, photos, photosphere images, and spatial measurement tools to assess distances were also used. It is acknowledged that it may be possible that a few of the survey questions about physically small details (e.g., trip hazards or sidewalk heaves) might be missed in the imagery and may be more easily apparent to observers when physically walking the segment.

The current study involved different observers for local in-field and local online data collection, limiting the study’s analyses and the authors’ ability to determine whether differences were more influenced by the individual completing the survey or the method of completing the survey. The inability to apply a random assignment of observers to in-field and online domains due to data acquisition resources was also recognized as a limitation. The study provided international breadth by including data from five countries worldwide, however, the relatively small sample was limited to urbanized areas in five cities. Although consistent training manuals and materials were distributed, and the same certification process was used for each country, the reliability results presented here suggest that future studies should continue to enhance the training protocols to limit variability even further. Researchers may consider an increased unification of training sessions and practice routes among all observers at the same time to ensure that presentation materials and example scenarios are delivered by the same person(s). This will allow all observers an opportunity to become familiar with a broad range of microscale features and the prescribed consistent way to score them, reducing ambiguity and subjectivity of responses. Differences in supervision methods across countries are likely a source of error that may be more difficult to standardize. However, it might be possible for the supervision of observers in all countries to be overseen centrally by the same person, though that protocol was not used in the current study.

Conclusions

To expand the research and data available on microscale built environments and their implications for physical activity at an international level, there must be a continued concerted effort to identify more cost-effective and efficient methods of data acquisition. Recent research found the MAPS-Global instrument to be a valid and reliable audit tool for in-field data collection of microscale features of the built environment [11]. MAPS-Global can be implemented more broadly using online resources that are rapidly becoming available globally. This study demonstrated a relatively high level of reliability for composite subscale measures, especially pedestrian design and bicycle facilities, and a high level of consistency for grand overall scores of remote online observations compared to both local in-field and local online data collection. Researchers should exercise caution using MAPS-Global for virtual audits, whether by local or remote observers, when interpreting positive and negative subscale scores for aesthetic/social characteristics, and microscale features that are rarely observed. The results presented in this study support the use of remote online observations with MAPS-Global as an effective alternative to local data collection. Using a central team of observers and supervisors to conduct online observations in multiple countries could be an efficient approach to building an international database that maximizes comparability across countries.

Availability of data and materials

The data presented in this article are not shared publicly because the data are proprietary and owned individually by each participating research institution. Data acquired pertaining to participant health and behavior must be securely protected to ensure participant privacy and cannot be made available to the public.

Abbreviations

DLU:

Destinations and land use

GIS:

Geographic information systems

ICC:

Intraclass correlation coefficient

IPEN:

International Physical Activity and the Environment Network

MAPS:

Microscale Audit of Pedestrian Streetscapes

References

  1. Brownson RC, Hoehner CM, Day K, Forsyth A, Sallis JF. (2009). Measuring the built environment for physical activity: state of the science. Am J Prev Med, 36. https://0-doi-org.brum.beds.ac.uk/10.1016/j.amepre.2009.01.005.

  2. Sallis JF, Floyd MF, RodrĂ­guez DA, Saelens BE. (2012). Role of built environments in physical activity, obesity, and cardiovascular disease. Circulation.

  3. Frank L, Schmid TL, Sallis J, Chapman J, Saelens B. (2005). Linking objectively measured physical activity with objectively measured urban form: Findings from SMARTRAQ. American Journal of Preventive Medicine, 28(2 SUPPL. 2), 117–125. https://0-doi-org.brum.beds.ac.uk/10.1016/j.amepre.2004.11.001.

  4. Sallis, J. F., Cerin, E., Conway, T. L., Adams, M. A., Frank, L. D., Pratt, M., … Owen, N. (2016). Physical activity in relation to urban environments in 14 cities worldwide: A cross-sectional study. Lancet, 387(10034), 2207–2217. https://0-doi-org.brum.beds.ac.uk/10.1016/S0140-6736(15)01284-2.

  5. Smith, M., Hosking, J., Woodward, A., Witten, K., MacMillan, A., Field, A., … Mackie, H. (2017). Systematic literature review of built environment effects on physical activity and active transport - an update and new findings on health equity. Int J Behav Nutr Phys Activity. https://0-doi-org.brum.beds.ac.uk/10.1186/s12966-017-0613-9.

  6. Barnett DW, Barnett A, Nathan A, Van Cauwenberg J, Cerin E. Council on Environment and Physical Activity (CEPA) – Older adults working group. Built environmental correlates of older adults’ total physical activity and walking: a systematic review and meta-analysis. Int J Behav Nutr Phys Act. 2017;14(1):103. https://0-doi-org.brum.beds.ac.uk/10.1186/s12966-017-0558-z.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Van Cauwenberg J, Nathan A, Barnett A, Barnett DW, Cerin E. (2018).Council on Environment and Physical Activity (CEPA)- Older Adults Working Group. Relationships Between Neighbourhood Physical Environmental Attributes and Older Adults’ Leisure-Time Physical Activity: A Systematic Review and Meta-Analysis. Sports Med, 48(7):1635–60. https://0-doi-org.brum.beds.ac.uk/10.1007/s40279-018-0917-1.

    Article  PubMed  Google Scholar 

  8. Frank LD, Sallis JF, Saelens BE, Leary L, Cain K, Conway TL. (2010). The development of a walkability index: application to the neighborhood quality of life study. Br J Sports Med, 44. https://0-doi-org.brum.beds.ac.uk/10.1136/bjsm.2009.058701.

  9. Cerin E, Nathan A, van Cauwenberg J, Barnett DW, Barnett A. Council on Environment and Physical Activity (CEPA) – Older Adults working group. The neighbourhood physical environment and active travel in older adults: a systematic review and meta-analysis. Int J Behav Nutr Phys Act. 2017;14(1):15. https://0-doi-org.brum.beds.ac.uk/10.1186/s12966-017-0471-5.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Frank LD, Hong A, Ngo VD. Causal evaluation of urban greenway retrofit: A longitudinal study on physical activity and sedentary behavior. Prev Med. 2019;123:109–16. https://0-doi-org.brum.beds.ac.uk/10.1016/j.ypmed.2019.01.011.

    Article  PubMed  Google Scholar 

  11. Cain, K. L., Geremia, C. M., Conway, T. L., Frank, L. D., Chapman, J. E., Fox, E. H., … Sallis, J. F. (2018). Development and reliability of a streetscape observation instrument for international use: MAPS-global. Int J Behav Nutr Phys Activity, 15(1), 1–11. https://0-doi-org.brum.beds.ac.uk/10.1186/s12966-018-0650-z.

  12. Cain, K. L., Millstein, R. A., Sallis, J. F., Conway, T. L., Gavand, K. A., Frank, L. D., … King, A. C. (2014). Contribution of streetscape audits to explanation of physical activity in four age groups based on the Microscale Audit of Pedestrian Streetscapes (MAPS). Social Science and Medicine. https://0-doi-org.brum.beds.ac.uk/10.1016/j.socscimed.2014.06.042.

  13. Ewing R, Hajrasouliha A, Neckerman KM, Purciel-Hill M, Greene W. Streetscape Features Related to Pedestrian Activity. Journal of Planning Education Research. 2016. https://0-doi-org.brum.beds.ac.uk/10.1177/0739456X15591585.

    Article  Google Scholar 

  14. Janssen I, Rosu A. Measuring sidewalk distances using Google Earth. BMC Med Res Methodol. 2012;12(1):39. https://0-doi-org.brum.beds.ac.uk/10.1186/1471-2288-12-39.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Mooney SJ, Bader MDM, Lovasi GS, Neckerman KM, Teitler JO, Rundle AG. Validity of an ecometric neighborhood physical disorder measure constructed by virtual street audit. Am J Epidemiol. 2014;180(6):626–35. https://0-doi-org.brum.beds.ac.uk/10.1093/aje/kwu180.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Vanwolleghem, G., Ghekiere, A., Cardon, G., De Bourdeaudhuij, I., D’Haese, S., Geremia, C. M., … Van Dyck, D. (2016). Using an audit tool (MAPS Global) to assess the characteristics of the physical environment related to walking for transport in youth: reliability of Belgian data. Int J Health Geographics, 15(1), 41. https://0-doi-org.brum.beds.ac.uk/10.1186/s12942-016-0069-1.

  17. Phillips, C. B., Engelberg, J. K., Geremia, C. M., Zhu, W., Kurka, J. M., Cain, K. L., … Adams, M. A. (2017). Online versus in-person comparison of Microscale Audit of Pedestrian Streetscapes (MAPS) assessments: reliability of alternate methods. Int J Health Geographics, 16(1), 27. https://0-doi-org.brum.beds.ac.uk/10.1186/s12942-017-0101-0.

  18. Charreire, H., Mackenbach, J. D., Ouasti, M., Lakerveld, J., Compernolle, S., Ben-Rebah, M., … Oppert, J. M. (2014). Using remote sensing to define environmental characteristics related to physical activity and dietary behaviours: A systematic review (the SPOTLIGHT project). Health and Place. https://0-doi-org.brum.beds.ac.uk/10.1016/j.healthplace.2013.09.017.

  19. Clarke P, Ailshire J, Melendez R, Bader M, Morenoff J. Using Google Earth to conduct a neighborhood audit: Reliability of a virtual audit instrument. Health Place. 2010;16(6):1224–9. https://0-doi-org.brum.beds.ac.uk/10.1016/j.healthplace.2010.08.007.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Kelly CM, Wilson JS, Baker EA, Miller DK, Schootman M. Using Google Street View to audit the built environment: Inter-rater reliability results. Ann Behav Med. 2013. https://0-doi-org.brum.beds.ac.uk/10.1007/s12160-012-9419-9.

    Article  PubMed  Google Scholar 

  21. Lee S, Talen E. Measuring Walkability: A Note on Auditing Methods. Journal of Urban Design. 2014;19(3):368–88. https://0-doi-org.brum.beds.ac.uk/10.1080/13574809.2014.890040.

    Article  Google Scholar 

  22. Mckee, M., Rutter, H., Charreire, H., Oppert, J., Mackenbach, J., Ouasti, M., … Using, M. B. (2013). Using remote sensing to define environmental characteristics related to physical activity and dietary behaviours : a systematic review. Health Place, 25, 1–9. https://0-doi-org.brum.beds.ac.uk/10.1016/j.healthplace.2013.09.017.

  23. Pliakas, T., Hawkesworth, S., Silverwood, R. J., Nanchahal, K., Grundy, C., Armstrong, B., … Lock, K. (2017). Optimising measurement of health-related characteristics of the built environment: Comparing data collected by foot-based street audits, virtual street audits and routine secondary data sources. Health and Place. https://0-doi-org.brum.beds.ac.uk/10.1016/j.healthplace.2016.10.001.

  24. Rundle AG, Bader MDM, Richards CA, Neckerman KM, Teitler JO. Using google street view to audit neighborhood environments. Am J Prev Med. 2011;40(1):94–100. https://0-doi-org.brum.beds.ac.uk/10.1016/j.amepre.2010.09.034.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Ben-Joseph E, Lee JS, Cromley EK, Laden F, Troped PJ. Virtual and actual: Relative accuracy of on-site and web-based instruments in auditing the environment for physical activity. Health Place. 2013;19(1):138–50. https://0-doi-org.brum.beds.ac.uk/10.1016/j.healthplace.2012.11.001.

    Article  PubMed  Google Scholar 

  26. Twardzik E, Antonakos C, Baiers R, Dubowitz T, Clarke P, Colabianchi N. Validity of environmental audits using GigaPan®and Google Earth Technology. International Journal of Health Geographics. 2018. https://0-doi-org.brum.beds.ac.uk/10.1186/s12942-018-0147-7.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Millstein, R. a, Cain, K., Sallis, J., Conway, T., Geremia, C., Frank, L., … Saelens, B. (2013). Development, scoring, and reliability of the Microscale Audit of Pedestrian Streetscapes (MAPS). BMC Public Health, 13, 403. https://0-doi-org.brum.beds.ac.uk/10.1186/1471-2458-13-403.

  28. Sallis, J. F., Cain, K. L., Conway, T. L., Gavand, K. A., Millstein, R. A., Geremia, C. M., … King, A. C. (2015). Is Your Neighborhood Designed to Support Physical Activity? A Brief Streetscape Audit Tool. Prev Chronic Dis, 12, 1–11. https://0-doi-org.brum.beds.ac.uk/10.5888/pcd12.150098.

  29. Cain KL, Gavand KA, Conway TL, Geremia CM, Millstein RA, Frank LD, Saelens BE, Adams MA, Glanz K, King AC, Sallis JF. Developing and validating an abbreviated version of the Microscale Audit for Pedestrian Streetscapes (MAPS-Abbreviated). Journal of Transport Health. 2017;5:84–96.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Zhu, W., Sun, Y., Kurka, J., Geremia, C., Engelberg, J. K., Cain, K., … Adams, M. A. (2017). Reliability between online raters with varying familiarities of a region: Microscale Audit of Pedestrian Streetscapes (MAPS). Landscape Urban Planning, 167(November 2016), 240–248. https://0-doi-org.brum.beds.ac.uk/10.1016/j.landurbplan.2017.06.014.

  31. Sallis, J. F., Saelens, B. E., Frank, L. D., Conway, T. L., Slymen, D. J., Cain, K. L., … Kerr, J. (2009). Neighborhood built environment and income: Examining multiple health outcomes. Soc Sci Med, 68(7), 1285–1293. https://0-doi-org.brum.beds.ac.uk/10.1016/J.SOCSCIMED.2009.01.017.

  32. Sallis, J. F., Bowles, H. R., Bauman, A., Ainsworth, B. E., Bull, F. C., Craig, C. L., … Bergman, P. (2009). Neighborhood Environments and Physical Activity Among Adults in 11 Countries. Am J Prev Med, 36(6), 484–490. https://0-doi-org.brum.beds.ac.uk/10.1016/j.amepre.2009.01.031.

  33. Cerin E, Sit CH, Wong SH, Huang YJ, Gao GY, Lai PC, Macfarlane DJ, Barnett A. Relative contribution and interactive effects of psychological, social, and environmental correlates of physical activity, sedentary behaviour, and dietary behaviours in Hong Kong adolescents. Hong Kong Med J. 2019;25(Suppl 2):34–9.

    PubMed  Google Scholar 

  34. De Meester F, Van Dyck D, De Bourdeaudhuij I, Deforche B, Cardon G. Do psychosocial factors moderate the association between neighborhood walkability and adolescents’ physical activity? Soc Sci Med. 2013;81:1–9.

    Article  PubMed  Google Scholar 

  35. Lachapelle U, Frank LD, Saelens BE, Sallis JF, Conway TL. Commuting by public transit and physical activity: Where you live, where you work, and how you get there. Journal of Physical Activity Health. 2011;8(1):72.

    Article  Google Scholar 

  36. Molina-García J, Queralt A, Adams MA, Conway TL, Sallis JF. Neighborhood built environment and socio-economic status in relation to multiple health outcomes in adolescents. Prev Med. 2017;105:88–94.

    Article  PubMed  Google Scholar 

  37. World Health Organization. (2018). WHO global action plan on physical activity 2018–2030. Retrieved from http://www.who.int/dietphysicalactivity/publications/9789241599979/en/.

  38. Cain KL, Salmon J, Conway TL, Cerin E, Hinckson E, Mitáš J, Schipperijn J, Frank LD, Ajana RM, Barnett A, Dygrýn J, Islam MZ, Molina-Garcia J, Moran M, Muda WW, Oyeyemi WA, Reis AL, Santos R, Schmidt MP, Schofield T, Timperio G, van Dyck A, D., and Sallis JF. (in press). The International Physical Activity and Built Environment Study of Adolescents: IPEN Adolescent design, protocol, and measures. BMJ Open.

  39. Adlakha D, Hipp AJ, Marx C, Yang L, Tabak R, Dodson EA, Brownson RC. (2015). Home and workplace built environment supports for physical activity. Am J Prev Med, 48. https://0-doi-org.brum.beds.ac.uk/10.1016/j.amepre.2014.08.023.

  40. Hurvitz PM, Moudon AV. Home versus nonhome neighborhood: Quantifying differences in exposure to the built environment. Am J Prev Med. 2012;42(4):411–7. https://0-doi-org.brum.beds.ac.uk/10.1016/j.amepre.2011.11.015.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Cohen J. A coefficient of agreement for nominal scales. Ed Psych Measurement. 1960;20(1):37–46.

    Article  Google Scholar 

  42. Landis JR, Koch GG. The Measurement of Observer Agreement for Categorical Data. Biometrics. 1977;33(1):159–74. https://0-doi-org.brum.beds.ac.uk/10.2307/2529310.

    Article  CAS  PubMed  Google Scholar 

  43. Pikora TJ, Bull FCL, Jamrozik K, Knuiman M, Giles-Corti B, Donovan RJ. Developing a reliable audit instrument to measure the physical environment for physical activity. Am J Prev Med. 2002;23(3):187–94. https://0-doi-org.brum.beds.ac.uk/10.1016/S0749-3797(02)00498-1.

    Article  PubMed  Google Scholar 

  44. Cicchetti D. Methodological Commentary The Precision of Reliability and Validity Estimates Re-Visited: Distinguishing Between Clinical and Statistical Significance of Sample Size Requirements. J Clin Exp Neuropsychol. 2001;23(5):695–700. https://0-doi-org.brum.beds.ac.uk/10.1076/jcen.23.5.695.1249.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

The authors would like to acknowledge the data collection observers who participated in all study regions. In Hong Kong, the authors thank Casper Zhang, Kilo Leung, and Ryan Lip for assisting with the data collection.

Funding

Funding for the IPEN Adolescent study was made possible by a grant from the National Institutes of Health (NIH) R01 CA127296. The role of the funding body was to disperse the funds and monitor the activities of the grantees. Ester Cerin was supported by an Australian Research Council Future Fellowship (FT #140100085).

Author information

Authors and Affiliations

  1. Urban Design 4 Health, Inc., Rochester, NY, USA

    Eric H. Fox, James E. Chapman, Abraham M. Moland, Nicole E. Alfonsin, Lawrence D. Frank & Suzanne E. Kershaw

  2. Department of Urban Studies and Planning, University of California San Diego, San Diego, CA, USA

    Lawrence D. Frank

  3. Department of Family Medicine and Public Health (now Herbert Wertheim School of Public Health and Human Longevity Science), University of California San Diego, San Diego, CA, USA

    James F. Sallis, Terry L. Conway, Kelli L. Cain & Carrie Geremia

  4. Mary MacKillop Institute for Health Research, Australian Catholic University, Melbourne, Australia

    James F. Sallis, Terry L. Conway, Kelli L. Cain & Ester Cerin

  5. School of Public Health, The University of Hong Kong, Hong Kong, China

    Ester Cerin

  6. Faculty of Medicine and Health Sciences, Department of Movement and Sport Sciences, Ghent University, Ghent, Belgium

    Griet Vanwolleghem & Delfien Van Dyck

  7. Department of Nursing, University of Valencia, Valencia, Spain

    Ana Queralt

  8. Department of Teaching of Musical, Visual, and Corporal Expression, University of Valencia, Valencia, Spain

    Javier Molina-GarcĂ­a

  9. Postgraduate Program in Health Sciences, Pontifical Catholic University of Parana, Curitiba, Brazil

    Adriano Akira Ferreira Hino

  10. Postgraduate Program in Public Health, Federal University of Santa Catarina, Florianopolis, Brazil

    Adalberto Aparecido dos Santos Lopes

  11. Institute for Physical Activity and Nutrition, School of Exercise & Nutrition Science, Deakin University, Geelong, Australia

    Jo Salmon & Anna Timperio

Authors
  1. Eric H. Fox
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. James E. Chapman
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Abraham M. Moland
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Nicole E. Alfonsin
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Lawrence D. Frank
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. James F. Sallis
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Terry L. Conway
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Kelli L. Cain
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Carrie Geremia
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Ester Cerin
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Griet Vanwolleghem
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Delfien Van Dyck
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Ana Queralt
    View author publications

    You can also search for this author in PubMed Google Scholar

  14. Javier Molina-GarcĂ­a
    View author publications

    You can also search for this author in PubMed Google Scholar

  15. Adriano Akira Ferreira Hino
    View author publications

    You can also search for this author in PubMed Google Scholar

  16. Adalberto Aparecido dos Santos Lopes
    View author publications

    You can also search for this author in PubMed Google Scholar

  17. Jo Salmon
    View author publications

    You can also search for this author in PubMed Google Scholar

  18. Anna Timperio
    View author publications

    You can also search for this author in PubMed Google Scholar

  19. Suzanne E. Kershaw
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

EHF led the study, managed the remote observer data acquisition, analyzed the data, synthesized results, and wrote the manuscript. JEC assisted with the study design and analysis approach, as well as contributed to manuscript preparation. AM assisted with the statistical analyses. NEA assisted with the interpretation of results and contributed to manuscript preparation. LDF helped developed the study design and contributed to the manuscript. JFS, TLC, KLC, CG lead the larger IPEN Adolescent study, developed the MAPS-Global tool, guided the manuscript design, and contributed to the manuscript. EC, KLC, MAA, GRS, JS, AT, LBC, SM, EH, AAFH, DVD, GVW, AQ, JMG, and AASL led the national data collections from their respective research institutions. SEK helped perform the statistical analyses and participated in the remote data collection. All authors read the final manuscript and consent to approval for publication.

Corresponding author

Correspondence to Eric H. Fox.

Ethics declarations

Ethics approval and consent to participate

All investigators completed the San Diego State University Institutional Review Board training, the National Institutes of Health (NIH) Fogarty International Center ethical requirements, and their own country’s ethics requirements. All participants provided informed consent for participation in their country-level study.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Fox, E.H., Chapman, J.E., Moland, A.M. et al. International evaluation of the Microscale Audit of Pedestrian Streetscapes (MAPS) Global instrument: comparative assessment between local and remote online observers. Int J Behav Nutr Phys Act 18, 84 (2021). https://0-doi-org.brum.beds.ac.uk/10.1186/s12966-021-01146-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12966-021-01146-3

Keywords

International Journal of Behavioral Nutrition and Physical Activity

ISSN: 1479-5868

Contact us