Next Article in Journal
A Mediation Model between Self-Esteem, Anxiety, and Depression in Sport: The Role of Gender Differences in Speleologists
Previous Article in Journal
Acute Effects of Tecar Therapy on Skin Temperature, Ankle Mobility and Hyperalgesia in Myofascial Pain Syndrome in Professional Basketball Players: A Pilot Study
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJERPH
Volume 18
Issue 16
10.3390/ijerph18168764
ijerph-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Using a Naturalistic Store Laboratory for Clinical Trials of Point-of-Sale Nutrition Policies and Interventions: A Feasibility and Validation Study

by
Marissa G. Hall
1,2,3,*,
Isabella C. A. Higgins
1,3,
Anna H. Grummon
4,5,
Allison J. Lazard
2,6,
Carmen E. Prestemon
3,
Jennifer Mendel Sheldon
2 and
Lindsey Smith Taillie
3,7
1
Department of Health Behavior, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
2
Lineberger Comprehensive Cancer Center, University of North Carolina at Chapel Hill, Chapel Hill, NC 27514, USA
3
Carolina Population Center, University of North Carolina at Chapel Hill, Chapel Hill, NC 27516, USA
4
Harvard Center for Population and Development Studies, Harvard TH Chan School of Public Health, Cambridge, MA 02138, USA
5
Department of Population Medicine, Harvard Medical School, Harvard Pilgrim Health Care Institute, Boston, MA 02215, USA
6
Hussman School of Journalism and Media, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
7
Department of Nutrition, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2021, 18(16), 8764; https://doi.org/10.3390/ijerph18168764
Submission received: 16 July 2021 / Revised: 13 August 2021 / Accepted: 15 August 2021 / Published: 19 August 2021
Browse Figures
Versions Notes

Abstract

:
Point-of-sale policies such as warnings and taxes are promising tools for improving the nutritional quality of food purchases. Research studies conducted in naturalistic store laboratories could improve the quality of evidence about point-of-sale interventions by allowing for realistic exposure in a controlled setting. This study aimed to assess whether purchasing behavior in a naturalistic store laboratory setting was similar to real-life purchasing behavior and to evaluate participants’ perceptions of store realism and the acceptability of research study protocols in this setting. In a longitudinal observational study in 2019, Latinx parents in North Carolina (n = 61) attended five weekly visits at the UNC Mini Mart, a naturalistic store laboratory that resembled a small convenience store. At each visit, participants purchased a week’s supply of beverages. Purchases of beverages in the Mini Mart were compared to participants’ purchases from receipts submitted the week prior to the study. Analyses compared the percentage of participants buying sugary drinks and non-sugary drinks in the Mini Mart vs. in real stores using Chi-Square tests with Fisher’s p. The percentage of parents who purchased sugary drinks in the Mini Mart (93%) was not significantly different from the percentage who purchased sugary drinks during the week before the study (74%, p = 0.28). The percentage purchasing non-sugary drinks was similar in the two settings (85% in the Mini Mart vs. 85% from receipts, p = 0.33). Nearly all participants reported that their Mini Mart purchases were similar to real-life purchases (96%); the Mini Mart felt like a real store (94%); they could find all the beverages they were looking for (92%); and they could imagine doing their real-life beverage shopping in the Mini Mart (92%). Moreover, retention was high, with 97% of participants attending the final study visit. These results indicate that naturalistic store laboratories are a promising method for increasing the ecological validity of trials to evaluate point-of-sale interventions.

1. Introduction

Poor quality diets, including high consumption of sugary drinks and ultra-processed food, are a major contributor to morbidity and mortality [1,2,3]. Solutions to encourage healthier food purchases in retail settings are urgently needed. Nutrition-related point-of-sale policies and interventions that have shown promise include excise taxes on sugary drinks and ultra-processed food [4,5,6,7]; marketing restrictions [8,9]; and requiring warning labels on sugary drinks and ultra-processed food [9,10,11,12,12]. Most evidence on these policies comes from either real-world observational studies or laboratory-based experimental studies. Observational studies tend to have high external validity but may be limited in their ability to eliminate alternative explanations for observed changes [13]. By contrast, experiments can allow for stronger causal inference but often occur in artificial settings and rely on self-reported outcomes, which may limit their generalizability to real-world settings and behaviors [13]. For example, prior experiments of nutrition interventions have typically involved showing participants a food or beverage product via an online survey, after which participants rate their perceptions of the product or their intentions to purchase the product [10,14,15,16]. Online experiments have several benefits, including that they allow for manipulation of many experimental arms within the same study; can be conducted at relatively low cost; can easily be conducted in national samples; and can provide early insights about the potential for policies to change behavior. However, participants’ stated impressions of products do not perfectly predict actual behavior change [17,18].
By contrast, naturalistic laboratories that resemble real-world stores offer a novel solution for providing high-quality evidence about the effect of point-of-sale interventions on consumer behavior. Store laboratories can create a naturalistic, immersive experience that mimics real-life shopping experiences. These labs also allow researchers to measure real-life behavioral outcomes, which may have better construct validity than self-reported outcomes [19]. Moreover, store laboratories enable researchers to randomly assign participants to experience different interventions, allowing for strong causal inference without needing to rely on partnerships with retailers who may be resistant to implementing point-of-sale policies like taxes or warning labels. Studies have successfully used laboratory stores to examine point-of-sale interventions to reduce the purchase of sugary drinks [20], as well as tobacco [21,22] and alcohol [23]. However, studies have not yet examined the validity of using store laboratories as a proxy for real-world purchases, including evaluating 1) the extent to which behavior in store laboratories mirrors behavior in the world and 2) the extent to which participants perceive store laboratories to resemble real-world environments. Moreover, the feasibility of using store laboratories for longitudinal data collection remains to be established, especially among populations at risk for diet-related health disparities.
To address the need for novel methods for testing point-of-sale nutrition policies and interventions, we conducted a validation and feasibility pilot study. The study took place in a naturalistic store laboratory and focused on parents who identify as Latino/a/x or Hispanic (hereinafter “Latinx”), given high rates of sugary drink consumption among Latinx parents and children [24,25,26]. We focused on sugary beverages because the consumption of sugary drinks is associated with health outcomes such as obesity and type 2 diabetes [27]. Thus, we aimed to assess whether beverage purchasing behavior in the store laboratory setting was similar to real-life beverage purchasing behavior. In addition, we aimed to examine whether participants viewed the store as being realistic and whether the protocol was feasible and acceptable.

2. Materials and Methods

2.1. Store Development

The research study was conducted at the UNC Mini Mart (Mini Mart), a naturalistic laboratory designed to mimic a real-life store (Figure 1). The Mini Mart measures 245 square feet and contains a commercial refrigerator, two gondola shelving units, and a register stand with a fully functioning point-of-sale payment system. For this study, the Mini Mart contained more than 200 unique packaged beverage products and approximately 60 unique food products and household goods. The process for selecting products and pricing the products is described in Supplementary Exhibit S1.
After initially stocking the Mini Mart, we invited ten Latinx community members to visit. The community members navigated the store to provide input on what products they felt were missing and how we could better organize the store to seem more realistic. We then added several new products and made additional organizational changes to the store layout based on their feedback.

2.2. Study Protocol

Participants attended five visits at the Mini Mart, spaced approximately one week apart (for a summary of each study visit, see Supplementary Table S2). At all visits, participants completed a shopping task, took an online survey, and received an incentive. At Visit 1, participants provided written informed consent. At Visits 1 and 3, participants provided beverage receipts from the prior week. At Visits 2–5, all sugary drinks were taxed (tax cohort) or labeled (warning cohort) (cohorts described below). At Visit 5, participants completed an exit interview after the online survey and received an informational handout on sugary drinks. The incentive for Visits 1–4 totaled USD 45 per visit and USD 70 for Visit 5. The incentive comprised of the total value of the items acquired from the Mini Mart plus the remaining value added to a Visa gift card.

2.3. Receipt Collection

At Visits 1 and 3, participants were asked to provide all their grocery receipts from the prior week. This included supermarkets, department stores with groceries (e.g., Target), convenience stores, drug stores, and farmers’ markets, and did not include receipts from restaurants, fast-food establishments, or coffee shops. Additional details regarding receipt collection appear in Supplementary Exhibit S1.

2.4. Shopping Task and Survey

At each visit, the research staff led a participant into the Mini Mart for a shopping task, instructing said participant to select a week’s supply of beverages for their household with a minimum of two beverages. Participants could also select food and household goods from the store. Children could accompany the participants in the Mini Mart. After completing the shopping task, the research assistant recorded the selected groceries using the point-of-sale system, notified the participant of the final cost, and bagged the groceries. The research staff then led the participant to a computer lab to complete a self-administered survey (programmed using Qualtrics) on either a computer or tablet. Participants took their food and beverages home, with the price deducted from their study incentive as described above. At Visits 2–5, participants were exposed to study stimuli in the store during their shopping task (Supplementary Figure S1). Additional details about study stimuli appear in Supplementary Exhibit S1).

2.5. Measures

The Visit 1 survey assessed standard demographic measures and beverage intake with items adapted from the Beverage Intake Questionnaire (BEVQ-15) [28]. The Visit 5 survey assessed reactions to study stimuli that are known to predict behavior change. The Visit 5 survey also assessed study acceptability using existing measures [29,30] and realism of the store using new items. Exact item wording appears in Supplementary Table S1. Several Visit 5 process measure responses were collected over the phone due to an error with survey programming. The survey could be completed in English or Spanish based on participants’ preferences.

2.6. Analysis

For validation analyses, we calculated the percentage of participants that purchased each of the following beverage categories: (1) 100% fruit juice; (2) coffee and tea; (3) fruit drinks; (4) milk; (5) sports and energy drinks and flavored water; (6) soda; and (7) water in stores (i.e., according to receipts from the prior seven days before Visit 1) compared to in the Mini Mart during the Visit 1 shopping task. We then compared the percentages from real-world purchases vs. Mini Mart purchases for sugary drinks and non-sugary drinks using Chi-Square tests with Fisher’s p. We also reported the percentage agreement for purchasing any sugary drinks and purchasing any non-sugary drinks. We descriptively compared the medians of total volume in mL purchased from stores (i.e., according to receipts provided at Visit 1) and the total volume in mL purchased at the Mini Mart at Visit 1. For these calculations, we created a per capita/per day variable by dividing the volume in mL by household members and then dividing that number by seven. We reported results both including and excluding coffee and tea because these tend to be purchased in bulk and thus infrequently. We did not compare Visit 3 receipts with Mini Mart purchases because we did not expect them to be similar (participants were instructed to buy their beverages in the Mini Mart for that week). Analyses used Stata/SE version 16.

3. Results

Participants’ mean age was 36 years and nearly all were women (98%, Table 1). Most (84%) reported educational attainment of a high school diploma or less and 75% earned an annual household income of less than $25,000. Most (82%) completed the Visit 1 survey in Spanish and 72% spoke mostly or only Spanish at home. Over half (57%) reported a BMI in the overweight or obese categories.

3.1. Validation

Overall, the percentage of parents who purchased sugary drinks in the Mini Mart (93%) was similar and not statistically significantly different from receipts (74%, p = 0.28), as well as non-sugary drinks (85% in the Mini Mart vs. 85% from receipts, p = 0.33). The percentage agreement was high for purchasing sugary drinks (74%) and non-sugary drinks (70%). The percentage of participants who purchased various beverages types is depicted in Figure 2. There was some variation within the subcategories of beverages. For example, 49% of people purchased soda according to receipt purchases compared to 41% in the Mini Mart, and 15% of people purchased 100% juice based on receipts compared to 28% in the Mini Mart.
The median per capita volume of purchases (mL) per day and interquartile range (IQR) is presented in Supplementary Table S3. Comparing the total volume, parents purchased more beverages from stores (342 mL/capita/day, IQR 203–1238) than in the Mini Mart (319 mL/capita/day, IQR 176–476). Parents also purchased more non-sugary drinks from stores (245 mL/capita/day, IQR 110–686) than from the Mini Mart (137 mL/capita/day, IQR 18–269). Parents purchased fewer sugary drinks from stores (108 mL/capita/day, IQR 0–289) compared to the Mini Mart (152 mL/capita/day, IQR 74–276).
Nearly all participants reported that their Mini Mart purchases were similar to real-life purchases (96%, Figure 3), that the Mini Mart felt like a real store (94%), and that they could find all the beverages they were looking for (92%). Moreover, nearly all participants reported that they could imagine completing their real-life beverage shopping in the Mini Mart (92%) and that there were enough beverage options (88%).

3.2. Process Measures

Participants found the study to be highly acceptable. Nearly all (98%) would recommend the study to a friend, 95% would participate in the study again, and 76% found participating in the study easy or very easy (Figure 3). Retention was very high, with 97% of participants attending the final study visit. Nearly all (92%) participants attended all five study visits, and 96% of total study visits were attended out of all possible visits. Reactions to stimuli appear in Supplementary Table S4.

4. Discussion

This study examined the validity and feasibility of using the Mini Mart, a naturalistic store laboratory, to evaluate the impact of point-of-sale policies and interventions on beverage purchases. We found that participants’ beverage purchasing patterns in the store laboratory were similar to their purchases in real stores. Moreover, the study protocol resulted in high retention and high acceptability. This realistic store laboratory holds promise for evaluating the impact of a variety of point-of-sale strategies on behavior change, including the effect of interventions on real-life purchasing behavior over time.
Participants’ purchases from the receipt data collection and in the Mini Mart showed a high level of agreement in the percentage of parents who purchased sugary drinks. The proportion purchasing non-sugary drinks was also similar across the two settings. However, receipt data from stores showed a higher volume of overall beverage purchases, lower volume of sugary drink purchases, and higher volume of non-sugary drink purchases compared to the Mini Mart. One possibility for the observed differences is that participants may have purchased fewer beverages in the Mini Mart because the Mini Mart was located on the second floor of a building and only had shopping baskets, not carts, therefore limiting the volume participants could carry. In addition, although the study budget was designed to reflect typical beverage expenditures, the budget was set at an average based on top grocery retailers in North Carolina and might not reflect a given family’s shopping budget, especially given that the majority of participants reported an annual household income below $25,000. If the Mini Mart budget was larger than a parent’s typical budget, an income effect may have led parents to purchase products in the Mini Mart that they might not typically buy [31], potentially including more sugary drinks. Future studies could construct more tailored budgets based on a household’s typical expenditures [32]. A third possibility is that the receipt collection is itself an imperfect approach for assessing typical beverage purchases. It is possible that not all receipts were reported and the act of collecting receipts could have changed participants’ behavior. In addition, one week of receipt data may not be representative of a household’s “typical” purchases [33]. Receipt collection occurred the week prior to participants starting the study in the Mini Mart. This could have posed a particular problem for items purchased in bulk (e.g., multipacks of water); if parents purchased these products the week before, they may not have needed to purchase these items in the Mini Mart. In the future, it would be useful to validate Mini Mart results with multiple weeks of receipt data and collect these with a washout period of at least two weeks prior to beginning Mini Mart visits.
In our study, we found that the store felt realistic to participants. Over 90% of participants stated that their purchases were similar to real-life, that the Mini Mart felt like a real store, and that they could imagine completing their grocery shopping there. Although 88% stated that there were enough beverage options, this is one area for potential improvement, as it is possible that the 12% who felt there were inadequate beverage options purchased less, resulting in the overall reduced beverage purchases we observed in the Mini Mart. One possibility would be to conduct a pre-experiment survey to identify the most-purchased products among participants and use those data to selectively stock the store with brands that are most frequently consumed by participants in the study. That said, randomized trials are internally valid even if participants’ purchases differ somewhat from real life because the observed differences across treatment groups can still be attributed to the treatment.
The longitudinal study protocol was feasible and acceptable to participants. We recruited 61 Latinx parents to attend five study visits within the intended timeframe of three months. The ease of recruitment offers a promising sign for subsequent trials using similar methods, given that the main reason trials are terminated early is low enrollment [34]. All but two participants attended the final study visit, representing 97% retention, which is well above the typical threshold for acceptable retention of around 80% [35]. High retention in trials is important for both ensuring timely study completion and preventing potential biases caused by differential attrition by trial arm [35]. Nearly all (95% or more) participants said they would recommend the study to a friend and that they would participate in the study again if they had the opportunity. These acceptability ratings are similar to a tobacco study protocol [30] that was used successfully in two large-scale randomized trials [36,37].
There are advantages and disadvantages of utilizing a physical store laboratory compared to other approaches. Working directly with retailers would allow for a truly “real-world” setting for a trial, but collaborating with retailers presents challenges such as: finding retailers willing to participate in studies; obtaining transaction data; and randomizing at the individual level. In addition, food retailers may be reluctant to test interventions they view as potentially harmful to sales, such as taxes or warning labels. Another viable option is to conduct experiments in virtual 3D stores [38,39,40], which may facilitate faster and more affordable recruitment, although the simulated shopping environment is not as realistic as a physical store. Finally, some studies have used experimental online stores intended to replicate online grocery shopping or food ordering websites [41,42]. Online stores may also allow for faster recruitment and can be very realistic for people who typically buy groceries online; rates of online shopping have increased during the COVID-19 pandemic [43]. However, online stores would provide a less realistic experience for people who do not shop online.
Researchers should consider the relative advantages of different study settings alongside budget to determine the best path forward. Scientists who wish to use a physical store laboratory might consider partnering with colleagues studying different health issues (e.g., nutrition, tobacco, alcohol) and pooling resources to create a physical store laboratory that can be used in a variety of studies. The total amount of space required to create a store laboratory could be relatively small depending on the type of environment being emulated. For example, we were able to stock over 200 unique beverages, similar to beverage offerings in a grocery store, plus 60 additional food and household products in only 245 square feet of space. Finally, before conducting clinical trials in store laboratories, researchers should consider budgeting for pilot studies to develop and test protocols for: (1) managing inventory throughout the study; (2) exposing participants to study stimuli; (3) randomizing participants to study arms; (4) providing shopping instructions to participants; (5) tracking participants’ selections; and (6) collecting and administering payment exchanges.
The use of a novel, realistic store laboratory resembling a real store was one strength of this study. We also successfully recruited and retained a sample of Latinx adults, an important population for nutrition research that is often underrepresented in research studies [44,45]. However, the generalizability of our findings to other populations, locations, and product types remains to be established. Finally, the small sample size and non-randomized design precluded us from examining the effects of tax and labeling policies, which were beyond the scope of this feasibility study.

5. Conclusions

Many experiments evaluating policies and interventions have been conducted using artificial exposure and settings, which can mask the complexity of real-world decision making in which consumers must evaluate many products and factors (e.g., price, marketing, quality, brand preferences) quickly and at once. Our naturalistic store laboratory addresses these limitations by improving the realism of point-of-sale studies, while still allowing for experimental control. This model could be leveraged to evaluate the impact of a variety of public health strategies (e.g., excise taxes, manipulating product placement) on the healthfulness of food purchases.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/ijerph18168764/s1, Table S1: Measures used in study in the UNC Mini Mart, a naturalistic store laboratory. Measures assessed at Visit 5, Table S2: Protocol elements for study in UNC Mini Mart, a naturalistic store laboratory, Table S3: Total volume of beverages purchased, measured via receipts at baseline visit compared to purchases in UNC Mini Mart at Visit 1(mL/capita/day), Table S4: Reactions to sugary drink price increases and warning labels in the UNC Mini Mart, a naturalistic convenience store lab, Figure S1: Stimuli used the UNC Mini Mart, a naturalistic convenience store lab, Exhibit S1: Additional methodological details about product selection, pricing, and receipt data entry.

Author Contributions

M.G.H.: Conceptualization, methodology, writing—original draft, writing—review and editing, supervision, funding acquisition. I.C.A.H.: project administration, methodology, writing—original draft, writing—review and editing, formal analysis. A.H.G.: conceptualization, methodology, writing—review and editing. A.J.L.: conceptualization, methodology, writing—review & editing. C.E.P.: project administration, methodology, writing—review and editing. J.M.S.: project administration, methodology, writing—review and editing. L.S.T.: conceptualization, methodology, writing—review and editing, supervision, funding acquisition. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by NC TraCS grants 550KR201820 and SE1910. The project described was supported by the National Center for Advancing Translational Sciences (NCATS), National Institutes of Health (NIH), through Grant Award Number UL1TR002489. General support was provided by NIH grants to the Carolina Population Center (grant numbers P2C HD050924, P30 AG066615, and T32 HD007168). K01HL147713 from the National Heart, Lung, and Blood Institute of the NIH supported Marissa Hall’s time writing the paper. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH. We used data reported by Nielsen through its Homescan Services to determine which beverages to stock and how to set prices in the store. The conclusions drawn from the Nielsen data are those of UNC and do not reflect the views of Nielsen. Nielsen is not responsible for, had no role in, and was not involved in analyzing and preparing the results reported herein.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Institutional Review Board of the University of North Carolina at Chapel Hill (protocol code # 19-0277, approved 23 May 2019).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Acknowledgments

We thank Pilar Rocha-Goldberg and the team at El Centro Hispano for their consultation and collaboration on this project. We also thank Caitlin Lowery and Alice Wistar for their contributions to the study methodology in preparation for data collection. We thank Mirian Avendaño, Ana Richter, Hannah Rayala, and Zamantha Granados for their work recruiting, enrolling, and taking participants through the research study. We thank Alice Ammerman, Anne Cole, Beverly Garcia, Christina Rodriguez, and the UNC Center for Health Promotion and Disease Prevention for providing the space for the UNC Mini Mart and their support with logistics and administration for the study. We have received permission to acknowledge the people listed here.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. World Health Organization. WHO Global Report: Mortality Attributable to Tobacco; World Health Organization: Geneva, Switzerland, 2012. [Google Scholar]
  2. Health effects of dietary risks in 195 countries, 1990–2017: A systematic analysis for the Global Burden of Disease Study 2017. Lancet 2019, 393, 1958–1972. [CrossRef] [Green Version]
  3. Rehm, J.; Shield, K.D. Alcohol and mortality: Global alcohol-attributable deaths from cancer, liver cirrhosis, and injury in 2010. Alcohol Res. Curr. Rev. 2014, 35, 174. [Google Scholar]
  4. Batis, C.; Rivera, J.A.; Popkin, B.M.; Taillie, L.S. First-Year Evaluation of Mexico’s Tax on Nonessential Energy-Dense Foods: An Observational Study. PLoS Med. 2016, 13, e1002057. [Google Scholar] [CrossRef] [Green Version]
  5. Colchero, M.A.; Popkin, B.M.; Rivera, J.A.; Ng, S.W. Beverage purchases from stores in Mexico under the excise tax on sugar sweetened beverages: Observational study. BMJ 2016, 352, h6704. [Google Scholar] [CrossRef] [Green Version]
  6. Powell, L.M.; Leider, J. The impact of Seattle’s Sweetened Beverage Tax on beverage prices and volume sold. Econ. Hum. Biol. 2020, 37, 100856. [Google Scholar] [CrossRef]
  7. Teng, A.M.; Jones, A.C.; Mizdrak, A.; Signal, L.; Genç, M.; Wilson, N. Impact of sugar-sweetened beverage taxes on purchases and dietary intake: Systematic review and meta-analysis. Obes. Rev. 2019, 20, 1187–1204. [Google Scholar] [CrossRef]
  8. Mediano Stoltze, F.; Reyes, M.; Taillie, L.S.; Correa, T.; Corvalán, C.; Carpentier, F.R.D. Prevalence of Child-Directed Marketing on Breakfast Cereal Packages before and after Chile’s Food Marketing Law: A Pre- and Post-Quantitative Content Analysis. Int. J. Environ. Res. Public Health 2019, 16, 4501. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  9. Taillie, L.S.; Reyes, M.; Colchero, M.A.; Popkin, B.; Corvalan, C. An evaluation of Chile’s Law of Food Labeling and Advertising on sugar-sweetened beverage purchases from 2015 to 2017: A before-and-after study. PLoS Med. 2020, 17, e1003015. [Google Scholar] [CrossRef]
  10. Grummon, A.H.; Hall, M.G. Sugary drink warnings: A meta-analysis of experimental studies. PLoS Med. 2020, 17, e1003120. [Google Scholar] [CrossRef]
  11. Clarke, N.; Pechey, E.; Kosīte, D.; König, L.M.; Mantzari, E.; Blackwell, A.K.M.; Marteau, T.M.; Hollands, G.J. Impact of Health Warning Labels on Selection and Consumption of Food and Alcohol Products: Systematic Review with Meta-analysis. Health Psychol. Rev. 2020, 1–39. [Google Scholar] [CrossRef]
  12. An, R.; Liu, J.; Liu, R.; Barker, A.R.; Figueroa, R.B.; McBride, T.D. Impact of Sugar-Sweetened Beverage Warning Labels on Consumer Behaviors: A Systematic Review and Meta-Analysis. Am. J. Prev. Med. 2021, 60, 115–126. [Google Scholar] [CrossRef]
  13. Shadish, W.R.; Cook, T.D.; Campbell, D.T. Experimental and Quasi-Experimental Designs for Generalized Causal Inference; Cengage Learning: Boston, MA, USA, 2002. [Google Scholar]
  14. Kaur, A.; Scarborough, P.; Rayner, M. A systematic review, and meta-analyses, of the impact of health-related claims on dietary choices. Int. J. Behav. Nutr. Phys. Act. 2017, 14, 93. [Google Scholar] [CrossRef]
  15. Hall, M.G.; Lazard, A.J.; Grummon, A.H.; Higgins, I.C.A.; Bercholz, M.; Richter, A.P.C.; Taillie, L.S. Designing warnings for sugary drinks: A randomized experiment with Latino parents and non-Latino parents. Prev. Med. 2021, 148, 106562. [Google Scholar] [CrossRef]
  16. Noar, S.M.; Hall, M.G.; Francis, D.B.; Ribisl, K.M.; Pepper, J.K.; Brewer, N.T. Pictorial cigarette pack warnings: A meta-analysis of experimental studies. Tob. Control 2016, 25, 341–354. [Google Scholar] [CrossRef]
  17. Sheeran, P.; Webb, T.L. The intention–behavior gap. Soc. Personal. Psychol. Compass 2016, 10, 503–518. [Google Scholar] [CrossRef]
  18. Webb, T.L.; Sheeran, P. Does changing behavioral intentions engender behavior change? A meta-analysis of the experimental evidence. Psychol. Bull. 2006, 132, 249–268. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  19. DeVellis, R.F. Scale Development: Theory and Applications; Sage publications: Newcastle upon Tyne, UK, 2016; Volume 26, ISBN 1-5063-4155-1. [Google Scholar]
  20. Grummon, A.H.; Taillie, L.S.; Golden, S.D.; Hall, M.G.; Ranney, L.M.; Brewer, N.T. Sugar-Sweetened Beverage Health Warnings and Purchases: A Randomized Controlled Trial. Am. J. Prev. Med. 2019, 57, 601–610. [Google Scholar] [CrossRef] [PubMed]
  21. Shadel, W.G.; Martino, S.C.; Setodji, C.M.; Scharf, D.M.; Kusuke, D.; Sicker, A.; Gong, M. Hiding the tobacco power wall reduces cigarette smoking risk in adolescents: Using an experimental convenience store to assess tobacco regulatory options at retail point-of-sale. Tob. Control 2016, 25, 679–684. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  22. Shadel, W.G.; Martino, S.C.; Setodji, C.; Dunbar, M.; Kusuke, D.; Lanna, S.; Meyer, A. Placing antismoking graphic warning posters at retail point-of-sale locations increases some adolescents’ susceptibility to future smoking. Nicotine Tob. Res. 2019, 21, 220–226. [Google Scholar] [CrossRef] [PubMed]
  23. Clarke, N.; Blackwell, A.K.M.; De-Loyde, K.; Pechey, E.; Hobson, A.; Pilling, M.; Morris, R.W.; Marteau, T.M.; Hollands, G.J. Health warning labels and alcohol selection: A randomised controlled experiment in a naturalistic shopping laboratory. Addiction 2021. [Google Scholar] [CrossRef]
  24. Bleich, S.N.; Vercammen, K.A.; Koma, J.W.; Li, Z. Trends in beverage consumption among children and adults, 2003–2014. Obes. Silver Spring 2018, 26, 432–441. [Google Scholar] [CrossRef] [PubMed]
  25. Ogden, C.L.; Kit, B.K.; Carroll, M.D.; Park, S. Consumption of sugar drinks in the United States, 2005–2008. NCHS Data Brief 2011, 71, 1–8. [Google Scholar]
  26. Han, E.; Powell, L.M. Consumption patterns of sugar-sweetened beverages in the United States. J. Acad. Nutr. Diet 2013, 113, 43–53. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Malik, V.S.; Popkin, B.M.; Bray, G.A.; Despres, J.P.; Hu, F.B. Sugar-sweetened beverages, obesity, type 2 diabetes mellitus, and cardiovascular disease risk. Circulation 2010, 121, 1356–1364. [Google Scholar] [CrossRef]
  28. Hedrick, V.E.; Savla, J.; Comber, D.L.; Flack, K.D.; Estabrooks, P.A.; Nsiah-Kumi, P.A.; Ortmeier, S.; Davy, B.M. Development of a brief questionnaire to assess habitual beverage intake (BEVQ-15): Sugar-sweetened beverages and total beverage energy intake. J. Acad. Nutr. Diet. 2012, 112, 840–849. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Mendel, J.R.; Hall, M.G.; Baig, S.A.; Jeong, M.; Brewer, N.T. Placing health warnings on e-cigarettes: A standardized protocol. Int. J. Environ. Res. Public Health 2018, 15, 1578. [Google Scholar] [CrossRef] [Green Version]
  30. Brewer, N.T.; Hall, M.G.; Lee, J.G.; Peebles, K.; Noar, S.M.; Ribisl, K.M. Testing warning messages on smokers’ cigarette packages: A standardised protocol. Tob. Control 2015, 25, 153–159. [Google Scholar] [CrossRef]
  31. Burns, C.; Cook, K.; Mavoa, H. Role of expendable income and price in food choice by low income families. Appetite 2013, 71, 209–217. [Google Scholar] [CrossRef]
  32. Nederkoorn, C.; Havermans, R.C.; Giesen, J.C.; Jansen, A. High tax on high energy dense foods and its effects on the purchase of calories in a supermarket. An experiment. Appetite 2011, 56, 760–765. [Google Scholar] [CrossRef]
  33. French, S.A.; Wall, M.; Mitchell, N.R.; Shimotsu, S.T.; Welsh, E. Annotated receipts capture household food purchases from a broad range of sources. Int. J. Behav. Nutr. Phys. Act. 2009, 6, 37. [Google Scholar] [CrossRef] [Green Version]
  34. Desai, M. Recruitment and retention of participants in clinical studies: Critical issues and challenges. Perspect Clin. Res. 2020, 11, 51–53. [Google Scholar] [CrossRef]
  35. Fewtrell, M.S.; Kennedy, K.; Singhal, A.; Martin, R.M.; Ness, A.; Hadders-Algra, M.; Koletzko, B.; Lucas, A. How much loss to follow-up is acceptable in long-term randomised trials and prospective studies? Arch. Child 2008, 93, 458–461. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  36. Brewer, N.T.; Jeong, M.; Mendel, J.R.; Hall, M.G.; Zhang, D.; Parada, H., Jr.; Boynton, M.H.; Noar, S.M.; Baig, S.A.; Morgan, J.C.; et al. Cigarette pack messages about toxic chemicals: A randomised clinical trial. Tob. Control 2019, 28, 74–80. [Google Scholar] [CrossRef] [PubMed]
  37. Brewer, N.T.; Hall, M.G.; Noar, S.M.; Parada Jr, H.; Stein-Seroussi, A.; Bach, L.E.; Hanley, S.; Ribisl, K.M. Effect of pictorial cigarette pack warnings on changes in smoking behavior: A randomized clinical trial. JAMA Intern. Med. 2016, 176, 905–912. [Google Scholar] [CrossRef] [PubMed]
  38. Kim, A.E.; Nonnemaker, J.M.; Loomis, B.R.; Shafer, P.R.; Shaikh, A.; Hill, E.; Holloway, J.W.; Farrelly, M.C. Influence of point-of-sale tobacco displays and graphic health warning signs on adults: Evidence from a virtual store experimental study. Am. J. Public Health 2014, 104, 888–895. [Google Scholar] [CrossRef] [PubMed]
  39. Blitstein, J.L.; Guthrie, J.F.; Rains, C. Low-Income Parents’ Use of Front-of-Package Nutrition Labels in a Virtual Supermarket. J. Nutr. Educ. Behav. 2020, 52, 850–858. [Google Scholar] [CrossRef]
  40. Jáuregui, A.; Vargas-Meza, J.; Nieto, C.; Contreras-Manzano, A.; Alejandro, N.Z.; Tolentino-Mayo, L.; Hall, M.G.; Barquera, S. Impact of front-of-pack nutrition labels on consumer purchasing intentions: A randomized experiment in low- and middle-income Mexican adults. BMC Public Health 2020, 20, 463. [Google Scholar] [CrossRef]
  41. Rummo, P.E.; Higgins, I.; Chauvenet, C.; Vesely, A.; Jaacks, L.M.; Taillie, L. A Standardized Guide to Developing an Online Grocery Store for Testing Nutrition-Related Policies and Interventions in an Online Setting. Int. J. Environ. Res. Public. Health 2021, 18, 4527. [Google Scholar] [CrossRef]
  42. Gugliucci, V.; Machín, L.; Curutchet, M.R.; Ares, G. Do nutritional warnings encourage healthier choices on food ordering websites? An exploratory experimental study in Uruguay. Public Health Nutr. 2021, 1–5. [Google Scholar] [CrossRef]
  43. Redman, R. Nearly 80% of U.S. Consumers Shopped Online for Groceries since COVID-19 Outbreak. Available online: https://www.supermarketnews.com/online-retail/nearly-80-us-consumers-shopped-online-groceries-covid-19-outbreak (accessed on 16 July 2021).
  44. George, S.; Duran, N.; Norris, K. A systematic review of barriers and facilitators to minority research participation among African Americans, Latinos, Asian Americans, and Pacific Islanders. Am. J. Public Health 2014, 104, e16–e31. [Google Scholar] [CrossRef]
  45. Svensson, K.; Ramírez, O.F.; Peres, F.; Barnett, M.; Claudio, L. Socioeconomic determinants associated with willingness to participate in medical research among a diverse population. Contemp. Clin. Trials 2012, 33, 1197–1205. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Ijerph 18 08764 g001 550
Figure 1. Photographs of and logo for UNC Mini Mart, a naturalistic store laboratory.
Figure 1. Photographs of and logo for UNC Mini Mart, a naturalistic store laboratory.
Ijerph 18 08764 g001
Ijerph 18 08764 g002 550
Figure 2. Percentage of participants purchasing each beverage type as measured via receipts. Receipts collected week prior to enrolling in the study and purchases in the UNC Mini Mart (at first study visit).
Figure 2. Percentage of participants purchasing each beverage type as measured via receipts. Receipts collected week prior to enrolling in the study and purchases in the UNC Mini Mart (at first study visit).
Ijerph 18 08764 g002
Ijerph 18 08764 g003 550
Figure 3. Realism of UNC Mini Mart and acceptability of participating in a study among Latinx parents (n = 61). * Responses collected via computer survey at Visit 5. ** Responses collected over the phone due to survey error.
Figure 3. Realism of UNC Mini Mart and acceptability of participating in a study among Latinx parents (n = 61). * Responses collected via computer survey at Visit 5. ** Responses collected over the phone due to survey error.
Ijerph 18 08764 g003
Table
Table 1. Characteristics of study participants in a naturalistic store laboratory.
Table 1. Characteristics of study participants in a naturalistic store laboratory.
n%
Cohort
    Tax3151%
    Warning 3049%
Age
    18–29 years1118%
    30–39 years3151%
    40–49 years1728%
    50+ years23%
Mean in years (SD)36.37.3
Gender
    Man12%
    Woman5798%
Educational attainment
    Less than high school or GED2239%
    High school diploma or GED2951%
    Four-year college degree59%
    Master’s degree or greater12%
State of health
    Excellent, very good, or good3354%
    Fair or poor2846%
Preferred language to speak at home
    Mostly or only English47%
    Mostly or only Spanish4272%
    Equally Spanish and English1221%
Household income, annual
    USD 0–24,9994675%
    USD 25,000+1525%
Number of children in household (age 0–18)
    One1321%
    Two3252%
    Three or more1626%
Used SNAP in the last year2033%
Used WIC in the last year1728%
Average weekly spending on beverages
    Less than USD 535%
    USD 5–10915%
    USD 11–151118%
    USD 16–201525%
    USD 21–251321%
    More than USD 251016%
Body mass index (BMI, kg/m2)
    Underweight (<18.5)23%
    Healthy weight (18.5–24.9)915%
    Overweight (25.0–29.9)1220%
    Obese (>29.9)2338%
    Missing1525%
Mean BMI (SD)30.99.6
Language of Survey
    English1118%
    Spanish5082%
Missing demographic data ranged from 0% to 7%. Demographic characteristics did not differ between the two cohorts, except for number of children in household (p < 0.05). SNAP = Supplemental Nutrition Assistance Program. WIC= Special Supplemental Nutrition Program for Women, Infants, and Children.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Hall, M.G.; Higgins, I.C.A.; Grummon, A.H.; Lazard, A.J.; Prestemon, C.E.; Sheldon, J.M.; Taillie, L.S. Using a Naturalistic Store Laboratory for Clinical Trials of Point-of-Sale Nutrition Policies and Interventions: A Feasibility and Validation Study. Int. J. Environ. Res. Public Health 2021, 18, 8764. https://doi.org/10.3390/ijerph18168764

AMA Style

Hall MG, Higgins ICA, Grummon AH, Lazard AJ, Prestemon CE, Sheldon JM, Taillie LS. Using a Naturalistic Store Laboratory for Clinical Trials of Point-of-Sale Nutrition Policies and Interventions: A Feasibility and Validation Study. International Journal of Environmental Research and Public Health. 2021; 18(16):8764. https://doi.org/10.3390/ijerph18168764

Chicago/Turabian Style

Hall, Marissa G., Isabella C. A. Higgins, Anna H. Grummon, Allison J. Lazard, Carmen E. Prestemon, Jennifer Mendel Sheldon, and Lindsey Smith Taillie. 2021. "Using a Naturalistic Store Laboratory for Clinical Trials of Point-of-Sale Nutrition Policies and Interventions: A Feasibility and Validation Study" International Journal of Environmental Research and Public Health 18, no. 16: 8764. https://doi.org/10.3390/ijerph18168764

APA Style

Hall, M. G., Higgins, I. C. A., Grummon, A. H., Lazard, A. J., Prestemon, C. E., Sheldon, J. M., & Taillie, L. S. (2021). Using a Naturalistic Store Laboratory for Clinical Trials of Point-of-Sale Nutrition Policies and Interventions: A Feasibility and Validation Study. International Journal of Environmental Research and Public Health, 18(16), 8764. https://doi.org/10.3390/ijerph18168764

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop