Next Article in Journal
Dietary Supplementation with Biobran/MGN-3 Increases Innate Resistance and Reduces the Incidence of Influenza-like Illnesses in Elderly Subjects: A Randomized, Double-Blind, Placebo-Controlled Pilot Clinical Trial
Next Article in Special Issue
Recommendations for Integrating Evidence-Based, Sustainable Diet Information into Nutrition Education
Previous Article in Journal
Clinical Presentation of Celiac Disease and Diagnosis Accuracy in a Single-Center European Pediatric Cohort over 10 Years
Previous Article in Special Issue
Validation of a Home Food Environment Instrument Assessing Household Food Patterning and Quality
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

An Exploratory Approach to Deriving Nutrition Information of Restaurant Food from Crowdsourced Food Images: Case of Hartford

1
Department of Geography, University of Connecticut, Storrs, CT 06269, USA
2
Department of Allied Health Sciences, University of Connecticut, Storrs, CT 06269, USA
3
Department of Computer Science & Engineering, University of Connecticut, Storrs, CT 06269, USA
*
Author to whom correspondence should be addressed.
Nutrients 2021, 13(11), 4132; https://doi.org/10.3390/nu13114132
Submission received: 26 September 2021 / Revised: 12 November 2021 / Accepted: 16 November 2021 / Published: 18 November 2021
(This article belongs to the Special Issue Diet Quality, Food Environment and Diet Diversity)

Abstract

Deep learning models can recognize the food item in an image and derive their nutrition information, including calories, macronutrients (carbohydrates, fats, and proteins), and micronutrients (vitamins and minerals). This technology has yet to be implemented for the nutrition assessment of restaurant food. In this paper, we crowdsource 15,908 food images of 470 restaurants in the Greater Hartford region on Tripadvisor and Google Place. These food images are loaded into a proprietary deep learning model (Calorie Mama) for nutrition assessment. We employ manual coding to validate the model accuracy based on the Food and Nutrient Database for Dietary Studies. The derived nutrition information is visualized at both the restaurant level and the census tract level. The deep learning model achieves 75.1% accuracy when compared with manual coding. It has more accurate labels for ethnic foods but cannot identify portion sizes, certain food items (e.g., specialty burgers and salads), and multiple food items in an image. The restaurant nutrition (RN) index is further proposed based on the derived nutrition information. By identifying the nutrition information of restaurant food through crowdsourced food images and a deep learning model, the study provides a pilot approach for large-scale nutrition assessment of the community food environment.
Keywords: nutrition assessment; food image; image recognition; restaurant; food environment; FAFH; crowdsourcing; deep learning; GIS; Hartford nutrition assessment; food image; image recognition; restaurant; food environment; FAFH; crowdsourcing; deep learning; GIS; Hartford

Share and Cite

MDPI and ACS Style

Chen, X.; Johnson, E.; Kulkarni, A.; Ding, C.; Ranelli, N.; Chen, Y.; Xu, R. An Exploratory Approach to Deriving Nutrition Information of Restaurant Food from Crowdsourced Food Images: Case of Hartford. Nutrients 2021, 13, 4132. https://doi.org/10.3390/nu13114132

AMA Style

Chen X, Johnson E, Kulkarni A, Ding C, Ranelli N, Chen Y, Xu R. An Exploratory Approach to Deriving Nutrition Information of Restaurant Food from Crowdsourced Food Images: Case of Hartford. Nutrients. 2021; 13(11):4132. https://doi.org/10.3390/nu13114132

Chicago/Turabian Style

Chen, Xiang, Evelyn Johnson, Aditya Kulkarni, Caiwen Ding, Natalie Ranelli, Yanyan Chen, and Ran Xu. 2021. "An Exploratory Approach to Deriving Nutrition Information of Restaurant Food from Crowdsourced Food Images: Case of Hartford" Nutrients 13, no. 11: 4132. https://doi.org/10.3390/nu13114132

APA Style

Chen, X., Johnson, E., Kulkarni, A., Ding, C., Ranelli, N., Chen, Y., & Xu, R. (2021). An Exploratory Approach to Deriving Nutrition Information of Restaurant Food from Crowdsourced Food Images: Case of Hartford. Nutrients, 13(11), 4132. https://doi.org/10.3390/nu13114132

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop