TY - GEN
T1 - Instance-Aware Semantic Segmentation for Food Calorie Estimation using Mask R-CNN
AU - Yogaswara, Reza Dea
AU - Yuniarno, Eko Mulyanto
AU - Wibawa, Adhi Dharma
N1 - Publisher Copyright:
© 2019 IEEE.
PY - 2019/8
Y1 - 2019/8
N2 - Knowing the number of calorie content in the food we consume can help in maintaining body health. By fulfilling the basic calorie need well, it will produce many positive effects to the body, including controlling the ideal body weight and becoming an adequate source of energy for physical activity. Conversely, people who do not care about their calorie needs will face various health problems, including obesity and worsening degenerative diseases such as diabetes or high blood pressure. Calculating the actual number of calories digitally from food requires the parameters of area, volume, and mass of the food. Some previous studies in the field of computer vision have been carried out to get a constant number of calories based on food types and not based on actual food volume measurements. In this research, a system will be developed using a computer vision approach that can be used to calculate the number of food calories automatically based on the size of the food volume using the Deep Learning Mask Region-based Convolutional Neural Network (R-CNN) algorithm. The segmentation technique uses the instance-aware semantic segmentation approach, which is to identify each pixel from instance of objects for each object found in a food image. This work uses the concept of instance-aware data labeling or segmentation detection that distinguishes each instances in a similar class, where this model will be used to recognize each different food object instantaneously in one class so that the number of calories of each food object can be obtained precisely. The expected benefit of the results of this research is to help someone get information about the size of food calories according to the calorie needs of the body with the mean Average Precision (mAP) level obtained at 89.4% and the percentage accuracy in calories calculated at 97.48%.
AB - Knowing the number of calorie content in the food we consume can help in maintaining body health. By fulfilling the basic calorie need well, it will produce many positive effects to the body, including controlling the ideal body weight and becoming an adequate source of energy for physical activity. Conversely, people who do not care about their calorie needs will face various health problems, including obesity and worsening degenerative diseases such as diabetes or high blood pressure. Calculating the actual number of calories digitally from food requires the parameters of area, volume, and mass of the food. Some previous studies in the field of computer vision have been carried out to get a constant number of calories based on food types and not based on actual food volume measurements. In this research, a system will be developed using a computer vision approach that can be used to calculate the number of food calories automatically based on the size of the food volume using the Deep Learning Mask Region-based Convolutional Neural Network (R-CNN) algorithm. The segmentation technique uses the instance-aware semantic segmentation approach, which is to identify each pixel from instance of objects for each object found in a food image. This work uses the concept of instance-aware data labeling or segmentation detection that distinguishes each instances in a similar class, where this model will be used to recognize each different food object instantaneously in one class so that the number of calories of each food object can be obtained precisely. The expected benefit of the results of this research is to help someone get information about the size of food calories according to the calorie needs of the body with the mean Average Precision (mAP) level obtained at 89.4% and the percentage accuracy in calories calculated at 97.48%.
KW - Computer Vision
KW - Deep Learning
KW - Food Calories
KW - Instance Segmentation
KW - Mask R-CNN
UR - http://www.scopus.com/inward/record.url?scp=85078417745&partnerID=8YFLogxK
U2 - 10.1109/ISITIA.2019.8937129
DO - 10.1109/ISITIA.2019.8937129
M3 - Conference contribution
AN - SCOPUS:85078417745
T3 - Proceedings - 2019 International Seminar on Intelligent Technology and Its Application, ISITIA 2019
SP - 416
EP - 421
BT - Proceedings - 2019 International Seminar on Intelligent Technology and Its Application, ISITIA 2019
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2019 International Seminar on Intelligent Technology and Its Application, ISITIA 2019
Y2 - 28 August 2019 through 29 August 2019
ER -