AI-Driven Implicit Consumer Emotion Measurement in Food Sensory Evaluation: Research Progress and Future Directions
Main Article Content
Keywords
artificial intelligence, implicit emotion measurement, facial expression analysis, eye tracking, electroencephalography
Abstract
Traditional food sensory evaluation relies heavily on explicit judgments such as descriptive analysis, check-all-that-apply questions, and hedonic ratings. These methods remain indispensable, yet they are vulnerable to memory limits, social desirability, fatigue, contextual bias, and the difficulty of verbalizing weak or rapidly changing affective states. This review examines how artificial intelligence is accelerating implicit consumer emotion measurement in food sensory evaluation. We synthesize recent progress in facial expression analysis, eye tracking, and electroencephalography, with attention to the affective signals each modality can capture, the signal-processing and machine-learning methods that make those signals usable, and the role of multimodal fusion in more robust preference prediction. The review argues that implicit measurement should be treated as a complementary layer rather than a substitute for explicit sensory science. Its future value depends on calibrated multimodal protocols, transparent models, ecological test environments, and strict ethical governance of biometric data.
References
- [1] Rodrigues, Sandra S. Q., Luis G. Dias, and Alfredo Teixeira. 2024. “Emerging Methods for the Evaluation of Sensory Quality of Food: Technology at Service.” Current Food Science and Technology Reports 2: 77–90. https://doi.org/10.1007/s43555-024-00019-7.
- [2] Torrico, Damir D., Annu Mehta, and Amalia Bernardes Borssato. 2023. “New Methods to Assess Sensory Responses: A Brief Review of Innovative Techniques in Sensory Evaluation.” Current Opinion in Food Science 49: 100978. https://doi.org/10.1016/j.cofs.2022.100978.
- [3] Lee, Dongju, Hyemin Jeon, Yoonseo Kim, and Youngseung Lee. 2025. “Integrating Cutting-Edge Technologies in Food Sensory and Consumer Science: Applications and Future Directions.” Foods 14 (24): 4169. https://doi.org/10.3390/foods14244169.
- [4] Cong, Lei, Siqiao Luan, Erin Young, Miranda Mirosa, Phil Bremer, and Damir D. Torrico. 2023. “The Application of Biometric Approaches in Agri-Food Marketing: A Systematic Literature Review.” Foods 12 (16): 2982. https://doi.org/10.3390/foods12162982.
- [5] Wagner, J., and J. Hort. 2025. “A Practical Evaluation of Biometric Measures for Understanding the Consumer Experience During Direct Product Evaluation: Current and Future Perspectives.” Current Opinion in Food Science 63: 101311. https://doi.org/10.1016/j.cofs.2025.101311.
- [6] Lagast, S., X. Gellynck, J. J. Schouteten, V. De Herdt, and H. De Steur. 2017. “Consumers’ Emotions Elicited by Food: A Systematic Review of Explicit and Implicit Methods.” Trends in Food Science and Technology 69: 172–89. https://doi.org/10.1016/j.tifs.2017.09.006.
- [7] Kaneko, Daisuke, Alexander Toet, Anne-Marie Brouwer, Victor Kallen, and Jan B. F. van Erp. 2018. “Methods for Evaluating Emotions Evoked by Food Experiences: A Literature Review.” Frontiers in Psychology 9: 911. https://doi.org/10.3389/fpsyg.2018.00911.
- [8] Crist, Courtney A., Susan E. Duncan, and Daniel L. Gallagher. 2016. “Protocol for Data Collection and Analysis Applied to Automated Facial Expression Analysis Technology and Temporal Analysis for Sensory Evaluation.” Journal of Visualized Experiments, no. 114: 54046. https://doi.org/10.3791/54046.
- [9] Kessler, Samuel J., Funan Jiang, and R. Andrew Hurley. 2020. “The State of Automated Facial Expression Analysis (AFEA) in Evaluating Consumer Packaged Beverages.” Beverages 6 (2): 27. https://doi.org/10.3390/beverages6020027.
- [10] Clark, Elizabeth A., J’Nai Kessinger, Susan E. Duncan, et al. 2020. “The Facial Action Coding System for Characterization of Human Affective Response to Consumer Product-Based Stimuli: A Systematic Review.” Frontiers in Psychology 11: 920. https://doi.org/10.3389/fpsyg.2020.00920.
- [11] Matsufuji, Yasuyo, Kayoko Ueji, and Takashi Yamamoto. 2023. “Predicting Perceived Hedonic Ratings Through Facial Expressions of Different Drinks.” Foods 12 (18): 3490. https://doi.org/10.3390/foods12183490.
- [12] Motoki, Kosuke, Toshiki Saito, and Takuya Onuma. 2021. “Eye-Tracking Research on Sensory and Consumer Science: A Review, Pitfalls and Future Directions.” Food Research International 145: 110389. https://doi.org/10.1016/j.foodres.2021.110389.
- [13] Bilucaglia, Marco, Mara Bellati, Alessandro Fici, Vincenzo Russo, and Margherita Zito. 2025. “Tuning into Flavor: Predicting Coffee Sensory Attributes from EEG with Boosted-Tree Regression Models.” Frontiers in Human Neuroscience 19: 1661214. https://doi.org/10.3389/fnhum.2025.1661214.
- [14] Wang, He, Hong Men, and Yan Shi. 2025. “Adaptive Identification of Food Sweetness Concentration: An Electroencephalogram Feature Classification Network Under Taste Stimulation.” Foods 14 (22): 3855. https://doi.org/10.3390/foods14223855.
- [15] Usman, Syed Muhammad, Shehzad Khalid, Aimen Tanveer, Ali Shariq Imran, and Muhammad Zubair. 2025. “Multimodal Consumer Choice Prediction Using EEG Signals and Eye Tracking.” Frontiers in Computational Neuroscience 18: 1516440. https://doi.org/10.3389/fncom.2024.1516440.
