We are proud to announce Dr. Shengjie Bi’s successful dissertation defense and to share his doctoral thesis. Bi’s dissertation focuses on a generalizable approach to sensing eating-related behavior. Bi describes the creation of Auracle, a wearable earpiece that can automatically detect eating episodes, its adaptation to measure children’s eating behavior, and improvements in eating-activity detection algorithms. Bi also describes the development of a computer-vision approach for eating detection in free-living scenarios.
The Auracle device previously enabled us to automatically and unobtrusively recognize eating behavior in adults. The Auracle team recognized the need for adapting such technology to measure children’s eating behavior and to bolster research efforts focusing on adolescents’ eating behaviors.
We identified and addressed several challenges pertaining to monitoring eating behavior in children, paying particular attention to device fit and comfort. We also improved the accuracy and robustness of the eating-activity detection algorithms.
Check out the 4-minute video below to see graduate student Shengjie Bi’s presentation of our research at IEEE’s International Conference on Healthcare Informatics (ICHI). To read the paper, check out the link at the bottom of this post.
What if your tablecloth could recognize what is on the table and provide you with useful information? You’re running out of the house and your tablecloth, of all things, reminds you to take your sunglasses. When you come home, your tablecloth detects whether the plant on it needs to be watered and then later updates your diet tracking app when you pour yourself a glass of apple cider. This could be the future of Capacitivo.
Check out this video showcasing Capacitivo. Unlike prior work that has focused on metallic object recognition, our technique recognizes non-metallic objects such as food, different types of fruits, liquids, and other types of objects that are often found around a home or in a workplace.
Te-Yen Wu, Lu Tan, Yuji Zhang, Teddy Seyed, Xing-Dong Yang. Capacitivo: Contact-based Object Recognition on Interactive Fabrics Using Capacitive Sensing. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (UIST). Oct. 2020, pp. 649–661. DOI: 10.1145/3379337.3415829