Yashu's health-AI robot mascot
Postdoc · Dartmouth · Behavior Science × AI
YashaswiniBhat

I develop ML, computer vision, and AI methods to automate and scale health behavior measurement — and use ML and statistical modeling to uncover how behaviors relate to each other, and how they drive obesity and health outcomes. Currently focused on children; broadly interested in behavior science at scale.

Behavior measurement ML & GenAI Computer vision Pediatric health Big data analytics
~300citations
7+publications
7awards
1open-source tool + 1 app
about me

Methods-first scientist building the future of behavior tech

I'm a Postdoc in the Department of Biomedical Data Sciences at Dartmouth's Geisel School of Medicine. My work sits at two intersecting goals: (1) automating and scaling behavioral measurement using ML, computer vision, and AI pipelines; and (2) using ML and statistical modeling to uncover how behaviors relate to each other — and how they drive obesity and health outcomes.

From automated bite detection to marketing exposure pipelines to mindfulness apps — I build rigorous, production-grade tools that turn observational research into scalable science.

🔬
Research
active projects
📄
Publications
7+ papers
🤖
ByteTrack
bite detection AI
🎓
Experience
career & education
✍️
Bytes for Bites
blog
research

Building the tools that measure behavior

My work centers on methods — ML, computer vision, and generative AI — for automating and scaling the measurement of health behaviors. Interested in behavior broadly; currently focused on children.

🚀 Active projects
ActiveOpen source · stay tuned

Marketing exposure detection pipeline

Children are saturated with food marketing across TV, streaming, and social media — but measuring this exposure at scale is a massive research bottleneck. I'm building an automated, scalable open-source pipeline using computer vision to detect and quantify food marketing exposure in children's media environments, replacing hours of manual coding with a reproducible, shareable tool.

Computer visionObject detectionPythonOpenCVPyTorchOpen source
🌱 Stay tuned — open-source release coming. Interested in collaborating? Reach out.
iOS + AndroidLive on app stores

Bio3 — mindfulness logging & class teaching app

A cross-platform mobile app (single iOS + Android codebase) built for Dartmouth's Bio3 class students. The app supports mindfulness practice logging, guided exercises, and class-integrated teaching tools — enabling students to track their mindfulness habits and allowing the class to be taught at scale. Also supports data collection for mindfulness behavior research. Built full-stack: frontend, backend, and testing pipelines.

React NativeiOSAndroidNode.jsPostgreSQLFull-stack + testing
Deployed on both app stores for Dartmouth Bio3 class students.
🍎 App Store ▶ Google Play
v1 published 2025v2 in progress

ByteTrack — automated bite detection from meal videos

ByteTrack is a two-stage deep learning pipeline that automatically counts bites and measures eating rate from video-recorded children's meals — replacing hours of manual coding with a scalable, reproducible tool. v1 is published (Frontiers in Nutrition 2025, 70.6% F1, ICC 0.66 vs. manual coding, 1,440 min of video, 94 children). v2 is actively in development, targeting improved occlusion handling, diverse populations, high-motion robustness, and open-source CLI packaging.

YOLOv7Faster R-CNNEfficientNetLSTM-RNNPyTorchOptical flow
📚 Completed work
Published J Nutr 2024

Eating in the Absence of Hunger (EAH) — longitudinal study

Led a longitudinal study of 7–9 year olds examining EAH stability and its role as a predictor of future adiposity gains. Included fMRI, behavioral paradigms, and cognitive tasks. Published Journal of Nutrition Dec 2024.

fMRIICC analysisLinear regressionR
Manuscript in prep

Best practices for ML in childhood obesity research

Framework and tutorial dataset using XGBoost to predict BMI percentile change from eating behaviors. Designed to be the field's reference for applying ML rigorously to behavioral pediatric data.

XGBoostScikit-learnPythonBMI prediction
🔬 Manuscript in preparation.
🧬 Associated research areas
Published Cell Metabolism 2022Published Cell Systems 2021

NAD+ metabolism & gut microbiome

As part of the Baur Lab at UPenn's Institute for Diabetes, Obesity and Metabolism, contributed to work characterizing how NAD precursors cycle between host tissues and the gut microbiome, and how NAD+ flux is maintained in aged mice despite lower tissue concentrations. Involved in biochemical assays, animal model work, and data analysis contributing to two Cell-family publications with 200+ combined citations.

NAD+ flux analysisGut microbiomeMouse modelsAging researchBiochemical assaysELISAWestern blot
3 publications · 2023

Neuroscience of neuropeptides in obesity & eating behavior

Two years in the Skibicka Lab at Penn State characterizing how neuropeptides — GLP-1, ghrelin, amylin, and oxytocin — regulate food intake, reward-motivated eating, and anxiety-like behaviors through distinct neural circuits. Work involved fMRI in awake rats, 200+ stereotaxic brain surgeries (cannula implantation), operant conditioning (Skinner boxes), anxiety maze paradigms, and molecular techniques. Three publications resulting from this work.

GLP-1GhrelinAmylinOxytocinfMRI (awake rats)Stereotaxic surgeryOperant conditioningAnxiety mazesRT-PCR
📡 Data I have worked with

HRV & actigraphy data

Worked with physiological time-series data including heart rate variability (HRV) and actigraphy (wrist-worn accelerometry for sleep/activity cycles). Contributed to preprocessing, cleaning pipelines, and feature extraction — handling missing data, artifact rejection, and alignment of multi-modal physiological streams.

HRV analysisActigraphyTime-series cleaningSignal processingPythonR

Behavioral & clinical eating data

Extensive experience with structured behavioral data from eating paradigms — laboratory meal intake records, food frequency, dietary recall, and clinical assessments. Data wrangling, quality control, and analysis of large behavioral datasets from children's eating studies.

Eating behavior paradigmsLab meal dataDietary assessmentClinical recordsData cleaningR / SPSS

Video & image data

Deep experience with video and image data pipelines — from raw meal recording footage to annotated training sets. Video preprocessing (frame extraction, normalization, fps conversion), bounding box labeling (LabelImg), face detection, and building CV training datasets from observational research video.

Video preprocessingFrame extractionBounding box labelingOpenCVLabelImgTraining datasets

Neuroimaging & cognitive task data

Worked with fMRI data from both human children (task-based paradigms for eating behavior and reward) and awake rats (neuropeptide response). Also managed cognitive task data from in-lab assessments — response time, inhibitory control, attention measures — linked to eating behavior outcomes.

fMRI (human)fMRI (rat)Cognitive tasksInhibitory controlReward paradigmsData linking
publications

Research output

~300 citations across ML, behavioral nutrition, and molecular metabolism. Google Scholar · ORCID

Peer-reviewed publications
01
Bhat YR, Keller KL, Brick TR, Pearce AL. ByteTrack: a deep learning approach for bite count and bite rate detection using meal videos in children.2025
Yashaswini Rajendra Bhat, Kathleen L Keller, Timothy R Brick, Alaina L Pearce · Penn State
Frontiers in Nutrition · 2025;12:1610363 · PMID: 41112744 · PMC12532775
02
Bhat YR, Rolls BJ, Wilson SJ, Rose E, Geier CF, Fuchs B, Garavan H, Keller KL. Eating in the Absence of Hunger is a stable predictor of adiposity gains in middle childhood.2024
Yashaswini R Bhat, Barbara J Rolls, Stephen J Wilson, Emma Rose, Charles F Geier, Bari Fuchs, Hugh Garavan, Kathleen L Keller · Penn State
Journal of Nutrition · Dec 2024 · 154(12):3726–3739
03
Maric I, López-Ferreras L, Bhat Y, et al. From the stomach to locus coeruleus: new neural substrate for ghrelin's effects on ingestive, motivated and anxiety-like behaviors.
Maric I, López-Ferreras L, Bhat Y, et al. · Skibicka Lab, Penn State
Frontiers in Pharmacology · Nov 2023 · 14:1286805
04
Asker M, Krieger JP, Liles A, …Bhat YR, et al. Peripherally restricted oxytocin is sufficient to reduce food intake and motivation, while CNS entry is required for locomotor and taste avoidance effects.
Asker M, Krieger JP, … Bhat YR, … Skibicka KP · Skibicka Lab, Penn State
Diabetes, Obesity & Metabolism · Jan 2023 · 25(3):856–877
05
Chellappa K, McReynolds MR, Lu W, …Bhat YR, et al. NAD precursors cycle between host tissues and the gut microbiome.
Chellappa K, McReynolds MR, … Bhat YR, … Baur JA · Baur Lab, UPenn
Cell Metabolism · 2022 · 34(12):1947–1959.e5
06
McReynolds MR, Chellappa K, …Bhat YR, et al. NAD+ flux is maintained in aged mice despite lower tissue concentrations.
McReynolds MR, Chellappa K, … Bhat YR, … Baur JA · Baur Lab, UPenn
Cell Systems · 2021 · 12(12):1160–1172.e4
07
Bhat YR, Brick TR, Hillary F, Wilson SJ, Masterson T, Keller KL. Best practices for the application of machine learning in childhood obesity.In prep
Yashaswini R Bhat, Timothy R Brick, Frank Hillary, Stephen J Wilson, Travis Masterson, Kathleen L Keller · Penn State
Manuscript in preparation
Conference abstracts & presentations
INFORMS Annual Meeting · Seattle 2024
Bite by Byte: an open-source automatic bite detection system from mealtime videos in children
Bhat YR, Brick TR, Pearce AL, Keller KL · Accepted for presentation talk
Obesity Week · Dallas 2023
Incorporating eating behaviors into machine learning algorithms to predict pediatric obesity
Bhat YR, Keller KL · Poster & Early Career Lightning Talk finalist (13 of ~600 submissions)
SSIB · Portland 2023
Eating in the Absence of Hunger remains stable and predicts gains in adiposity in middle childhood
Bhat YR, Rolls BJ, Keller KL · Presentation talk
Penn State Graduate Exhibition · 2023
EAH remains stable in middle childhood (7–9-year-olds)
Bhat YR, Keller KL · Video presentation · 🏆 3rd Prize winner
BITE COUNT
Open-source · Bite detection · Childhood obesity research
ByteTrack — automated bite detection

A deep learning system that automatically counts bites and measures eating rate from video-recorded children's meals — replacing hours of manual coding with a scalable, reproducible pipeline. v1 published; v2 actively in development.

v1 · Published 2025
ByteTrack v1 — complete

Two-stage deep learning pipeline trained on 1,440 minutes of children's meal videos (242 videos, 94 children, ages 7–9). YOLOv7 + Faster R-CNN for face detection → EfficientNet CNN + LSTM-RNN for bite classification. Post-processed with optical flow validation and temporal smoothing.

79.4%
Precision
67.9%
Recall
70.6%
F1 Score
ICC 0.66 agreement with gold-standard manual coding · PMC12532775 · Open access
🚧
v2 · Actively in development
ByteTrack v2 — in progress

Building on v1 results to improve real-world robustness and expand adoption. Key limitations of v1 (occlusion, motion, narrow recording conditions) are being addressed with improved architectures and broader training data.

🔲

Better occlusion handling — hands, utensils, napkins blocking the face

🔲

Expanded training across diverse populations, skin tones, and recording environments

🔲

Improved temporal modelling for high-motion meal segments

🔲

Reproducible open-source CLI packaging for lab adoption

🔲

Integration with marketing exposure detection pipeline

how it works

Two-stage pipeline

1
Face detection — YOLOv7 + Faster R-CNN
Videos normalized to 30fps. YOLOv7 detects faces; Faster R-CNN as fallback for blur, occlusion, low light. Face crops extracted per frame.
YOLOv7Faster R-CNN30fps normalization
2
Bite classification — EfficientNet + LSTM
Face crops → EfficientNet CNN for spatial features → LSTM-RNN for temporal bite pattern classification. Captures the sequential motion signature of a bite.
EfficientNet CNNLSTM-RNNPyTorch
3
Post-processing & output
Optical flow validation (Lucas-Kanade), duplicate suppression, temporal smoothing → timestamped bite events, per-meal bite count and eating rate.
Optical flowLucas-KanadeTemporal smoothing
dataset (v1)

Training & test data

1,440
min video
242
videos
94
children
4
meals each
51
test videos
Bhat YR, Keller KL, Brick TR, Pearce AL. ByteTrack: a deep learning approach for bite count and bite rate detection using meal videos in children. Front Nutr. 2025;12:1610363. PMID: 41112744.
DOI →PMC free text
experience

Engineering, biology, and behavior science

From biochemistry and molecular biology to neuroscience, behavioral nutrition, and applied ML — each chapter has built toward one goal: rigorous, scalable methods for understanding how behavior shapes health.

Education
🎓
PhD, Nutritional Sciences
Dartmouth · Geisel School of Medicine · Dept. of Biomedical Data Sciences
2020 – present
🔬
Master of Biotechnology (MBIOT)
University of Pennsylvania · Baur Lab, IDOM
2018 – 2020
⚙️
Bachelor of Engineering, Biotechnology
RV College of Engineering, Bengaluru, India
2014 – 2018
Career timeline
2024 – present
Postdoc
Dartmouth College · Geisel School of Medicine · Dept. of Biomedical Data Sciences
Developing automated behavioral measurement tools and scalable pipelines. Building marketing exposure detection (CV), improving ByteTrack v2, and leading full-stack development of the Bio3 app for mindfulness teaching at Dartmouth.
Marketing detectionByteTrack v2Bio3 appFull-stack dev
Oct 2022 – 2024
PhD Candidate — Children's Eating Behavior Lab
Dartmouth / Penn State · Keller Lab (Metabolic Kitchen)
Led 50+ lab visits with children ages 7–9 for fMRI, behavioral, and cognitive eating paradigms. Built ByteTrack (published 2025), XGBoost BMI predictors, and conducted the longitudinal EAH study (published J Nutr 2024).
50+ lab visitsByteTrackEAH studyfMRIXGBoost
Aug 2020 – Oct 2022
PhD Student — Preclinical Neuroscience & Obesity
Penn State · Skibicka Lab
Characterized neuropeptide pathways (GLP-1, ghrelin, amylin, oxytocin) in obesity, eating, and anxiety using rat models. Performed 200+ stereotaxic brain surgeries, fMRI in ~80 awake rats. Three publications.
200+ surgeriesfMRI in rats3 publications
Oct 2018 – May 2020
Graduate Research Assistant
UPenn · Baur Lab · Institute for Diabetes, Obesity & Metabolism
NAD+ mechanisms and gut microbiome in obesity and aging mouse models. Co-author: Cell Metabolism 2022, Cell Systems 2021.
Cell Metabolism 2022Cell Systems 2021Mouse models
Awards & fellowships
🏆
Barbara J. Rolls Graduate Scholarship
Dept. of Nutritional Sciences, Penn State · $3,000 · 2023–24
✈️
Mary Frances Picciano Endowment Travel Award
$1,500 · 2023
🥉
3rd Prize — Penn State Graduate Exhibition
EAH video presentation · $100 · Spring 2023
🌟
Ruth L. Pike Fellow
Dept. of Nutritional Sciences · $1,000 each · 2021–22 & 2022–23
🎓
Robert Graham Endowed Grad Fellowship & Fund for Excellence
College of HHD, Penn State · $7,000 · 2020–21
Conference talks & presentations
🎤
Presentation talk — INFORMS Annual Meeting
ByteTrack "Bite by Byte" · Seattle, WA · 2024
Early Career Lightning Talk Finalist
Obesity Week, The Obesity Society · 13 of ~600 submissions · Dallas 2023
📣
Presentation talk — SSIB Annual Meeting
Society for the Study of Ingestive Behavior · Portland, OR · 2023
🎬
Video presentation — Penn State Graduate Exhibition
EAH research · Spring 2023
Skills
Languages
PythonRMATLABSPSSJavaScript
ML / Deep learning
PyTorchTensorFlowScikit-learnXGBoostKeras
Computer vision
OpenCVYOLOv7Faster R-CNNEfficientNetLSTM
App / Full-stack
React NativeiOSAndroidNode.jsPostgreSQL
Data & visualization
PandasNumPySeabornPlotlyggplot2
Preclinical methods
Stereotaxic surgeryfMRI (rats)Western blotELISAOrganoid culture
blog

Bytes for Bites

Where food science, machine learning, and behavioral research collide. Writing about tools, methods, and ideas at the intersection of behavior science and technology.

🥦📊
Precision nutrition · AI/ML · Oct 2023

From Data to Diet: The AI Transformation

Understanding precision nutrition through AI/ML — insights from a PhD student building predictive models for pediatric obesity. How generic diet advice falls short, and what machine learning can do about it.

Yashaswini Rajendra Bhat 4 min read Precision nutrition AI / ML
🥗
Read post →
what I write about

Topics & themes

🤖
ML & computer vision for behavior
Building and deploying machine learning tools for behavioral health research — what works, what doesn't, and what it means in practice.
🍽️
Eating behavior & measurement
The science of how we measure eating — from lab paradigms and video coding to automated pipelines and what it tells us about obesity.
⚙️
Scalability & automation in research
Why manual coding is a bottleneck, how to build pipelines that scale, and making behavioral science more reproducible and open.
🧘
Tech, mindfulness & app development
Lessons from building the Bio3 app — going from researcher to full-stack developer, and what technology can do for mindfulness research.
← back to blog
Bytes for Bites · Precision nutrition · AI/ML

From Data to Diet:
The AI Transformation

Understanding precision nutrition through AI/ML — insights from a PhD student building predictive models for pediatric obesity.

You are what you eat.

It's a saying we've all heard. But here's the thing: we're all unique. Each of us has a distinct genetic blueprint, varied lifestyles, different habits, and our environments all play a role in our health. So while generic diet advice might work for some, it's not a one-size-fits-all situation.

Generic dietary guidelines give us a broad idea of healthy eating. But each person's risk of nutrition-based illnesses — like obesity or certain cancers — can vary based on individual factors. A diet that works wonders for one person might not be as effective for another.

Traditional diet plans fall short

The limitations of population-level dietary advice have become increasingly clear as research shows that individual responses to the same foods can vary dramatically. Factors like gut microbiome composition, genetic variants affecting nutrient metabolism, stress levels, sleep quality, and even social environment all interact to determine how any given diet affects a particular person.

This is the fundamental challenge that precision nutrition is trying to solve — and where AI and machine learning are beginning to make a meaningful difference.

Precision nutrition: the comprehensive approach

Precision Nutrition is an umbrella term encompassing a vast spectrum of methodologies to decode our individual dietary needs. It's about diving deep and gathering exhaustive detail: from gut microbiome composition, a plethora of 'omics' data (genomics, proteomics, metabolomics), to unique dietary patterns, eating behaviors, and even the influences of our surrounding environments — both built and natural.

This approach also takes into account family histories, which often play a crucial role in shaping nutritional susceptibilities. The result is a far richer picture of how diet and health interact — for a specific individual, not a statistical average.

However, gathering such an immense amount of data is just one part of the equation. Analyzing it, finding patterns, and translating it into actionable advice is another colossal task. This is where the capabilities of machine learning and AI shine.

Harnessing AI/ML in precision nutrition

While Precision Nutrition lays the groundwork with its rich observational data, AI/ML is the vital component that amplifies its potential. These technologies can sift through vast datasets, identifying intricate patterns and correlations that would be impossible to detect manually.

They help in building predictive models that not only forecast future health outcomes but also fine-tune recommendations to an individual's unique needs. In essence, ML/AI doesn't just belong to the world of Precision Nutrition — it powers and propels it forward, turning comprehensive data into truly personalized dietary advice.

As someone building ML models for pediatric eating behavior and obesity, I see this potential directly. The same principles that apply to adult precision nutrition — using behavioral and biological data to predict outcomes — translate to understanding why some children are more vulnerable to weight gain than others, and what behavioral signatures predict future adiposity.

The current state — and honest limitations

Precision Nutrition and ML/AI are starting to work together in promising ways. But we're still learning how much they can really do. Right now, several challenges remain:

  • Data scarcity and cost: many models use data from limited populations, and collecting high-quality behavioral and biological data isn't easy or cheap.
  • Generalizability: models trained on one population don't always perform well on another — a significant barrier for real-world deployment.
  • Interpretability: complex ML models can make accurate predictions without being transparent about why — a problem for clinical trust.
  • Validation: models need to be tested rigorously in real settings like hospitals and clinics before we can trust them for individual advice.

To make the most of this technology in food and health, experts across disciplines need to collaborate. It's not just about building new models — they also need to be validated where it matters, compared honestly with existing approaches, and designed to be understandable.

Concluding thoughts

Precision Nutrition and ML/AI are joining forces, ushering in an era of customized dietary recommendations tailored to individual profiles. The journey isn't without challenges — expanding data sources, fostering cross-disciplinary collaboration, and ensuring models are transparent and ethical are all crucial steps forward.

But it's equally important to remember that this technological evolution is designed to work alongside, not replace, the deep knowledge of health experts. As we tap into the power of AI to refine precision nutrition, our goal remains steadfast: guiding individuals towards the healthiest choices, backed by both cutting-edge technology and trusted human expertise.

These technological tools provide valuable insights, but they haven't replaced the expertise of health professionals — at least not yet. For now, they serve as an aid, enhancing our understanding of food and health while streamlining the efforts of experts.

Sources & further reading

  • Livingstone KM, Ramos-Lopez O, Pérusse L, et al. Precision nutrition: A review of current approaches and future endeavors. Trends Food Sci Technol 128:253–64. sciencedirect.com ↗
  • AI in the Advancement of Precision Nutrition, Mary Mc Keown, Oct 2023. aibusiness.com ↗
  • Nutrition for Precision Health, powered by the All of Us Research Program. NIH ↗
← back to blog
Precision nutrition AI / ML Obesity research
press & media

In the press

News coverage, academic impact metrics, newsletter features, and community recognition of the research — from Penn State news to the Obesity & Energetics newsletter.

📰
🤖 ByteTrack coverage
Penn State News · October 15, 2025

Counting bites with AI might one day help prevent childhood obesity

An interdisciplinary team at Penn State published a pilot study demonstrating the potential of using AI to streamline research on obesity risk in children. Features Yashaswini Bhat as lead author and includes direct quotes on the vision for a smartphone app that could help children develop healthy eating habits.

"One day, we might be able to offer a smartphone app that warns children when they need to slow their eating so they can develop healthy habits that last a lifetime." — Yashaswini Bhat, as quoted in Penn State News
Read the full article
📊
Altmetric · Impact tracking
ByteTrack altmetric score

Tracking news coverage, social media mentions, policy citations, and public engagement with the ByteTrack paper — showing the real-world reach of the research beyond academic citations.

View Altmetric score
🌐
Frontiers Loop · Social buzz
ByteTrack social impact

Frontiers Loop tracks the social and academic reach of the ByteTrack paper — including views, shares, and engagement across the research community since publication in October 2025.

View Loop impact
🧠 EAH paper coverage
Penn State HHD College News

Children who eat when not hungry may be at greater risk for weight gain

Coverage from Penn State's College of Health and Human Development on the published EAH study — reporting that children who eat in the absence of hunger show a stable behavioral pattern that predicts adiposity gains in middle childhood. Published in the Journal of Nutrition, December 2024.

Read the coverage
🎓 Dissertation feature
Obesity & Energetics Offerings · September 5, 2025

Dissertation featured in Obesity & Energetics newsletter

The dissertation "Predicting Childhood Obesity: Integrating Eating Behavior with Statistical and Machine Learning Approaches" was featured in the weekly Obesity & Energetics Offerings newsletter — a curated digest of the latest obesity research produced by Indiana University's School of Public Health and UAB's Nutrition Obesity Research Center (NORC).

Featured under the "Children and Adolescents" section of the September 5, 2025 issue — highlighting the dissertation's integration of behavioral eating paradigms with ML approaches for childhood obesity prediction.

🏛️
View newsletter issue
media enquiries
Want to cover this research?

Happy to speak with journalists, science communicators, and podcasters about AI in behavioral health, childhood obesity measurement, and open-source research tools.

Get in touch →