Can AI Read a Dog's Behavior? What Current Studies Actually Show
Table of Contents
A source-backed Evidence Review of canine emotion and pain-indicator research, from DogFACS to video models, and the limits of bringing a laboratory result into a living room.
Research & Evidence | Evidence Review | Updated August 31, 2026
The short answer
Current research shows that computer-vision models can classify selected labels from dog images or video under defined study conditions. For example, a model may distinguish two experimentally induced conditions in a controlled group of Labradors, or classify short clips that experts have annotated for pain indicators. That is a meaningful research result.
It is not the same as reading a dog's private feelings. The studies do not establish that a phone app can diagnose pain, identify a dog's mood from one picture, or decide that a dog is safe or unsafe from a single home video. The question is not simply whether a model can produce a percentage. It is whether the label, data, test design and real-world setting justify the decision someone wants to make.

This review asks: What can current computer-vision studies actually infer from a dog's facial or body video, and what evidence is still missing before those outputs should be used by pet families?
What we reviewed
This is a narrative evidence review, not a systematic review or meta-analysis. We selected five scholarly sources that help answer the question from different angles:
- a foundational behavioral study using FACS and DogFACS;
- a controlled deep-learning study of two canine emotional conditions;
- a veterinary-annotated video study of pain indicators;
- a study that tested emotion models on clips from different breeds and less controlled environments; and
- a peer-reviewed survey of computer-vision methods for animal pain and affective states.
We prioritized the formal journal or conference record when one was available, then checked the full text or an authoritative repository. We recorded each study's species, population, data source, label definition, model task, evaluation design and limits. We did not include consumer-app marketing as evidence, and we did not treat work on other species as proof about dogs.
First, define what "emotion recognition" means here
In everyday speech, "recognize my dog's emotion" sounds like direct access to an inner experience. In a study, it usually means something narrower: map visible pixels, body points or facial action codes to a label that researchers defined for a particular protocol.
DogFACS is a useful example. It is an anatomically based coding system for observable facial movements. It gives researchers a vocabulary for describing actions such as an ear movement, blink or mouth movement. It is not a mood meter. The 2017 study by Caeiro, Guo and Mills used FACS and DogFACS to compare human and dog facial actions across stimulus categories. Dogs did show distinctive actions associated with different categories, but the actions were not simply human expressions copied onto a canine face. The paper's conclusion is a reason to reduce anthropomorphic guesses, not a licence to equate one facial pose with one universal feeling. The article also has an author correction, so it should be read as a living scholarly record rather than an infallible label dictionary. Read the Scientific Reports study
That distinction matters because a model can be very good at reproducing a study's labels while the labels remain narrower than the question a family wants answered. "This clip resembles the study's frustration condition" is not the same statement as "your dog is frustrated."
The evidence map
| Study | What was recorded and labelled | What the model or analysis reported | What the result does not establish |
|---|---|---|---|
| Caeiro, Guo and Mills (2017) | Video of 100 family dogs and 50 humans responding to four stimulus categories; facial movements coded with FACS and DogFACS. | Dogs produced distinctive facial actions by stimulus category, but not a simple human-like expression system. | A single face, breed or facial action is a universal emotion detector. |
| Boneh-Shitrit et al. (2022) | 29 Labrador Retrievers in a controlled protocol; 164 balanced three-second videos representing positive anticipation or frustration; DogFACS annotations. | The DogFACS-based approach exceeded 71% accuracy in the reported setup. A DINO-ViT deep-learning approach exceeded 89% at video level and reached 85% at frame level. | General emotion recognition across breeds, home videos or all positive and negative states. |
| Zhu et al. (conference version 2023; full text 2022) | 61 veterinary-collected videos, 23 labelled pain and 38 non-pain, totalling 6 hours 45 minutes. Veterinary professionals supplied the annotations. | A two-stream model combining body keypoints and RGB video reported mean F1 of 76.3% ± 4.4 and mean accuracy of 77.0% ± 4.6 in its cross-validation experiments. | A diagnosis, a validated home screening test or a direct measurement of subjective pain. |
| Franzoni, Biondi and Milani (2024) | 100 public-source videos from different breeds, evenly distributed across five study labels: fear, frustration, happiness, positive anticipation and relaxation. | In one video-partition setup, a face-bounding-box VGG19 model setup reached 0.605 accuracy for the five-label task. A separate two-class aggregation labelled "danger" reached a reported peak accuracy of 0.8577 after preprocessing. | A real-time safety guarantee. The "danger" classes were the authors' aggregation of study labels, not a clinically validated bite-risk instrument. |
| Broomé et al. (2023) | Peer-reviewed survey of computer-vision research on animal pain and affective states, including facial, body and video methods. | The survey emphasizes that accuracy numbers are not directly comparable when data collection, labels, class balance and validation differ. It recommends subject-exclusive testing and stronger external validation. | One universal benchmark or a reason to rank consumer tools by a single headline percentage. |
The percentages are reproduced as reported results, not as a league table. The studies use different populations, tasks, labels, units and splits. The survey explicitly warns that those differences can change the metric before a model ever sees a new dog. Read the survey record

What the studies agree on
1. Context is part of the measurement
The strongest controlled emotion result came from a deliberately narrow question. Boneh-Shitrit and colleagues worked with 29 Labradors and two experimentally induced conditions: positive anticipation and frustration. The videos were short, balanced and collected within a protocol designed to make the conditions interpretable. The deep model's reported result is interesting because it shows that a model can learn a distinction under those conditions, and the heatmaps provide a way to inspect where it looked.
The same design is also the limitation. A Labrador in a controlled experiment is not every dog in a kitchen, park or grooming room. A three-second clip is not a whole day of behavior. The study itself calls for broader participant characteristics and longer or more varied data before making wider claims. Read the controlled emotion study
2. Pain indicators are not the subjective experience of pain
The dog pain study by Zhu and colleagues is careful about this boundary. Its pipeline combines a pose stream with an RGB stream, uses an eight-frame clip sampled over four seconds, and returns a model output for a binary pain-state task. The paper says that a simple image or video cannot measure the subjective experience of pain directly. It can, at most, estimate visual indications that were represented in the data and labels.
The dataset is useful because veterinary professionals collected the videos and supplied the annotations. It is also small by consumer-product standards: 61 source videos, with repeated short clips derived from those videos. The source dataset is not publicly available, although the authors made code and annotations available under the conditions described in the paper. Breed differences, body posture, lighting, occlusion and coping behavior all affect what a camera can see. The reported F1 and accuracy are therefore evidence about that experimental pipeline, not a home diagnosis. Read the paper and its data statement or the published conference record
3. A model can learn the background instead of the dog
Franzoni, Biondi and Milani tested a dataset of 100 public-source videos covering five labels and different breeds. Their analysis is useful because it treats preprocessing as an evidence question. Cropping the face, segmenting the dog and blurring the background changed performance. The authors discuss a familiar failure mode: if many "happy" dogs are filmed in parks and many "sad" dogs are filmed indoors, a model can learn the park or the room rather than the expression.
The study's reported 0.605 accuracy for one five-label model setup and 0.8577 peak accuracy for its two-class "danger" aggregation should be read with that context. The numbers describe one dataset, one task definition and one evaluation design. The authors themselves point to missing breed diversity and the need to test temporal dynamics. The transformed clips are available through the paper's data statement, while the original public-source collection has copyright limits. Read the Neural Computing and Applications study
4. Time can carry information that a still image loses
The survey by Broomé and colleagues divides computer-vision work into single-frame methods, frame aggregation and genuinely spatiotemporal video models. Each choice answers a different question. Counting how often an ear is forward may be a frame-level task. Distinguishing a blink, a change in posture or a repeated avoidance pattern requires a sequence.
Video models are not automatically better. They need more data, can be expensive to train and can overfit repeated frames from the same recording. A still image and a four-second clip are different measurements. A consumer claim that does not state the input window is missing a necessary part of the method.
5. "Accuracy" is not the same as trustworthiness
Accuracy answers one question: how often did the predicted label match the recorded label in that test setup? F1 balances performance across classes in a different way. Neither number tells us, by itself, whether the model is calibrated for a new breed, how many urgent cases it misses, whether it works on a phone camera, or what happens when lighting and posture change.
The survey makes this comparison problem explicit. Researchers use different cameras, angles, sample units, label sources, class balances and validation schemes. A random split can place near-duplicate frames or clips from the same dog on both sides of the test boundary. A subject-exclusive split, where an entire dog is held out, is harder and more informative about generalization to a new individual. External validation on a new clinic, household, camera or breed is harder still.
This is why the table above places the reported metric next to the population and task. Removing the denominator and study conditions would turn a useful result into a misleading marketing number.
What stronger evidence would look like
Before a consumer-facing tool could responsibly make a high-stakes claim, we would want to see more than a high score on one paper's test set:
- A transparent target. The tool should say whether it classifies an observable behavior, an operational study label or a clinical outcome. "Emotion" without a definition is too broad.
- Diverse participants. Testing should cover breeds, head shapes, coat colors, ages, health contexts and normal variation, with the counts shown rather than hidden in a headline.
- Dog-level separation. No dog, household or near-duplicate recording should leak across training and test sets.
- External and prospective validation. The model should be evaluated on new clinics, homes, cameras and time periods, not only on a held-out slice of the original collection.
- Clinically meaningful error reporting. Sensitivity, specificity, calibration, false negatives and uncertainty should be reported for the decision that the tool asks a person to make.
- Independent review and correction. Veterinary and behavior experts should review the target, labels, safety language and failure cases. Version changes and known limitations should remain visible.
- A safe action path. If the output could influence care or interaction, the interface should tell a person what to observe next and when to contact a veterinarian. It should not turn a low-confidence classification into reassurance.
These are not hurdles invented by one brand. They are the practical consequences of the measurement and validation gaps described across the studies.

A useful boundary for pet families
If you try an AI behavior feature, treat it as a question prompt, not a verdict. A more responsible workflow is:
- record what happened before and after the clip, not only the most expressive frame;
- note movement, appetite, breathing, posture, environment and duration alongside the image;
- compare the observation with your dog's own normal pattern, not a generic label;
- avoid changing medication, delaying care or approaching a frightened dog because an app sounds confident; and
- contact a veterinarian promptly for pain, breathing difficulty, sudden weakness, collapse, injury or a rapid change in behavior.
Our Pet Wellness library is the better place for practical care questions. For the market context behind the recent interest in smart pet technology, see our August Industry Weekly.
Bottom line
The research is promising, but its promise is more precise than the slogan. Computer vision can help researchers quantify visible patterns and classify carefully defined labels. DogFACS can make facial movement descriptions more explicit. Video models can combine posture, appearance and time. Those are real advances.
The evidence still does not justify the consumer shortcut from "the model matched a study label" to "the app knows what my dog feels" or "the dog is safe." The next useful test is not another impressive percentage in isolation. It is better ground truth, more diverse dogs, dog-level and external validation, transparent uncertainty and a clear professional-help boundary.
That is the standard we will use for future Research & Evidence articles: show the source, preserve the method, state the uncertainty and make the non-inference as visible as the finding.
Questions readers ask
Can an AI app tell whether my dog is happy?
It may classify a clip using labels learned from a particular dataset, but current studies do not validate a universal happiness detector for household dogs. Ask what labels, dogs, cameras and test design support the app's claim.
Can a dog pain model diagnose my pet?
No. The published dog pain work estimates visual indicators in a research task. It does not replace a veterinary examination or directly measure subjective pain from a home video.
Why do papers report 77%, 86% or 89% if the technology is not ready?
Those figures can be legitimate results within their experiments. They are not interchangeable because the studies use different labels, samples, input windows, splits and metrics. A result becomes useful only when its denominator and limits travel with it.
What should I look for before trusting a behavior-AI claim?
Look for a clear target definition, dog-level separation, external validation, error and uncertainty reporting, a description of the data, and a safety path that directs urgent concerns to a veterinarian.
Sources and update note
All source pages were checked on August 31, 2026. The study descriptions above distinguish reported findings from our interpretation. If a source is corrected, retracted or materially updated, we will revise the relevant passage and identify the change rather than silently replacing the conclusion. This article is informational and does not provide veterinary diagnosis or treatment advice.
- Caeiro, C., Guo, K. and Mills, D. "Dogs and humans respond to emotionally competent stimuli by producing different facial actions." Scientific Reports (2017; author correction 2018). Nature record
- Boneh-Shitrit, T. et al. "Explainable automated recognition of emotional states from canine facial expressions: the case of positive anticipation and frustration." Scientific Reports (2022). Nature record
- Zhu, H. et al. "Video-based estimation of pain indicators in dogs." IEEE International Conference on Affective Computing and Intelligent Interaction (published conference record 2023; arXiv full text v2 2022). DOI record | Full text
- Franzoni, V., Biondi, G. and Milani, A. "Advanced techniques for automated emotion recognition in dogs from video data through deep learning." Neural Computing and Applications (2024). Springer Nature record
- Broomé, S. et al. "Going deeper than tracking: a survey of computer-vision based recognition of animal pain and emotions." International Journal of Computer Vision (2023). Springer DOI record | University repository