Publications

SHIC-XE: Viewpoint-Invariant Explainability via Dense 2D-3D Correspondences: an Application to Equine Pain Recognition

Marcelo Feighelstein, Omer Bibi, Ofer Rozenbaum, Nathali Adrielli Agassi De Sales, Guilherme Camargo Ferraz, Ilan Shimshoni, Dirk van der Linden, Emanuela Dalla Costa, Annika Bremhorst, Claudia Spadavecchia, Anna Zamansky

Automated recognition of animal pain often relies on two-dimensional saliency maps, which suffer from severe flickering and instability as subjects move across changing camera viewpoints. To overcome this limitation, this study presents an explainability framework that leverages dense 2D-3D correspondence mapping to project neural network attention from video frames onto a canonical three-dimensional surface prototype. Evaluated on horses across post-surgical, orthopedic, and acute pain conditions, the approach achieved video-level classification F1 scores ranging from 0.67 to 0.80. Crucially, the method provides quantitative metrics that map model focus to specific facial regions, establishing statistically significant correlations between machine attention and expert veterinary pain scores for key features like ears and cheek muscles.

Now Available in Audio!
Listen to our publication as a podcast. 

Disclaimer: This content was generated using AI tools and is intended for informational purposes only.

Related Works

Contact us to try MELD facial analysis