First-Person Social Interactions Dataset

This dataset contains day-long videos of 8 subjects spending their day at Disney World Resort in Orlando, Florida. The cameras are mounted on a cap worn by subjects.

Subjects	Videos
Alin, Day 1	1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13
Alireza, Day 1	1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14
Alireza, Day 2	1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20
Alireza, Day 3	1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11
Denis, Day 1	1, 2, 3, 4, 5, 6, 7, 8, 9
Hussein, Day 1	1, 2, 3, 4, 5, 6, 7, 8, 9, 10
Michael, Day 2	1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20
Munehiko, Day 1	1, 2, 3, 4, 5, 6, 7, 8, 9,10(empty), 11, 12, 13, 14, 15, 16, 17,

Elan annotations for number of active participants in the scene, and the type of activity (walking, waiting, gathering, sitting, buying something, eating, etc.): Alin_Day1, Alireza_Day1, Alireza_Day2, Alireza_Day3, Michael_Day2, Munehiko_Day1.

Annotations for Social Interactions: Alin_Day1, Alireza_Day1, Alireza_Day2, Alireza_Day3, Denis_Day1, Munehiko_Day1, Michael_Day2, Hussein_Day1,

Cite the following paper when using the dataset:

Alireza Fathi, Jessica K. Hodgins, James M. Rehg, Social Interactions: A First-Person Perspective, IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), 2012. (PDF)

Special Thanks to Aline Normoyle, Hussein Raza, Denis Aleshin, Michael Sibley, Matthew Glisson, Tian Lan, Munehiko Sato and others who kindly wore the cameras to help with data collection. Special thanks to Leonid Sigal for brainstorming and insightful discussions.