The file contains the annotations of human body parts and objects of the sports data set collected by Abhinav Gupta [1].
The body parts and objects were annotated by Bangpeng Yao and firstly used in [2].

If you use the sports data set, please cite [1]. If you use the annotations, please cite [2].
The original images can be downloaded from: http://www.cs.cmu.edu/~abhinavg/pami2009_release.zip

References:
  [1] A.Gupta, A.Kembhavi, and L.S.Davis. "Observing human-object interactions: Using spatial and functional compatibility for recognition." PAMI 2009.
  [2] B.Yao and L.Fei-Fei. "Modeling Mutual Context of Object and Human Pose in Human-Object Interaction Activities." CVPR 2010.



  
Besides this README file, there are two other files in this package:
  hoi_label.mat  --  annotation data
  ShowAnnotation.m  --  an example program of displaying the annotation bounding boxes.

  
  
How to use this ShowAnnotation.m

  1. Download the data set from http://www.cs.cmu.edu/~abhinavg/pami2009_release.zip.
  2. Unzip pami2009_release, then copy ShowAnnotation.m and hoi_label.mat to the folder ./pami09_preRelease/
  3. Add ./pami09_preRelease/ to your matlab path, then run ShowAnnotation.
  4. Click Enter to see the next image and the annotations. 
 
  

Data structure in hoi_label.mat
  hoi_label.mat is an array, each element corresponds to an image. Taking the i-th image as an example:
    hoi_label(i).fname  --  the filename of the i-th image
	hoi_label(i).part(j).center_x  --  the x-coordinate of the center of the j-th part
	hoi_label(i).part(j).center_y  --  the y-coordinate of the center of the j-th part
	hoi_label(i).part(j).width  --  the width of the j-th part
	hoi_label(i).part(j).height  --  the height of the j-th part
	hoi_label(i).part(j).angle  --  the rotation angle of the j-th part
	
  We only annotate one object for each class, so we have 11 parts in total. The 11 parts are (j = 1 to 11):
    head, torso, upper-left arm, lower-left arm, upper-right arm, lower-right arm, 
	upper-left leg, lower-left leg, upper-right leg, lower-right leg, object
	
  For each activity class, we only annotation one object. They are:
    "cricket bat" in cricket defensive shot;
	"cricket ball" in cricket bowling;
	"croquet mallet" in croquet shot;
	"tennis racket" in tennis forehand and tennis serve;
	"volleyball" in volleyball smash.
  
  
  
  
  
  