ChildPlay-Hand
LAHands is an annotation dataset for studying hand-centered visual attention in natural scenes. It extends the existing gaze-following datasets GazeFollow, ChildPlay, and VideoAttentionTarget with Looking-at-Hands (LAHands) annotations, building on VSGaze person identities and head bounding boxes. The LAHands task determines whether a person's gaze is directed toward a particular hand or toward an object held or actively manipulated by that hand. The annotations associate gazers with candidate hands and provide labels for gazer–hand pairs, enabling the training and evaluation of models that jointly reason about gaze, hands, and hand interactions with objects.
Description
ChildPlay-Hand is a video dataset for modeling Hand-Object Interaction (HOI) in the wild that includes person and object bounding boxes, as well as manipulation actions. ChildPlay-Hand is unique in: (1) providing per-hand annotations; (2) featuring videos in uncontrolled settings with natural interactions; and (3) including gaze labels from the ChildPlay-Gaze dataset for joint modeling of manipulations and gaze. It contains annotations for 401 video clips from the ChildPlay-Gaze dataset, resulting in 7,653 segments and 10 actions.
Reference
If you're using this code, models or dataset, please cite the following publications:
@inproceedings{Farkhondeh_ECCVW_2024,
author = {Farkhondeh*, Arya and Tafasca*, Samy and Odobez, Jean-Marc},
title = {ChildPlay-Hand: A Dataset of Hand Manipulations in the Wild},
booktitle = {Proceedings of the European Conference on Computer Vision (ECCV) Workshops},
year = {2024},
note = {* Equal contribution}
}@InProceedings{Tafasca_2023_ICCV,
author = {Tafasca*, Samy and Gupta*, Anshul and Odobez, Jean-Marc},
title = {ChildPlay: A New Benchmark for Understanding Children's Gaze Behaviour},
booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
month = {October},
year = {2023},
pages = {20935-20946},
note = {* Equal contribution}
}