Interactive Multiple Object Learning with Scanty Human Supervision
M. Villamizar, A. Garrell, A. Sanfeliu and F. Moreno-Noguer
Computer Vision and Image Understanding (CVIU) - 2016

Abstract - We present a fast and online human-robot interaction approach that progressively learns multiple object classifiers using scanty human supervision. Given an input video stream recorded during the human-robot interaction, the user just needs to annotate a small fraction of frames to compute object specific classifiers based on random ferns which share the same features. The resulting methodology is fast (in a few seconds, complex object appearances can be learned), versatile (it can be applied to unconstrained scenarios), scalable (real experiments show we can model up to 30 different object classes), and minimizes the amount of human intervention by leveraging the uncertainty measures associated to each classifier. We thoroughly validate the approach on synthetic data and on real sequences acquired with a mobile platform in indoor and outdoor scenarios containing a multitude of different objects. We show that with little human assistance, we are able to build object classifiers robust to viewpoint changes, partial occlusions, varying lighting and cluttered backgrounds.

Link

PDF

BibTex

Code

Online Multi-Object Detector

Online Multi-Class Learning

Videos

Videos