3D Multiple Target Tracking and Face Pose Estimation with a Rotating and Zooming Camera

We present two demos of two modules of a surveillance system under development at MICC with the collaboration of Thales. The first demo presents a method for tracking multiple targets in world coordinates using a zooming camera [1]. The method achieves an almost constant standard deviation error of less than 0.3 meters in recovering world coordinate trajectories of multiple moving targets in an area of 70x15 meters. The main novelty relies on exploiting device-tagged text information from the camera encoders to index and then refine at runtime a set of pre-build camera poses (i.e. internal and external camera parameters). Real time camera pose estimation allows to recover world coordinate localizations of moving targets in the presence of large focal length variations [1][2]. In addition to this, scene geometry and appearance variation are also taken into account allowing the system to operate unattended for several hours [3]. The second module estimates the orientation of target face provided that the target is taken in a sufficient high resolution. Once head localization is obtained within the frame using the first module (a fixed height of a person is assumed), the camera begins moving and zooming to center it within the camera view [4][5]. References [1] A. Del Bimbo G. Lisanti F. Pernici. Scale Invariant 3D Multi-Person Tracking using a Base Set of Bundle Adjusted Visual Landmarks. Proc. of ICCV Int'l Workshop on Visual Surveillance (VS) 2009. Kyoto, Japan. [2] A. Del Bimbo, G. Lisanti, I. Masi, F. Pernici. Person Detection using Temporal and Geometric Context with a Pan Tilt Zoom Camera. In Proc. of the International Conference on Pattern Recognition (ICPR) 2010. Istanbul, Turkey. [3] A. Del Bimbo, G. Lisanti, I. Masi, Pernici F. Device-Tagged Feature-based Localization and Mapping of Wide Areas with a PTZ Camera. In Proc. of CVPR International Workshop on Socially Intelligent Surveillance and Monitoring (SISM) 2010. San Francisco, CA, USA [4] A. Del Bimbo, F. Dini, and G. Lisanti, "A real time solution for face logging," in Proc. of Int’l Conference on Imaging for Crime Detection and Prevention (ICDP), London, United Kingdom, 2009. [5] A. D. Bagdanov, A. Del Bimbo, and W. Nunziati, "Improving Evidential Quality of Surveillance Imagery Through Active Face Tracking" 18th Int’l Conf. on Pattern Recognition, 2006.