Video Surveillance of Pedestrians and Vehicles

Gutchess, D., Ablavsky, V., Thangali, A., Sclaroff, S., and Snorrason, M.

Proceedings of SPIE Defense & Security, vol. 6569, Orlando, FL (May, 2007).

In this paper, we focus on the problem of automated surveillance in a parking lot scenario. We call our research system VANESSA, for Video Analysis for Nighttime Surveillance and Situational Awareness. VANESSA is capable of: 1) detecting moving objects via background modeling and false motion suppression, 2) tracking and classifying pedestri-ans and vehicles, and 3) detecting events such as person entering or exiting a vehicle. Moving object detection utilizes a multi-stage cascading approach to identify pixels that belong to the true objects and reject any spurious motion (e.g., due to vehicle headlights or moving foliage). Pedestrians and vehicles are tracked using a multiple hypothesis tracker coupled with a particle filter for state estimation and prediction. The space-time trajectory of each tracked object is stored in an SQL database along with sample imagery to support video forensics applications. The detection of pedestrians entering/exiting vehicles is accomplished by first estimating the three-dimensional pose and the corresponding entry and exit points of each tracked vehicle in the scene. A pedestrian activity model is then used to probabilistically assign pedestrian tracks that appear or disappear in the vicinity of these entry/exit points. We evaluate the performance of tracking and pedestrian-vehicle association on an extensive data set collected in a challenging real-world scenario.

For More Information

To learn more or request a copy of a paper (if available), contact D. Gutchess.

(Please include your name, address, organization, and the paper reference. Requests without this information will not be honored.)