A Multi-Target Detection and Tracking Algorithm Incorporating Historical Trajectories for Intelligent Vehicles in Urban Complicated Conditions[J]. 2018, 52(10): 132-140.
DOI:
A Multi-Target Detection and Tracking Algorithm Incorporating Historical Trajectories for Intelligent Vehicles in Urban Complicated Conditions[J]. 2018, 52(10): 132-140.DOI: 10.7652/xjtuxb201810018.
A Multi-Target Detection and Tracking Algorithm Incorporating Historical Trajectories for Intelligent Vehicles in Urban Complicated Conditions
A new type of multi-target detection and tracking algorithm based on net classifiers and historical trajectories is proposed to focus the problem that most existing popular environmental perception algorithms for intelligent vehicles are designed for specific type of targets and they have been proved to be low recognition accuracy in complicated urban conditions where occlusion of different targets and abrupt light change are frequent. Images are scanned from a multi-scale sliding window and then fused by a fusion model according to occlusion relations among pedestrians
vehicles and traffic signs. Historical detection results are obtained based on correlation of target features through short trajectory generation
long trajectory generation and reliability verification of trajectories
and are used to generate a library of historical trajectories
which is used to predict and to fuse detection results in the next step. Then
the standard deviation classifier
the nearest neighbor classifier and historical trajectories are updated by new detection and tracking results. Multi-target long-time tracking in complicated conditions is realized in this way. Field experiment shows that the proposed algorithm exhibits excellent performance of multi-target long-time tracking in complicated urban conditions such as rainy
shade
luminance changes. The average recognition rates for KITTI database samples is up to 77.17%~81.32% and calculation time of single frame picture is only 0.05 s. These results show a promising algorithm for real-time application.
关键词
Keywords
references
GAVRILA D. Pedestrian detection from a moving vehicle [C]∥Proceedings of the European Conference on Computer Vision. Berlin, Germany: Springer, 2000: 37-49.
GAVRILA D M, GIEBEL J. Shape-based pedestrian detection and tracking [C]∥Proceedings of the Intelligent Vehicle Symposium. Piscataway, NJ, USA: IEEE, 2002: 8-14.
SRINIVASA N. Vision-based vehicle detection and tracking method for forward collision warning in automobiles [C]∥Proceedings of the Intelligent Vehicle Symposium. Piscataway, NJ, USA: IEEE, 2002: 626-631.
BERTOZZI M, BROGGI A, FASCIOLI A, et al. Stereo vision-based vehicle detection [C]∥Proceedings of the Intelligent Vehicles Symposium. Piscataway, NJ, USA: IEEE, 2000: 39-44.
BROGGI A, CERRI P, ANTOELLO P C. Multi-resolution vehicle detection using artificial vision [C]∥Proceedings of the Intelligent Vehicles Symposium. Piscataway, NJ, USA: IEEE, 2004: 310-314.
ESTABLE S, SCHICK J, STEIN F, et al. A real-time traffic sign recognition system [C]∥Proceedings of the Intelligent Vehicles Symposium. Piscataway, NJ, USA, IEEE, 1994: 213-218.
BERTOZZI M, BROGGI A, CASTELLUCCIO S. A real-time oriented system for vehicle detection [J]. Journal of Systems Architecture, 1997, 43(1): 317-325.
OUYANG W, WANG X. Joint deep learning for pedestrian detection [C]∥Proceedings of the International Conference on Computer Vision. Piscataway, NJ, USA: IEEE, 2013: 2056-2063.
BETKE M, HARITAOGLU E, DAVIS L S. Multiple vehicle detection and tracking in hard real-time [C]∥Proceedings of the Intelligent Vehicles Symposium. Piscataway, NJ, USA: IEEE, 1996: 351-356.
PAPAGEORGIOU C P, OREN M, POGGIO T. A general framework for object detection [C]∥Proceedings of the International Conference on Computer Vision. Piscataway, NJ, USA: IEEE, 1998: 555-562.
STALLKAMP J, SCHLIPSING M, SALMEN J, et al. Man vs. computer: benchmarking machine learning algorithms for traffic sign recognition [J]. Neural Networks the Official Journal of the International Neural Network Society, 2012, 32(2): 323-332.
GIRSHICK R, DONAHUE J, DARRELL T, et al. Rich feature hierarchies for accurate object detection and semantic segmentation [C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, NJ, USA: IEEE, 2014: 580-587.
GIRSHICK R. Fast R-CNN [C]∥Proceedings of the International Conference on Computer Vision. Piscataway, NJ, USA: IEEE, 2015: 1440-1448.
REN Shaoqing, HE Kaiming, ROSS G, et al. Faster R-CNN: towards real-time object detection with region proposal networks [J]. IEEE Transactions on Pattern Analysis Machine Intelligence, 2015, 39(6): 1137-1149.
REDMON J, DIVVALA S, GIRSHICK R, et al. You only look once: unified, real-time object detection [C]∥Proceedings of the Computer Vision and Pattern Recognition. Berlin, Germany: Springer, 2015: 779-788.
REDMON J, FARHADI A. YOLO9000: better, faster, stronger [C]∥Proceedings of the Computer Vision and Pattern Recognition. Berlin, Germany: Springer, 2017: 21-25.
LIU W, ANGUELOV D, ERHAN D, et al. SSD: single shot multibox detector [C]∥Proceedings of the European Conference on Computer Vision. Berlin, Germany: Springer, 2016: 21-37.
JONATHAN L, EVAN S, TREVOR D. Fully convolutional networks for semantic segmentation [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 4(39): 640-651.
PASZKE A, CHAURASIA A, KIM S, et al. ENet: a deep neural network architecture for real-time semantic segmentation [C]∥Proceedings of the Computer Vision and Pattern Recognition. Berlin, Germany: Springer, 2017: 21-25.
ZHAO Hengshuang, SHI Jianping, QI Xiaojuan, et al. Pyramid scene parsing network [C]∥Proceedings of the Computer Vision and Pattern Recognition. Berlin, Germany: Springer, 2017: 21-25.
ZHAO Hengshuang, QI Xiaojuan, SHEN Xiaoyong, et al. ICNet for real-time semantic segmentation on high-resolution images [C]∥Proceedings of the Computer Vision and Pattern Recognition. Berlin, Germany: Springer, 2017: 21-25.
YANG Feng, WANG Yongqi, LIANG Yan, et al. A survey of PHD filter based multi-target tracking [J]. ACTA Automatic Sinica, 2013, 39(11): 1944-1956.
OKUMA K, TALEGHANI A, FREITAS N D, et al. A boosted particle filter: multitarget detection and tracking [C]∥Proceedings of the European Conference on Computer Vision. Berlin, Germany: Springer, 2004: 28-39.
ANDRIYENKO A, SCHINDLER K. Globally optimal multi-target tracking on a hexagonal lattice [C]∥Proceedings of the European Conference on Computer Vision. Berlin, Germany: Springer, 2010: 466-479.
MALLICK M, KRANT J, SHALON J. Multi-sensor multi-target tracking with out-of-sequence measurements [C]∥Proceedings of the 6th International Conference of Information Fusion. Piscataway, NJ, USA: IEEE, 2003: 672-679.
HOWARD A, PADGETT C, LIEBE C C. A multi-stage neural network for automatic target detection [C]∥Proceedings of the IEEE World Congress on Computational Intelligence. Piscataway, NJ, USA: IEEE, 1998: 4-9.
GRINBERG M, OHR F, BEYERER J. Feature-based probabilistic data association(FBPDA)for visual multi-target detection and tracking under occlusions and split and merge effects [C]∥Proceedings of the International Conference on Intelligent Transportation Systems. Piscataway, NJ, USA: IEEE, 2009: 1-8.
KALAL Z, MIKOLAJCZYK K, MATAS J. Tracking-learning-detection [J]. IEEE Transactions on Pattern Analysis Machine Intelligence, 2011, 34(7): 1409-1422.
HU Weiming, HU We, MAYBANK S. AdaBoost-based algorithm for network intrusion detection [J]. IEEE Transactions on Systems Man and Cybernetics: Part B Cybernetics, 2008, 38(2): 577-583.