A novel segmentation algorithm for road scenes based on hierarchical graph-based inference(HGI)is proposed to solve the problem that object boundaries extracted by existing graph-based segmentation algorithms are not fine enough and it is hard to adapt to complex road scene layouts. The algorithm first over-segments an image into small homogeneous regions called superpixels
and then the random forest model is used to train a multi-class regressor and a consistency regressor of superpixels. Regression results are then used to calculate the energy terms in a Markov random field(MRF)energy function. An initial segmentation of the image is obtained by using the superpixel MRF inference. A pixel-level labeling based on fully connected conditional random fields is constructed to avoid the label confusion caused by the superpixels and to get a fine segmentation finally. Experimental results show that the proposed algorithm solves the label confusion in the superpixel inference and gets fine segmentation boundaries for both the images in manually labeled datasets and the real road scenes. A comparison with the traditional MRF graph-based inference methods shows that the HGI algorithm provides improvements of 2% and 3% on the overall precision and per-class average metrics
respectively.
关键词
Keywords
references
HOIEM D, EFROS A, HEBERT M. Recovering surface layout from an image [J]. International Journal of Computer Vision, 2007, 75(1): 151-172.
COSTEA A D, NEDEVSCHI S. Fast traffic scene segmentation using multi-range features from multi-resolution filtered and spatial context channels [C]∥IEEE Intelligent Vehicles Symposium Proceedings. Piscataway, NJ, USA: IEEE, 2016: 328-334.
GOULD S. Darwin: a framework for machine learning and computer vision research and development [J]. Journal of Machine Learning Research, 2012, 13(18): 3533-3537.
COSTEA A D, NEDEVSCHI S. Semantic channels for fast pedestrian detection [C]∥Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Piscataway, NJ, USA: IEEE, 2016: 2360-2368.
DENG Yanzi, LU Zhaoyang, LI Jing. Segmentation of the image with multi-visual features for a traffic scene [J]. Journal of Xidian University, 2015, 42(6): 11-16.
CHACRA D A, ZELEK J. Road segmentation in street view images using texture information [C]∥Proceedings of 2016 IEEE Conference on Computer and Robot Vision. Piscataway, NJ, USA: IEEE, 2016: 424-431.
FARABET C, COUPRIE C, NAJMAN L, et al. Learning hierarchical features for scene labeling [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2013, 35(8): 1915-1929.
WANG Hai, CAI Yingfeng, JIA Yunyi, et al. Scene adaptive road segmentation algorithm based on deep convolutional neural network [J]. Journal of Electronics and Information Technology, 2017, 39(2): 263-269.
YU Miao, HU Zhanyi. Higher-order Markov random fields and their applications in scene understanding [J]. Acta Automatica Sinica, 2015, 41(7): 1213-1234.
HORNE L, ALVAREZ J M, SALZMANN M, et al. Efficient scene parsing by sampling unary potentials in a fully-connected CRF [C]∥IEEE Intelligent Vehicles Symposium Proceedings. Piscataway, NJ, USA: IEEE, 2015: 820-825.
KRAHENBUHL P, KOLTUN V. Efficient inference in fully connected CRFs with Gaussian edge potentials [C]∥Proceedings of 25th Annual Conference on Neural Information Processing Systems 2011. Red Hook, NY, USA: Curran Associates Inc., 2011: 109-117.
FELZENSZWALB P F, HUTTENLOCHER D P. Efficient graph-based image segmentation [J]. International Journal of Computer Vision, 2004, 59(2): 167-181.
ARBELAEZ P, MAIRE M, FOWLKES C, et al. Contour detection and hierarchical image segmentation [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011, 33(5): 898-916.
XIAO L, DAI B, LIU D, et al. Monocular road detection using structured random forest [J]. International Journal of Advanced Robotic Systems, 2016, 13(3): 101-114.
XU Shengjun, HAN Jiuqiang, ZHAO Liang, et al. Algorithm of minimizing local region energy for image segmentation [J]. Journal of Xi'an Jiaotong University, 2011, 45(8): 7-12.
GRIDCHYN I, KOLMOGOROV V. Potts model, parametric maxflow and K-submodular functions [C]∥Proceedings of the IEEE International Conference on Computer Vision. Piscataway, NJ, USA: IEEE, 2013: 2320-2327.
ADAMS A, BAEK J, DAVIS M A. Fast high-dimensional filtering using the permutohedral lattice [J]. Computer Graphics Forum, 2010, 29(2): 753-762.
ALVAREZ J M, GEVERS T, LECUN Y, et al. Road scene segmentation from a single image [C]∥Proceedings of the 12th European Conference on Computer Vision. Berlin, Germany: Springer Verlag, 2012: 376-389.
LADICKY L, RUSSELL C, KOHLI P, et al. Associative hierarchical random fields [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2014, 36(6): 1056-1077.