面向监控视频内容自适应的通用视频编码量化参数级联

公衍超; 张森森; 何书婷; 李宝贵; 刘颖; 林庆帆

doi:10.7652/xjtuxb202312004

您当前的位置：

首页 >

文章列表页 >

面向监控视频内容自适应的通用视频编码量化参数级联

专题视频编码理论与应用 | 更新时间：2025-07-09

- 面向监控视频内容自适应的通用视频编码量化参数级联
- Content Adaptive Quantization Parameter Cascading for Surveillance Video Coding Using Versatile Video Coding
- 西安交通大学学报 2023年57卷第12期页码：30-40
- 作者机构：
  
  1. 西安邮电大学通信与信息工程学院,西安,710121
  2. 陕西省法庭科学电子信息实验研究中心,西安,710121
  3. 陕西省无线通信与信息处理技术国际联合研究中心,西安,710121
  4. 新加坡XsecPro公司,新加坡,787820
- 作者简介：
  
  : 2023-05-30。作者简介: 公衍超(1986—),男,副教授,硕士生导师。基金项目: 国家自然科学基金资助项目(62277036,61801381)
- 基金信息：
  
  : 2023-05-30。作者简介: 公衍超(1986—),男,副教授,硕士生导师。基金项目: 国家自然科学基金资助项目(62277036,61801381);西安邮电大学研究生创新基金资助项目(CXJJZL2022005)。
- DOI：10.7652/xjtuxb202312004
  中图分类号： TN911.7
- 网络首发：2023-12-10，
  
  纸质出版：2023
- 稿件说明：
移动端阅览
公衍超, 张森森, 何书婷, 等. 面向监控视频内容自适应的通用视频编码量化参数级联[J]. 西安交通大学学报, 2023,57(12):30-40.

GONG Yanchao, ZHANG Sensen, HE Shuting, et al. Content Adaptive Quantization Parameter Cascading for Surveillance Video Coding Using Versatile Video Coding[J]. 2023, 57(12): 30-40.
公衍超, 张森森, 何书婷, 等. 面向监控视频内容自适应的通用视频编码量化参数级联[J]. 西安交通大学学报, 2023,57(12):30-40. DOI： 10.7652/xjtuxb202312004.

GONG Yanchao, ZHANG Sensen, HE Shuting, et al. Content Adaptive Quantization Parameter Cascading for Surveillance Video Coding Using Versatile Video Coding[J]. 2023, 57(12): 30-40. DOI： 10.7652/xjtuxb202312004.

摘要

最新通用视频编码(VVC)标准测试模型VTM推荐的JCTVC-X0038量化参数级联方法未考虑监控视频的内容特性

编码效率低。针对这一问题

提出了一种有效考虑监控视频空时域内容特性的VVC量化参数级联方法(SCA-QPC)。基于VVC混合编码框架原理

理论分析得出时间层及监控视频的空时域内容特性是影响量化参数(QP)选择的关键因素

设计编码实验对理论分析结果进行验证; 采用梯度和背景帧差分别评测监控视频的空域和时域特性

将梯度和背景帧差作为反向传播神经网络的输入

构建预测低时延结构时间层对应最优QP的模型; 提出适用于VVC标准有效提高监控视频编码效率的量化参数级联方法。与当前最先进的JCTVC-X0038量化参数级联方法相比

对于所有测试序列

SCA-QPC对应的平均BD-rate为-4.26%。研究对于VVC编码框架中量化参数级联和码率控制模块的优化具有指导意义。

Abstract

The JCTVC-X0038 quantization parameter cascading(QPC)method recommended by the latest versatile video coding(VVC)standard test model VTM has low coding efficiency because the surveillance video content characteristics are not considered. For this problem

a VVC QPC method considering the spatio-temporal content characteristics of the surveillance videos

referred to as SCA-QPC

was proposed. First

based on the VVC hybrid coding framework principle

it was found that the temporal layer and spatio-temporal content characteristics of the surveillance videos were the key factors affecting the selection of quantization parameters(QP)by theoretical analysis. And the coding experiments were further carried out to verify the results of the theoretical analysis. Then the gradient and background frame difference were used to measure the spatio-temporal characteristics of the surveillance videos respectively and further used as the inputs to the back propagation neural network to construct a model predicting the optimal QPs corresponding to temporal layers in low delay structure. Finally

the SCA-QPC suitable for VVC standard was proposed to effectively improve the surveillance video coding efficiency. Compared with the state-of-the-art JCTVC-X0038 QPC method

the average BD-rate of SCA-QPC is -4.26% for all test sequences. This study can guide the optimization of QPC and rate control modules in the VVC coding framework.

关键词

Keywords

references

SCHWARZ H, MARPE D, WIEGAND T. Overview of the scalable video coding extension of the H.264/AVC standard [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2007, 17(9): 1103-1120.

SULLIVAN G J, OHM J R, HAN W J, et al. Overview of the high efficiency video coding(HEVC)standard [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2012, 22(12): 1649-1668.

李维, 任鹏, 赵凡, 等. 高效视频编码中帧内码率控制改进算法 [J]. 西安交通大学学报, 2019, 53(4): 79-84.

LI Wei, REN Peng, ZHAO Fan, et al. A modified method for intra-coding rate control in high efficiency video coding [J]. Journal of Xi'an Jiaotong University, 2019, 53(4): 79-84.

BROSS B, WANG Yekui, YE Yan, et al. Overview of the versatile video coding(VVC)standard and its applications [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2021, 31(10): 3736-3764.

SCHWARZ H, MARPE D, WIEGAND T, et al. Hierarchical B pictures [EB/OL].(2005-07-23)[2023-05-12]. https://www.itu.int/wftp3/av-arch/jvt-site/JVT-P014.doc.

MCCANN K, ROSEWARNE C, BROSS B, et al. High efficiency video coding(HEVC)test model 16(HM16)improved encoder description [EB/OL].(2014-10-17)[2023-05-12]. http://phenix.int-evry.fr/jct/JCTVC-S1002.doc.

LI Bin, ZHANG Dong, LI Houqiang, et al. QP determination by Lambda value [EB/OL].(2012-05-07)[2023-05-12]. http://phenix.int-evry.fr/jct/JCTVC-I0426.doc.

YANG Yuan, WAN Shuai, GONG Yanchao, et al. Adaptive quantization parameter cascading for random-access prediction in H.265/HEVC based on dependent R-D models [C]//2016 IEEE International Conference on Image Processing(ICIP). Piscataway, NJ, USA: IEEE, 2016: 4235-4239.

GONG Yanchao, WAN Shuai, YANG Kaifang, et al. Rate-distortion-optimization-based quantization parameter cascading technique for random-access configuration in H.265/HEVC [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2017, 27(6): 1304-1312.

ZHAO Tiesong, WANG Zhou, CHEN Changwen. Adaptive quantization parameter cascading in HEVC hierarchical coding [J]. IEEE Transactions on Image Processing, 2016, 25(7): 2997-3009.

XU Yiwen, LI Qi, LI Xia, et al. Efficient QP cascading in H.265/HEVC low-delay prediction [C]//2017 IEEE International Conference on Multimedia Expo Workshops(ICMEW). Piscataway, NJ, USA: IEEE, 2017: 151-156.

HE Jing, YANG Enhui, YANG Fuzheng, et al. Adaptive quantization parameter selection for H.265/HEVC by employing inter-frame dependency [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2018, 28(12): 3424-3436.

AMER H, YANG Enhui. Adaptive quantization parameter selection for low-delay HEVC via temporal propagation length estimation [J]. Signal Processing: Image Communication, 2020, 84: 115826.

GONG Yanchao, YANG Kaifang, LIU Ying, et al. Quantization parameter cascading for surveillance video coding considering all inter reference frames [J]. IEEE Transactions on Image Processing, 2021, 30: 5692-5707.

BROWNE A, YE Yan, KIM S. Algorithm description for versatile video coding and test model 16(VTM16)[EB/OL].(2022-01-12)[2023-05-12]. https://jvet-experts.org/JVET-Y2002.docx.

ANDERSSON K, WENNERSTEN P, SAMUELSSON J, et al. AHG3 recommended settings for HM [EB/OL].(2016-06-01)[2023-05-12]. http://phenix.int-evry.fr/jct/JCTVC-X0038.doc.

公衍超, 吕显龙, 杨楷芳, 等. 考虑全帧间参考依赖性的监控视频高效视频编码码率控制算法 [J]. 西安交通大学学报, 2021, 55(3): 72-80.

GONG Yanchao, LÜ Xianlong, YANG Kaifang, et al. Rate control for high efficiency video coding coded surveillance videos considering all of the inter-frame reference dependency [J]. Journal of Xi'an Jiaotong University, 2021, 55(3): 72-80.

YANG Kaifang, GONG Yanchao, MA Miao, et al. An efficient rate-distortion optimization method for low-delay configuration in H.265/HEVC based on temporal layer rate and distortion dependence [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2019, 29(4): 1230-1236.

MAO Yunhao, WANG Meng, WANG Shiqi, et al. High efficiency rate control for versatile video coding based on composite Cauchy distribution [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2022, 32(4): 2371-2384.

LIU Hewei, ZHU Shuyuan, ZENG Bing. Inter-frame dependency-based rate control for VVC low-delay coding [J]. IEEE Signal Processing Letters, 2022, 29: 2727-2731.

GONG Yanchao, WAN Shuai, YANG Kaifang, et al. Temporal-layer-motivated lambda domain picture level rate control for random-access configuration in H.265/HEVC [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2019, 29(1): 156-170.

YANG Xiaokang, LIN Weisi, LU Zhongkang, et al. Motion-compensated residue preprocessing in video coding based on just-noticeable-distortion profile [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2005, 15(6): 742-752.

WANG Wei, ZHU Qingshan, WANG Zhaoba, et al. Research on indoor positioning algorithm based on SAGA-BP neural network [J]. IEEE Sensors Journal, 2022, 22(4): 3736-3744.

金成, 王久洪, 张成, 等. 结合传感器阵列和BP神经网络的挥发性有机物定量检测系统 [J]. 西安交通大学学报, 2021, 55(10): 106-113.

JIN Cheng, WANG Jiuhong, ZHANG Cheng, et al. A quantitative detection system of volatile organic compounds based on combining sensor array and BP neural network [J]. Journal of Xi'an Jiaotong University, 2021, 55(10): 106-113.

文必洋, 汤文成, 田应伟. 基于BP神经网络的高频雷达有效浪高场反演 [J]. 华中科技大学学报(自然科学版), 2021, 49(4): 114-119.

WEN Biyang, TANG Wencheng, TIAN Yingwei. Significant wave height field inversion of high frequency radar based on BP neural network [J]. Journal of Huazhong University of Science and Technology(Nature Science Edition), 2021, 49(4): 114-119.

LIU Jiguo, HUANG Jian, SUN Rui, et al. Data fusion for multi-source sensors using GA-PSO-BP neural network [J]. IEEE Transactions on Intelligent Transportation Systems, 2021, 22(10): 6583-6598.

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

采用轻量级卷积神经网络的H.266/通用视频编码跨分量预测

适用于不等保护的自适应视频编码方法

考虑全帧间参考依赖性的监控视频高效视频编码码率控制算法

中文文本屏幕内容图像通用视频编码标准编码感知失真研究

电动车辆间接热系统快速除湿响应迟滞机理及优化控制策略