中文文本屏幕内容图像通用视频编码标准编码感知失真研究

杨楷芳; 晁学敏; 蒙琴琴; 公衍超

doi:10.7652/xjtuxb202404002

您当前的位置：

首页 >

文章列表页 >

中文文本屏幕内容图像通用视频编码标准编码感知失真研究

专题视频编码理论与应用 | 更新时间：2025-07-09

- 中文文本屏幕内容图像通用视频编码标准编码感知失真研究
- Research on the Perceptual Distortion of Chinese Text Screen Content Image Using Versatile Video Coding
- 西安交通大学学报 2024年58卷第4期页码：18-31
- 作者机构：
  
  1. 陕西师范大学计算机科学学院,西安,710119
  2. 现代教学技术教育部重点实验室,西安,710062
  3. 陕西省教学信息技术工程实验室,西安,710119
  4. 西安邮电大学通信与信息工程学院,西安,710121
- 作者简介：
  
  : 2023-05-29。作者简介: 杨楷芳(1987—),女,副教授,硕士生导师
  公衍超(通信作者),男,副教授,硕士生导师。基金项目: 国家自然科学基金资助项目(62277036)
- 基金信息：
  
  : 2023-05-29。作者简介: 杨楷芳(1987—),女,副教授,硕士生导师;公衍超(通信作者),男,副教授,硕士生导师。基金项目: 国家自然科学基金资助项目(62277036)
- DOI：10.7652/xjtuxb202404002
  中图分类号： TN911.7
- 网络首发：2024-04-10，
  
  纸质出版：2024
- 稿件说明：
移动端阅览
杨楷芳, 晁学敏, 蒙琴琴, 等. 中文文本屏幕内容图像通用视频编码标准编码感知失真研究[J]. 西安交通大学学报, 2024,58(4):18-31.

YANG Kaifang, CHAO Xuemin, MENG Qinqin, et al. Research on the Perceptual Distortion of Chinese Text Screen Content Image Using Versatile Video Coding[J]. 2024, 58(4): 18-31.
杨楷芳, 晁学敏, 蒙琴琴, 等. 中文文本屏幕内容图像通用视频编码标准编码感知失真研究[J]. 西安交通大学学报, 2024,58(4):18-31. DOI： 10.7652/xjtuxb202404002.

YANG Kaifang, CHAO Xuemin, MENG Qinqin, et al. Research on the Perceptual Distortion of Chinese Text Screen Content Image Using Versatile Video Coding[J]. 2024, 58(4): 18-31. DOI： 10.7652/xjtuxb202404002.

摘要

为了探索最新一代通用视频编码标准(versatile video coding

VVC)对中文文本屏幕内容图像(text screen content image

TSCI)感知质量的影响

设计图像主观观测实验并基于VVC混合编码框架原理研究了中文TSCI的VVC编码感知失真。构建中文文本屏幕内容图像数据库(Chinese text screen content image dataset

CT-SCID)

设计图像主观观测实验

分析VVC引起的中文TSCI感知失真类型及其发展路径; 结合VVC的混合编码框架原理

理论分析并实验验证影响VVC编码的中文TSCI感知失真程度的因素; 总结当前代表性的屏幕内容图像质量评价方法在中文TSCI VVC编码感知失真评测上的性能表现。实验结果表明:字体大小和对比度是影响中文TSCI VVC编码感知质量的重要因素

且中文TSCI的字体越小、对比度越低时

图像的感知质量等级越低; 当前代表性的屏幕内容图像质量评价方法均无法给出完全符合人眼感知特性的质量评价结果。研究对于后续开发适用于中文TSCI的感知质量评价方法、高效编码方法等具有指导意义。

Abstract

To explore the influence of the state-of-the-art versatile video coding(VVC)on the perceptual quality of the Chinese text screen content image(TSCI)

image subjective observation experiments were designed to study the perceptual distortion of Chinese TSCI using VVC based on the hybrid coding framework principles of VVC. A Chinese text screen content image dataset(CT-SCID)was constructed and image subjective observation experiments were designed to analyze the types and development paths of Chinese TSCI perceptual distortion caused by VVC. By combining the hybrid coding framework principles of VVC

factors that affect the degree of perceptual distortion of Chinese TSCI using VVC were theoretically analyzed and experimentally verified. The performance of representative screen content image quality evaluation methods for evaluating the perceptual distortion of Chinese TSCI using VVC was summarized. Experimental results show that font size and contrast are crucial factors affecting the perceptual quality of Chinese TSCI using VVC. A smaller font size and lower contrast of Chinese TSCI shall lead to a lower perceptual quality of the image. The existing representative screen content image quality evaluation methods are unable to provide quality evaluation results that fully conform to human visual perception characteristics. The research has some guiding significance for the subsequent development of perceptual quality evaluation methods and efficient coding methods applicable to Chinese TSCI.

关键词

Keywords

references

TANG Tong, LI Ling, WU Xiaoyu, et al. TSA-SCC: text semantic-aware screen content coding with ultra low bitrate [J]. IEEE Transactions on Image Processing, 2022, 31: 2463-2477.

NI Zhangkai, MA Lin, ZENG Huanqiang, et al. ESIM: edge similarity for screen content image quality assessment [J]. IEEE Transactions on Image Processing, 2017, 26(10): 4818-4831.

YANG Huan, FANG Yuming, LIN Weisi. Perceptual quality assessment of screen content images [J]. IEEE Transactions on Image Processing, 2015, 24(11): 4408-4421.

GONG Yanchao, YANG Kaifang, LIU Ying, et al. Quantization parameter cascading for surveillance video coding considering all inter reference frames [J]. IEEE Transactions on Image Processing, 2021, 30: 5692-5707.

WANG Shiqi, GU Ke, ZHANG Xiang, et al. Subjective and objective quality assessment of compressed screen content images [J]. IEEE Journal on Emerging and Selected Topics in Circuits and Systems, 2016, 6(4): 532-543.

YANG Jiachen, BIAN Zilin, ZHAO Yang, et al. Full-reference quality assessment for screen content images based on the concept of global-guidance and local-adjustment [J]. IEEE Transactions on Broadcasting, 2021, 67(3): 696-709.

CHENG Shan, ZENG Huanqiang, CHEN Jing, et al. Screen content video quality assessment: subjective and objective study [J]. IEEE Transactions on Image Processing, 2020, 29: 8636-8651.

LI Teng, MIN Xiongkuo, ZHAO Heng, et al. Subjective and objective quality assessment of compressed screen content videos [J]. IEEE Transactions on Broadcasting, 2021, 67(2): 438-449.

FANG Yuming, YAN Jiebin, LIU Jiaying, et al. Objective quality assessment of screen content images by uncertainty weighting [J]. IEEE Transactions on Image Processing, 2017, 26(4): 2016-2027.

JIANG Xuhao, SHEN Liquan, FENG Guorui, et al. An optimized CNN-based quality assessment model for screen content image [J]. Signal Processing: Image Communication, 2021, 94: 116181.

JAKHETIYA V, GU Ke, LIN Weisi, et al. A prediction backed model for quality assessment of screen content and 3-D synthesized images [J]. IEEE Transactions on Industrial Informatics, 2018, 14(2): 652-660.

王存睿, 丁阳, 刘宇, 等. 融合笔画语义和注意力机制的汉字字体生成算法 [J]. 计算机辅助设计与图形学学报, 2022, 34(8): 1229-1237.

WANG Cunrui, DING Yang, LIU Yu, et al. Chinese font generation from stroke semantic and attention mechanism [J]. Journal of Computer-Aided Design Computer Graphics, 2022, 34(8): 1229-1237.

张积家. 汉字词认知过程中整体与部分关系论 [J]. 自然辩证法通讯, 2002, 24(3): 91-94.

ZHANG Jijia.On the relation of entirety and components in identifying process of Chinese characters and words [J]. Journal of Dialectics of Nature, 2002, 24(3): 91-94.

苏培成. 现代汉字学的学科建设 [J]. 语言文字应用, 2007(2): 2-11.

SU Peicheng.The discipline building of modern Chinese character study [J]. Applied Linguistics, 2007(2): 2-11.

李维, 任鹏, 赵凡, 等. 高效视频编码中帧内码率控制改进算法 [J]. 西安交通大学学报, 2019, 53(4): 79-84.

LI Wei, REN Peng, ZHAO Fan, et al. A modified method for intra-coding rate control in high efficiency video coding [J]. Journal of Xi'an Jiaotong University, 2019, 53(4): 79-84.

宋蓓蓓, 何帆, 马穗娜, 等. 一种高精度的自适应码率控制图像压缩算法 [J]. 西安交通大学学报, 2022, 56(2): 198-206.

SONG Beibei, HE Fan, MA Suina, et al. An image compression algorithm with high-precision adaptive rate control [J]. Journal of Xi'an Jiaotong University, 2022, 56(2): 198-206.

BROSS B, WANG Yekui, YE Yan, et al. Overview of the versatile video coding(VVC)standard and its applications [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2021, 31(10): 3736-3764.

SHI Sheng, ZHANG Xiang, WANG Shiqi, et al. Study on subjective quality assessment of Screen Content Images [C]//2015 Picture Coding Symposium(PCS).Piscataway, NJ, USA: IEEE, 2015: 75-79.

ITU. Methodology for the subjective assessment of video quality in multimedia applications: BT.1788 [S]. Geneva: ITU, 2007: 1-13.

ITU ISO/IEC.VTM reference software for VVC [EB/OL]. [2022-05-03]. https: //vcgit.hhi.fraunhofer.de/jvet/VVCSoftw are_VTM/-/tree/VTM-16.2.

BROSS B, CHEN Jianle, OHM J R, et al. Developments in international video coding standardization after AVC, with an overview of versatile video coding(VVC)[J]. Proceedings of the IEEE, 2021, 109(9): 1463-1493.

郭嘉骏, 姜求平, 邵枫. 分形理论引导的图像临界差异感知阈值估计 [J]. 中国图象图形学报, 2022, 27(11): 3303-3315.

GUO Jiajun, JIANG Qiuping, SHAO Feng. Fractal-guided JND threshold estimation for natural images [J]. Journal of Image and Graphics, 2022, 27(11): 3303-3315.

ITU. Methodology for the subjective assessment of the quality of television pictures: BT.500-13 [S]. Geneva: ITU, 2012: 1-46.

王信峰. 概率论与数理统计 [M]. 北京: 清华大学出版社, 2016.

魏传义, 陈勤, 张旻. 基于投影的文本图像版面分割算法研究 [J]. 现代计算机, 2016(10): 33-38.

WEI Chuanyi, CHEN Qin, ZHANG Min. Research on document image layout segmentation algorithm based on projection [J]. Modern Computer, 2016(10): 33-38.

NI Zhangkai, ZENG Huanqiang, MA Lin, et al. A Gabor feature-based quality assessment model for the screen content images [J]. IEEE Transactions on Image Processing, 2018, 27(9): 4516-4528.

LIU Anmin, LIN Weisi, NARWARIA M. Image quality assessment based on gradient similarity [J]. IEEE Transactions on Image Processing, 2012, 21(4): 1500-1512.

NI Zhangkai, MA Lin, ZENG Huanqiang, et al. Gradient direction for screen content image quality assessment [J]. IEEE Signal Processing Letters, 2016, 23(10): 1394-1398.

FU Ying, ZENG Huanqiang, MA Lin, et al. Screen content image quality assessment using multi-scale difference of Gaussian [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2018, 28(9): 2428-2432.

YANG Qi, MA Zhan, XU Yiling, et al. Modeling the screen content image quality via multiscale edge attention similarity [J]. IEEE Transactions on Broadcasting, 2020, 66(2): 310-321.

WANG Zhou, BOVIK A C, SHEIKH H R, et al. Image quality assessment: from error visibility to structural similarity [J]. IEEE Transactions on Image Processing, 2004, 13(4): 600-612.

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

采用轻量级卷积神经网络的H.266/通用视频编码跨分量预测

面向监控视频内容自适应的通用视频编码量化参数级联

语义区分和子图整合驱动的知识图谱表示学习方法

三塔合一间接空冷系统结构参数对夏季运行特性的影响研究

电子级超纯氮深冷空分流程节能优化研究