Research on the Perceptual Distortion of Chinese Text Screen Content Image Using Versatile Video Coding

YANG Kaifang; CHAO Xuemin; MENG Qinqin; GONG Yanchao

doi:10.7652/xjtuxb202404002

您当前的位置：

首页 >

文章列表页 >

Research on the Perceptual Distortion of Chinese Text Screen Content Image Using Versatile Video Coding

更新时间：2025-07-09

- Research on the Perceptual Distortion of Chinese Text Screen Content Image Using Versatile Video Coding
- Vol. 58, Issue 4, Pages: 18-31(2024)
- 作者机构：
  
  1. 陕西师范大学计算机科学学院,西安,710119
  2. 现代教学技术教育部重点实验室,西安,710062
  3. 陕西省教学信息技术工程实验室,西安,710119
  4. 西安邮电大学通信与信息工程学院,西安,710121
- 作者简介：
- 基金信息：
- DOI：10.7652/xjtuxb202404002
  CLC： TN911.7
- Online First：10 April 2024，
  
  Published：2024
- 稿件说明：
移动端阅览
YANG Kaifang, CHAO Xuemin, MENG Qinqin, et al. Research on the Perceptual Distortion of Chinese Text Screen Content Image Using Versatile Video Coding[J]. 2024, 58(4): 18-31.
DOI：

YANG Kaifang, CHAO Xuemin, MENG Qinqin, et al. Research on the Perceptual Distortion of Chinese Text Screen Content Image Using Versatile Video Coding[J]. 2024, 58(4): 18-31. DOI： 10.7652/xjtuxb202404002.

摘要

为了探索最新一代通用视频编码标准(versatile video coding

VVC)对中文文本屏幕内容图像(text screen content image

TSCI)感知质量的影响

设计图像主观观测实验并基于VVC混合编码框架原理研究了中文TSCI的VVC编码感知失真。构建中文文本屏幕内容图像数据库(Chinese text screen content image dataset

CT-SCID)

设计图像主观观测实验

分析VVC引起的中文TSCI感知失真类型及其发展路径; 结合VVC的混合编码框架原理

理论分析并实验验证影响VVC编码的中文TSCI感知失真程度的因素; 总结当前代表性的屏幕内容图像质量评价方法在中文TSCI VVC编码感知失真评测上的性能表现。实验结果表明:字体大小和对比度是影响中文TSCI VVC编码感知质量的重要因素

且中文TSCI的字体越小、对比度越低时

图像的感知质量等级越低; 当前代表性的屏幕内容图像质量评价方法均无法给出完全符合人眼感知特性的质量评价结果。研究对于后续开发适用于中文TSCI的感知质量评价方法、高效编码方法等具有指导意义。

Abstract

To explore the influence of the state-of-the-art versatile video coding(VVC)on the perceptual quality of the Chinese text screen content image(TSCI)

image subjective observation experiments were designed to study the perceptual distortion of Chinese TSCI using VVC based on the hybrid coding framework principles of VVC. A Chinese text screen content image dataset(CT-SCID)was constructed and image subjective observation experiments were designed to analyze the types and development paths of Chinese TSCI perceptual distortion caused by VVC. By combining the hybrid coding framework principles of VVC

factors that affect the degree of perceptual distortion of Chinese TSCI using VVC were theoretically analyzed and experimentally verified. The performance of representative screen content image quality evaluation methods for evaluating the perceptual distortion of Chinese TSCI using VVC was summarized. Experimental results show that font size and contrast are crucial factors affecting the perceptual quality of Chinese TSCI using VVC. A smaller font size and lower contrast of Chinese TSCI shall lead to a lower perceptual quality of the image. The existing representative screen content image quality evaluation methods are unable to provide quality evaluation results that fully conform to human visual perception characteristics. The research has some guiding significance for the subsequent development of perceptual quality evaluation methods and efficient coding methods applicable to Chinese TSCI.

关键词

Keywords

references

TANG Tong, LI Ling, WU Xiaoyu, et al. TSA-SCC: text semantic-aware screen content coding with ultra low bitrate [J]. IEEE Transactions on Image Processing, 2022, 31: 2463-2477.

NI Zhangkai, MA Lin, ZENG Huanqiang, et al. ESIM: edge similarity for screen content image quality assessment [J]. IEEE Transactions on Image Processing, 2017, 26(10): 4818-4831.

YANG Huan, FANG Yuming, LIN Weisi. Perceptual quality assessment of screen content images [J]. IEEE Transactions on Image Processing, 2015, 24(11): 4408-4421.

GONG Yanchao, YANG Kaifang, LIU Ying, et al. Quantization parameter cascading for surveillance video coding considering all inter reference frames [J]. IEEE Transactions on Image Processing, 2021, 30: 5692-5707.

WANG Shiqi, GU Ke, ZHANG Xiang, et al. Subjective and objective quality assessment of compressed screen content images [J]. IEEE Journal on Emerging and Selected Topics in Circuits and Systems, 2016, 6(4): 532-543.

YANG Jiachen, BIAN Zilin, ZHAO Yang, et al. Full-reference quality assessment for screen content images based on the concept of global-guidance and local-adjustment [J]. IEEE Transactions on Broadcasting, 2021, 67(3): 696-709.

CHENG Shan, ZENG Huanqiang, CHEN Jing, et al. Screen content video quality assessment: subjective and objective study [J]. IEEE Transactions on Image Processing, 2020, 29: 8636-8651.

LI Teng, MIN Xiongkuo, ZHAO Heng, et al. Subjective and objective quality assessment of compressed screen content videos [J]. IEEE Transactions on Broadcasting, 2021, 67(2): 438-449.

FANG Yuming, YAN Jiebin, LIU Jiaying, et al. Objective quality assessment of screen content images by uncertainty weighting [J]. IEEE Transactions on Image Processing, 2017, 26(4): 2016-2027.

JIANG Xuhao, SHEN Liquan, FENG Guorui, et al. An optimized CNN-based quality assessment model for screen content image [J]. Signal Processing: Image Communication, 2021, 94: 116181.

JAKHETIYA V, GU Ke, LIN Weisi, et al. A prediction backed model for quality assessment of screen content and 3-D synthesized images [J]. IEEE Transactions on Industrial Informatics, 2018, 14(2): 652-660.

王存睿, 丁阳, 刘宇, 等. 融合笔画语义和注意力机制的汉字字体生成算法 [J]. 计算机辅助设计与图形学学报, 2022, 34(8): 1229-1237.

WANG Cunrui, DING Yang, LIU Yu, et al. Chinese font generation from stroke semantic and attention mechanism [J]. Journal of Computer-Aided Design Computer Graphics, 2022, 34(8): 1229-1237.

张积家. 汉字词认知过程中整体与部分关系论 [J]. 自然辩证法通讯, 2002, 24(3): 91-94.

ZHANG Jijia.On the relation of entirety and components in identifying process of Chinese characters and words [J]. Journal of Dialectics of Nature, 2002, 24(3): 91-94.

苏培成. 现代汉字学的学科建设 [J]. 语言文字应用, 2007(2): 2-11.

SU Peicheng.The discipline building of modern Chinese character study [J]. Applied Linguistics, 2007(2): 2-11.

李维, 任鹏, 赵凡, 等. 高效视频编码中帧内码率控制改进算法 [J]. 西安交通大学学报, 2019, 53(4): 79-84.

LI Wei, REN Peng, ZHAO Fan, et al. A modified method for intra-coding rate control in high efficiency video coding [J]. Journal of Xi'an Jiaotong University, 2019, 53(4): 79-84.

宋蓓蓓, 何帆, 马穗娜, 等. 一种高精度的自适应码率控制图像压缩算法 [J]. 西安交通大学学报, 2022, 56(2): 198-206.

SONG Beibei, HE Fan, MA Suina, et al. An image compression algorithm with high-precision adaptive rate control [J]. Journal of Xi'an Jiaotong University, 2022, 56(2): 198-206.

BROSS B, WANG Yekui, YE Yan, et al. Overview of the versatile video coding(VVC)standard and its applications [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2021, 31(10): 3736-3764.

SHI Sheng, ZHANG Xiang, WANG Shiqi, et al. Study on subjective quality assessment of Screen Content Images [C]//2015 Picture Coding Symposium(PCS).Piscataway, NJ, USA: IEEE, 2015: 75-79.

ITU. Methodology for the subjective assessment of video quality in multimedia applications: BT.1788 [S]. Geneva: ITU, 2007: 1-13.

ITU ISO/IEC.VTM reference software for VVC [EB/OL]. [2022-05-03]. https: //vcgit.hhi.fraunhofer.de/jvet/VVCSoftw are_VTM/-/tree/VTM-16.2.

BROSS B, CHEN Jianle, OHM J R, et al. Developments in international video coding standardization after AVC, with an overview of versatile video coding(VVC)[J]. Proceedings of the IEEE, 2021, 109(9): 1463-1493.

郭嘉骏, 姜求平, 邵枫. 分形理论引导的图像临界差异感知阈值估计 [J]. 中国图象图形学报, 2022, 27(11): 3303-3315.

GUO Jiajun, JIANG Qiuping, SHAO Feng. Fractal-guided JND threshold estimation for natural images [J]. Journal of Image and Graphics, 2022, 27(11): 3303-3315.

ITU. Methodology for the subjective assessment of the quality of television pictures: BT.500-13 [S]. Geneva: ITU, 2012: 1-46.

王信峰. 概率论与数理统计 [M]. 北京: 清华大学出版社, 2016.

魏传义, 陈勤, 张旻. 基于投影的文本图像版面分割算法研究 [J]. 现代计算机, 2016(10): 33-38.

WEI Chuanyi, CHEN Qin, ZHANG Min. Research on document image layout segmentation algorithm based on projection [J]. Modern Computer, 2016(10): 33-38.

NI Zhangkai, ZENG Huanqiang, MA Lin, et al. A Gabor feature-based quality assessment model for the screen content images [J]. IEEE Transactions on Image Processing, 2018, 27(9): 4516-4528.

LIU Anmin, LIN Weisi, NARWARIA M. Image quality assessment based on gradient similarity [J]. IEEE Transactions on Image Processing, 2012, 21(4): 1500-1512.

NI Zhangkai, MA Lin, ZENG Huanqiang, et al. Gradient direction for screen content image quality assessment [J]. IEEE Signal Processing Letters, 2016, 23(10): 1394-1398.

FU Ying, ZENG Huanqiang, MA Lin, et al. Screen content image quality assessment using multi-scale difference of Gaussian [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2018, 28(9): 2428-2432.

YANG Qi, MA Zhan, XU Yiling, et al. Modeling the screen content image quality via multiscale edge attention similarity [J]. IEEE Transactions on Broadcasting, 2020, 66(2): 310-321.

WANG Zhou, BOVIK A C, SHEIKH H R, et al. Image quality assessment: from error visibility to structural similarity [J]. IEEE Transactions on Image Processing, 2004, 13(4): 600-612.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Cross-Component Prediction for H.266/Versatile Video Coding Based on Lightweight Convolutional Neural Network

Content Adaptive Quantization Parameter Cascading for Surveillance Video Coding Using Versatile Video Coding

A Fast Calculation Method for Thermal Flow Fields in Transformer Windings Based on PI-DeepONet

Electrothermal Coupling Research on the Evolutionary Law of Anti-Corona Performance for High-Altitude Air-Cooled Generators

Integrated and Joint Design Optimization of Centrifugal Compressor Impeller and Casing Treatment at Multiple Working Points

Related Author

ZOU Chengyi

WAN Shuai

ZHU Zhiwei

YIN Yujie

GONG Yanchao

ZHANG Sensen

HE Shuting

LI Baogui

Related Institution

School of Electronic and Information, Northwestern Polytechnical University

School of Engineering, Royal Melbourne Institute of Technology

Electronic Information Experimental Research Center for Forensic Science of Shaanxi Province

International Joint Research Center for Wireless Communication and Information Processing Technology of Shaanxi Province

XsecPro Pte. Ltd.

⁰