三维投影变换辅助的云游戏编码优化算法

您当前的位置：

首页 >

文章列表页 >

三维投影变换辅助的云游戏编码优化算法

更新时间：2025-07-09

- 三维投影变换辅助的云游戏编码优化算法
- Issue 12, Pages: 20-29(2023)
- 作者机构：
  
  1. 西安电子科技大学通信工程学院
  2. 阿里巴巴集团
  3. 鹏城实验室人工智能研究中心
- 作者简介：
- 基金信息：
- DOI：
  CLC： TP317;TP391.41
- Published：2023
- 稿件说明：
移动端阅览
[J]. 2023, (12): 20-29.
DOI：

[J]. 2023, (12): 20-29. DOI：

摘要

针对传统视频压缩技术无法对云游戏视频中复杂的全局相机旋转以及剧烈变化的大范围运动进行很好的运动估计与补偿的问题，提出了一种三维投影变换辅助的编码优化算法，以提高云游戏视频的编码效率。分析了三维游戏场景下一点投影到二维平面的详细空间变换过程，在此基础上通过建立约束进行最优化估计构建了虚拟相机的内参估计算法。利用估计的内参，结合相机运动信息，基于图像单应性理论生成了与待编码帧平行的辅助参考帧，利用其更新参考帧列表参与编码。由于生成的辅助参考帧与待编码帧之间只有平移运动，所以更有利于传统的运动估计和补偿。实验结果表明：与原始的高效视频编码(HEVC)相比，所提算法在云游戏视频上可以实现平均8.14%的BD-rate增益，一定程度上缓解了云游戏对网络带宽的高需求；特别地，在仅有相机旋转的情况下，BD-rate可达-24.68%

同时编码时间平均缩短5.34%;与HEVC-SCC相比，所提算法的BD-rate性能增益超过20%。

Abstract

关键词

Keywords

references

公衍超,吕显龙,杨楷芳,刘颖,林庆帆,王富平.考虑全帧间参考依赖性的监控视频高效视频编码码率控制算法[J].西安交通大学学报,2021(03).

李维,任鹏,赵凡,陈亚军.高效视频编码中帧内码率控制改进算法[J].西安交通大学学报,2019(04).

李维,张和仙,杨付正.高效率视频编码快速模式判决算法[J].西安交通大学学报,2013(08).

Ren Guangjie,Liu Feiyang,Wang Huairui,Yang Daiqin,Wang Tao,Wang Sihan,Zhang Yunfei.Multi-objective optimization based perceptual bit allocation for gaming video coding in VVC[J].Signal Processing,2022.

Wang Yifan,Wang Hao,Wang Kaijie,Zhang Wei.Cloud Gaming Video Coding Optimization Based on Camera Motion-Guided Reference Frame Enhancement[J].Applied Sciences,2022.

Di Domenico Andrea,Perna Gianluca,Trevisan Martino,Vassio Luca,Giordano Danilo.A Network Analysis on Cloud Gaming: Stadia, GeForce Now and PSNow[J].Network,2021.

Gao Han,Esenlik Semih,Alshina Elena,Steinbach Eckehard.Geometric Partitioning Mode in Versatile Video Coding: Algorithm Review and Analysis[J].IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY,2021.

Wu Jiyan,Yuen Chau,Cheung Ngai Man,Chen Junliang,Chen Chang Wen.Streaming Mobile Cloud Gaming Video Over TCP With Adaptive Source–FEC Coding[J].IEEE Transactions on Circuits and Systems for Video Technology,2017.

Jizheng Xu,Rajan L. Joshi,Robert A. Cohen.Overview of the Emerging HEVC Screen Content Coding Extension.[J].IEEE Trans. Circuits Syst. Video Techn.,2016.

Wei Cai,Ryan Shea,Chun-Ying Huang,Kuan-Ta Chen,Jiangchuan Liu,Victor C. M. Leung,Cheng-Hsin Hsu.A Survey on Cloud Gaming: Future of Computer Games.[J].IEEE Access,2016.

Mehdi Semsarzadeh,Abdulsalam Yassine,Shervin Shirmohammadi.Video Encoding Acceleration in Cloud Gaming.[J].IEEE Trans. Circuits Syst. Video Techn.,2015.

Hamed Ahmadi,Saman Zad Tootaghaj,Mahmoud Reza Hashemi,Shervin Shirmohammadi.A game attention model for efficient bit rate allocation in cloud gaming[J].Multimedia systems,2014.

Andrey Norkin,Gisle Bjøntegaard,Arild Fuldseth,Matthias Narroschke,Masaru Ikeda,Kenneth Andersson,Minhua Zhou,Geert Van Der Auwera.HEVC Deblocking Filter.[J].IEEE Trans. Circuits Syst. Video Techn.,2012.

Sullivan, G. J.,Ohm, J.-R.,Han, W.-J.,Wiegand, T..Overview of the High Efficiency Video Coding (HEVC) Standard[J].IEEE Transactions on Circuits and Systems for Video Technology,2012.

Kim, H.-D.,Lee, J.-W.,Oh, T.-W.,Lee, H.-K..Robust DT-CWT Watermarking for DIBR 3D Images[J].IEEE Transactions on Broadcasting,2012.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Turbulent Kinetic Energy Dissipation Mechanism of Supercritical Carbon Dioxide Leakage Flow in a Scallop Bionic Seal Cavity

Review of the Application of EBSILON Software in Combined Heat and Power System Optimization

Influence of Structural Parameters on the Summer Operational Characteristics of a Three-Tower-in-One Indirect Air-Cooling System

Numerical Simulation of Heat-Moisture Barrier Performance of a Horizontal Air Curtain in Cold Storage

I/O Performance Modeling and Prediction Method for Large-Scale Parallel Applications Using Machine Learning

Related Author

No data

Related Institution

No data

⁰