Immersive Cloud VR Gaming and Beyond

Prof. Cheng-Hsin Hsu (National Tsing Hua University, Department of Computer Science)
Cloud VR gaming shifts computationally intensive games to cloud servers, alleviating strain on Head-Mounted Displays. Yet, ensuring high-quality experiences faces challenges like human perception complexities and network variability. We introduce dynamic foveation techniques to enhance gamer Quality of Experience (QoE) by prioritizing resources to foveal regions, improving visual fidelity and bandwidth usage. We next present predictive models to adjust encoding settings for better gamer QoE. Our studies stream 2D video codecs from cloud servers to HMD clients, with the potential for emerging 3D representations. Along that direction, we share a novel error concealment pipeline for dynamic 3D point clouds, enhancing streaming quality under high packet loss rates. These advancements in cloud VR gaming open avenues for future research and development
#IoSRC #nthu #VRGaming #foveationtechniques