Although cloud gaming is seen as the future direction of the industry, issues such as latency, bandwidth consumption, and device compatibility have always hindered its widespread adoption. Sony appears to be exploring a breakthrough solution—dynamically adjusting streaming quality based on players' real-time attention, significantly reducing network and hardware burdens while ensuring a smooth experience.
According to patent documents published by the World Intellectual Property Organization (WIPO) (patent titled "STREAMING SYSTEM AND METHOD"), Sony has designed a dynamic adaptive cloud gaming streaming architecture. This system uses an attention estimation processor combined with AI-driven autoencoders/decoders to track user engagement in real time and adjust encoding/decoding quality on both the server and client sides accordingly.
The patent document states: "The attention estimation processor is configured to estimate the user's level of attention to streaming content; the decoder then decodes the content at a corresponding quality based on this estimated level of attention."
Specifically, the system will dynamically switch streaming parameters based on the user's different behavioral states: when the player is actively playing, the system outputs at the highest resolution and frame rate; during cutscenes or story segments, image quality remains high but the frame rate can drop to 30 FPS; if the user is briefly distracted, blinks, or takes a short break, the system skips some decoding stages, outputting medium quality and a lower frame rate; and once it detects that the user has completely left or is not participating at all, resolution and frame rate drop to the minimum, significantly saving bandwidth. Additionally, if the user's gaze focuses on a specific area of the screen, the system can reduce the quality of peripheral areas, further compressing data transmission volume.
Sony stated that the core goal of this technology is to lower the minimum performance requirements for cloud gaming while addressing latency issues—current cloud gaming performance on low-spec devices and battery-powered devices remains unsatisfactory. By allocating image quality resources on demand, the system can achieve smooth operation even in weaker network environments or under limited hardware conditions, thereby expanding cloud gaming compatibility with more devices.