- Number
- 20260261686
- Published
- 2026-09-03
- Filed
- 2026-01-12
- Assignee
- Disney Enterprises, Inc.
- Inventors
- Emmenegger; Andre, Relic; Lucas, Azevedo; Roberto Gerson de Albuquerque, Zhang; Yang, Schroers; Christopher Richard
- CPC
- H04N19/159; H04N19/119; H04N19/172
- Verdict
- Set aside dropped in weekly review
- In edition
- 2026-W36
- Source
- Google Patents · FreePatentsOnline
The keeper's note
A system includes a video decoder, and a video encoder including a processor configured to execute video compression software code to partition video frames into video keyframes and video inter-frames, encode the video …
Abstract
A system includes a video decoder, and a video encoder including a processor configured to execute video compression software code to partition video frames into video keyframes and video inter-frames, encode the video keyframes to generate encoded video keyframes, process, using an optical flow model, the video inter-frames to produce forward flows from the video inter-frames to a first video keyframe and backward flows from the video inter-frames to a second video keyframe, generate, using the forward and backward flows, bidirectional flow maps corresponding respectively to the video inter-frames, encode the bidirectional flow maps to provide video decoding metadata, and generate a bitstream including the encoded video keyframes and the video decoding metadata. The video decoder receives the bitstream and produces reconstructed video frames corresponding to the video frames including the video keyframes and the video inter-frames using a generative video model.
Background
BACKGROUND
The substantial and growing fraction of internet bandwidth taken up by video data traffic necessitates ongoing advancements to video compression algorithms in order to reduce stress on global internet infrastructure. The objective of such compression algorithms is to optimize bandwidth usage and improve storage efficiency, while ensuring minimal distortion. However, when compressing video to low bit rates, such as bit rates of approximately 0.03 bits per pixel for example, present state-of-the-art methods often produce blurry reconstructions which can contain undesirable artifacts such as blocking, ringing, or banding. While conventional state-of-the-art reconstructions can achieve low quantitative error metrics, those reconstructions tend to be significantly lacking in subjective visual quality, thereby diminishing the viewing experience of the end user. This result is due to what is known as the rate-distortion-perception triple tradeoff, which holds that at low bit rates it is possible to achieve either low distortion or high perceptual quality, but not both. Consequently, there is a need in the art for a low bit rate video compression solution capable of providing reconstructed video having both low distortion and high perceptual quality.
Claims
1. A video encoder comprising: a hardware processor; and a memory storing a video compression software code and an optical flow model; the hardware processor configured to execute the video compression software code to: partition a plurality of video frames into a plurality of video keyframes and a plurality of video inter-frames; encode the plurality of video keyframes to generate a plurality of encoded video keyframes; process, using the optical flow model, the plurality of video inter-frames to produce a plurality of forward flows from the plurality of video inter-frames to a first video keyframe of the plurality of video keyframes and a plurality of backward flows from the plurality of video inter-frames to a second video keyframe of the plurality of video keyframes; generate, using the plurality of forward flows and the plurality of backward flows, a plurality of bidirectional flow maps corresponding respectively to the plurality of video inter-frames; encode the plurality of bidirectional flow maps to provide video decoding metadata for the plurality of video inter-frames; and generate a bitstream corresponding to the plurality of video frames, the bitstream including the plurality of encoded video keyframes and the video decoding metadata. ||
8. A video decoder comprising: a hardware processor; and a memory storing a video reconstruction software code and a generative video model; the hardware processor configured to execute the video reconstruction software code to: receive a bitstream corresponding to a plurality of video frames, the bitstream including a plurality of encoded video keyframes and a video decoding metadata including a plurality of encoded bidirectional flow maps corresponding respectively to a plurality of video inter-frames included among the plurality of video frames; decode the plurality of encoded video keyframes and the plurality of encoded bidirectional flow maps to provide a plurality of compressed video keyframes and a plurality of compressed bidirectional flow maps for the plurality of video inter-frames; warp, using the compressed plurality of bidirectional flow maps, the plurality of compressed video keyframes to provide a plurality of compressed video inter-frame predictions corresponding to the plurality of video inter-frames; and produce, using the generative video model, the plurality of compressed video keyframes and the plurality of compressed video inter-frame predictions, a plurality of reconstructed video frames corresponding to the plurality of video frames. ||
16. A method for use by a video processing system, the method comprising: partitioning, using a video encoder of the video processing system, a plurality of video frames into a plurality of video keyframes and a plurality of video inter-frames; encoding, by the video encoder, the plurality of video keyframes to generate a plurality of encoded video keyframes; processing, by the video encoder using an optical flow model, plurality of video inter-frames to produce a plurality of forward flows from the plurality of video inter-frames to a first video keyframe of the plurality of video keyframes and a plurality of backward flows from the plurality of video inter-frames to a second video keyframe of the plurality of video keyframes; generating, by the video encoder using the plurality of forward flows and the plurality of backward flows, a plurality of bidirectional flow maps corresponding respectively to the plurality of video inter-frames; encoding, by the video encoder, the plurality of bidirectional flow maps to provide video decoding metadata for the plurality of video inter-frames; and generating, by the video encoder, a bitstream including the plurality of encoded video keyframes and the video decoding metadata.