Outer Rim Archives
Archives · 2026 · 12744873

Granted patent

Temporally stable occlusion free caption rendering position in Z-plane for stereoscopic video

Number
12744873
Published
2026-09-22
Filed
2024-07-06
Assignee
Disney Enterprises, Inc.
Inventors
Xue; Yuanyi, Labrozzi; Scott, Abecassis; Eitan M., Mathur; Chetan, Bracco; Michael J.
CPC
H04N13/128; G06T7/74; G06T2207/10021; G06T2207/20228; H04N2013/0081
Verdict
Set aside dropped in weekly review
In edition
2026-W39
Source
Google Patents · FreePatentsOnline

The keeper's note

a method determines a disparity value from a plurality of disparity values in a current frame of a stereoscopic video.

Abstract

In some embodiments, a method determines a disparity value from a plurality of disparity values in a current frame of a stereoscopic video. The disparity value is based on a difference of a value for a pixel between a first video and a second video of the stereoscopic video. A location is determined in a current frame that include the disparity value. The method analyzes first frames prior to the current frame to adjust disparity values in the first frames to generate one or more adjusted first disparity values. Also, the method analyzes second frames after the current frame to adjust disparity values in the second frames to generate one or more adjusted second disparity values. The one or more adjusted first disparity values and the one or more adjusted second disparity values are output for use in displaying captions in the first video or the second video.

Background

BACKGROUND (1) Stereoscopic video is a type of media presentation that utilizes a pair of videos to reconstruct the disparity that is the foundation of three dimensional (3D) visual perception of human eyes. Disparity or Z-plane position is defined as the horizontal displacement between a left video and a right video. In a convergent camera setup, a more negative value of disparity for an object implies an object is closer to the viewer. In a parallel camera setup, the disparity value will always be positive, and a larger disparity value in parallel camera setup indicates closer to the viewer. (2) Captions may be rendered in the stereoscopic video. The placement of captions in the Z-plane may cause problems for a viewer. If the captions are placed too far from the viewer in the Z-plane, the captions may be occluded by objects in front of the captions. Also, if the captions are placed too close to the viewer in the Z-plane, eye fatigue may result where the viewer has to focus on objects that are farther away in the Z-plane and the captions that are too close. Another problem is where the Z-plane position of captions changes drastically over successive frames (e.g., near then far), which causes eye fatigue where the viewer is hunting for the captions in different Z-plane positions.

Claims

1. A method comprising: determining a disparity value from a plurality of disparity values in a current frame of a stereoscopic video, wherein the disparity value is based on a difference of a value for a pixel between a first video and a second video of the stereoscopic video; determining a location in a current frame that includes the disparity value; analyzing one or more first frames prior to the current frame to adjust disparity values in the one or more first frames to generate one or more adjusted first disparity values, wherein analyzing one or more first frames prior to the current frame comprises: determining a first frame; determining whether a disparity value for the first frame is less than a disparity value for the current frame, wherein less than indicates closer to a viewer of the stereoscopic video; when the disparity value for the first frame is not less than the disparity value for the current frame, determining whether the disparity value for the first frame is greater than the disparity value for the current frame and a difference value, wherein greater than indicates farther away from the viewer of the stereoscopic video; adjusting the disparity value for the first frame to an adjusted first disparity value that is equal to or less than the disparity value and the difference value; determining another first frame that is previous to the first frame that was determined; and analyzing a disparity value of the another first frame and the adjusted first disparity value of the first frame to determine whether to adjust the disparity value of the another first frame to generate an adjusted first disparity value for the another first frame; analyzing one or more second frames after the current frame to adjust disparity values in the one or more second frames to generate one or more adjusted second disparity values; and outputting the one or more adjusted first disparity values and the one or more adjusted second disparity values for use in displaying captions in the first video or the second video. || 16. A non-transitory computer-readable storage medium having stored thereon computer executable instructions, which when executed by a computing device, cause the computing device to be operable for: determining a disparity value from a plurality of disparity values in a current frame of a stereoscopic video, wherein the disparity value is based on a difference of a value for a pixel between a first video and a second video of the stereoscopic video; determining a location in a current frame that includes the disparity value; analyzing one or more first frames prior to the current frame to adjust disparity values in the one or more first frames to generate one or more adjusted first disparity values, wherein analyzing one or more first frames prior to the current frame comprises: determining a first frame; determining whether a disparity value for the first frame is less than a disparity value for the current frame, wherein less than indicates closer to a viewer of the stereoscopic video; when the disparity value for the first frame is not less than the disparity value for the current frame, determining whether the disparity value for the first frame is greater than the disparity value for the current frame and a difference value, wherein greater than indicates farther away from the viewer of the stereoscopic video; adjusting the disparity value for the first frame to an adjusted first disparity value that is equal to or less than the disparity value and the difference value; determining another first frame that is previous to the first frame that was determined; and analyzing a disparity value of the another first frame and the adjusted first disparity value of the first frame to determine whether to adjust the disparity value of the another first frame to generate an adjusted first disparity value for the another first frame; analyzing one or more second frames after the current frame to adjust disparity values in the one or more second frames to generate one or more adjusted second disparity values; and outputting the one or more adjusted first disparity values and the one or more adjusted second disparity values for use in displaying captions in the first video or the second video. || 17. An apparatus comprising: one or more computer processors; and a computer-readable storage medium comprising instructions for controlling the one or more computer processors to be operable for: determining a disparity value from a plurality of disparity values in a current frame of a stereoscopic video, wherein the disparity value is based on a difference of a value for a pixel between a first video and a second video of the stereoscopic video; determining a location in a current frame that includes the disparity value; analyzing one or more first frames prior to the current frame to adjust disparity values in the one or more first frames to generate one or more adjusted first disparity values, wherein analyzing one or more first frames prior to the current frame comprises: determining a first frame; determining whether a disparity value for the first frame is less than a disparity value for the current frame, wherein less than indicates closer to a viewer of the stereoscopic video; when the disparity value for the first frame is not less than the disparity value for the current frame, determining whether the disparity value for the first frame is greater than the disparity value for the current frame and a difference value, wherein greater than indicates farther away from the viewer of the stereoscopic video; adjusting the disparity value for the first frame to an adjusted first disparity value that is equal to or less than the disparity value and the difference value; determining another first frame that is previous to the first frame that was determined; and analyzing a disparity value of the another first frame and the adjusted first disparity value of the first frame to determine whether to adjust the disparity value of the another first frame to generate an adjusted first disparity value for the another first frame; analyzing one or more second frames after the current frame to adjust disparity values in the one or more second frames to generate one or more adjusted second disparity values; and outputting the one or more adjusted first disparity values and the one or more adjusted second disparity values for use in displaying captions in the first video or the second video.