Lens distortion method for broadcast video

Number: 9667887
Published: 2017-05-30
Filed: 2010-11-19
Assignee: DISNEY ENTERPRISES, INC.
Inventors: Katz; Sheldon, House; Gregory
CPC: H04N23/81; H04N5/272; H04N5/2723; H04N25/61
Verdict: Low Notable software
Source: Google Patents · FreePatentsOnline

The keeper's note

Improves a generic camera lens distortion curve to better approximate real lens distortion for broadcast video correction.

Abstract

A method, apparatus, and computer program product are described to improve a lens distortion curve which roughly approximates distortion caused by a camera lens to capture an event onto video. The present invention selects a generic lens distortion curve that roughly approximates the distortion caused by the camera lens while capturing the event onto the video. The video as well as information from the generic lens distortion curve is used to generate a camera model. Thiscamera model is used to integrate virtual insertions into the video. If the camera model is sufficiently accurate to present a realistic appearance of the virtual insertions to the remote viewer, this camera model is then used to integrate more virtual insertions into the video. However, if the camera model is not sufficiently accurate, an iterative processis employed to refine this camera model.

Background

BRIEF DESCRIPTION OF THE FIGURES(1) The present invention is described with reference to the accompanying drawings. In the drawings, like reference numbers indicate identical or functionally similar elements. The drawing in which an element first appears is indicated by the left-most digit in the corresponding reference number.(2) FIG. 1 illustrates a block diagram of a virtual insertion system for broadcast video according to anexemplary embodiment of the present invention.(3) FIG. 2 illustrates a flowchart of exemplary operational steps of an iterative process to improve a generic lens distortion curve according to a first exemplary embodiment of the present invention.(4) FIG. 3 illustrates a flowchart of exemplary operational steps of an iterative process to improve a lens distortion curve near live as an event is happening in real-time, or after the event is complete, according to a first exemplary embodiment of the present invention.(5) FIG. 4 illustrates a second flowchart of exemplary operational steps of an iterative process to improve a generic lens distortion curve according to a second exemplary embodiment of the present invention.(6) FIG. 5 is a schematic diagram of an exemplary computer system according to an exemplary embodiment of the present invention.(7) The present embodiments will now be described with reference to the accompanying drawings. In the drawings, like reference numbersmay indicate identical or functionally similar elements.DETAILED DESCRIPTION

Claims

1. A method of modeling lens distortion for a camera lens used to capture video of an event, comprising: (a) selecting a lens distortion curve, the lens distortion curve including a plurality of camera lens distortionparameters, wherein calibration of the camera lens using calibration targets is not performed; (b) generating a camera model based upon the lens distortion curve; (c) integrating one or more first virtual insertions onto the video using the camera model; and (d) applying a correction factor including scale, offset and curve gain to the one or more camera lens distortion parameters to adjust the lens distortion curve, wherein the correction factor is determined based on a realistic appearance of the virtual insertion with respect to the video, wherein the realistic appearance is when the virtual insertion appears to be rationally integrated onto the video to a remote viewer. 15. A non-transitory electronic-readable medium having embodied thereon a program, the program being executable by a computer system to perform instructions for modeling lens distortion for a camera lens used to capture video of an event, the instructions comprising: instructions for selecting a lens distortion curve, the lens distortion curve including a plurality of camera lens distortion parameters; instructions for generating a camera model based upon the lens distortion curve;instructions for integrating one or more first virtual insertions onto the video using the camera model; and instructions for applying a correction factor including scale, offset and curve to the one or more camera lens distortion parameters to adjust the lens distortion curve, wherein the correction factor is determined based on a realistic appearance of the virtual insertion with respect to the video, wherein the realistic appearance is when the virtual insertion appears to be rationally integrated onto the video to a remote viewer.