RENDERING A VIRTUAL MARK ON A VIDEO FRAME

Number: 20170223431
Published: 2017-08-03
Filed: 2016-08-23
Assignee: Disney Enterprises, Inc.
Inventors: Rao; Cen et al.
CPC: H04N21/8146; G06T7/75; G06T19/006; G06T7/194; H04N21/2187; H04N21/23418
Verdict: Set aside rendering virtual mark on video frame - watermark/business
Source: Google Patents · FreePatentsOnline

Abstract

One embodiment provides a method for rendering a virtual mark on a video frame, including: receiving the video frame, captured by a camera, comprising a scene; obtaining a three-dimensional model of a mark in the scene; obtaining a foreground mask of the video frame; denoting a predetermined region corresponding to a mark mask, wherein the mark mask is an image projection of the mark on the video frame; updating the mark mask to exclude foreground regions, wherein the updating comprises: partitioning the predetermined region into a plurality of segments; and filtering out, from the mark mask, foreground pixelsbased on the plurality of segments and the foreground mask; and rendering, on the video frame, the virtual mark using the updated mark mask. Other aspects are described and claimed.

Background

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

FIG. 1 illustrates an example method of rendering a virtual mark on a video frame.

FIG. 2 illustrates an example scene captured from a video frame.

FIG. 3 illustrates an example foreground mask.

FIG. 4 illustrates an example of a mark mask.

FIG. 5 illustrates an example of a mark mask cut with foreground objects.

FIG. 6 illustrates an example of mark mask center segments and boundary segments.

FIG. 7 illustrates an example of a resulting video frame with a virtual mark.

FIG. 8 illustrates an example electronic device.DETAILED DESCRIPTION

It will be readily understood that the components of the embodiments, as generally described and illustrated in the figures herein, may be arranged and designed ina wide variety of different configurations in addition to the described example embodiments. Thus, the following more detailed description of the example embodiments, as represented in the figures, is not intended to limit the scope of the embodiments, as claimed, but is merely representative of example embodiments.

Reference throughout this specification to “one embodiment” or “an embodiment” (or the like) means that a particular feature,structure, or characteristic described in connection with the embodiment is included in at least one embodiment. Thus, appearances of the phrases “in one embodiment” or “in an embodiment” or the like in various places throughout this

Claims

1. A method for rendering a virtual mark on a video frame, comprising: receiving the video frame, captured by a camera, comprising a scene; obtaining a three-dimensional model of a mark in the scene; obtaining a foreground mask of the video frame; denotinga predetermined region corresponding to a mark mask, wherein the mark mask is an image projection of the mark on the video frame; updating the mark mask to exclude foreground regions, wherein the updating comprises: partitioning the predetermined region into a plurality of segments; and filtering out, from the mark mask, foreground pixels based on the plurality of segments and the foreground mask; and rendering, on the video frame, the virtual mark using the updated mark mask. 11. A system for rendering a virtual mark on a video frame, comprising: an electronic device that includes a processor; a memory device that storesinstructions executable by the processor to: receive the video frame, captured by a camera, comprising a scene; obtain a three-dimensional model of a mark in the scene; obtain a foreground mask of the video frame; denote a predetermined region corresponding to a mark mask, wherein the mark mask is an image projection of the mark on the video frame; update the mark mask to exclude foreground regions, wherein to update comprises: partitioning the predetermined region into a plurality of segments; and filtering out, from the mark mask, foreground pixels based on the plurality of segments and the foreground mask; and render, on the video frame, the virtual mark using the updated mark mask. 20. A program product, comprising: a computer readable storage device having code embodied therewith, the code being executable by a processor and comprising: code that receives the video frame, captured by a camera, comprising a scene; code that obtains a three-dimensional model of a mark in the scene; code that obtains a foreground mask of the video frame; code that denotes a predetermined region corresponding to a mark mask, wherein the mark mask is an image projection of the mark on the video frame; code that updates the mark mask to exclude foreground regions, wherein the code that updates comprises: code that partitions the predetermined region into a plurality of segments; and code that filters out, from the mark mask, foreground pixels based on the plurality of segments and the foreground mask; and code that renders, on the video frame, the virtual mark using the updated mark mask.