Video image cancellation/removal (VFX).
A video processing system includes a computing platform having a hardware processor and a system memory storing an image cancellation software code. The hardware processor executes the image cancellation software code to receive a frame of video, detect an object image for cancellation from the received frame, and map the received frame from an original representation to a representation in which the object image does not intersect a frame boundary. The image cancellation software code also filters the mapped frame to remove features of the object image that appear to be in motion, inpaint the mapped and filtered frame to mask the object image, and reverse map the mapped and filtered frame having the object image masked to the original representation. The reverse mapped frame is composited with the received frame to produce an inpainted frame of video from which the object image has been cancelled.
BACKGROUND
Advances in Virtual Reality (VR) technologies have resulted in an increased demand for the generation of panoramic and three hundred and sixty degree (360-degree) video. The generation of detailed and accurate representations of a local environment, for example, can be of value in the production of immersive VR content used in games, simulators, and other VR applications.
Especially compelling video can be obtained when a video camera is attached to a robotic vehicle, such as an aerial drone, capable of providing environmental perspectives that are unavailable to a land based camera operator. In the case of 360-degree video, however, the aerial drone or other robotic vehicle will often be present in the field of view of the video camera, which undesirably reduces the immersion of a user viewing the 360-degree video.SUMMARY
There are provided systems and methods for performing image cancellation from video, substantially as shown in and/or described in connection with at least one of the figures, and as set forth more completely in the claims.
1. A video processing system comprising: a computing platform including a hardware processor and a system memory; an image cancellation software code stored in the system memory; the hardware processor configured to execute the image cancellation software code to: receive a frame of video; detect an object image for cancellation from the received frame; map the received frame from an original representation to a centered representation in which the object image does not intersect a boundary of the mapped frame; filter the mapped frame of video to remove features of the object image that appear to be in motion; inpaint the mapped and filtered frame of video to mask the object image; reverse map the mapped and filtered frame of video having the object image masked to the original representation; and composite the reverse mapped frame of video with the received frame to produce an inpainted frame of video from which the object image has been cancelled.
8. A method for use by a video processing system including a computing platform having a hardware processor and a system memory storing an image cancellation software code, the method comprising: receiving, using the hardware processor, a frame of video; detecting, using the hardware processor, an object image for cancellation from the received frame; mapping, using the hardware processor, the received frame from an original representation to a centered representation in which the object image does not intersect a boundary of the mapped frame; filtering, using the hardware processor, the mapped frame of video to remove features of the object image that appear to be in motion; inpainting, using the hardware processor, the mapped and filtered frame of video to mask the object image; reverse mapping, using the hardware processor, the mapped and filtered frame of video having the object image masked to the original representation; and compositing, using the hardware processor, the reverse mapped frame of video with the received frame to produce an inpainted frame of video from which the object image has been cancelled.
15. A computer-readable non-transitory medium having stored thereon instructions, which when executed by a hardware processor, instantiate a method comprising: receiving a frame of video; detecting an object image for cancellation from the received frame; mapping the received frame from an original representation to a centered representation in which the object image does not intersect a boundary of the mapped frame; filtering the mapped frame of video to remove features of the object image that appear to be in motion; inpainting the mapped and filtered frame of video to mask the object image; reverse mapping the mapped and filtered frame of video having the object image masked to the original representation; and compositing the reverse mapped frame of video with the received frame to is produce an inpainted frame of video from which the object image has been cancelled.