Method and device for hybrid robotic/virtual pan-tilt-zoom cameras for autonomous event recording

Number: 10165157
Published: 2018-12-25
Filed: 2013-09-30
Assignee: DISNEY ENTERPRISES, INC.
Inventors: Carr; G. Peter K.; Mistry; Michael Peter K.; Matthews; Iain; Sheikh; Yaser
CPC: H04N5/222; H04N23/90; H04N5/2224
Verdict: Low Hardware
Source: Google Patents · FreePatentsOnline

The keeper's note

Robotic PTZ camera hardware.

Abstract

A system and method generates a broadcast image. The method includes receiving a first image captured by a first camera having a first configuration incorporating a first center of projection. The method includes determining a first mapping from a first image plane of the first camera onto a sphere. The method includes determining a second mapping from the sphere to a second image plane of a second virtual camera having a second configuration incorporating the first center of projection of the first configuration. The method includes generating a second image based upon the first image and a concatenation of the first and second mappings.

Background

BACKGROUND INFORMATION(1) A live broadcast such as one shown on television includes at least one video camera that is directed toward a scene. Conventional systems provide for a camera operator to manually operate the camera. Accordingly, the field of view of the camera is determined by the camera operator based upon the discretion of the camera operator. However, there are ways of improving a selection of the field of view of the camera in an automated manner. A robotic camera may be used to record live events autonomously with the potential to streamline and improve current broadcasting models. For example, an optimal shooting location may be impractical for manual human operation. Hiring a professional camera operator increases costs and may not justify the benefit of an additional perspective. In these instances, conventional methods to improve or automate the control of the robotic camera is extremely beneficial. Automatically planning where the camera should look is a key challenge especially when the source information is noisy sensor data. In practice, the camera must be controlled to ensure that it actually looks at the intended target. Although path planning and camera control are separate tasks, the two are highly correlated. That is, it is futile to plan a motion path that the camera is physically unable to follow.(2) When automated systems are used to control the manner in which the camera operates, the camera should move smoothly and purposefully to avoid disori

Claims

1. A method, comprising: receiving a first image captured by a first camera having a first configuration including a first optical axis; determining a first mapping from a first image plane of the first camera onto a sphere, wherein the sphere is centered at the first camera; determining a second mapping from the sphere to a second image plane of a second virtual camera having a second configuration; and generating a second image based on a resampling of the first image, the second mapping from the sphere to the second image plane and applying a three-dimensional rotation to the first optical axis to generate a second optical axis that corresponds to the second image plane. 11. A device, comprising: a processor coupled to a memory, wherein the processor is programmed to generate a broadcast image by: receiving a first image captured by a first camera having a first configuration including a first optical axis; determining a first mapping from a first image plane of the first camera onto a sphere, wherein the sphere is centered at the first camera; determining a second mapping from the sphere to a second image plane of a second virtual camera having a second configuration; and generating a second image based on a resampling of the first image, the second mapping from the sphere to the second image plane and applying a three-dimensional rotation to the first optical axis to generate a second optical axis that corresponds to the second image plane. 20. A non-transitory computer readable storage medium including a set of instructions executable by a processor, the set of instructions operable to: receive a first image captured by a first camera having a first configuration including a first optical axis; determine a first mapping from a first image plane of the first camera onto a sphere, wherein the sphere is centered at the first camera; determine a second mapping from the sphere to a second image plane of a second virtual camera having a second configuration; and generate a second image based on a resampling of the first image, the second mapping from the sphere to the second image plane and applying a three-dimensional rotation to the first optical axis to generate a second optical axis that corresponds to the second image plane.