Camera systems for motion capture

Number: 10701253
Published: 2020-06-30
Filed: 2018-08-13
Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD.
Inventors: Knoll; John, Estebecorena; Leandro, Grabli; Stephane, Karefelt; Per, Helman; Pablo, Levin; John M.
CPC: G01S3/7864; G06T13/40; G06T7/246; G06T7/292; G06T7/73; G06V40/23; G11B27/031; G11B27/10; H04N23/11; H04N23/20; H04N23/54; H04N23/56; H04N23/90; H04N23/957; H04N5/2224; H04N5/272
Verdict: Low Hardware
Source: Google Patents · FreePatentsOnline

The keeper's note

Motion-capture camera system hardware.

Abstract

Embodiments of the disclosure provide systems and methods for motion capture to generate content (e.g., motion pictures, television programming, videos, etc.). An actor or other performing being can have multiple markers on his or her face that are essentially invisible to the human eye, but that can be clearly captured by camera systems of the present disclosure. Embodiments can capture the performance using two different camera systems, each of which can observe the same performance but capture different images of that performance. For instance, a first camera system can capture the performance within a first light wavelength spectrum (e.g., visible light spectrum), and a second camera system can simultaneously capture the performance in a second light wavelength spectrum different from the first spectrum (e.g., invisible light spectrum such as the IR light spectrum). The images captured by the first and second camera systems can be combined to generate content.

Background

BACKGROUND(1) Computer animation is the process of generating animated images of objects in a computer environment. In the film industry, computer animation is often used to animate the natural movement of humans for creating realistic characters in a film that have humanoid features and mannerisms. This type of animation is known in the film industry as motion-capture or performance capture. To capture the natural movements of a human, an actor is equipped with a number of markers, and a number of cameras track the positions of the markers in space as the actor moves. This technique allows the actor's movements and expressions to be captured, and the captured movements and expressions can then be manipulated in a digital environment to produce content, e.g., footage for a motion picture.(2) Such motion capture systems however have shortcomings. For instance, some such systems may include additional equipment and markers that interfere with the performance of the actor. Accordingly, improved systems and methods for motion capture are desired.SUMMARY(3) Embodiments provide systems and methods for motion capture to generate content (e.g., motion pictures, television programming, videos, etc.). In some embodiments, an actor or other performing being can have multiple markers on his or her face that are essentially invisible to the human eye, but that can be clearly captured by camera systems of the present disclosure. Embodiments of the disclosure can capture the performance usi

Claims

1. A system for motion capture, comprising: a first set of one or more cameras operable to capture first light at wavelengths in a first spectrum, the first set of one or more cameras positioned around a performance area to capture a first series of images of an actor during a performance by the actor in the performance area; a plurality of markers applied to a face of the actor, wherein the plurality of markers includes a first reflective element having a first diameter and a second reflective element having a second diameter different in length from the first diameter; one or more light sources configured to emit first light at wavelengths in the first spectrum to illuminate at least a portion of the actor during the performance with the first light; and a second set of one or more cameras operable to capture light at wavelengths in a second spectrum different from the first spectrum, the second set of one or more cameras positioned around the performance area to capture a second series of images comprising an appearance of the actor without the plurality of markers during the performance simultaneously with the first set of one or more cameras so that the first set and the second set of one or more cameras are configured to capture images of the performance at a same time, wherein the first set of one or more cameras are configured to capture movement of the plurality of markers applied to the face of the actor during the performance by capturing the first light reflected off of markers on a head of the actor from at least two perspectives, and wherein the plurality of markers are gel-based retroreflective markers that are configured to reflect the first light but not reflect second light. 9. A system for motion capture, comprising: a set of one or more witness cameras positioned on stands that holds the set of one or more witness cameras in an elevated positioned around a performance area to capture a first series of images of an actor during a performance by the actor in the performance area, the set of one or more witness cameras being operable to capture first light at wavelengths in a first spectrum; a plurality of markers applied to a face of the actor, wherein the plurality of markers includes a first reflective element having a first diameter and a second reflective element having a second diameter different in length from the first diameter; one or more light sources positioned around the performance area and configured to emit first light at wavelengths in the first spectrum to illuminate at least a portion of the actor during the performance with the first light; and a taking camera operable to capture light at wavelengths in a second spectrum different from the first spectrum, the taking camera positioned around the performance area to capture a second series of images comprising an appearance of the actor without the plurality of markers during the performance simultaneously with the first set of the one or more witness cameras so that the taking camera and the set of one or more witness cameras are configured to capture images of the performance at a same time, wherein the first set of the one or more witness cameras are configured to capture movement of the plurality of markers applied to the face of the actor during the performance by capturing the first light reflected off of markers on a head of the actor from at least two perspectives, and wherein the plurality of markers are gel-based retroreflective markers that are configured to reflect the first light but not reflect second light.