- Number
- 10403019
- Published
- 2019-09-03
- Filed
- 2016-02-11
- Assignee
- LUCASFILM ENTERTAINMENT COMPANY
- Inventors
- Levin; John
- CPC
- G06F3/017; G06T13/80; G06T7/246; G06T7/248; G06T7/285; G06T7/73; G06T7/90; G06V10/56; G06V40/103; G06V40/23; H04N23/90; H04N5/222
- Verdict
- High Hardware
- Source
- Google Patents · FreePatentsOnline
The keeper's note
Multi-channel tracking pattern (Lucasfilm mocap markers).
Abstract
A multi-channel tracking pattern is provided along with techniques and systems for performing motion capture using the multi-channel tracking pattern. The multi-channel tracking pattern includes a plurality of shapes having different colors on different portions of the pattern. The portions with the unique shapes and colors allow a motion capture system to track motion of an object bearing the pattern across a plurality of video frames.
Background
FIELD(1) The present disclosure generally relates to motion capture. For example, a multi-channel tracking pattern is provided, along with systems and techniques for performing motion capture using the multi-channel tracking pattern.BACKGROUND(2) Motion capture is an approach for generating motion data that is based on tracking and recording the movement of real objects. One common application of motion capture is in animation, where a realistic sequence of motion (e.g., by a human actor or other object) can be captured and used to represent the motion of an animated object.SUMMARY(3) In some examples provided herein, a multi-channel tracking pattern is provided that allows motion tracking to be performed. The multi-channel tracking pattern includes a plurality of shapes having different colors on different portions of the pattern. The portions with the unique shapes and colors allow a motion capture system (or tracking system) to track motion of an object bearing the pattern across a plurality of video frames. The pattern can take the form of makeup, a support structure (e.g., a bodysuit and/or a set of bands), or other articles worn by the object.(4) The multi-channel tracking pattern allows a motion capture system to efficiently and effectively perform object tracking. In some embodiments, the pattern is track-able over multiple different channels (e.g., over multiple color channels and/or multiple shape channels). For example, a respective color channel can be isolated fo
Claims
1. A computer-implemented method of motion capture, the method comprising: tracking motion of an object bearing a multichannel pattern across a plurality of video images based on the multichannel pattern, wherein different portions of the pattern have different configurations of shapes and colors, the different configurations of shapes and colors on the different portions of the multichannel pattern being used to simultaneously track motion of different parts of the object, wherein the multichannel pattern includes a first portion and a second portion, the first portion including a first shape and a first color and the second portion including a second shape and a second color, wherein the multichannel pattern is configured such that the first portion of the pattern is tracked based on the first shape and the first color and the second portion of the multichannel pattern is tracked based on the second shape and the second color; isolate a color channel associated with the first color or the second color by isolating pixels in the plurality of video images with high levels of the first color or the second color from pixels in the plurality of images; calculate a ray trace extending from a camera through a first mark and a second mark of the multichannel pattern in the video images, wherein a distance between the first mark and the second mark is known; triangulate a three-dimensional position of a point representing a position between the first mark and the second mark relative to a position of the camera; track motion of the object using the isolated color channel, shape identification, and ray-trace triangulation; and causing data representing the motion of the object to be stored to a computer readable medium.
7. A system for performing motion capture, comprising: a memory storing a plurality of instructions; and one or more processors configurable to: track motion of an object bearing a multichannel pattern across a plurality of video images based on the multichannel pattern, wherein different portions of the multichannel pattern have different configurations of shapes and colors, the different configurations of shapes and colors on the different portions of the multichannel pattern being used to simultaneously track motion of different parts of the object, wherein the multichannel pattern includes a first portion and a second portion, the first portion including a first shape and a first color and the second portion including a second shape and a second color, wherein the multichannel pattern is configured such that the first portion of the pattern is tracked based on the first shape and the first color and the second portion of the pattern is tracked based on the second shape and the second color; isolate a color channel associated with the first color or the second color by isolating pixels in the plurality of video images with high levels of the first color or the second color from the pixels in the plurality of images; calculate a ray trace extending from a camera through a first mark and a second mark of the pattern in the video images, wherein a distance between the first make and the second mark is known; triangulate a three-dimensional position of a point representing a position of the first mark and second mark relative to a position of the camera; track motion of the object using the isolated color channel, shape identification, and ray-trace triangulation; and cause data representing the motion of the object to be stored to a computer readable medium.
13. A non-transitory computer-readable memory storing a plurality of instructions executable by one or more processors, the plurality of instructions comprising: instructions that cause the one or more processors to track motion of an object bearing a pattern across a plurality of video images based on the pattern, wherein different portions of the pattern have different configurations of shapes and colors, the different configurations of shapes and colors on the different portions of the pattern being used to simultaneously track motion of different parts of the object, wherein the pattern includes a first portion and a second portion, the first portion including a first shape and a first color and the second portion including a second shape and a second color, wherein the pattern is configured such that the first portion of the pattern is tracked based on the first shape and the first color and the second portion of the pattern is tracked based on the second shape and the second color; and instructions that cause the one or more processors to isolate a color channel associated with the first color or the second color by isolating pixels in the plurality of video images with high levels of the first color or the second color from the pixels in the plurality of images; instructions that case the one or more processors to calculate a ray trace extending from a camera through a first mark and a second mark of the pattern in the video images, wherein a distance between the first make and the second mark is known; instructions that case the one or more processors to triangulate a three-dimensional position of a point representing a position of the first mark and second mark relative to a position of the camera; instructions that cause the one or more processors to track motion of the object using the isolated color channel, shape identification, and ray-trace triangulation; and instructions that cause the one or more processors to cause data representing the motion of the object to be stored to a computer readable medium.