- Number
- 12343616
- Published
- 2025-07-01
- Filed
- 2020-03-27
- Assignee
- DISNEY ENTERPRISES, INC.
- Inventors
- Iwanowski; Przemyslaw et al.
- CPC
- A63G33/00; G06T7/292; A63F13/213; A63F13/428; G06N20/00; G06T7/80; G06V40/113; G06V40/103; G06T7/248; G06V10/143; G06T7/75; G06V10/764; A63G31/16; A63F13/803; G06V40/23; A63G31/00; G06V10/454
- Verdict
- Medium Hardware
- Source
- Google Patents · FreePatentsOnline
The keeper's note
Motion-tracking interactive ride/attraction entertainment system.
Abstract
The present disclosure describes a method for providing an interactive experience. The method includes illuminating, by an enhancer, an area with light having wavelength invisible to humans. A plurality of image detectors capture at least two images of a person in the area including a portion of the light reflected from the person. A processing element determines a first skeletal feature of the person based on the at least two images. The processing element determines a position characteristic of the first skeletal feature; constructs, from the first skeletal feature, a vector in three dimensions corresponding to the position characteristic; and outputs an interactive effect based on the position characteristic.
Background
BACKGROUND (1) Motion capture systems that detect and translate the pose of a person, including the position and motion of the person's figure to a computer for use in rendering virtual characters or other visual effects, are widely used in gaming, entertainment, filmmaking, and other applications. Traditional motion capture systems that detect a person's pose may use markers placed on the person, for instance at joints of limbs, on the skin above facial muscles, clothing, or other locations on, or associated with, a person. The markers are then detected in images by cameras and used to re-create the pose in a virtual space, for example generating an animation of the pose via a computer. The virtual pose of the person may enable the person to interact with a virtual environment, or may be used as the basis for the pose of a virtual character. (2) However, as these types of traditional systems require a person to wear markers on his or her body and that such markers are accurately positioned, such systems require intensive calibration and setup processes, which limits their application and use. As such, these types of systems may not allow seamless, immersive theatrical, gameplay, theme park ride, or other entertainment experiences. BRIEF SUMMARY (3) A method for providing an interactive experience is disclosed. The method includes illuminating, by an enhancer, an area with light having a wavelength invisible to humans. A plurality image detectors receive at least two images o
Claims
1. A method for providing an interactive experience comprising: illuminating, by an enhancer, an area with light having an infrared (IR) wavelength; capturing, by a first image detector, a first image in an IR spectrum of a person in the area including a portion of light emitted by the enhancer and reflected from the person; capturing, by a second image detector, a second image in the IR spectrum of the person in the area including the portion of light emitted by the enhancer and reflected from the person; detecting, by a processing element, a first image skeletal feature of the person in the first image in the area illuminated with light having the IR wavelength and detecting a second image skeletal feature of the person in the second image in the area illuminated with light having the IR wavelength; determining that the first image skeletal feature and the second image skeletal feature are the same and correspond to a first skeletal feature; combining, by the processing element, a position of the first image skeletal feature in the first image and a position of the second image skeletal feature in the second image to reconstruct a position characteristic of the person in the first image and the second image; determining, by the processing element, a motion characteristic of the first skeletal feature wherein the motion characteristic includes a predicted motion of the first skeletal feature, wherein the motion characteristic is based at least on a current motion of the first skeletal feature; and outputting, at a location of the first skeletal feature of the person and on a wearable article attached to the first skeletal feature of the person, in response to determining the motion characteristic of the first skeletal feature and in response to determining that the position characteristic and the predicted motion of the first skeletal feature reach a target gesture, an interactive effect based on the position characteristic and the predicted motion of the first skeletal feature, wherein the location is determined based on the predicted motion of the first skeletal feature. ||
21. A method for providing an interactive experience comprising: illuminating, by an enhancer, an area with light having an infrared (IR) wavelength; capturing, by a first image detector, a first image in an IR spectrum of a person in the area including a portion of light emitted by the enhancer and reflected from the person; capturing, by a second image detector, a second image in the IR spectrum of the person in the area including the portion of light emitted by the enhancer and reflected from the person; activating an artificial intelligence or machine learning algorithm trained with images comprising labeled physical poses and joints; determining, by a processing element using the artificial intelligence or machine learning algorithm, a first skeletal feature of the person in the area illuminated with light having the IR wavelength based on at least the first image and the second image, wherein determining the first skeletal feature comprises using the artificial intelligence or machine learning algorithm to detect pixels in at least the first image and the second image corresponding to the first skeletal feature of the person and to ignore dark pixels detected in the first image and the second image; determining, by the processing element using the artificial intelligence or machine learning algorithm, a position characteristic of the first skeletal feature; determining, by the processing element using the artificial intelligence or machine learning algorithm, a motion characteristic of the first skeletal feature, wherein the motion characteristic includes a predicted motion of the first skeletal feature, wherein the motion characteristic is based at least on a current motion of the first skeletal feature; and outputting, at a location of the first skeletal feature of the person and on a wearable article attached to the first skeletal feature of the person, in response to determining the motion characteristic of the first skeletal feature and in response to determining that the position characteristic and the predicted motion of the first skeletal feature reach a target gesture, an interactive effect based on the position characteristic and the predicted motion of the first skeletal feature, wherein the location is determined based on the predicted motion of the first skeletal feature. ||
24. A method for providing an interactive experience comprising: illuminating, by an enhancer, an area with light having an infrared (IR) wavelength; capturing, by a first image detector, a first image in an IR spectrum of a person in the area including a portion of light emitted by the enhancer and reflected from the person; capturing, by a second image detector, a second image in the IR spectrum of the person in the area including the portion of light emitted by the enhancer and reflected from the person; determining, by a processing element, a first skeletal feature of the person in the area illuminated with light having the IR wavelength based on at least the first image and the second image; determining, by the processing element, a position characteristic of the first skeletal feature; determining, by the processing element, a motion characteristic of the first skeletal feature, wherein the motion characteristic includes a predicted motion of the first skeletal feature, wherein the motion characteristic is based at least on a current motion of the first skeletal feature; and outputting, at a location of the first skeletal feature of the person and on a wearable article attached to the first skeletal feature of the person, in response to determining the motion characteristic of the first skeletal feature and in response to determining that the position characteristic and the predicted motion of the first skeletal feature reach a target gesture, an interactive effect based on the position characteristic and the predicted motion of the first skeletal feature, wherein the location is determined based on the predicted motion of the first skeletal feature. ||
27. A method for providing an interactive experience comprising: illuminating, by an enhancer, an area with light having an infrared (IR) wavelength; capturing, by a first image detector, a first image in an IR spectrum of a person in the area including a portion of light emitted by the enhancer and reflected from the person; capturing, by a second image detector, a second image in the IR spectrum of the person in the area including the portion of light emitted by the enhancer and reflected from the person; determining, by a processing element, a first skeletal feature of the person in the area illuminated with light having the IR wavelength based on at least the first image and the second image; determining, by the processing element, a position characteristic of the first skeletal feature; determining, by the processing element, a motion characteristic of the first skeletal feature, wherein the motion characteristic includes a predicted motion of the first skeletal feature, wherein the motion characteristic is based at least on a current motion of the first skeletal feature; and outputting, at a location of the first skeletal feature of the person and on a wearable article attached to the first skeletal feature of the person, in response to determining the motion characteristic of the first skeletal feature, an interactive effect based on the position characteristic and the predicted motion of the first skeletal feature, wherein the location is determined based on the predicted motion of the first skeletal feature.