- Number
- 11854224
- Published
- 2023-12-26
- Filed
- 2021-07-23
- Assignee
- Disney Enterprises, Inc.
- Inventors
- Papon; Jeremie A. et al.
- CPC
- G06T7/97; G06T7/75; G06T7/73
- Verdict
- Medium Notable software
- Source
- Google Patents · FreePatentsOnline
The keeper's note
3D skeleton-mapping technique (animation/robotics-adjacent, granted).
Abstract
A system includes processing hardware and a memory storing software code. When executed, the software code receives first skeleton data including a first location of each of multiple skeletal key-points from the perspective of a first camera, receives second skeleton data including a second location of each of the skeletal key-points from the perspective of a second camera, correlates first and second locations of some or all of the multiple skeletal key-points to produce correlated skeletal key-point location data for each of at least some skeletal key-points. The software code further merges the correlated skeletal key-point location data for each of those at least some skeletal key-points to provide merged location data, and generates, using the merged location data and the locations of the first, second, and third cameras, a mapping of the 3D pose of a skeleton.
Background
BACKGROUND (1) Pose and gesture detection systems tend to perform poorly when multiple bodies are in close proximity with one another, or are in physical contact. For example, entertainment venues at which the bodies of spectators occlude one another, and environments where adults may be carrying children pose substantial challenges to conventional pose and gesture detection techniques. Nevertheless, there are many use cases in which accurately distinguishing amongst individual bodies in a crowded environment may have significant health, safety, and logistical applications. Consequently, there is a need in the art for a mapping solution capable of reliably distinguishing the location, pose, posture, and gestures of one body from another.
Claims
1. A three-dimensional (3D) skeleton mapping system comprising: a computing platform having processing hardware and a system memory storing a software code; the processing hardware configured to execute the software code to: receive first skeleton data of a skeleton, the first skeleton data including a first location of each of a plurality of skeletal key-points from a perspective of a first camera; receive second skeleton data of the skeleton, the second skeleton data including a second location of each of the plurality of skeletal key-points from a perspective of a second camera; correlate, for the plurality of skeletal key-points, the first location of each of the plurality of skeletal key-points from the perspective of the first camera with the second location of each of the plurality of skeletal key-points from the perspective of the second camera to produce a correlated skeletal key-point location data for each of the plurality of skeletal key-points; merge the correlated skeletal key-point location data for each of the plurality of skeletal key-points to provide a merged location data; and generate, using the merged location data and a respective location of each of the first camera and the second camera, a mapping of a 3D pose of the skeleton. ||
7. A method for use by a 3D skeleton mapping system including a computing platform having a processing hardware and a system memory storing a software code, the method comprising: receiving, by the software code executed by the processing hardware, first skeleton data of a skeleton, the first skeleton data including a first location of each of a plurality of skeletal key-points from a perspective of a first camera; receiving, by the software code executed by the processing hardware, second skeleton data of the skeleton, the second skeleton data including a second location of each of the plurality of skeletal key-points from a perspective of a second camera; correlating, by the software code executed by the processing hardware, the plurality of skeletal key-points, the first location of each of the plurality of skeletal key-points from the perspective of the first camera with the second location of each of the plurality of skeletal key-points from the perspective of the second camera to produce a correlated skeletal key-point location data for each of the plurality of skeletal key-points; merging, by the software code executed by the processing hardware, the correlated skeletal key-point location data for each of the plurality of skeletal key-points to provide a merged location data; and generating, by the software code executed by the processing hardware and using the merged location data and a respective location of each of the first camera and the second camera, a mapping of a 3D pose of the skeleton. ||
12. A three-dimensional (3D) skeleton mapping system comprising: a computing platform having processing hardware and a system memory storing a software code; the processing hardware configured to execute the software code to: receive first skeleton data of a skeleton, the first skeleton data including a first location of each of a plurality of skeletal key-points from a perspective of a first camera; receive second skeleton data of the skeleton, the second skeleton data including a second location of each of the plurality of skeletal key-points from a perspective of a second camera; receive third skeleton data of the skeleton, the third skeleton data including a third location of each of the plurality of skeletal key-points from a perspective of a third camera; correlate, for at least some skeletal key-points of the plurality of skeletal key-points, the first location of each of the at least some skeletal key-points from the perspective of the first camera with the second location of each of the at least some skeletal key-points from the perspective of the second camera and the third location of each of the at least some skeletal key-points from the perspective of the third camera to produce a correlated skeletal key-point location data for each of the at least some skeletal key-points; merge the correlated skeletal key-point location data for each of the at least some skeletal key-points to provide a merged location data; and generate, using the merged location data and a respective location of each of the first camera, the second camera, and the third camera, a mapping of a 3D pose of the skeleton. ||
19. A three-dimensional (3D) skeleton mapping system comprising: a computing platform having processing hardware and a system memory storing a software code; the processing hardware configured to execute the software code to: receive first skeleton data of a skeleton, the first skeleton data including a first location of each of a plurality of skeletal key-points from a perspective of a first camera; receive second skeleton data of the skeleton, the second skeleton data including a second location of each of the plurality of skeletal key-points from a perspective of a second camera; correlate, for at least some skeletal key-points of the plurality of skeletal key-points, the first location of each of the at least some skeletal key-points from the perspective of the first camera with the second location of each of the at least some skeletal key-points from the perspective of the second camera to produce a correlated skeletal key-point location data for each of the at least some skeletal key-points; merge the correlated skeletal key-point location data for each of the at least some skeletal key-points to provide a merged location data; and generate, using the merged location data and a respective location of each of the first camera and the second camera, a mapping of a 3D pose of the skeleton without determining any personally identifiable information (PII) of a person comprising the skeleton.