HYBRID APPROACH TO PERFORM DYNAMIC PROJECTION MAPPING ONTO ROBOTIC FIGURES IN REAL-TIME

Number: 20260225257
Published: 2026-08-06
Filed: 2026-01-14
Assignee: DISNEY ENTERPRISES, INC.
Inventors: Jiarathanakul; Prutsdom, Ayala; Alfredo Medina, Peavy; Joel Jason, Goldberg; David Powell, Tye; Bryan S.
CPC: B25J11/0015; H04N9/3194; B25J11/003; G06T7/246; B25J9/1085; B25J9/142; G06T2207/10028; G06T2207/10048; G06T2207/30204; H04N9/3182; H04N9/3185
Verdict: High Hardware
First reported: 2026-W32 (2026-08-07)
Source: Google Patents · FreePatentsOnline

The keeper's note

Systems, methods and apparatuses for a hybrid approach to perform dynamic projection mapping onto robots in real-time are discussed herein.

Abstract

Systems, methods and apparatuses for a hybrid approach to perform dynamic projection mapping onto robots in real-time are discussed herein. For example, a robotic system includes a projection surface coupled to a robotic structure and configured to be moved by the robotic structure. The robotic system includes a tracking mechanism comprising at least one of a first tracking mechanism positioned internal to the robotic structure and configured to generate intrinsic tracking data or a second tracking mechanism positioned external to the robotic structure and configured to generate extrinsic tracking data. The robotic system includes a controller in communication with the tracking mechanism. The robotic system includes a projector having a field of view aligned with the projection surface and configured to project content onto the projection surface, wherein the controller modifies the projected content based on data generated by the tracking mechanism.

Background

FIELD

The present disclosure relates generally to systems and methods for controlling and implementing robotic devices, such as animatronics. BACKGROUND

Amusement parks, theme parks, carnivals, arcades, and various attractions use robotic devices, such as animatronics, to produce an interactive effect for guests. For example, animatronics mimic the movement, look, and emotion of characters sharing the theme of the rides, shows, and games, and can interact with guests to provide a truly immersive experience. Additionally, other types of robotic devices appear in everyday life such as in food service environments, manufacturing environments, and social interaction environments, interacting with users and the environment.

Traditional animatronics use mechanical actuators to animate or move different portions of the robotic device, e.g., an animation including movement of an arm includes mechanically moving an appendage of the animatronic. However, such mechanical motions are limited by mechanical constraints, space constraints, and wear rapidly over time. Further, such motions look unrealistic as they are often large and slow motions that are not realistic in appearance. SUMMARY

In one embodiment, a robotic system is disclosed. The robotic system includes a projection surface coupled to a robotic structure and configured to be moved by the robotic structure. The robotic system includes a tracking mechanism comprising at least one of a first tracking m

Claims

1. A robotic system comprising: a projection surface coupled to a robotic structure and configured to be moved by the robotic structure; a tracking mechanism comprising at least one of: a first tracking mechanism positioned internal to the robotic structure and configured to generate intrinsic tracking data; or a second tracking mechanism positioned external to the robotic structure and configured to generate extrinsic tracking data; a controller in communication with the tracking mechanism; and a projector having a field of view aligned with the projection surface and configured to project content onto the projection surface, wherein the controller modifies the projected content based on data generated by the tracking mechanism. || 11. A method for tracking a robot comprising: projecting content on a projection surface of the robot; generating tracking data using a tracking mechanism, the tracking mechanism comprising at least one of (i) a first tracking mechanism positioned internal to the robot and configured to generate intrinsic tracking data, or (ii) a second tracking mechanism positioned external to the robot and configured to generate extrinsic tracking data; and modifying at least one of (i) the content projected on the projection surface, or (ii) mechanical movement of the projection surface based on the tracking data to align the content with the projection surface of the robot. || 17. A non-transitory computer-readable media comprising instructions to cause a robotic system to: generate tracking data using a tracking mechanism, the tracking mechanism comprising at least one of (i) a first tracking mechanism coupled internally to a robotic structure of the robotic system robot and configured to generate intrinsic tracking data, or (ii) a second tracking mechanism positioned externally to the robotic structure robot and configured to generate extrinsic tracking data; and modify, based on the tracking data, at least one of (i) content projected on a projection surface of the robotic system, or (ii) mechanical movement of the projection surface to align the content with the projection surface of the robot.