Synchronized Effects for Multi-User Mixed Reality Experiences

Number: 20210090334
Published: 2021-03-25
Filed: 2019-09-25
Assignee: Disney Enterprises, Inc.
Inventors: Evans; Leslie, Newberg; Nicholas, Wieland; Alexis P., Carroll; Clare M., Hager, IV; Joseph G., Scerbo; Siroberto, Becker; Jonathan
CPC: G02B27/0093; G06F1/1694; G06F1/1698; G06F3/0304; G06F3/012; G08B6/00; G06F1/163; G06F3/011; G06T19/006; G06F3/04815; G06F1/1686; G06F3/016; G06F3/167; G02B27/017; G06F3/017
Verdict: Medium Hardware
Source: Google Patents · FreePatentsOnline

The keeper's note

Haptic-synchronized effects hardware for multi-user mixed reality.

Abstract

There are provided systems and methods for synchronizing effects for multi-user mixed reality experiences. In one implementation, such a system includes a computing platform having a hardware processor and a system memory storing a software code. The hardware processor executes the software code to receive sensor data from multiple sensors within a venue, identify an activity in the venue based on the sensor data, and track a respective perspective and a respective location within the venue of each of multiple observers of the activity. The hardware processor also executes the software code to identify a first effect triggered by an action of one of the observers, conform the first effect to the respective perspective and the respective location of each of the observers to produce multiple second effects corresponding to the first effect, and output the second effects for operating multiple actuating devices within the venue during the activity.

Background

BACKGROUND

Mixed reality involves the merging of real and virtual components in a physical space such that digital and physical objects co-exist and interact. Conventional mixed reality experiences are typically directed at a single participant viewing the mixed reality environment from a single perspective. Moreover, conventional mixed reality experiences according to the present state-of-the-art may omit or severely limit object-to-object interactions. For example, virtual light emitted from a virtual object typically may not suffuse adjacent physical objects with light as natural light in a real environment would. Such omissions and simplifications in existing implementations lower computing and rendering complexity, but create a much less interesting user experience.

By contrast, when multiple participants utilize a shared mixed reality environment concurrently, the complexity of computing and rendering the mixed reality components from multiple points of view increases exponentially. In addition, as object-to-object interactions are added to a multi-user mixed reality environment, the computational and rendering complexity is increased to a level to which conventional mixed reality implementations are simply incapable of scaling. SUMMARY

There are provided systems and methods for synchronizing effects for multi-user mixed reality experiences, substantially as shown in and/or described in connection with at least one of the figures, and as set forth m

Claims

1: A system comprising: a computing platform including a hardware processor and a system memory storing a software code; a plurality of smart objects each having one or more actuating devices, each of the plurality of smart objects being configured to communicate its state to the computing platform; wherein the hardware processor is configured to execute the software code to: maintain a real-time state model for the smart objects based on states of the plurality of smart objects communicated by the plurality of smart objects to the computing platform; receive sensor data from a plurality of sensors within a venue; identify an activity in the venue based on the sensor data; track a respective perspective and a respective location within the venue of each of a plurality of observers of the activity; identify a first effect triggered by an action of one of the plurality of observers; conform, based on the real-time state model, the first effect to the respective perspective and the respective location of each of the plurality of observers to produce a plurality of second effects corresponding to the first effect; and output the plurality of second effects for operating the one or more actuating devices of each of the plurality of smart objects within the venue during the activity. || 11: A method for use by a system including a computing platform having a hardware processor and a system memory storing a software code, and a plurality of smart objects each having one or more actuating devices, each of the plurality of smart objects being configured to communicate its state to the computing platform, the method comprising: maintaining, by the software code executed by the hardware processor, a real-time state model for the smart objects based on states of the plurality of smart objects communicated by the plurality of smart objects to the computing platform; receiving, by the software code executed by the hardware processor, sensor data from a plurality of sensors within a venue; identifying, by the software code executed by the hardware processor, an activity in the venue based on the sensor data; tracking, by the software code executed by the hardware processor, a respective perspective and a respective location within the venue of each of a plurality of observers of the activity; identifying, by the software code executed by the hardware processor, a first effect triggered by an action of one of the plurality of observers; conforming, by the software code executed by the hardware processor, based on the real-time state model, the first effect to the respective perspective and the respective location of each of the plurality of observers to produce a plurality of second effects corresponding to the first effect; and outputting, by the software code executed by the hardware processor, the plurality of second effects for operating the one or more actuating devices of each of the plurality of smart objects within the venue during the activity.