- Number
- 10380800
- Published
- 2019-08-13
- Filed
- 2016-11-17
- Assignee
- Disney Enterprises, Inc.
- Inventors
- Smith; Tony R., Arana; Mark, Drake; Edward, Chen; Alexander C.
- CPC
- G06T1/20; G06T19/006
- Verdict
- Medium Notable software
- Source
- Google Patents · FreePatentsOnline
The keeper's note
Linking/interacting between AR and VR environments.
Abstract
Systems and methods are described for linking and interacting between augmented reality (AR) and virtual reality (VR) environments. An AR host system may capture or retrieve data associated with an AR view of a first user's real-world environment. The data may include an audio-visual stream of the real-world view, digital object data associated with digital objects overlaid on the real-world view, and other data. The AR host system transmits the data to a VR system. The VR system may place a second user into a VR environment that is a representation of the AR view. The VR system may also generate additional digital object data associated with the AR view and transmit the generated digital object data to the AR host system. The AR host system receives the digital object data and modifies the AR view presented to the first user.
Background
TECHNICAL FIELD(1) The present disclosure relates generally to augmented reality and virtual reality environments, and more particularly, to a system and method for linking and interacting between augmented reality and virtual reality environments.BRIEF SUMMARY OF THE DISCLOSURE(2) Systems and methods are described for linking and interacting between augmented reality and virtual reality environments.(3) In a first embodiment, a method implemented by an augmented reality system associated with a first user may include: capturing data of an augmented reality view of a real-world environment; transmitting, to a device associated with a second user, the captured data of the augmented reality view; receiving, from the device associated with the second user, digital object data of a digital object associated with the augmented reality view; and in response to receiving the digital object data, modifying the augmented reality view.(4) In a further implementation, the method includes: rendering the augmented reality view of the real-world environment, the augmented reality view including digital objects registered with the real-world environment. The augmented reality view may be rendered by displaying one of the digital objects overlaid over the real-world environment. The captured data that is transmitted may include video data of the real-word environment and digital object data associated with the one or more digital objects overlaid over the real-world environment.(5) The augme
Claims
1. A method, comprising: capturing data of an augmented reality view of a real-world environment using an augmented reality system associated with a first user, wherein the captured data comprises video data of the real-word environment and graphical digital object data comprising a graphical digital object overlaid over the real-world environment; transmitting, from the augmented reality system to a device associated with a second user, the video data and the graphical digital object data of the augmented reality view, wherein the video data and the graphical digital object data are transmitted as separate data streams; after transmitting the video data and the graphical digital object data, receiving, from the device associated with the second user, digital object data modifying a state of the graphical digital object; and in response to receiving the digital object data modifying the state of the graphical digital object, the augmented reality system modifying the augmented reality view.
15. An augmented reality system, comprising: a processor; a non-transitory computer-readable medium operatively coupled to the processor and having instructions stored thereon that, when executed by the processor cause the system to: render an augmented reality view of a real-world environment, the augmented reality view comprising a graphical digital object registered with the real-world environment; capture data of the rendered augmented reality view, wherein the captured data comprises video data of the real-word environment and graphical digital object data comprising the graphical digital object; transmit, to a device associated with a second user, the video data and the graphical digital object data of the rendered augmented reality view, wherein the video data and the graphical digital object data are transmitted as separate data streams; after transmitting the video data and the graphical digital object data, receive, from the device associated with the second user, digital object data modifying a state of the graphical digital object; and in response to receiving the digital object data modifying the state of the graphical digital object, modify the rendered augmented reality view.
21. A method, comprising: receiving, at a first device associated with a first user, video data and digital object data from a second device associated with a second user, wherein the video data and digital object data are associated with a display of an augmented reality view of a real-world environment having a first viewing angle; based on the received video data and digital object data, rendering a virtual reality view using the first device; receiving digital object data generated by the first user by physical manipulation of a user input device, the data comprising digital object data associated with the augmented reality view; wherein the video data and digital object data are received as separate data streams, the digital object data comprising a graphical digital object that is overlaid over the video, and wherein receiving digital object data generated by the first user by physical manipulation of a user input device comprises the user selecting the graphical digital object; transmitting the digital object data to the second device, wherein the digital object data modifies the display of the augmented reality view; receiving, at the first device, video data from a third device associated with a third user, wherein the video data is associated with a second display of an augmented reality view of the real-world environment having a second viewing angle; and temporally synching and spatially reconstructing, at the first device, the video data received from the second device with the video data received from the third device to create a three-dimensional representation of the real-world environment.