RECORDING HIGH FIDELITY DIGITAL IMMERSIVE EXPERIENCES THROUGH OFF-DEVICE COMPUTATION

Number: 20180124370
Published: 2018-05-03
Filed: 2016-10-31
Assignee: Disney Enterprises, Inc.
Inventors: BEJOT; JASON
CPC: H04N9/8715; G06T11/00; G06T11/60; G11B27/036; H04N5/77
Verdict: Medium Notable software
Source: Google Patents · FreePatentsOnline

The keeper's note

Off-device immersive-experience recording.

Abstract

Systems and methods are described for recording high fidelity augmented reality or virtual reality experiences through off-device computation. In one implementation, an augmented reality system renders an augmented reality object overlaid over a real-world environment; captures video and audio data of the real-world environment during rendering of the augmented reality object; and stores augmented reality object data associated with the rendered augmented reality object. The augmented reality system transmits the augmented reality object data to a server that rerenders the augmented reality object based on the transmitted augmented reality object data to create rerendered augmented reality object data. The augmented reality system receives the rerendered augmented reality object data or a video of the rerendered augmented reality object data composited with the captured video and audio data.

Background

TECHNICAL FIELD

The present disclosure relates generally to augmented reality and virtual reality technology, and more particularly, some embodiments relate to systems and methods for recording high fidelity augmented reality or virtual reality experiences through off-device computation.DESCRIPTION OF THE RELATED ART

Being immersed in augmented reality or virtual reality using a smartphone, head-mounted display, or other augmented reality capable device, may be an engaging and unique experience.BRIEF SUMMARY OF THE DISCLOSURE

Systems and methods are described for recording high fidelity augmented reality or virtual reality experiences through off-device computation.

In a first embodiment, an augmented reality system renders an augmented reality object overlaid over a real-world environment; captures video and audio data of the real-world environment during rendering of the augmented reality object; and stores augmented reality object data associated with the rendered augmented reality object. The augmented reality system transmits, over a network, the augmented reality object data to a server that rerenders the augmented reality object based on the transmitted augmented reality object data to create rerendered augmented reality object data. The augmented reality system receives, over the network, the rerendered augmented reality object data or a video of the rerendered augmented reality object data composited with the captured video and audio data.[000

Claims

1. A method, comprising: rendering an augmented reality object overlaid over a real-world environment; capturing video and audio data of the real-world environment during rendering of the augmented reality object; storing augmented reality object data associated with the rendered augmented reality object; transmitting, over a network, the augmented reality object data to a server, wherein the server rerenders the augmented reality object based on the transmitted augmented reality object data to create rerendered augmented reality object data; and receiving, over the network, the rerendered augmented reality object data or a video of the rerendered augmented reality object data composited with the captured video and audio data. 9. A system, comprising: a non-transitory computer-readable medium having instructions stored thereon that, when executed by a processor cause the system to: render an augmented reality object overlaid over a real-world environment; capture video and audio data of the real-world environment during rendering of the augmented reality object; store augmented reality object data associated with the rendered augmented reality object; transmit, over a network, the augmented reality object data to a server, wherein the server rerenders the augmented reality object based on the transmitted augmented reality object data to create rerendered augmented reality object data; and receive, over the network, the rerendered augmented reality object data or a video of the rerendered augmented reality object data composited with the captured video and audio data. 17. A method, comprising: receiving, at a server, augmented reality object data associated with an augmented reality object rendered by a device during capturing of video and audio data of a real-world environment that the augmented reality object is overlaid over; and rerendering, at the server, the augmented reality object based on the received augmented reality object data to create rerendered augmented reality object data. 24. A server system, comprising: a non-transitory computer-readable medium having instructions stored thereon that, when executed by a processor cause the server system to: receive: augmented reality object data associated with an augmented reality object rendered by a device during capturing of video and audio data of a real-world environment that the augmented reality object is overlaid over; and the captured video and audio data; rerender the augmented reality object based on the received augmented reality object data to create rerendered augmented reality object data; and composite the rerendered augmented reality object data with the received, captured video and audio data, to create a video.