- Number
- 10110871
- Published
- 2018-10-23
- Filed
- 2016-10-31
- Assignee
- DISNEY ENTERPRISES, INC.
- Inventors
- Bejot; Jason
- CPC
- H04N9/8715; G06T11/00; G06T11/60; G11B27/036; H04N5/77
- Verdict
- Medium Notable software
- Source
- Google Patents · FreePatentsOnline
The keeper's note
Off-device immersive-experience recording (grant dup).
Abstract
Systems and methods are described for recording high fidelity augmented reality or virtual reality experiences through off-device computation. In one implementation, an augmented reality system renders an augmented reality object overlaid over a real-world environment; captures video and audio data of the real-world environment during rendering of the augmented reality object; and stores augmented reality object data associated with the rendered augmented reality object. The augmented reality system transmits the augmented reality object data to a server that rerenders the augmented reality object based on the transmitted augmented reality object data to create rerendered augmented reality object data. The augmented reality system receives the rerendered augmented reality object data or a video of the rerendered augmented reality object data composited with the captured video and audio data.
Background
TECHNICAL FIELD(1) The present disclosure relates generally to augmented reality and virtual reality technology, and more particularly, some embodiments relate to systems and methods for recording high fidelity augmented reality or virtual reality experiences through off-device computation.DESCRIPTION OF THE RELATED ART(2) Being immersed in augmented reality or virtual reality using a smartphone, head-mounted display, or other augmented reality capable device, may be an engaging and unique experience.BRIEF SUMMARY OF THE DISCLOSURE(3) Systems and methods are described for recording high fidelity augmented reality or virtual reality experiences through off-device computation.(4) In a first embodiment, an augmented reality system renders an augmented reality object overlaid over a real-world environment; captures video and audio data of the real-world environment during rendering of the augmented reality object; and stores augmented reality object data associated with the rendered augmented reality object. The augmented reality system transmits, over a network, the augmented reality object data to a server that rerenders the augmented reality object based on the transmitted augmented reality object data to create rerendered augmented reality object data. The augmented reality system receives, over the network, the rerendered augmented reality object data or a video of the rerendered augmented reality object data composited with the captured video and audio data.(5) In one imple
Claims
1. A method, comprising: rendering an augmented reality object overlaid over a real-world environment; capturing video and audio data of the real-world environment during rendering of the augmented reality object; storing augmented reality object data associated with the rendered augmented reality object; transmitting, over a network, the augmented reality object data to a server, wherein the server rerenders the augmented reality object based on the transmitted augmented reality object data to create rerendered augmented reality object data, wherein the rerendered augmented reality object data provides a higher fidelity representation of the rendered augmented reality object; and receiving, over the network, the rerendered augmented reality object data or a video of the rerendered augmented reality object data composited with the captured video and audio data.
9. A system, comprising: a processor; a non-transitory computer-readable medium having instructions stored thereon that, when executed by the processor, cause the system to: render an augmented reality object overlaid over a real-world environment; capture video and audio data of the real-world environment during rendering of the augmented reality object; store augmented reality object data associated with the rendered augmented reality object; transmit, over a network, the augmented reality object data to a server, wherein the server rerenders the augmented reality object based on the transmitted augmented reality object data to create rerendered augmented reality object data, wherein the rerendered augmented reality object data provides a higher fidelity representation of the rendered augmented reality object; and receive, over the network, the rerendered augmented reality object data or a video of the rerendered augmented reality object data composited with the captured video and audio data.
17. A method, comprising: receiving, at a server, augmented reality object data associated with an augmented reality object rendered by a device during capturing of video and audio data of a real-world environment that the augmented reality object is overlaid over; and rerendering, at the server, the augmented reality object based on the received augmented reality object data to create rerendered augmented reality object data, wherein the rerendered augmented reality object data provides a higher fidelity representation of the rendered augmented reality object.
24. A server system, comprising: a processor; a non-transitory computer-readable medium having instructions stored thereon that, when executed by the processor, cause the server system to: receive: augmented reality object data associated with an augmented reality object rendered by a device during capturing of video and audio data of a real-world environment that the augmented reality object is overlaid over; and the captured video and audio data; rerender the augmented reality object based on the received augmented reality object data to create rerendered augmented reality object data, wherein the rerendered augmented reality object data provides a higher fidelity representation of the rendered augmented reality object; and composite the rerendered augmented reality object data with the received, captured video and audio data, to create a video.