NEURAL EXTENSION OF 2D CONTENT IN AUGMENTED REALITY ENVIRONMENTS

Number: 20240242445
Published: 2024-07-18
Filed: 2023-01-17
Assignee: DISNEY ENTERPRISES, INC.
Inventors: Riemenschneider; Hayko Jochen Wilhelm et al.
CPC: G06T15/08; G06T7/11; G06T19/006; G06T19/20
Verdict: Low Notable software
Source: Google Patents · FreePatentsOnline

The keeper's note

Neural extension technique for 2D content in AR environments.

Abstract

One embodiment of the present invention sets forth a technique for generating augmented reality content. The technique includes inputting a first layout of a physical space and a first set of anchor content into a machine learning model. The technique also includes generating, via execution of the machine learning model, a first augmented reality view that includes (i) a first portion of the physical space and (ii) an extension of the first set of anchor content across a second portion of the physical space. The technique further includes causing the first augmented reality view to be outputted in a computing device.

Background

BACKGROUND Field of the Various Embodiments

Embodiments of the present disclosure relate generally to machine learning and augmented reality and, more specifically, to neural extension of two-dimensional (2D) content in augmented reality environments. DESCRIPTION OF THE RELATED ART

Augmented reality (AR) refers to the merging of real-world and computer-generated content into an interactive sensory experience. For example, an AR system could include a camera, depth sensor, microphone, accelerometer, gyroscope, and/or another type of sensor that detects events or changes in the environment around a user. The AR system could also include a display, speaker, and/or another type of output device that combines data collected by the sensors with additional AR content into an immersive experience. The AR system could additionally modify the output of real-world and/or AR content in response to changes in the environment, interaction between the user and the AR content, and/or other input.

One application of AR involves combining traditional media content, such as images, audio, and/or video, with the layout of a real-world physical space. For example, an AR system executing on a wearable device or portable electronic device could “extend” an image or video of a scene across a room by overlaying objects, shapes, colors, and/or textures from the scene onto walls, ceilings, floors, and/or other parts of the room. The AR system could also arrange various portions of

Claims

1. A computer-implemented method for generating augmented reality content, the method comprising: inputting a first layout of a physical space and a first set of anchor content into a machine learning model; generating, via execution of the machine learning model, a first augmented reality view that includes (i) a first portion of the physical space and (ii) an extension of the first set of anchor content across a second portion of the physical space; and causing the first augmented reality view to be outputted in a computing device. || 11. One or more non-transitory computer-readable media storing instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of: inputting a first layout of a physical space and a first set of anchor content into a machine learning model; generating, via execution of the machine learning model, a first augmented reality view that includes (i) a first portion of the physical space and (ii) an extension of the first set of anchor content across a second portion of the physical space; and causing the first augmented reality view to be outputted in a computing device. || 20. A system, comprising: one or more memories that store instructions, and one or more processors that are coupled to the one or more memories and, when executing the instructions, are configured to perform the steps of: inputting a representation of a physical space and a set of anchor content into a machine learning model; generating, via execution of the machine learning model, a first augmented reality view that includes (i) a first portion of the physical space and (ii) an extension of the set of anchor content across a second portion of the physical space; and causing the first augmented reality view to be outputted in a computing device.