Outer Rim Archives
Archives · 2020 · 20200066043

Application (pre-grant publication)

MULTI-SCREEN INTERACTIONS IN VIRTUAL AND AUGMENTED REALITY

Number
20200066043
Published
2020-02-27
Filed
2018-08-21
Assignee
Disney Enterprises, Inc.
Inventors
GRAHAM; Todd Michael, CROCKER; John H., BAUMBACH; Elliott H., NELSON; Amy E.
CPC
A63F13/428; G02B27/0172; A63F13/5255; A63F13/26; G06T7/73; A63F13/213; A63F13/212; G06T19/006; A63F13/5252; G06F3/012; G02B27/017; A63F13/211; G06F3/011
Verdict
Low Notable software
Source
Google Patents · FreePatentsOnline

The keeper's note

Multi-screen AR/VR interaction technique.

Abstract

Techniques for providing multi-screen interaction in an interactive application. A primary device establishes an application session. The application session includes a virtual environment relating to a physical environment in which the primary user device is located. The primary user device is configured to display a graphical image relating to a primary virtual camera view of the virtual environment. A secondary virtual camera view of the virtual environment, relating to the primary virtual camera view, is determined. The primary user device transmits image data relating to the secondary virtual camera view from the primary user device to a secondary user device, which is configured to display a graphical image based on the image data. Responsive to receiving an interaction request from the secondary user device, the primary user device controls the application session based on the interaction request.

Background

BACKGROUNDField of the Invention

This disclosure relates in general to virtual reality (VR) and augmented reality (AR), and more particularly, though not exclusively, to multi-screen interaction with an interactive AR or VR application.Description of the Related Art

Many AR and VR applications use a head mounted display to provide to a user a virtual environment corresponding to the physical environment in which the user is located. But consumers of AR and VR applications sometimes buy only one head mounted display, allowing only one consumer at a time to use the application. For example, an AR or VR video game might require a head mounted display. A consumer that purchases only one head mounted display would then be limited to a single player game experience. This can isolate the player from people around them, and can limit the game play options.SUMMARY

Embodiments described herein include a method of providing multi-screen interaction in an interactive application. The method includes establishing an application session using a primary user device. The application session includes a virtual environment relating to a physical environment in which the primary user device is located. The primary user device is configured to display a graphical image relating to a primary virtual camera view of the virtual environment. The method further includes determining a secondary virtual camera view of the virtual environment. The secondary virtual camera view relates

Claims

1. A method of providing multi-screen interaction in an interactive application, comprising: establishing an application session using a primary user device, the application session comprising a virtual environment relating to a physical environment in which the primary user device is located, wherein the primary user device is configured to display a graphical image relating to a primary virtual camera view of the virtual environment; determining a secondary virtual camera view of the virtual environment, wherein the secondary virtual camera view relates to the primary virtual camera view; transmitting image data relating to the secondary virtual camera view from the primary user device to a secondary user device, wherein the secondary user device is configured to display a graphical image relating to the secondary virtual camera view based on the image data; and responsive to receiving an interaction request from the secondary user device, controlling, by the primary user device, the application session based on the interaction request. 12. A computer program product for providing multi-screen interaction in an interactive application, the computer program product comprising: a computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code executable by one or more computer processors to perform an operation, the operation comprising: establishing an application session using a primary user device, the application session comprising a virtual environment relating to a physical environment in which the primary user device is located, wherein the primary user device is configured to display a graphical image relating to a primary virtual camera view of the virtual environment; determining a secondary virtual camera view of the virtual environment, wherein the secondary virtual camera view relates to the primary virtual camera view; transmitting image data relating to the secondary virtual camera view from the primary user device to a secondary user device, wherein the secondary user device is configured to display a graphical image relating to the secondary virtual camera view based on the image data; and responsive to receiving an interaction request from the secondary user device, controlling, by the primary user device, the application session based on the interaction request. 17. A system, comprising: a processor; and a memory storing a program, which, when executed on the processor, performs an operation, the operation comprising: establishing an application session using a primary user device, the application session comprising a virtual environment relating to a physical environment in which the primary user device is located, wherein the primary user device is configured to display a graphical image relating to a primary virtual camera view of the virtual environment; determining a secondary virtual camera view of the virtual environment, wherein the secondary virtual camera view relates to the primary virtual camera view; transmitting image data relating to the secondary virtual camera view from the primary user device to a secondary user device, wherein the secondary user device is configured to display a graphical image relating to the secondary virtual camera view based on the image data; and responsive to receiving an interaction request from the secondary user device, controlling, by the primary user device, the application session based on the interaction request.