- Number
- 10832481
- Published
- 2020-11-10
- Filed
- 2018-08-21
- Assignee
- Disney Enterprises, Inc.
- Inventors
- Graham; Todd Michael, Crocker; John H., Baumbach; Elliott H., Nelson; Amy E.
- CPC
- G06F3/012; A63F13/26; A63F13/213; G02B27/017; G06T19/006; A63F13/211; G06T7/73; A63F13/212; A63F13/5252; A63F13/5255; G06F3/011; G02B27/0172; A63F13/428
- Verdict
- Low Notable software
- Source
- Google Patents · FreePatentsOnline
The keeper's note
Multi-screen AR/VR interaction technique (granted).
Abstract
Techniques for providing multi-screen interaction in an interactive application. A primary device establishes an application session. The application session includes a virtual environment relating to a physical environment in which the primary user device is located. The primary user device is configured to display a graphical image relating to a primary virtual camera view of the virtual environment. A secondary virtual camera view of the virtual environment, relating to the primary virtual camera view, is determined. The primary user device transmits image data relating to the secondary virtual camera view from the primary user device to a secondary user device, which is configured to display a graphical image based on the image data. Responsive to receiving an interaction request from the secondary user device, the primary user device controls the application session based on the interaction request.
Background
BACKGROUNDField of the Invention(1) This disclosure relates in general to virtual reality (VR) and augmented reality (AR), and more particularly, though not exclusively, to multi-screen interaction with an interactive AR or VR application.Description of the Related Art(2) Many AR and VR applications use a head mounted display to provide to a user a virtual environment corresponding to the physical environment in which the user is located. But consumers of AR and VR applications sometimes buy only one head mounted display, allowing only one consumer at a time to use the application. For example, an AR or VR video game might require a head mounted display. A consumer that purchases only one head mounted display would then be limited to a single player game experience. This can isolate the player from people around them, and can limit the game play options.SUMMARY(3) Embodiments described herein include a method of providing multi-screen interaction in an interactive application. The method includes establishing an application session using a primary user device. The application session includes a virtual environment relating to a physical environment in which the primary user device is located. The primary user device is configured to display a graphical image relating to a primary virtual camera view of the virtual environment. The method further includes determining a secondary virtual camera view of the virtual environment. The secondary virtual camera view relates to the pr
Claims
1. A method of providing multi-screen interaction in an interactive application, comprising: establishing an application session using a primary user device, the application session comprising a virtual environment relating to a physical environment in which the primary user device is located, wherein the primary user device is configured to display one or more graphical images relating to a primary virtual camera view of the virtual environment; determining a physical location of a secondary user device relative to the primary user device based on identifying a virtual glyph using the secondary user device, wherein the virtual glyph comprises a computer generated symbol generated using the primary user device, wherein the virtual glyph is generated to be visible at both the primary user device and the secondary user device, and wherein the virtual glyph is configured to be visible to the secondary user device through a transparent display of the primary user device; determining a secondary virtual camera view of the virtual environment, wherein the secondary virtual camera view relates to the primary virtual camera view and is based on the determined physical location of the secondary user device relative to the primary user device; transmitting image data relating to the secondary virtual camera view from the primary user device to the secondary user device, wherein the secondary user device is configured to display a first graphical image relating to the secondary virtual camera view based on the image data; and responsive to receiving an interaction request from the secondary user device, controlling, by the primary user device, the application session based on the interaction request, wherein the secondary user device is further configured to: generate a second graphical image relating to the secondary virtual camera view, based on data received from an Inertial Measurement Unit (IMU) at the secondary user device, and display the second graphical image.
11. A computer program product for providing multi-screen interaction in an interactive application, the computer program product comprising: a non-transitory computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code executable by one or more computer processors to perform an operation, the operation comprising: establishing an application session using a primary user device, the application session comprising a virtual environment relating to a physical environment in which the primary user device is located, wherein the primary user device is configured to display one or more graphical images relating to a primary virtual camera view of the virtual environment; determining a physical location of a secondary user device relative to the primary user device based on identifying a virtual glyph using the secondary user device, wherein the virtual glyph comprises a computer generated symbol generated using the primary user device, wherein the virtual glyph is generated to be visible at both the primary user device and the secondary user device, and wherein the virtual glyph is configured to be visible to the secondary user device through a transparent display of the primary user device; determining a secondary virtual camera view of the virtual environment, wherein the secondary virtual camera view relates to the primary virtual camera view and is based on the determined physical location of the secondary user device relative to the primary user device; transmitting image data relating to the secondary virtual camera view from the primary user device to the secondary user device, wherein the secondary user device is configured to display a first graphical image relating to the secondary virtual camera view based on the image data; and responsive to receiving an interaction request from the secondary user device, controlling, by the primary user device, the application session based on the interaction request, wherein the secondary user device is further configured to: generate a second graphical image relating to the secondary virtual camera view, based on data received from an Inertial Measurement Unit (IMU) at the secondary user device, and display the second graphical image.
16. A system, comprising: a processor; and a memory storing a program, which, when executed on the processor, performs an operation, the operation comprising: establishing an application session using a primary user device, the application session comprising a virtual environment relating to a physical environment in which the primary user device is located, wherein the primary user device is configured to display one or more graphical images relating to a primary virtual camera view of the virtual environment; determining a physical location of a secondary user device relative to the primary user device based on identifying a virtual glyph using the secondary user device, wherein the virtual glyph comprises a computer generated symbol generated using the primary user device, wherein the virtual glyph is generated to be visible at both the primary user device and the secondary user device, and wherein the virtual glyph is configured to be visible to the secondary user device through a transparent display of the primary user device; determining a secondary virtual camera view of the virtual environment, wherein the secondary virtual camera view relates to the primary virtual camera view and is based on the determined physical location of the secondary user device relative to the primary user device; transmitting image data relating to the secondary virtual camera view from the primary user device to the secondary user device, wherein the secondary user device is configured to display a first graphical image relating to the secondary virtual camera view based on the image data; and responsive to receiving an interaction request from the secondary user device, controlling, by the primary user device, the application session based on the interaction request, wherein the secondary user device is further configured to: generate a second graphical image relating to the secondary virtual camera view, based on data received from an Inertial Measurement Unit (IMU) at the secondary user device, and display the second graphical image.