HAPTIC INTERFACE FOR POPULATION OF A THREE-DIMENSIONAL VIRTUAL ENVIRONMENT

Number: 20170322700
Published: 2017-11-09
Filed: 2017-07-25
Assignee: Disney Enterprises, Inc.
Inventors: SUMNER; Robert, NORIS; Gioacchino
CPC: G06F3/0425; G06F3/0346; G06F3/04815
Verdict: Medium Notable software
Source: Google Patents · FreePatentsOnline

The keeper's note

A haptic interface that tracks a handheld device via its own screen image to let users populate and place objects within a 3D virtual environment by hand (PGPUB duplicate).

Abstract

The disclosure provides an approach for populating a virtual environment with objects. In one embodiment, an editing application may track a handheld device using sensor data from a camera, by following an image displayed on the handheld device's screen. The editing application then updates the position of an object in the virtual environment according to the tracked position of the handheld device. Initially, the handheld device may be placed at a fixed location for calibration purposes, during which the editing application initializes a mapping between the virtual and physical environments. To add an object to the virtual environment, a user may select the object on the handheld device. The user may then place the object at a desired location and orientation in the virtual environment by moving the handheld device in the physical environment.

Background

BRIEF DESCRIPTION OF THE DRAWINGS

So that the manner in which the above recited features of the present disclosure can be understood in detail, a more particular description of the disclosure, briefly summarized above, may be had by reference to embodiments, some of which are illustrated in the appended drawings. It is to be noted, however, thatthe appended drawings illustrate only exemplary embodiments and are therefore not to be considered limiting of its scope, may admit to other equally effective embodiments.

FIG. 1 illustrates an example of manipulating an object in a three-dimensional virtual environment, according to an embodiment.

FIG. 2 illustrates a system in which an embodiment of this disclosure may be implemented.

FIG. 3 illustrates a method for populating a virtual environment with objects, according to an embodiment.

To facilitate understanding, identical reference numerals have been used, where possible, to designate identical elements that are common to the figures. It is contemplated that elements and features of one embodiment may be beneficially incorporated in other embodiments without further recitation.DETAILED DESCRIPTION

This disclosure provides techniques for populating avirtual environment with objects. In one embodiment, a three-dimensional (3D) virtual environment editing application tracks movement of a handheld device in physical space. Basedon the movement, the editing application updates a position of an

Claims

1. A computer-implemented method of manipulating an object in a virtual environment, comprising: receiving one or more image frames captured by a camera; determining, in each of the received image frames, a location and orientation of a predefined image displayed on a handheld device, wherein the handheld device is switched to display the predefinedimage when movement of the handheld device is to be tracked; and updating a location and orientation of the object in the virtual environment based on at least the determined location and orientation of the predefined image in each of the received image frames and a mapping between a physical environment in which the handheld device is located and the virtual environment. 10. A non-transitory computer-readable storage medium storing a program, which, when executed by a processor performs operations for manipulating an object in a virtual environment, the operations comprising: receiving one or more image frames captured by a camera; determining, in each of the received image frames, a location and orientation of a predefined image displayed on a handheld device, wherein the handheld device is switched to display the predefined image when movement of the handheld device is to be tracked;and updating a location and orientation of the object in the virtual environment based onat least the determined location and orientation of the predefined image in each of the received image frames and a mapping between a physical environment in which the handheld device is located and the virtual environment. 19. A system, comprising: a processor; and a memory, wherein the memory includes an application program configured to perform operations for manipulating an object in a virtual environment, the operations comprising: receiving one or more image frames captured by a camera, determining, in each of the received image frames, a location and orientation of a predefined image displayed on a handheld device,wherein the handheld device is switched to display the predefined image when movement of the handheld device is to be tracked, and updating a location and orientation of the object in the virtual environment based on at least the determined location and orientation of the predefined image in each of the received image frames and a mapping between a physicalenvironment in which the handheld device is located and the virtual environment.