- Number
- 9733790
- Published
- 2017-08-15
- Filed
- 2014-10-30
- Assignee
- Disney Enterprises, Inc.
- Inventors
- Sumner; Robert, Noris; Gioacchino
- CPC
- G06F3/0346; G06F3/0425; G06F3/04815
- Verdict
- Medium Notable software
- Source
- Google Patents · FreePatentsOnline
The keeper's note
A haptic interface that tracks a handheld device via its own screen image to let users populate and place objects within a 3D virtual environment by hand.
Abstract
The disclosure providesan approach for populating a virtual environment with objects. In one embodiment, an editing application may track a handheld device using sensor data from a camera, by following an image displayed on the handheld device's screen. The editing application then updates the position of an object in the virtual environment according to the tracked position of the handheld device. Initially, the handheld device may be placed at a fixed location for calibration purposes, during which the editing application initializes a mapping between the virtual and physical environments. To add an object to the virtual environment, a user may select the object on the handheld device. The user may then place the object at a desired location and orientation in the virtual environment by moving the handheld device in the physical environment.
Background
BRIEF DESCRIPTION OF THE DRAWINGS(1) So that the manner in which the above recited features of the present disclosure can be understood in detail, a more particular description of the disclosure, briefly summarized above, may be had by reference to embodiments, some of which are illustrated in the appended drawings. It is to be noted, however, that the appended drawingsillustrate only exemplary embodiments and are therefore not to be considered limiting of its scope, may admit to other equally effective embodiments.(2) FIG. 1 illustrates an example of manipulating an object in a three-dimensional virtual environment, according to an embodiment.(3) FIG. 2 illustrates a system in which an embodiment of this disclosure may be implemented.(4) FIG. 3 illustrates a method for populating a virtual environment with objects, according to an embodiment.(5) To facilitate understanding, identical reference numerals have been used, where possible, to designate identical elements that are common to the figures. It is contemplated that elements and features of one embodiment may be beneficially incorporated in other embodiments without further recitation.DETAILED DESCRIPTION(6)This disclosure provides techniques for populating a virtual environment with objects. Inone embodiment, a three-dimensional (3D) virtual environment editing application tracks movement of a handheld device in physical space. Based on the movement, the editing application updates a position of an object in a 3D vir
Claims
1. A computer-implemented method for populating a virtual environment, comprising: receiving, from a handheld device, a selection of an object toadd to the virtual environment; tracking a position of the handheld device, wherein tracking the position of the handheld device includes using one or more computer vision algorithms to compute the position of the handheld device based on either an image displayed on ascreen of the handheld device, the image including a depiction of the object, or one or more near infrared (IR) markers positioned on the handheld device; and updating a position of the object in the virtual environment based on the tracked position of the handheld device.
7. A non-transitory computer-readable storage medium storing a program, which, when executed by a processor performs operations for populating a virtual environment, the operations comprising: receiving, from a handheld device, a selection of an object to add to the virtual environment; tracking a position of the handheld device, wherein tracking the position of the handheld device includes using one or more computer vision algorithms to compute the position of the handheld device based on either an image displayed on a screen ofthe handheld device, the image including a depiction of the object, or one or more near infrared (IR) markers positioned on the handheld device; and updating a position of the object in the virtual environment based on the tracked position of the handheld device.
13. Asystem, comprising: a processor; and a memory, wherein the memory includes an applicationprogram configured to perform operations for populating a virtual environment, the operations comprising: receiving, from a handheld device, a selection of an object to add to thevirtual environment, tracking a position of the handheld device, wherein tracking the position of the handheld device includes using one or more computer vision algorithms to compute the position of the handheld device based on either an image displayed on a screen of the handheld device, the image including a depiction of the object, or one or more near infrared (IR) markers positioned on the handheld device, and updating a position of the object in the virtual environment based on the tracked position of the handheld device.
15. A computer-implemented method, comprising: receiving a depth map of a physical environment in which a handheld device is located; receiving one or more images of the physical environment; receiving, from the handheld device, a selection of an object to add to an augmentedreality environment; tracking a location and orientation of the handheld device, wherein tracking the location and orientation of the handheld device includes using one or more computer vision algorithms to compute the location and orientation of the handheld device based on at least one of an image of the selected object displayed on a screen of the handheld device, a predefined image displayed on the screen of the handheld device, and one or more near infrared (IR) markers positioned on the handheld device; updating a location and orientation of the object in the augmented reality environment based on the tracked location and orientation of the handheld device and the depth map of the physical environment; and adding, to the one or more images of the physical environment, a depiction of the object based on the updated location and orientation of the object.