- Number
- 10217289
- Published
- 2019-02-26
- Filed
- 2017-12-12
- Assignee
- Disney Enterprises, Inc.
- Inventors
- Mitchell; Kenneth John, Sumner; Robert Walker
- CPC
- G06T19/006
- Verdict
- Low Notable software
- Source
- Google Patents · FreePatentsOnline
The keeper's note
AR device with predefined object data.
Abstract
Embodiments capture one or more images of a visual scene that includes a first physical object. A first region of the first physical object to apply one or more augmentations to is determined. Embodiments determine which configuration the first physical object is currently in. The first physical object is configured to be physically manipulatable into each of a plurality of configurations. A sequence of frames is rendered for display in which the first region of the first physical object is animated in a predefined manner depicting a virtual light source within the first physical object, based on the determined configuration of the first physical object, by applying the one or more augmentations to a first virtual object generated based on predefined geometric information corresponding to a determined object type of the first physical object. The rendered sequence of frames is output for display using one or more display devices.
Background
BACKGROUNDField of the Invention(1) The present invention generally relates to a human-computer interface and more specifically to techniques for recognizing and displaying predefined objects on an augmented reality device.Description of the Related Art(2) Computer graphics technology has come a long way since video games were first developed. Relatively inexpensive 3D graphics engines now provide nearly photo-realistic interactive game play on hand-held video game, home video game and personal computer hardware platforms costing only a few hundred dollars. These video game systems typically include a hand-held controller, game controller, or, in the case of a hand-held video game platform, an integrated controller. A user or player uses the controller to send commands or other instructions to the video game system to control a video game or other simulation being played. For example, the controller may be provided with a manipulator (e.g., a joystick) and buttons operated by the user.(3) Many hand-held gaming devices include some form of camera device which may be used to capture an image or a series of images of a physical, real-world scene. The captured images can then be displayed, for instance, on a display of the hand-held gaming device. Certain devices may be configured to insert virtual objects into the captured images before the images are displayed. Additionally, other devices or applications may enable users to draw or paint particular within a captured image of a
Claims
1. A computer-implemented method to augment virtual objects corresponding to physical objects, based on type and configuration of the physical objects, the computer-implemented method comprising: capturing, using one or more camera devices, one or more images of a visual scene that includes a first physical object; classifying the first physical object as a first predetermined object type, based on at least one of: (i) one or more object identifiers associated with the first physical object and (ii) a plurality of edges of the first physical object within the visual scene; determining which one of a plurality of distinct physical configurations the first physical object is currently in, wherein the first physical object is configured to be physically manipulatable into each of the plurality of distinct physical configurations; generating a first virtual object based on predefined geometric information corresponding to the first predetermined object type of the first physical object; determining one or more augmentations to apply to a first region of the first virtual object, by operation of one or more computer processors and based on the predefined geometric information corresponding to the first predetermined object type of the first object; rendering a sequence of frames for display in which the first region of the first physical object is animated in a predefined manner depicting a virtual light source within the first physical object, including applying, based on the determined physical configuration of the first physical object, the one or more augmentations to the first virtual object; and outputting the rendered sequence of frames for display using one or more display devices.
13. A computer-readable memory containing a program that, when executed, performs an operation to augment virtual objects corresponding to physical objects, based on type and configuration of the physical objects, the operation comprising: capturing, using one or more camera devices, one or more images of a visual scene that includes a first physical object; classifying the first physical object as a first predetermined object type, based on one or more object identifiers associated with the first physical object; determining which one of a plurality of distinct physical configurations the first physical object is currently in, wherein the first physical object is configured to be physically manipulatable into each of the plurality of distinct physical configurations; generating a first virtual object based on predefined geometric information corresponding to the first predetermined object type of the first physical object; determining one or more augmentations to apply to a first region of the first virtual object, by operation of one or more computer processors when executing the program, and based on the predefined geometric information corresponding to the first predetermined object type of the first object; rendering a sequence of frames for display in which the first region of the first physical object is animated in a predefined manner depicting a virtual light source within the first physical object, including applying the one or more augmentations to the first virtual object; and outputting the rendered sequence of frames for display using one or more display devices.
19. An augmented reality device to augment virtual objects corresponding to physical objects, based on type and configuration of the physical objects, the augmented reality device comprising: one or more computer processors; and a memory containing a program that, when executed by the one or more computer processors, performs an operation comprising: capturing, using one or more camera devices, one or more images of a visual scene that includes a first physical object; classifying the first physical object as a first predetermined object type, based on one or more object identifiers associated with the first physical object; determining which one of a plurality of distinct physical configurations the first physical object is currently in, wherein the first physical object is configured to be physically manipulatable into each of the plurality of distinct physical configurations; generating a first virtual object based on predefined geometric information corresponding to the first predetermined object type of the first physical object; determining one or more augmentations to apply to a first region of the first virtual object, based on the predefined geometric information corresponding to the first predetermined object type of the first object; rendering a sequence of frames for display in which the first region of the first physical object is animated in a predefined manner depicting a virtual light source within the first physical object, including applying the one or more augmentations to the first virtual object; and outputting the rendered sequence of frames for display using one or more display devices.