AR device with predefined object data.
Embodiments capture one or more images of a visual scene that includes a first physical object. A first region of the first physical object to apply one or more augmentations to is determined. Embodiments determine which configuration the first physical object is currently in. The first physical object is configured to be physically manipulatable into each of a plurality of configurations. A sequence of frames is rendered for display in which the first region of the first physical object is animated in a predefined manner depicting a virtual light source within the first physical object, based on the determined configuration of the first physical object, by applying the one or more augmentations to a first virtual object generated based on predefined geometric information corresponding to a determined object type of the first physical object. The rendered sequence of frames is output for display using one or more display devices.
BACKGROUNDField of the Invention
The present invention generally relates to a human-computer interface and more specifically to techniques for recognizing and displaying predefined objects on an augmented reality device.Description of the Related Art
Computer graphics technology has come a long way since video games were first developed. Relatively inexpensive 3D graphics engines now provide nearly photo-realistic interactive game play on hand-held video game, home video game and personal computer hardware platforms costing only a few hundred dollars. These video game systems typically include a hand-held controller, game controller, or, in the case of a hand-held video game platform, an integrated controller. A user or player uses the controller to send commands or other instructions to the video game system to control a video game or other simulation being played. For example, the controller may be provided with a manipulator (e.g., a joystick) and buttons operated by the user.
Many hand-held gaming devices include some form of camera device which may be used to capture an image or a series of images of a physical, real-world scene. The captured images can then be displayed, for instance, on a display of the hand-held gaming device. Certain devices may be configured to insert virtual objects into the captured images before the images are displayed. Additionally, other devices or applications may enable users to draw or paint particular within a captured im
1. A method, comprising: capturing, using one or more camera devices, one or more images of a visual scene that includes a first physical object; determining a first region of the first physical object to apply one or more augmentations to; determining which one of a plurality of configurations the first physical object is currently in, wherein the first physical object is configured to be physically manipulatable into each of the plurality of configurations; rendering a sequence of frames for display in which the first region of the first physical object is animated in a predefined manner depicting a virtual light source within the first physical object, based on the determined configuration of the first physical object, by applying the one or more augmentations to a first virtual object generated based on predefined geometric information corresponding to a determined object type of the first physical object; and outputting the rendered sequence of frames for display using one or more display devices.
10. A computer-readable memory containing a program that, when executed, performs an operation, comprising: capturing, using one or more camera devices, one or more images of a visual scene that includes a first physical object; determining a first region of the first physical object to apply one or more augmentations to; determining which one of a plurality of configurations the first physical object is currently in, wherein the first physical object is configured to be physically manipulatable into each of the plurality of configurations; rendering a sequence of frames for display in which the first region of the first physical object is animated in a predefined manner depicting a virtual light source within the first physical object, based on the determined configuration of the first physical object, by applying the one or more augmentations to a first virtual object generated based on predefined geometric information corresponding to a determined object type of the first physical object; and outputting the rendered sequence of frames for display using one or more display devices.
19. An augmented reality device, comprising: a processor; and a memory containing a program that, when executed by the processor, performs an operation for displaying a first physical object, comprising: capturing, using one or more camera devices, one or more images of a visual scene that includes a first physical object; determining a first region of the first physical object to apply one or more augmentations to; determining which one of a plurality of configurations the first physical object is currently in, wherein the first physical object is configured to be physically manipulatable into each of the plurality of configurations; rendering a sequence of frames for display in which the first region of the first physical object is animated in a predefined manner depicting a virtual light source within the first physical object, based on the determined configuration of the first physical object, by applying the one or more augmentations to a first virtual object generated based on predefined geometric information corresponding to a determined object type of the first physical object; and outputting the rendered sequence of frames for display using one or more display devices.