- Number
- 11112886
- Published
- 2021-09-07
- Filed
- 2019-01-30
- Assignee
- Disney Enterprises, Inc.
- Inventors
- Schmidt; Craig J., Barrett; Kyle W.
- CPC
- G02B27/0176; G06F3/011; G06F3/0346; G06F3/016; G06F3/0304; A63F13/24
- Verdict
- Low Hardware
- Source
- Google Patents · FreePatentsOnline
The keeper's note
Detachable physical controller for AR/VR experience (granted).
Abstract
Embodiments include a method and associated system for providing an augmented reality experience. The method comprises receiving identification information from circuitry of a model removably attached to a controller device. A power source of the controller device provides power to the circuitry. The method further comprises receiving orientation information from one or more sensors of the controller device, and identifying, using a visual sensor, one or more external visual indicators of the model. The method further comprises maintaining a virtual model representing a model type indicated by the identification information. An orientation of the virtual model is based on the orientation information and referenced to the one or more external visual indicators, The method further comprises, responsive to receiving an input, displaying one or more visual effects referenced to the virtual model.
Background
BACKGROUND (1) The present disclosure generally relates to computer-based entertainment, and more specifically to models and detachable controllers suitable for use with augmented reality (AR) and/or virtual reality (VR) devices. (2) Computer graphics technology has significantly progressed since the first video games were developed. Relatively inexpensive 3D graphics engines now provide nearly photo-realistic interactive game play on hand-held video game, home video game, and personal computer hardware platforms costing only a few hundred dollars. These video game systems typically include a hand-held controller, game controller, or, in the case of a hand-held video game platform, an integrated controller. A user interacts with the controller to send commands or other instructions to the video game system to control a video game or other simulation. For example, the controller may include a joystick and buttons operated by the user. (3) While video games allow the user to interact directly with the video game system, such interactions primarily influence the graphical depiction shown on the video game device (or on a connected display), and rarely influence any other objects outside of the virtual world. That is, a user may specify an input to the video game system, indicating that the user's avatar should perform a jump action, and in response the video game system could display the user's avatar jumping. However, such interactions are typically limited to the virtual world
Claims
1. A method comprising: receiving identification information from circuitry of a model removably attached to a controller device, wherein the model has a physical appearance according to a model type of the model, wherein the model type is included in a set of predefined virtual elements of an augmented reality environment, wherein the controller device is formed to include a handle configured to be gripped by a user's hand, wherein a power source of the controller device provides power to the circuitry; receiving orientation information from one or more sensors of the controller device; identifying, using a forward-sensing visual sensor of a body-worn device, one or more external visual indicators of the model, wherein the one or more external visual indicators comprise a first external visual indicator that is visible at an external surface of the model when the handle is gripped; maintaining, within the augmented reality environment, a virtual model corresponding to the model type indicated by the identification information, wherein a structural configuration of the virtual model corresponds to the physical appearance of the model, wherein an orientation of the virtual model is based on the orientation information and referenced to the one or more external visual indicators; displaying, using the display, the virtual model at a location referenced to a location of the model within a field of view of the user, wherein displaying the virtual model comprises selecting a magnification to cause the virtual model to appear larger than the model within the field of view; and responsive to receiving an input, displaying one or more visual effects using a display of the body-worn device, wherein the one or more visual effects are referenced to the virtual model. ||
9. A system comprising: a model comprising circuitry and one or more external visual indicators, wherein the model has a physical appearance according to a model type of the model, wherein the model type is included in a set of predefined virtual elements of an augmented reality environment; a controller device comprising: a handle configured to be gripped by a user's hand; an interface dimensioned to removably attach to the model; a power supply configured to provide power to the circuitry when the controller device is removably attached to the model; and one or more sensors; a body-wearable device comprising: a forward-sensing visual sensor; and a display; and one or more computer processors configured to: identify, using the visual sensor, at least a first external visual indicator of the one or more external visual indicators that is visible at an external surface of the model when the handle is gripped; maintain, within the augmented reality environment, a virtual model corresponding to the model type indicated by identification information received from the circuitry, wherein a structural configuration of the virtual model corresponds to the physical appearance of the model, wherein an orientation of the virtual model is based on orientation information received from the one or more sensors and referenced to the one or more external visual indicators; display, using the display, the virtual model at a location referenced to a location of the model within a field of view of the user, wherein displaying the virtual model comprises selecting a magnification to cause the virtual model to appear larger than the model within the field of view; and responsive to receiving an input, displaying one or more visual effects using the display, wherein the one or more visual effects are referenced to the virtual model. ||
14. A controller device comprising: a body contoured as a handle to be gripped by a user's hand; an attachment interface dimensioned to removably attach the body to a selected model of a plurality of models, each model of the plurality of models having a physical appearance according to a respective model type of a plurality of model types, wherein the plurality of model types are included in a set of predefined virtual elements of an augmented reality environment, each model comprising circuitry and at least a first external visual indicator that is visible at an external surface of the model when the model is attached to the attachment interface and the handle is gripped; a power supply configured to provide power to the circuitry of a first model of the plurality of models when the first model is removably attached to the attachment interface; one or more sensors; a communication interface configured to: transmit identification information identifying the model type of the first model to an external computing device; transmit sensor information from the one or more sensors to the external computing device, wherein the sensor information configures an application executing on the external computing device to display a virtual model within the augmented reality environment with a selected magnification to cause the virtual model to appear larger than the model within a field of view of the user, wherein a structural configuration of the virtual model corresponds to the physical appearance of the first model as indicated by the identification information, and wherein a location of displaying the model is referenced to a location of the first model within the field of view; and receive information from the application that corresponds to one or more actions of the virtual model within the augmented reality environment; and a sensory feedback device configured to provide sensory feedback with timing based on the one or more actions of the virtual model.