Detachable physical controller for an AR/VR model experience.
Embodiments include a method and associated system for providing an augmented reality experience. The method comprises receiving identification information from circuitry of a model removably attached to a controller device. A power source of the controller device provides power to the circuitry. The method further comprises receiving orientation information from one or more sensors of the controller device, and identifying, using a visual sensor, one or more external visual indicators of the model. The method further comprises maintaining a virtual model representing a model type indicated by the identification information. An orientation of the virtual model is based on the orientation information and referenced to the one or more external visual indicators, The method further comprises, responsive to receiving an input, displaying one or more visual effects referenced to the virtual model.
BACKGROUND
The present disclosure generally relates to computer-based entertainment, and more specifically to models and detachable controllers suitable for use with augmented reality (AR) and/or virtual reality (VR) devices.
Computer graphics technology has significantly progressed since the first video games were developed. Relatively inexpensive 3D graphics engines now provide nearly photo-realistic interactive game play on hand-held video game, home video game, and personal computer hardware platforms costing only a few hundred dollars. These video game systems typically include a hand-held controller, game controller, or, in the case of a hand-held video game platform, an integrated controller. A user interacts with the controller to send commands or other instructions to the video game system to control a video game or other simulation. For example, the controller may include a joystick and buttons operated by the user.
While video games allow the user to interact directly with the video game system, such interactions primarily influence the graphical depiction shown on the video game device (or on a connected display), and rarely influence any other objects outside of the virtual world. That is, a user may specify an input to the video game system, indicating that the user's avatar should perform a jump action, and in response the video game system could display the user's avatar jumping. However, such interactions are typically limited to the virtual
1. A method comprising: receiving identification information from circuitry of a model removably attached to a controller device, wherein the controller device is formed to include a handle configured to be gripped by a user's hand, wherein a power source of the controller device provides power to the circuitry; receiving orientation information from one or more sensors of the controller device; identifying, using a forward-sensing visual sensor of a body-worn device, one or more external visual indicators of the model, wherein the one or more external visual indicators comprise a first external visual indicator that is visible at an external surface of the model when the handle is gripped; maintaining a virtual model representing a model type indicated by the identification information, wherein an orientation of the virtual model is based on the orientation information and referenced to the one or more external visual indicators; and responsive to receiving an input, displaying one or more visual effects using a display of the body-worn device, wherein the one or more visual effects are referenced to the virtual model.
10. A system comprising: a model comprising circuitry and one or more external visual indicators; a controller device comprising: a handle configured to be gripped by a user's hand; an interface dimensioned to removably attach to the model; a power supply configured to provide power to the circuitry when the controller device is removably attached to the model; and one or more sensors; a body-wearable device comprising: a forward-sensing visual sensor; and a display; and one or more computer processors configured to: identify, using the visual sensor, at least a first external visual indicator of the one or more external visual indicators that is visible at an external surface of the model when the handle is gripped; maintain a virtual model representing a model type indicated by identification information received from the circuitry, wherein an orientation of the virtual model is based on orientation information received from the one or more sensors and referenced to the one or more external visual indicators; and responsive to receiving an input, displaying one or more visual effects using the display, wherein the one or more visual effects are referenced to the virtual model.
16. A controller device comprising: a body contoured as a handle to be gripped by a user's hand; an attachment interface dimensioned to removably attach the body to a selected model of a plurality of models, each model of the plurality of models having a respective model type of a plurality of model types, each model comprising circuitry and at least a first external visual indicator that is visible at an external surface of the model when the model is attached to the attachment interface and the handle is gripped; a power supply configured to provide power to the circuitry of a first model of the plurality of models when the first model is removably attached to the attachment interface; one or more sensors; a communication interface configured to: transmit identification information identifying the model type of the first model to an external computing device; transmit sensor information from the one or more sensors to the external computing device; and receive information from an application executing on the external computing device, wherein the information corresponds to one or more actions of a virtual model within an augmented reality environment, wherein the virtual model corresponds to the model type of the first model; and a sensory feedback device configured to provide sensory feedback with timing based on the one or more actions of the virtual model.