- Number
- 20190347855
- Published
- 2019-11-14
- Filed
- 2018-05-08
- Assignee
- DISNEY ENTERPRISES INC.
- Inventors
- Goslin; Michael P., Chapman; Steven M., Arana; Mark
- CPC
- G06T19/006; G06F3/011; G06F3/0346; G06T5/50; G06T7/74; G06T11/60
- Verdict
- Medium Notable software
- Source
- Google Patents · FreePatentsOnline
The keeper's note
Augmented reality image generation.
Abstract
According to one implementation, an augmented reality image generation system includes a display, and a computing platform having a hardware processor and a system memory storing a software code. The hardware processor executes the software code to receive a camera image depicting one or more real-world object(s), and to identify one or more reference point(s) corresponding to the camera image, each of the reference point(s) having a predetermined real-world location. The software code further maps the real-world object(s) to their respective real-world location(s) based on the predetermined real-world location(s) of the reference point(s), merges the camera image with a virtual object to generate an augmented reality image including the real-world object(s) and the virtual object, and renders the augmented reality image on the display. The location of the virtual object in the augmented reality image is determined based on the real-world location(s) of the real-world object(s).
Background
BACKGROUND
Augmented reality (AR) and virtual reality (VR) experiences may merge virtual objects or characters with real-world features in a way that can, in principle, provide a powerfully interactive experience to a user. AR can augment “real-reality”, i.e., a user can see the real world through clear lenses with virtual projections on top. VR can augment a virtual rendition of real-reality, where the view of the real-world comes from a headset mounted camera that are projected into VR space, so a user still sees the real world around them.SUMMARY
There are provided systems and methods for performing augmented reality image generation, substantially as shown in and/or described in connection with at least one of the figures, and as set forth more completely in the claims.
Claims
1. An augmented reality image generation system comprising: a computing platform including a hardware processor and a system memory; a software code stored in the system memory; a display communicatively coupled to the computing platforms; the hardware processor configured to execute the software code to: receive a camera image depicting at least one real-world object; identify at least one reference point depicted in the camera image based on a reference point metadata, the at least one reference point having a predetermined real-world location; map the at least one real-world object to a real-world location of the at least one real-world object based on the predetermined real-world location of the at least one reference point; merge the camera image with a virtual object to generate an augmented reality image including the at least one real-world object and the virtual object, wherein a location of the virtual object in the augmented reality image is determined based on the real-world location of the at least one real-world object; and render the augmented reality image on the display. 2: The augmented reality image generation system of claim 1, wherein the augmented reality image is rendered as a three-hundred-and-sixty degree (360°) image. 3: The augmented reality image generation system of claim 1, wherein the hardware processor is configured to execute the software code to identify the at least one reference point depicted in the camera image by performing an image analysis of the camera image. 4: The augmented reality image generation system of claim 3, wherein the hardware processor is further configured to execute the software code to: receive a sensor data corresponding to the at least one real-world object; and map the at least one real-world object to the real-world location of the at least one real-world object based on the predetermined real-world location of the at least one reference point and the sensor data. 5: The augmented reality image generation system of claim 1, wherein the camera image is captured indoors. 6: The augmented reality image generation system of claim 1, wherein the hardware processor is further configured to execute the software code to: receive a sensor data corresponding to the at least one real-world object; and map the at least one real-world object to the real-world location of the at least one real-world object based on the predetermined real-world location of the at least one reference point and the sensor data. 7: The augmented reality image generation system of claim 6, wherein the sensor data comprises at least one of depth sensor data, accelerometer data, and magnetometer data. 8: A method for use by an augmented reality image generation system including a computing platform having a hardware processor, a system memory storing a software code, and a display, the method comprising: receiving, using the hardware processor, a camera image depicting at least one real-world object; identifying, using the hardware processor, at least one reference point depicted in the camera image based on a reference point metadata, the at least one reference point having a predetermined real-world location; mapping, using the hardware processor, the at least one real-world object to a real-world location of the at least one real-world object based on the predetermined real-world location of the at least one reference point; merging, using the hardware processor, the camera image with a virtual object to generate an augmented reality image including the at least one real-world object and the virtual object, wherein a location of the virtual object in the augmented reality image is determined based on the real-world location of the at least one real-world object; and rendering, using the hardware processor, the augmented reality image on the display. 9: The method of claim 8, wherein the augmented reality image is rendered as a three-hundred-and-sixty degree (360°) image. 10: The method of claim 8, wherein identifying the at least one reference point depicted in the camera image comprises performing an image analysis of the camera image. 11: The method of claim 8, wherein the camera image is captured indoors. 12: The method of claim 8, further comprising: receiving, using the hardware processor, a sensor data corresponding to the at least one real-world object; and mapping, using the hardware processor, the at least one real-world object to the real-world location of the at least one real-world object based on the predetermined real-world location of the at least one reference point and the sensor data. 13: The method of claim 12, wherein the sensor data comprises at least one of depth sensor data, accelerometer data, and magnetometer data. 14: A mobile user system comprising: a hardware processor, a system memory, a display, and a camera; a software code stored in the system memory; the hardware processor configured to execute the software code to: receive a camera image from the camera, the camera image depicting at least one real-world object; identify at least one reference point depicted in the camera image based on a reference point metadata, the at least one reference point having a predetermined real-world location; map the at least one real-world object to a real-world location of the at least one real-world object based on the predetermined real-world location of the at least one reference point; merge the camera image with a virtual object to generate an augmented reality image including the at least one real-world object and the virtual object, wherein a location of the virtual object in the augmented reality image is determined based on the real-world location of the at least one real-world object; and render the augmented reality image on the display. 15: The mobile user system of claim 14, wherein the augmented reality image is rendered as a three-hundred-and-sixty degree (360°) image. 16: The mobile user system of claim 14, wherein the hardware processor is configured to execute the software code to identify the at least one reference point depicted in the camera image by performing an image analysis of the camera image. 17: The mobile user system of claim 14, wherein the camera image is captured indoors by the camera. 18: The mobile user system of claim 14, wherein the mobile user system is one of a smartphone, a tablet computer, and a head-mounted viewing device. 19: The mobile user system of claim 14, wherein the hardware processor is further configured to execute the software code to: receive a sensor data corresponding to the at least one real-world object; and map the at least one real-world object to the real-world location of the at least one real-world object based on the predetermined real-world location of the at least one reference point and the sensor data. 20: The mobile user system of claim 18, wherein the sensor data comprises at least one of depth sensor data, accelerometer data, and magnetometer data.