Outer Rim Archives
Archives · 2020 · 10589625

Granted patent

Systems and methods for augmenting an appearance of an actual vehicle component with a virtual vehicle component

Number
10589625
Published
2020-03-17
Filed
2015-12-11
Assignee
Disney Enterprises, Inc.
Inventors
Goslin; Michael P.
CPC
B60K35/10; B60K35/23; B60K35/28
Verdict
Set aside automotive dashboard AR feature, consumer product
Source
Google Patents · FreePatentsOnline

Abstract

This disclosure relates to systems and methods for augmenting an appearance of an actual vehicle component of an actual vehicle with a virtual vehicle component. An actual vehicle component may be augmented with a virtual vehicle component by obtaining a vehicle type of the actual vehicle, detecting a landmark associated with the actual vehicle, determining a position and an orientation of the landmark, selecting a virtual vehicle component, placing the virtual vehicle component within an overlay image, where the position and the orientation of the virtual vehicle component is based on the position and the orientation of the landmark, and displaying the overlay image so that one or more portions of the virtual vehicle component appear to cover one or more portions of the actual vehicle component.

Background

FIELD(1) This disclosure relates to systems and methods for augmenting an appearance of an actual vehicle component with a virtual vehicle component.BACKGROUND(2) Vehicle entertainment systems allow a person to use a display of a vehicle to play movies and/or games. Such vehicle entertainment systems do not allow a person to view actual vehicle components augmented by virtual vehicle components.SUMMARY(3) This disclosure relates to augmenting an appearance of an actual vehicle component of an actual vehicle with a virtual vehicle component. An actual vehicle component may be augmented with a virtual vehicle component by obtaining a vehicle type of the actual vehicle, detecting a landmark associated with the actual vehicle, determining a position and an orientation of the landmark, selecting a virtual vehicle component, placing the virtual vehicle component within an overlay image, where the position and the orientation of the virtual vehicle component is based on the position and the orientation of the landmark, and displaying the overlay image so that one or more portions of the virtual vehicle component appear to cover one or more portions of the actual vehicle component.(4) A system configured to augment an appearance of an actual vehicle component of an actual vehicle with a virtual vehicle component may include an image sensor, a display, one or more processors and/or other components. In some implementations, the image sensor and the one or more processors may be carrie

Claims

1. A system for augmenting an appearance of an actual vehicle component of an actual vehicle with a virtual vehicle component, the system comprising: an image sensor configured to generate output signals conveying visual information within a field of view of the image sensor; a display configured to display an overlay image; and one or more processors configured by machine readable instructions to: obtain a vehicle type of the actual vehicle and determine a structural composition of the actual vehicle based on the vehicle type of the actual vehicle; detect presence of the actual vehicle component within the actual vehicle within the field of view of the image sensor based on the output signals, and determine a position, a tilt, and a rotation of the actual vehicle component within the actual vehicle; select the virtual vehicle component based on the vehicle type and the actual vehicle component, the virtual vehicle component including one or more parts of a virtual vehicle conforming to the structural composition of the actual vehicle component of the actual vehicle, the virtual vehicle being of a second vehicle type that is different from the vehicle type of the actual vehicle; determine a position of the virtual vehicle component based on the determined position of the actual vehicle component, a tilt of the virtual vehicle component based on the determined tilt of the actual vehicle component, and a rotation of the virtual vehicle component based on the determined rotation of the actual vehicle component; determine the overlay image comprising the virtual vehicle component, wherein the virtual vehicle component: is placed within the overlay image according to the determined position of the virtual vehicle component, is tilted within the overlay image according to the determined tilt of the virtual vehicle component, is rotated within the overlay image according to the determined rotation of the virtual vehicle component, and has a virtual composition the conforms to the structural composition of the actual vehicle component of the actual vehicle; and effectuate displaying of the overlay image on the display such that the virtual vehicle component covers the actual vehicle component and augments the appearance of the actual vehicle component such that a user is caused to perceive the virtual vehicle component and not the actual vehicle component. 10. A method for augmenting an appearance of an actual vehicle component of an actual vehicle with a virtual vehicle component, the method comprising: generating output signals conveying visual information within a field of view of an image sensor; obtaining a vehicle type of the actual vehicle and determining a structural composition of the actual vehicle based on the vehicle type of the actual vehicle; detecting presence of the actual vehicle component within the actual vehicle within the field of view of the image sensor based on the output signals, and determining a position, a tilt, and a rotation of the actual vehicle component within the actual vehicle; selecting the virtual vehicle component based on the vehicle type and the actual vehicle component, the virtual vehicle component including one or more parts of a virtual vehicle conforming to the structural composition of the actual vehicle component of the actual vehicle, the virtual vehicle being of a second vehicle type that is different from the vehicle type of the actual vehicle; determining a position of the virtual vehicle component based on the determined position of the actual vehicle component, a tilt of the virtual vehicle component based on the determined tilt of the actual vehicle component, and a rotation of the virtual vehicle component based on the determined rotation of the actual vehicle component; determining an overlay image comprising the virtual vehicle component, wherein the virtual vehicle component: is placed within the overlay image according to the determined position of the virtual vehicle component, is tilted within the overlay image according to the determined tilt of the virtual vehicle component, is rotated within the overlay image according to the determined rotation of the virtual vehicle component, and has a virtual composition the conforms to the structural composition of the actual vehicle component of the actual vehicle; and effectuating displaying of the overlay image on a display such that the virtual vehicle component covers the actual vehicle component and augments the appearance of the actual vehicle component such that a user is caused to perceive the virtual vehicle component and not the actual vehicle component. 19. A system for augmenting an appearance of an actual vehicle component of an actual vehicle with a virtual vehicle component, the system comprising: an image sensor configured to generate output signals conveying visual information within a field of view of the image sensor; a display configured to display an overlay image; wherein the image sensor is mounted on the display, and wherein the field of view of the image sensor is a function of a position and an orientation of the display; and one or more processors configured by machine readable instructions to: obtain a vehicle type of the actual vehicle and determine a structural composition of the actual vehicle based on the vehicle type of the actual vehicle; detect presence of the actual vehicle component within the actual vehicle within the field of view of the image sensor based on the output signals, and determine a position, a tilt, and a rotation of the actual vehicle component within the actual vehicle; select the virtual vehicle component based on the vehicle type and the actual vehicle component, the virtual vehicle component including one or more parts of a virtual vehicle conforming to the structural composition of the actual vehicle component of the actual vehicle, the virtual vehicle being of a second vehicle type that is different from the vehicle type of the actual vehicle; change the selection of the virtual component based on a user input received through an input device; determine a position of the virtual vehicle component based on the determined position of the actual vehicle component, a tilt of the virtual vehicle component based on the determined tilt of the actual vehicle component, and a rotation of the virtual vehicle component based on the determined rotation of the actual vehicle component; determine the overlay image comprising the virtual vehicle component, wherein the virtual vehicle component: is placed within the overlay image according to the determined position of the virtual vehicle component, is tilted within the overlay image according to the determined tilt of the virtual vehicle component, is rotated within the overlay image according to the determined rotation of the virtual vehicle component, and has a virtual composition the conforms to the structural composition of the actual vehicle component of the actual vehicle; and effectuate displaying of the overlay image on the display such that the virtual vehicle component covers the actual vehicle component and augments the appearance of the actual vehicle component such that a user is caused to perceive the virtual vehicle component and not the actual vehicle component.