Three dimensional content projection (projection hardware).
The present application relates generally to a projection system and method for projecting content onto a moving performer. In one embodiment, the system includes a projector that projects light onto the performer, a position sensor, such as a camera and/or depth sensor that captures position information about the performer, and a computer that modifies original content based on the position information of the performer. The computer uses the position information to generate a mask, such as a silhouette, of the performer, and then modifies the original content based on the mask of the performer. The modified content is then projected by the projector onto the performer.
FIELD(1) The present disclosure relates generally to systems and methods for projecting content onto moving objects, actors, or characters.BACKGROUND(2) Performances and entertainment attractions often use projection systems to project content onto objects as part of the performance and/or to enhance the aesthetics of the objects, scenery, etc. For example, during a performance, a blank object may be transformed into a mysterious cave through the use of projected content. In some instances it may be desirable to project content onto a moving object, such as an actor or character that is moving across the stage or other performance area. Conventional projection systems use two dimensional tracking of a moving object and use the two dimensional information to project content onto the object. These systems allow content to be projected in a single area, but the content does not appear to “stick to” or move with the object. Accordingly, most of these systems produce effects such as an object walking through a colored object (e.g., a painting) but cannot replicate an effect of a content formed on the moving object, such as a projected logo that moves with and changes in appearance based on the orientation of the moving object. The present disclosure includes techniques and systems for improving the content projection allowing different types of effects and more realistic content projection than conventional systems.SUMMARY(3) One embodiment of the present disclosure may take the f
1. A method for modifying content projected onto a moving performer, the method comprising: receiving by one or more processing elements an original content image; receiving by one or more processing elements two dimensional positional data and three dimensional positional data corresponding to the performer, wherein the three dimensional positional data is directly received by tracking motion of the moving performer; utilizing by the one or more processing elements the two-dimensional positional data to generate a mask corresponding to a representation of the performer; utilizing by the one or more processing elements the three-dimensional positional data to generate a modified three-dimensional content image; constraining by one or more processing elements the modified three-dimensional content image by the mask to generate a masked output image, wherein the masked output image has a projection area that is different from a projection area of the modified three-dimensional content; and projecting the masked output image onto the moving performer. |
3. A method for projecting content onto a performer, comprising: receiving by a processing element detected two-dimensional data corresponding to a two-dimensional representation of the performer within a location; receiving by the processing element from a three-dimensional sensor, a detected three-dimensional position of the performer within the location, wherein the three-dimensional position sensor directly tracks the performer; generating by a processing element a mask based on the received two-dimensional data, wherein the mask corresponds to the two-dimensional representation of the performer; rendering three dimensional content by the processing element, wherein the three dimensional content is based on the detected three dimensional position of the performer, such that the three-dimensional content is rendered to match the detected three-dimensional position of the performer and has a content boundary; applying the mask to the rendered three dimensional content to set a projection boundary of the three dimensional content, wherein the projection boundary is different from the content boundary; and projecting by a projector the masked three dimensional content onto the performer, wherein the masked three dimensional content is projected within the projection boundary and three dimensional content falling within the content boundary but falling outside of the projection boundary is not projected. |
7. A projection system for projecting content onto a performer, the system comprising: a projector for projecting light onto the performer; a camera for capturing a two-dimensional image of the performer; a three dimensional position sensor for capturing three dimensional position information of the performer; and a computer in electronic communication with the projector, the camera, and the position sensor, wherein the computer is configured to perform the following operations: receive initial content for projection onto the performer; generate a silhouette of the performer based on the two-dimensional image of the performer; generate an updated content based on the captured three dimensional position information of the performer; setting a two dimensional perimeter of the updated content based on the silhouette of the performer to generate a modified content; and provide the modified content to the projector for projection onto the performer; and wherein the projector projects the modified content onto the performer. |
11. The projection system of 13, wherein to modify the initial content based on the silhouette of the performer, the computer constrains a projection area of the initial content to the silhouette of the performer.