Synthesized-viewpoint see-through operator awareness display hardware.
The disclosure is directed a method including capturing image data of a real-world environment at a first location and a second location different than the first location. The image data includes a plurality of intersecting image data points captured at both the first location and the second location, and a representation of an area occluded by an obstacle from a point of view of a user and; generating a synthesized field of view (“FOV”) that includes the plurality of intersecting image data points such that the synthesized FOV includes an unobstructed view of the area occluded by the obstacle from the point of view of the user; and rendering the synthesized FOV as a visual display.
CROSS REFERENCE TO RELATED APPLICATIONS (1) This application claims the benefit of priority pursuant to 35 U.S.C. § 120 of U.S. patent application Ser. No. 16/006,726, filed Jun. 12, 2018, entitled “See-Through Operator Awareness Tool Using Synthesized Viewpoints,” which is hereby incorporated by reference herein in its entirety. BRIEF SUMMARY OF THE DISCLOSURE (2) The disclosure is directed to providing operator visibility through an object that occludes the view of the operator by using a head mounted display (HMD) system in communication with one or more imaging devices. (3) In one embodiment a method, includes: capturing image data of a real-world environment at a first location and a second location different than the first location, wherein the image data includes a plurality of intersecting image data points captured at both the first location and the second location, and a representation of an area occluded by an obstacle from a point of view of a user and; generating a synthesized field of view (“FOV”) that includes the plurality of intersecting image data points such that the synthesized FOV includes an unobstructed view of the area occluded by the obstacle from the point of view of the user; and rendering the synthesized FOV as a visual display. (4) In one embodiment, a non-transitory computer-readable medium having executable instructions stored thereon that, when executed by a processor, cause the processor to: capture image data of a real-world environment at a
1. A method, comprising: capturing first image data of a real-world environment at a first location via a first imaging device and second image data at a second location different than the first location via a second imaging device different than the first imaging device, wherein the first imaging device and the second imaging device are movable together with a user based on a user movement, and wherein the first image data and the second image data includes a plurality of intersecting image data points captured at both the first location and the second location, and a representation of an area in the real world occluded by an obstacle from a point of view of the user; generating a synthesized field of view (“FOV”) that includes the plurality of intersecting image data points such that the synthesized FOV includes an unobstructed view of the area in the real world occluded by the obstacle from the point of view of the user, wherein the unobstructed view is mapped into the synthesized FOV as a patch including the plurality of intersecting image data points included in both the first image data captured at the first location and the second image data captured at the second location; overlaying the synthesized FOV with video data corresponding to the point of view of the user; and rendering the synthesized FOV as a visual display. ||
9. A non-transitory computer-readable medium having executable instructions stored thereon that, when executed by a processor, cause the processor to: capture first image data of a real-world environment at a first location via a first imaging device and second image data at a second location different than the first location via a second imaging device different than the first imaging device, wherein the first imaging device and the second imaging device are movable together with a user based on a user movement, and wherein the first image data and the second image data includes a plurality of intersecting image data points captured at both the first location and the second location, and a representation of an area occluded by an obstacle from a point of view of a user; generate a synthesized field of view (“FOV”) that includes the plurality of intersecting image data points such that the synthesized FOV includes an unobstructed view of the area occluded by the obstacle from the point of view of the user, wherein the unobstructed view is mapped into the synthesized FOV as a patch including the plurality of intersecting image data points included in both the first image data captured at the first location and the second image data captured at the second location; overlay the synthesized FOV with video data corresponding to the point of view of the user; and render the synthesized FOV as a visual display. ||
15. A visual display system, comprising: a display; a first imaging device; and a second imaging device different than the first imaging device, a processor in communication with the display and configured to: receive first image data of a real-world environment captured at a first location via the first imaging device and second image data at a second location different than the first location via the second imaging device, wherein the first imaging device and the second imaging device are movable together with a user based on a user movement, and wherein the first image data and the second image data includes a plurality of intersecting image data points captured at both the first location and the second location, and a representation of an area occluded by an obstacle from a point of view of a user; generate a synthesized field of view (“FOV”) that includes the plurality of intersecting image data points such that the synthesized FOV includes an unobstructed view of the area occluded by the obstacle from the point of view of the user, wherein the unobstructed view is mapped into the synthesized FOV as a patch including the plurality of intersecting image data points included in both the first image data captured at the first location and the second image data captured at the second location; overlay the synthesized FOV with video data corresponding to the point of view of the user; and render the synthesized FOV on the display.