- Number
- 20180059780
- Published
- 2018-03-01
- Filed
- 2016-08-24
- Assignee
- DISNEY ENTERPRISES, INC.
- Inventors
- Mitchell; Kenneth J.; Cosker; Darren; Swafford; Nicholas T.
- CPC
- A63F13/21; A63F13/52; G06F3/012; G06F3/013; G06T15/20; G06T3/40; G06T13/20
- Verdict
- Medium Notable software
- Source
- Google Patents · FreePatentsOnline
The keeper's note
Latency-aware focal-area animation rendering.
Abstract
Individual images for individual frames of an animation may be rendered to include individual focal areas. A focal area may include one or more of a foveal region corresponding to a gaze direction of a user, an area surrounding the foveal region, and/or other components. The foveal region may comprise a region along the user's line of sight that permits high visual acuity with respect to a periphery of the line of sight. A focal area within an image may be rendered based on parameter values of rendering parameters that are different from parameter values for an area outside the focal area.
Background
FIELD OF THE DISCLOSURE
This disclosure relates to a system and method of latency-aware rendering of a focal area of an animation.BACKGROUND
When rendering digital images in animations, it is often assumed that the human visual system is perfect, despite limitations arising from a variety of different complexities and phenomena. That is, current methods of real-time rendering of a digital animation may operate on an assumption that a single rendered frame image will be fully visually appreciated at any single point in time. However, peripheral vision may be significantly worse than foveal vision in many ways, and these differences may not be explained solely by a loss of acuity. However, acuity sensitivity still forms a significant portion of peripheral detail loss and can be a phenomena to exploit.
One method of exploitation, termed “foveated rendering” or “foveated imaging,” implements a high-resolution render of a particular region of individual frame images. A users gaze may be tracked so that the high-resolution render is positioned on the images to correspond with a user's foveal region. An area surrounding the high-resolution region is then rendered at relatively lower resolution. However, users may experience visual anomaly when prompted about the fact. Other techniques have implemented a foveated rendering method with spatial and temporal property variation. With such techniques, at a certain level-of-detail (LOD), users may experience the foveated
Claims
1. A system configured for latency-aware rendering of a focal area of an animation presented on a display, wherein the animation includes a sequence of frames, the sequence of frames including a first frame, the system comprising: one or more physical processors configured by machine-readable instructions to: obtain state information describing state of a virtual space, the state at an individual point in time defining one or more virtual objects within the virtual space and their positions; determine a field of view of the virtual space, the frames of the animation being images of the virtual space within the field of view, such that the first frame is an image of the virtual space within the field of view at a point in time that corresponds to the first frame; determine a gaze direction of a user within the field of view, the gaze direction defining a light of sight of the user, the user viewing the animation via the display; obtain gaze adjustment latency, wherein the gaze adjustment latency quantifies latency in determining changes in the gaze direction and making corresponding adjustments to a focal area within the field of view; determine the focal area within the field of view based on the gaze direction and gaze adjustment latency, the focal area including a foveal region corresponding to the gaze direction and an area surrounding the foveal region, wherein the foveal region is a region along the user's line of sight that permits high visual acuity with respect to a periphery of the line of sight; and render, from the state information, individual images for individual frames of the animation, individual images depicting the virtual space within the field of view determined at individual points in time that corresponds to individual frames, the rendered images including a first image for the first frame, the first image depicting the virtual space within the field of view at the point in time corresponding to the first frame, wherein the focal area within the field of view is rendered at a higher resolution than an area outside the focal area.
12. A method of latency-aware rendering of a focal area of an animation presented on a display, the animation including a sequence of frames, the sequence of frames including a first frame, the method being implemented in a computer system comprising one or more physical processors and storage media storing machine-readable instructions, the method comprising: obtaining state information describing state of a virtual space, the state at an individual point in time defining one or more virtual objects within the virtual space and their positions; determining a field of view of the virtual space, the frames of the animation being images of the virtual space within the field of view, such that the first frame is an image of the virtual space within the field of view at a point in time that corresponds to the first frame; determining a gaze direction of a user within the field of view, the gaze direction defining a light of sight of the user, the user viewing the animation via the display; obtaining gaze adjustment latency, wherein the gaze adjustment latency quantifies latency in determining changes in the gaze direction and making corresponding adjustments to a focal area within the field of view; determining the focal area within the field of view based on the gaze direction and gaze adjustment latency, the focal area including a foveal region corresponding to the gaze direction and an area surrounding the foveal region, wherein the foveal region is a region along the user's line of sight that permits high visual acuity with respect to a periphery of the line of sight; and rendering, from the state information, individual images for individual frames of the animation, individual images depicting the virtual space within the field of view determined at individual points in time that corresponds to individual frames, including rendering a first image for the first frame, the first image depicting the virtual space within the field of view at the point in time corresponding to the first frame, wherein the focal area within the field of view is rendered at a higher resolution than an area outside the focal area.