Haptic content presentation and implementation

Number: 11604516
Published: 2023-03-14
Filed: 2020-12-17
Assignee: Disney Enterprises, Inc.
Inventors: Goldberg; Evan M. et al.
CPC: G06F3/016; G06F3/041; G06F3/04842; G06F3/0488; G06F3/04886; G06F3/16; G06F3/167; G06V10/462; G06V20/46; G08B6/00; G09B21/003; G09B21/007
Verdict: Low Hardware
Source: Google Patents · FreePatentsOnline

The keeper's note

Haptic-content presentation hardware/system (granted).

Abstract

A method includes displaying, on a touchscreen, a video comprising a video frame and determining, based on a saliency map of the video frame, a region of interest in the video frame. The method also includes detecting a touch on a region of the touchscreen while the video frame is displayed and generating a haptic response in response to determining that the region of the touchscreen overlaps with the region of interest.

Background

BACKGROUND (1) Video content is viewed and enjoyed by hundreds of millions of people on a daily basis (e.g., on computers, smartphones, televisions, etc.). The blind or visually impaired, however, encounter challenges when consuming video. Because they cannot fully see the video, other techniques are used to communicate what is occurring in the video. For example, a descriptive audio track may play during different portions of the video to describe the events that are being shown in the video. These techniques, however, interfere with the presentation of the content. For example, the descriptive audio may conflict with the regular audio track for the video, as it is played over the top of the main audio track. SUMMARY (2) According to an embodiment, a method includes displaying, on a touchscreen, a video comprising a video frame and determining, based on a saliency map of the video frame, a region of interest in the video frame. The method also includes detecting a touch on a region of the touchscreen while the video frame is displayed and generating a haptic response in response to determining that the region of the touchscreen overlaps with the region of interest. Other embodiments include an apparatus and a system that perform this method.

Claims

1. A method comprising: displaying, on a touchscreen, a video comprising a video frame; determining, based on a saliency map of the video frame, a region of interest in the video frame; detecting a touch on a region of the touchscreen while the video frame is displayed; in response to determining that the region of the touchscreen overlaps with the region of interest, generating a haptic response having an aspect that is determined based on the saliency map, wherein the aspect comprises at least one of an intensity or a frequency; and varying the aspect based on a gradation of saliency in the saliency map. || 8. An apparatus comprising: a touchscreen configured to display a video comprising a video frame; and a hardware processor communicatively coupled to the touchscreen, the hardware processor configured to: determine, based on a saliency map of the video frame, a region of interest in the video frame; detect a touch on a region of the touchscreen while the video frame is displayed; in response to determining that the region of the touchscreen overlaps with the region of interest, generate a haptic response having an aspect that is determined based on the saliency map, wherein the aspect comprises at least one of an intensity or a frequency; and varying the aspect based on a gradation of saliency in the saliency map. || 15. A system comprising: a server configured to communicate a video comprising a video frame; and a computing device comprising: a touchscreen configured to display the video from the server; and a hardware processor communicatively coupled to the touchscreen, the hardware processor configured to: determine, based on a saliency map of the video frame, a region of interest in the video frame; detect a touch on a region of the touchscreen while the video frame is displayed; in response to determining that the region of the touchscreen overlaps with the region of interest, generate a haptic response having an aspect that is determined based on the saliency map, wherein the aspect comprises at least one of an intensity or a frequency; and varying the aspect based on a gradation of saliency in the saliency map.