Outer Rim Archives
Archives · 2022 · 20220197384

Application (pre-grant publication)

HAPTIC CONTENT PRESENTATION AND IMPLEMENTATION

Number
20220197384
Published
2022-06-23
Filed
2020-12-17
Assignee
Disney Enterprises, Inc.
Inventors
GOLDBERG; Evan M., BAKER; Daniel L., ROGOW; Jackson A.
CPC
G06F3/016; G06F3/041; G06F3/04842; G06F3/0488; G06F3/04886; G06F3/16; G06F3/167; G06V10/462; G06V20/46; G08B6/00; G09B21/003; G09B21/007
Verdict
Low Hardware
Source
Google Patents · FreePatentsOnline

The keeper's note

Haptic-content presentation hardware/system.

Abstract

A method includes displaying, on a touchscreen, a video comprising a video frame and determining, based on a saliency map of the video frame, a region of interest in the video frame. The method also includes detecting a touch on a region of the touchscreen while the video frame is displayed and generating a haptic response in response to determining that the region of the touchscreen overlaps with the region of interest.

Background

BACKGROUND

Video content is viewed and enjoyed by hundreds of millions of people on a daily basis (e.g., on computers, smartphones, televisions, etc.). The blind or visually impaired, however, encounter challenges when consuming video. Because they cannot fully see the video, other techniques are used to communicate what is occurring in the video. For example, a descriptive audio track may play during different portions of the video to describe the events that are being shown in the video. These techniques, however, interfere with the presentation of the content. For example, the descriptive audio may conflict with the regular audio track for the video, as it is played over the top of the main audio track. SUMMARY

According to an embodiment, a method includes displaying, on a touchscreen, a video comprising a video frame and determining, based on a saliency map of the video frame, a region of interest in the video frame. The method also includes detecting a touch on a region of the touchscreen while the video frame is displayed and generating a haptic response in response to determining that the region of the touchscreen overlaps with the region of interest. Other embodiments include an apparatus and a system that perform this method.

Claims

1. A method comprising: displaying, on a touchscreen, a video comprising a video frame; determining, based on a saliency map of the video frame, a region of interest in the video frame; detecting a touch on a region of the touchscreen while the video frame is displayed; and generating a haptic response in response to determining that the region of the touchscreen overlaps with the region of interest. || 8. An apparatus comprising: a touchscreen configured to display a video comprising a video frame; and a hardware processor communicatively coupled to the touchscreen, the hardware processor configured to: determine, based on a saliency map of the video frame, a region of interest in the video frame; detect a touch on a region of the touchscreen while the video frame is displayed; and generate a haptic response in response to determining that the region of the touchscreen overlaps with the region of interest. || 15. A system comprising: a server configured to communicate a video comprising a video frame; and a computing device comprising: a touchscreen configured to display the video from the server; and a hardware processor communicatively coupled to the touchscreen, the hardware processor configured to: determine, based on a saliency map of the video frame, a region of interest in the video frame; detect a touch on a region of the touchscreen while the video frame is displayed; and generate a haptic response in response to determining that the region of the touchscreen overlaps with the region of interest.