AUTOMATED HAPTICS GENERATION AND DISTRIBUTION

Number: 20230044961
Published: 2023-02-09
Filed: 2022-08-08
Assignee: Disney Enterprises, Inc.
Inventors: Resnick; David S. et al.
CPC: G08B6/00; G06F3/016; G06V20/44; G06F3/017; G06V10/7715; H04N21/4104
Verdict: Low Hardware
Source: Google Patents · FreePatentsOnline

The keeper's note

Automated haptic-effects generation/distribution hardware.

Abstract

Embodiments provide systems and techniques for automated haptics generation and distribution. An example technique includes receiving media content from a computing device. The media content includes at least one of audio content or video content. One or more features of the media content is determined. A set of haptic data is generated for the media content, based on evaluating the one or more features of the media content with at least one machine learning model. Another example technique includes obtaining a set of haptic data associated with media content. The set of haptic data, metadata, and the media content is transmitted to a computing device.

Background

INTRODUCTION

The present disclosure generally relates to haptic technology. More specifically, embodiments disclosed herein provide techniques for generating haptic data for media content and techniques for distributing (or transmitting) the haptic data for generation of haptic effects, such as haptic vibrations, during playback of media content.

Haptics has added a new dimension to modern entertainment and media applications, enhancing user interaction and immersion. Recent haptic technologies generally involve supplementing audio content with dynamic and engaging haptic effects that can be perceived by a user’s body. The haptic effects are generally based on haptic signals that are generated by converting one or more attributes of the audio signals (e.g., pitch, frequency) into one or more corresponding attributes of haptic signals (e.g., amplitude, frequency). For example, some haptic generation techniques can convert attributes of the audio (e.g., pitch, frequency, etc.) to corresponding attributes (e.g., amplitude of vibration, frequency of vibration, etc.) of haptics. In some cases, generating haptics in this manner can lead to a poor user experience during streaming of media content. For example, the generated haptic effect may not be the correct haptic effect for the particular context of a scene (e.g., haptic effect is generated for an event which is heard in the audio content but not visible in the video content), the generated haptic effects can overw

Claims

1. A computer-implemented method comprising: receiving media content from a computing device, wherein the media content comprises at least one of audio content or video content; determining one or more features of the media content; and generating a first set of haptic data for the media content, based on evaluating the one or more features of the media content with at least one first machine learning model. || 13. A computing system comprising: one or more processors; and a memory storing instructions, which, when executed on the one or more processors perform an operation comprising: receiving media content from a computing device, wherein the media content comprises at least one of audio content or video content; determining one or more features of the media content; and generating a first set of haptic data for the media content, based on evaluating the one or more features of the media content with at least one first machine learning model. || 15. A computer-implemented method comprising: obtaining a set of haptic data associated with media content, wherein: the media content comprises one or more audio files, one or more video files, and metadata; and the set of haptic data comprises a plurality of haptic files, each indicating haptic effects to be generated during streaming of the media content; and transmitting the set of haptic data, the one or more audio files, the one or more video files, and the metadata.