Optimization for technical targets in audio content

Number: 12424234
Published: 2025-09-23
Filed: 2022-08-01
Assignee: Lucas Entertainment Company Ltd. LLC
Inventors: Tsingos; Nicolas et al.
CPC: G10L25/21; H03G3/3005; G10L21/0316
Verdict: Set aside generic audio loudness/optimization processing
Source: Google Patents · FreePatentsOnline

Abstract

Some implementations of the disclosure relate to a non-transitory computer-readable medium having executable instructions stored thereon that, when executed by a processor, cause a system to perform operations comprising: obtaining a first energy-based target for audio; obtaining a first version of a sound mix including one or more audio components; computing, for each audio frame of multiple audio frames of each of the one or more audio components, a first audio feature measurement value; optimizing, based at least on the first energy-based target and the first audio feature measurement values, gain values of the audio frames; and after optimizing the gain values, applying the gain values to the first version of sound mix to obtain a second version of the sound mix.

Background

BRIEF SUMMARY OF THE DISCLOSURE (1) Implementations of the disclosure are directed to systems and methods for optimizing audio content for energy-based audio targets. In some cases multiple concurrent technical targets may be globally optimized for. (2) In one embodiment, a non-transitory computer-readable medium has executable instructions stored thereon that, when executed by a processor, cause a system to perform operations comprising: obtaining a first energy-based target for audio; obtaining a first version of a sound mix including one or more audio components; computing, for each audio frame of multiple audio frames of each of the one or more audio components, a first audio feature measurement value; optimizing, based at least on the first energy-based target and the first audio feature measurement values, gain values of the audio frames; and after optimizing the gain values, applying the gain values to the first version of sound mix to obtain a second version of the sound mix. (3) In some implementations, optimizing, based at least on the first energy-based target and the first audio feature measurement values, the gain values comprises: initializing the gain values; and iteratively: updating, based on the gain values, the first audio feature measurement values to obtain updated first audio feature measurement values computing, based at least on the first energy-based target and the updated first audio feature measurement values, a value of a loss function; after compu

Claims

1. A non-transitory computer-readable medium having executable instructions stored thereon that, when executed by a processor, cause a system to perform operations comprising: obtaining a first energy-based target for audio; obtaining a first version of a sound mix including multiple audio components, the first version of the sound mix corresponding to a first language; computing, for each audio frame of multiple audio frames of each of the audio components, a first audio feature measurement value; computing a relative energy balance between multiple audio components of a second version of the sound mix corresponding to a second language; optimizing, based at least on the first energy-based target, the first audio feature measurement values, and the relative energy balance, gain values of the audio frames; and after optimizing the gain values, applying the gain values to the first version of the sound mix to obtain a third version of the sound mix.