OPTIMIZATION FOR TECHNICAL TARGETS IN AUDIO CONTENT

Number: 20240038256
Published: 2024-02-01
Filed: 2022-08-01
Assignee: Lucasfilm Entertainment Company Ltd. LLC
Inventors: TSINGOS; NICOLAS et al.
CPC: G10L25/21; G10L21/0316; H03G3/3005
Verdict: Set aside generic audio loudness/optimization processing
Source: Google Patents · FreePatentsOnline

Abstract

Some implementations of the disclosure relate to a non-transitory computer-readable medium having executable instructions stored thereon that, when executed by a processor, cause a system to perform operations comprising: obtaining a first energy-based target for audio; obtaining a first version of a sound mix including one or more audio components; computing, for each audio frame of multiple audio frames of each of the one or more audio components, a first audio feature measurement value; optimizing, based at least on the first energy-based target and the first audio feature measurement values, gain values of the audio frames; and after optimizing the gain values, applying the gain values to the first version of sound mix to obtain a second version of the sound mix.

Background

BRIEF SUMMARY OF THE DISCLOSURE

Implementations of the disclosure are directed to systems and methods for optimizing audio content for energy-based audio targets. In some cases multiple concurrent technical targets may be globally optimized for.

In one embodiment, a non-transitory computer-readable medium has executable instructions stored thereon that, when executed by a processor, cause a system to perform operations comprising: obtaining a first energy-based target for audio; obtaining a first version of a sound mix including one or more audio components; computing, for each audio frame of multiple audio frames of each of the one or more audio components, a first audio feature measurement value; optimizing, based at least on the first energy-based target and the first audio feature measurement values, gain values of the audio frames; and after optimizing the gain values, applying the gain values to the first version of sound mix to obtain a second version of the sound mix.

In some implementations, optimizing, based at least on the first energy-based target and the first audio feature measurement values, the gain values comprises: initializing the gain values; and iteratively: updating, based on the gain values, the first audio feature measurement values to obtain updated first audio feature measurement values computing, based at least on the first energy-based target and the updated first audio feature measurement values, a value of a loss function; af

Claims

1. A non-transitory computer-readable medium having executable instructions stored thereon that, when executed by a processor, cause a system to perform operations comprising: obtaining a first energy-based target for audio; obtaining a first version of a sound mix including one or more audio components; computing, for each audio frame of multiple audio frames of each of the one or more audio components, a first audio feature measurement value; optimizing, based at least on the first energy-based target and the first audio feature measurement values, gain values of the audio frames; and after optimizing the gain values, applying the gain values to the first version of sound mix to obtain a second version of the sound mix. || 18. A method, comprising: obtaining, at a computing device, a first energy-based target for audio; obtaining, at the computing device, a first version of a sound mix including one or more audio components; computing, at the computing device, for each audio frame of multiple audio frames of each of the one or more audio components, a first audio feature measurement value; optimizing, at the computing device, based at least on the first energy-based target and the first audio feature measurement values, gain values of the audio frames; and after optimizing the gain values, applying, at the computing device, the gain values to the first version of sound mix to obtain a second version of the sound mix. || 20. A system, comprising: one or more processors; and one or more non-transitory computer-readable mediums having executable instructions stored thereon that, when executed by the one or more processors, cause the system to perform operations comprising: obtaining a first energy-based target for audio; obtaining a first version of a sound mix including one or more audio components; computing, for each audio frame of multiple audio frames of each of the one or more audio components, a first audio feature measurement value; optimizing, based at least on the first energy-based target and the first audio feature measurement values, gain values of the audio frames; and after optimizing the gain values, applying the gain values to the first version of sound mix to obtain a second version of the sound mix.