AUGMENTED REALITY MUSIC COMPOSITION

Number: 20170287456
Published: 2017-10-05
Filed: 2017-05-09
Assignee: DISNEY ENTERPRISES, INC.
Inventors: ZUND; FABIO, MARRA; ALESSIA, NITTI; MAURIZIO, RYFFEL; MATTIA, SUMNER; ROBERT
CPC: A63F13/92; A63F13/814; G10H1/0025; H04N5/44504; A63F13/213; A63F13/211; G06T19/006; G06T13/20; G10H1/368; G06V20/20; A63F13/25
Verdict: Medium Notable software
Source: Google Patents · FreePatentsOnline

The keeper's note

An AR music composition system where physical image markers representing musical entities/styles let a user re-arrange a musical track by rearranging the markers (PGPUB duplicate).

Abstract

Systems and methods for re-arranging a musical composition using augmented reality are disclosed. A user can be provided with one or more physical image markers representative of at least one of a musical entity and a musical style in which a musical track has been pre-recorded. Upon capturing a visual scene in which one or more of these physical image markers are included, an augmented reality version of the visual scene is displayed along withaudio corresponding to the musical style(s) and/or entities represented by the one or more physical image markers.

Background

BRIEF DESCRIPTION OF THE DRAWINGS

The present disclosure, in accordance with one or more various embodiments, is described in detail with reference to the following figures. Thefigures are provided for purposes of illustration only and merely depict typical or example embodiments.

FIG. 1 is an operational flow diagram illustrating an example process for augmented reality music composition in accordance with various embodiments.

FIG. 2A illustrates an example augmented reality device in accordance with various embodiments.

FIGS. 2B-2D illustrate example augmented reality interactions and presentations in accordance with various embodiments.

FIG. 3 is an example computing module that may be used to implement various features of embodiments described in the present disclosure.

The figures are not exhaustive and do not limit the present disclosure to the precise form disclosed.DETAILED DESCRIPTION

Existing technology for music composition typically focuses on software solutions for professionals. For example, sound mixing software, MIDI, and other tools allow a user to mix audio tracks, activate and deactivate instruments, modulate sound, etc. However, these software solutions often rely on traditional computer interfaces such as a computer display through which user interface elements like buttons and sliders, files, menus, etc. are presented. The majority of music composition software solutions targets professionals. The few aimed at h

Claims

1. A computer-implemented method, comprising: capturing a visual scene; identifying a physical image marker within the visual scene, the physical image marker representing a first musical entity; augmenting the visual scene with the augmented reality version of the physical image marker; outputting an augmented reality version of the visual scene for display as part of a computerized game in conjunction with audio output based upon a first portion of a musical arrangement of a musical composition, the first portion of the musical arrangement comprising a first musical style and sound characteristics associated with the first musical entity, the musical arrangement being re-arrangeable within the augmented reality version of the visual scene; and advancing gameplay within the computerized game upon a determination that the musical arrangement maintainsa musical theme and impression of the musical composition. 5. A computer-implemented method, comprising: capturing a visual scene; identifying a first set of physical image markers within the visual scene, the first set of physical image markers representing a first set of musical entities; augmenting the visual scene with augmented reality versions of the first set of physical image markers; outputting an augmented reality version of the visualscene for display as part of a computerized game in conjunction with audio output based upon a first musical arrangement of a musical composition, the first musical arrangement comprising a first musical style and sound characteristics associated with the first set of musical entities, the first musical arrangement being re-arrangeable within the augmented reality version of the visual scene; comparing the first musical arrangement with a secondmusical arrangement; and determining a preferred musical arrangement between the first musical arrangement and the second musical arrangement. 11. An apparatus, comprising: at least one camera capturing a visual scene; an augmented reality component identifying a physical image marker within the visual scene, the physical image marker representing a first musical entity, and augmenting the visual scene with the augmented reality version of the physical image marker; a display displaying an augmented reality version of the visual scene; and one or more speakers outputting audio in conjunction with the augmented reality version of the visual scene and based upon a first portion of a musical arrangement of a musical composition, the first portion of the musical arrangement comprising a first musical style and sound characteristics associated with the first musical entity, the musical arrangement being re-arrangeable within the augmented reality version of the visual scene whilemaintaining a musical theme and impression of the musical composition.