Augmented reality music composition

Number: 9679547
Published: 2017-06-13
Filed: 2016-04-04
Assignee: Disney Enterprises, Inc.
Inventors: Zund; Fabio, Marra; Alessia, Nitti; Maurizio, Ryffel; Mattia, Sumner; Robert
CPC: A63F13/25; G06T13/20; A63F13/814; A63F13/211; G06T19/006; G06V20/20; G10H1/0025; H04N5/44504; A63F13/92; G10H1/368; A63F13/213
Verdict: Medium Notable software
Source: Google Patents · FreePatentsOnline

The keeper's note

An AR music composition system where physical image markers representing musical entities/styles let a user re-arrange a musical track by rearranging the markers.

Abstract

Systems and methods for re-arranging a musical composition using augmented reality are disclosed. A user can be provided with one or more physical image markers representative of at least one of a musical entity and a musical style in which a musical track has been pre-recorded. Upon capturing a visual scene in which one or more of these physical image markers are included, an augmented reality version of the visual scene is displayed along with audio corresponding to the musical style(s) and/or entities represented by the one or more physical image markers.

Background

BRIEF DESCRIPTION OF THE DRAWINGS(1) The present disclosure, in accordance with one or more various embodiments, is described in detail with reference to the following figures. The figures are provided for purposes of illustration only and merely depict typical or example embodiments.(2) FIG. 1 is an operational flow diagram illustrating an example process for augmented reality music composition in accordance with various embodiments.(3) FIG. 2A illustrates an example augmented reality device in accordance with various embodiments.(4) FIGS. 2B-2D illustrate example augmented reality interactions and presentations in accordance with various embodiments.(5) FIG. 3 is an example computing module that may be used to implement various features of embodiments described in the present disclosure.(6) The figures are not exhaustive and do not limit the present disclosure to the precise form disclosed.DETAILED DESCRIPTION(7) Existing technology for music composition typically focuses on software solutions for professionals. For example, sound mixing software, MIDI, and other tools allow auser to mix audio tracks, activate and deactivate instruments, modulate sound, etc. However, these software solutions often rely on traditional computer interfaces such as a computer display through which user interface elements like buttons and sliders, files, menus, etc. are presented. The majority of music composition software solutions targets professionals. The few aimed at hobbyists still rely o

Claims

1. A computer-implemented method, comprising: capturing a visual scene; identifying a physical image marker within the visual scene, the physical image marker representing a first musical entity; augmenting the visual scene with the augmented reality version of the physical image marker; and outputting an augmented reality version of the visual scene for display in conjunction with audio output based upon a first portion of a musical arrangement of a musical composition, the first portion of the musical arrangement comprising a first musical style and sound characteristicsassociated with the first musical entity, the musical arrangement being re-arrangeable within the augmented reality version of the visual scene while maintaining a musical theme and impression of the musical composition. 15. An apparatus, comprising: at least one camera capturing a visual scene; an augmented reality component identifying a physical image marker within the visual scene, the physical image marker representing a first musical entity, and augmenting the visual scene with the augmented reality version of the physical image marker; a display displaying an augmented reality version of the visual scene; and one or more speakers outputting audio in conjunction with the augmented reality version of the visual scene and based upon a first portion of a musical arrangement of a musical composition, the first portion of the musical arrangement comprising a first musical style and sound characteristics associated with the first musical entity, the musical arrangement beingre-arrangeable within the augmented reality version of the visual scene while maintaininga musical theme and impression of the musical composition.