INTELLIGENT PHOTOGRAPHY WITH MACHINE LEARNING

Number: 20200259999
Published: 2020-08-13
Filed: 2020-01-15
Assignee: Disney Enterprises, Inc.
Inventors: ADAMS; Mathew G., KIRKLEY; Jere M., JENKINS; Jason B.
CPC: H04N23/611; G06N3/08; H04N23/90; H04N23/661; G06N3/09; G06N3/0464; H04N23/64
Verdict: Low Notable software
Source: Google Patents · FreePatentsOnline

The keeper's note

ML-driven intelligent camera automation.

Abstract

Embodiments of the present disclosure relate to intelligent photography with machine learning. Embodiments include receiving a video stream from a control camera. Embodiments include providing inputs to a trained machine learning model based on the video stream. Embodiments include determining, based on data output by the trained machine learning model in response to the inputs, at least a first time for capturing a first picture during a session. Embodiments include programmatically instructing a first camera to capture the first picture at the first time during the session.

Background

BACKGROUNDField of the Invention

The present invention generally relates to intelligent photography, and more specifically to techniques for using machine learning to determine indications for programmatically capturing photographs.Description of the Related Art

Photography generally involves analyzing a scene in order to determine optimal times for taking pictures, as well as identifying other optimal parameters, such as angles, exposures, and the like, for taking the pictures. When photographing live subjects, photographers generally observe the behavior of the subjects in order to determine photo-worthy events and optimal moments for capturing pictures.

In many settings, such as public places, photo-worthy events may occur frequently. For example, at theme parks, landmarks, sporting events, concerts and other public attractions, visitors are often photographed by both human and automated photographers and then provided with pictures of their visit, and may be given opportunities to purchase the pictures. Existing automated techniques, such as automatically capturing pictures at regular intervals for subsequent best-shot selection or post-processing to crop and improve photographs, may be inefficient and unresponsive to real-time circumstances. Furthermore, behavior of subjects may be unpredictable, making it more difficult to use systems based on fixed cues (e.g., regular intervals) for capturing pictures, as it is unlikely that such systems would success

Claims

1. A method performed by a first computing device, comprising: receiving a video stream from a control camera; providing inputs to a trained machine learning model based on the video stream; determining, based on data output by the trained machine learning model in response to the inputs, at least a first time for capturing a first picture during a session; and programmatically instructing a first camera to capture the first picture at the first time during the session. 9. A non-transitory computer-readable medium comprising instructions that, when executed by one or more processors, cause the one or more processors to perform a method, the method comprising: receiving a video stream from a control camera; providing inputs to a trained machine learning model based on the video stream; determining, based on data output by the trained machine learning model in response to the inputs, at least a first time for capturing a first picture during a session; and programmatically instructing a first camera to capture the first picture at the first time during the session. 17. A system, comprising: one or more processors; and a non-transitory computer-readable medium comprising instructions that, when executed by the one or more processors, cause the one or more processors to perform a method, the method comprising: receiving a video stream from a control camera; providing inputs to a trained machine learning model based on the video stream; determining, based on data output by the trained machine learning model in response to the inputs, at least a first time for capturing a first picture during a session; and programmatically instructing a first camera to capture the first picture at the first time during the session.