- Number
- 11544585
- Published
- 2023-01-03
- Filed
- 2018-11-13
- Assignee
- Disney Enterprises, Inc.
- Inventors
- Ahringer; Adam S. et al.
- CPC
- G06N5/04; H04N21/251; G06N20/00; H04L67/12; H04N21/258; H04N21/63
- Verdict
- Set aside viewer-behavior analytics, business
- Source
- Google Patents · FreePatentsOnline
Abstract
Systems, methods and articles of manufacture for are provided for analyzing user behavior in real time by ingesting telemetry data related to a streaming media application; feeding the telemetry data to a machine learning model (MLM) that produces a User Experience (UX) command based on the telemetry data and prior telemetry data received from the content streaming application; selecting content items to provide to the client device based on the telemetry data; determining, based on the telemetry data, whether the client device has sufficient free resources to receive the UX command and the content items in a current time window while providing a predefined level of service; when client device has sufficient free resources to receive the UX command and the content items, encapsulating the UX command with the content items in a content stream; and transmitting the content stream to the client device.
Background
BACKGROUND (1) Streaming applications provide digital video content to users on demand via various computing devices through the internet. The control and management of streaming applications may be affected by commands input by the viewer (e.g., play a first content item, pause a second content item, turn on captions in a third content item) and behaviors observed by the provider to provide a personalized experience to the individual viewers (e.g., a first viewer watches science fiction but not fantasy—prioritize recommending science fiction content and deprecate recommending fantasy content; a second viewer frequently pauses playback—adjust caching priorities for provisioning continent to the second viewer; a third user frequently turns on captioning—turn on captioning by default for the third user). The management of the content delivery may be managed locally to the viewer via application settings, or may be managed remotely from the viewer by a content provider. (2) Content providers are provided viewer behavior data in batches to manage streaming applications. Batches of data may include several elements of viewer behavior collected over various time periods. Batched data may be useful in non-real-time management of the streaming application, but are of limited use in real-time management of viewer behaviors, as those data may be received out of sync from the content stream provided to the viewer, and take significant time to process, thus lagging behind the viewer's co
Claims
1. A method, comprising: ingesting, in real-time, current telemetry data from a client device related to a streaming media application; feeding the current telemetry data to one or more machine learning models (MLMs) of a behavior analysis engine that produces, in real-time, one or more User Experience (UX) commands based on results obtained from feeding the current telemetry data and prior telemetry data received from the streaming media application into the one or more MLMs, the one or more MLMs including an anomaly detector trained to recommend adjustments based on identifying how network characteristics of client devices affect content delivery, wherein the one or more UX commands comprise a delivery command to adjust content delivery settings on the client device, and wherein feeding the current telemetry data to the one or more MLMs comprises identifying the content delivery settings based on operation data in the current telemetry data and in the prior telemetry data, the content delivery settings comprising content delivery pathway settings; selecting content items to provide to the client device based on the current telemetry data; in response to determining that the client device has sufficient free resources to receive the one or more UX commands in addition to the content items in a current transmission time window while providing a predefined level of service, encapsulating the one or more UX commands with the content items in a content stream; and transmitting the content stream to the client device, wherein the content delivery pathway settings on the client device are adjusted based on the prior telemetry data, which indicate an optimized state of the content delivery pathway settings. ||
8. A system, comprising: a processor; and a memory having instructions embodied therewith that when executed by the processor enable the system to perform an operation comprising: ingesting, in real-time, current telemetry data from a client device related to a streaming media application; feeding the current telemetry data to one or more machine learning models (MLMs) of a behavior analysis engine that produces, in real-time, one or more User Experience (UX) commands based on results obtained from feeding the current telemetry data and prior telemetry data received from the streaming media application into the one or more MLMs, the one or more MLMs including an anomaly detector trained to recommend adjustments based on identifying how network characteristics of client devices affect content delivery, wherein the one or more UX commands comprise a delivery command to adjust content delivery settings on the client device, and wherein feeding the current telemetry data to the one or more MLMs comprises identifying the content delivery settings based on operation data in the current telemetry data and in the prior telemetry data, the content delivery settings comprising content delivery pathway settings; selecting content items to provide to the client device based on the current telemetry data; in response to determining that the client device has sufficient free resources to receive the one or more UX commands in addition to the content items in a current transmission time window while providing a predefined level of service, encapsulating the one or more UX commands with the content items in a content stream; and transmitting the content stream to the client device, wherein the content delivery pathway settings on the client device are adjusted based on the prior telemetry data, which indicate an optimized state of the content delivery pathway settings. ||
15. A system, comprising: a processor; a memory having instructions embodied therewith that when executed by the processor enable the system to perform an operation comprising: gathering, in real-time, telemetry data for the system related to a streaming media application receiving a content stream; in response to determining that a free bandwidth of bandwidth available to the system while receiving the content stream satisfies a threshold, transmitting, in real-time, the telemetry data to a streaming server providing the content stream, the streaming server including a behavior analysis engine configured to produce one or more User Experience (UX) commands based on results obtained from feeding the telemetry data to one or more machine learning models (MLMs), the one or more MLMs including an anomaly detector trained to recommend adjustments based on identifying how network characteristics of client devices affect content delivery, wherein the one or more UX commands comprise a delivery command, and wherein feeding the telemetry data to the one or more MLMs comprises identifying content delivery settings based on operation data in the telemetry data, the content delivery settings comprising content delivery pathway settings; and in response to receiving the delivery command, adjusting the content delivery settings, including the content delivery pathway settings, in the streaming media application based on the telemetry data, which indicate an optimized state of the content delivery pathway settings, wherein the delivery command is included in the content stream.