Definitions of data terms
The following tables define the common terms used with Tableau reports and the TV Analytics product.
Term | Definition |
|---|---|
Active Account | Any account with any activity during the period selected for filtering. |
Active Session | Any session created without an end of the session, sign out or another end-of-session event in the last 24 hours. |
App Session | Application session from the start of the app to close/stop/exit or time out. |
App name | Supplied by the client a text value to indicate the application name, if not supplied then blank. |
Audience Share | Percentage of the total 'audience' / viewer/devices that are watching the specific piece of content at any one time. For example, if 10 connected devices stream 4 events, and 5 of them are watching event one, then event one has an audience share of 50% . |
Avg content completion | Take the max position value per device, account, and content where the position is >5% of the total run time. add them all up, divide by the number of unique views, count one for each unique device, account, and content where the position is >5% |
Best Devices Worst Devices Device QOE | Best Devices = those devices scoring in the top 10% of devices based on the following criteria. Worst Devices = those devices scoring in the bottom 10% of all devices based on the following criteria. Devices are allocated a score as follows. Buffering event ratio, which uses -1, 0, and 1 to represent poor, moderate, and good states respectively:
Error ratio, which uses -2, 0, and 2 to represent poor, moderate, and good conditions respectively:
Average bitrate, which uses -1, 0, and 1 to indicate suboptimal, acceptable, and excellent levels respectively:
These values are then multiplied by the ratio of the specific devices to overall devices in use to avoid distorting the results based on uncommon devices in use. |
Bitrate Downgrade | When the playout bitrate ‘drops’ is lower than the preceding reported bitrate for the same content stream. Example: a drop from a 3.5Mbit streaming profile to a 2.5Mbit profile is considered a downgrade. This is per device per content; it's not a downgrade if it is a different piece of content or at a different time. |
Avg Bitrate Downgrades | The average number of times that there was a bitrate downgrade per unit of time. |
Buffering Rate | Number of buffering events per unit of time. |
Buffering Ratio | Percentage of time during which the playback was buffering per unit of time. Example: 33% of buffering ratio means that during 15 minutes of playback, the video was buffering for 5 minutes and playing for 10 minutes. |
Collection Timestamp | The timestamp at which the collection of data is happening. |
Concurrent Devices | The total number of active users at a given time or between a given time and date range as specified in the report filter. A total of:
|
Device Type Display | A combination of OS + hardware type + model to create the string displayed. |
Device Type Groupings / Filtering | Device types reported, as defined in the OPF 3.x documentation. For example, Android, iOS, Browser, Fire, Other, Managed (STB). |
Live Audience | The number of unique devices currently consuming live content. A count of the total active devices streaming a specific piece of content at a specific time, e.g. over 24 hours or 30 minutes. The total live audience would be a count of all devices with a playback metric in the last 10 minutes. |
Most Popular Channels | The channel(s) with the most views over the filtered time period. |
Peak Audience Share | The highest audience share as obtained by the channel/event in the time frame filtered on the dashboard. |
Peak Viewers | The count is related to the above metric. The peak number of devices consuming content at the same time. |
Peak Viewing Times | The time of day when most plays are taking place, regardless of content type. To indicate when the highest amount of content is being consumed across the platform. Presented as :
|
Playback Session | Individual playout session – a unique id provided by the client or SDK for the specific piece of content playback activity. |
Playback Consumption | One of the following, in this order of precedence:
|
Position | The position in seconds of the current view, e.g. if a user watches content for 10 minutes, the value reported should be 600 |
Progress | The progress through a piece of content, e.g. content with a 100 minute run time where a user views 10 minutes is 10% |
Started but not finished | Failure to complete, track content that users start watching > 5% of content duration but fail to finish < 90% of the content duration |
Suspended Account | Any account that has had a suspended status over the time frame. |
timestamp | The timestamp at which the session is happening, provided by the client device. |
User | Unique device used to represent the concept of an individual consuming content through one device, e.g. TV, phone |
Viewer Active Viewer Active Views | A user (Active connected device) that is consuming content on the platform at a specific time or over a time period as driven by the filter on the dashboard. |
Views | Content that has been watched > 75% of the content duration. Any consumption of content is a view regardless of viewing type/time slot etc. Where we do not have progress or position reported by the client then we count any viewing time as a full view – that could be a watch or playout, or play or playback metric. |
Watched Total | Value of time watching content, any content, any user, any device. Sum of all minutes/seconds of consumption. |
Failed Sessions | A failed session is any session where its total_viewing_seconds <= 0 OR total_buffering_seconds <= 0 |
Time to start | Amount of time from the user pressing the Play button until the first frame of the video is displayed. It generally includes the first buffering event. |
Buffering Time | Number of seconds during which the playback was buffering or stalled seen by the end user as a |
Definition of Quality of Experience
For the overall quality of experience (QOE) and data specific QOE visualisations within Tableau, we use three primary colours to display the QOE rating:
Metric | Green | Orange | Red |
|---|---|---|---|
Overall QOE
| < 2 errors avg per device and avg time to start < 2000ms and < 0.5 avg buffering ratio | =>2 & <= 10 errors avg per device OR avg time to start >= 2000 < 3000ms OR > 0.5 <=3% buffering ratio | > 10 errors avg per device OR avg time to start > 3000ms OR > 3% avg buffering ratio |
Session QOE | As per overall but limited to the playout session timeframe | As per overall but limited to the playout session timeframe | As per overall but limited to the playout session timeframe |
Device QOE | See definition in the table above | See definition in the table above | See definition in the table above |
Buffering Ratio | 0.5% per 15min | > 0.5 <=3% per 15 min | >3% per 15 min |
Buffering Rate | < 1 per 15 min | >=1 <=2 per 15 min | > 2 per 15 min |
Avg Bitrate | >= 3mbps | >=1 < 3mbps | <1mbps |
Framedrops | <1 | >=1 < 3 | >3 |
Bitrate Downgrades | 5 per 15 min | >5 < 10 per 15 min | > 10 per 15 mins |
Time to start | < 2000ms | >= 2000 < 3000ms | > 3000ms |
Failed Sessions | < 1 per 15 min | >=1 < 2 per 15 min | >2 per 15 min |
Total Active Users | > previous 24 hours | = previous 24 hours - 10% | < previous 24 hours |
Total new users | > previous 24 hours | = previous 24 hours - 10% | < previous 24 hours |
failed sign on's | = 0 | >0 < 10 | >10 |
Daily consumption live | > previous 24 hours | = previous 24 hours - 10% | < previous 24 hours |
Daily consumption vod | > previous 24 hours | = previous 24 hours - 10% | < previous 24 hours |