OB35 Paper 06 KPI Report

Similar documents
KPI and SLA regime: September 2015 performance summary

KPI and SLA regime: June 2015 performance summary Ref Apr 15 May 15 Jun 15 Target Description KPI A 100% 100% 100% 99% green

KPI and SLA regime: November 2016 performance summary

KPI and SLA regime: August 2015 performance summary Ref Jun 15 Jul 15 Aug 15 Target Description KPI A 100% 100% 99.87% 99% green

KPI and SLA regime: March 2017 performance summary

KPI and SLA regime: October 2014 performance summary Reference Outcome Result Target Description KPI A Green 100% 99% green

KPI and SLA regime: September 2014 performance summary Reference Outcome Result Target Description KPI A Green 100% 99% green

OB17 Paper 6 KPI Report

DIGITAL SWITCHOVER & THE BBC S ROLE

700 MHz clearance programme timescale review. Review of progress, risks and readiness

Going Digital Strategic plan November 2011

Introduction. Introductory remarks

RELIABILITY REASON FOR A COMMERCIAL INADVERTENT-INTERCHANGE SETTLEMENT STANDARD.

The Communications Market: Digital Progress Report

TV COVERAGE FUN CUP CHAMPIONSHIP 2017

PROJECTS FOR THE MONTH(S) OF AUGUST 2014 OCTOBER 2014

THE SVOD REPORT CHARTING THE GROWTH IN SVOD SERVICES ACROSS THE UK 1 TOTAL TV: AVERAGE DAILY MINUTES

The Zendesk Benchmark. The ROI case for omnichannel support

The Concept of Digital Transition. Korea s Current Status. Korea s Digital Transition Policy. Public Communications Program

As novidades do Laboratório de Pesquisas de Ciências e de Técnicas (STRL) da NHK. Sep 2003 SET2003 9:00-11:00 Auditório B Hiroo Arata

ALA Webinar August 21, 2013

Joint submission by BBC, ITV, Channel 4, Channel 5, S4C, Arqiva 1 and SDN to Culture Media and Sport Committee inquiry into Spectrum

Response to Ofcom Consultation The future use of the 700MHz band. Response from Freesat. 29 August 2014

Deliverable 2.17 Periodic WP2 Progress Report 3

UPDATE ON THE 2 GHZ BAS RELOCATION PROJECT

Funny Factuals & Documentaries. Sponsorship Opportunity

CITY OF ISSAQUAH CABLE COMMISSION

Trigger Cost & Schedule

The Digital Dividend: THE challenge for digital TV

AN302 Anconda 3BR 3BA

RCOA Mandatory Contestability for Phase 1 Customers. 16 December 2016

A journey of many steps. Alma Integration with Libraries Australia

EXISTING SEASON TICKET HOLDER NUMBER [IF YOU ARE NEW PLEASE WRITE NEW ] AUSTRALIAN PENSIONER CONCESSION YES, I D LIKE TO RECEIVE S FROM STC:

AGENDA Cable TV Commission

GUIDELINES FOR THE PREPARATION AND SUBMISSION OF YOUR THESIS OR DISSERTATION

Happily ever after or not: E-book collection usage analysis and assessment at USC Library

Library. Summary Report

House of Lords Select Committee on Communications Digital switchover of television and radio 20 January Digital UK Submission

Scopus. Advanced research tips and tricks. Massimiliano Bearzot Customer Consultant Elsevier

Interim use of 600 MHz for DTT

Monitoring of deforestation and forest degradation using remote sensing techniques for REDD policy implementation

Digital TV Broadcasting in Japan. Tetsuo YAMAKAWA

REVIEW OF THE SCOTTISH BORDERS DIGITAL TV SWITCHOVER

Outsells. InStyle. Vogue, Harpers Bazaar, and Elle

SKY NETWORK TELEVISION. John Fellet CEO Jason Hollingworth - CFO 27 February 2007

ADAPTING IN A PERIOD OF IMMENSE CHANGE: Strategies you might consider

DTTB implementation in Thailand 23 May 2016, Incheon, Republic of Korea

The Future of Digital Terrestrial Television Enabling new services for viewers

ENFORCEMENT DECREE OF THE BROADCASTING ACT

Digital Switchover Management of Transition Coverage Issues Statement

Digital Television Update Q4 2004

MultiSpec Tutorial: Visualizing Growing Degree Day (GDD) Images. In this tutorial, the MultiSpec image processing software will be used to:

Note for Applicants on Coverage of Forth Valley Local Television

3. Green OA (self-archiving) needs to be mandated

2. Television and audio visual

Methods, Evidence, Action? The Case of Digital Television. Dr Jeremy Klein, Head of Public Sector, Generics Group.

SCOPUS : BEST PRACTICES. Presented by Ozge Sertdemir

Delaware Division of Libraries Update A presentation at the joint Delaware Library Association/ Maryland Library Association Annual Conference 2013

Maui OnStage Sponsorship Opportunities

Prospects of Digital Broadcasting and Convergence Services. - The Essential and Expanding Role of Broadcasting September 02, 2010

Music and arts. Fall, winter and spring seasons. September 2017 June 2018

A. The Cable Operator shall provide Subscribers a toll-free or local telephone number for installation, service, and complaint calls.

Before the Federal Communications Commission Washington, D.C

These restrictions, also called Network Constraints, are characterized by:

700MHz Clearance Programme Information for Freeview channel providers

Strategic innovation programme IoT Sweden Trend report:

6.3 DRIVERS OF CONSUMER ADOPTION

HOW FAIR IS THE GOOGLE BOOK SEARCH SETTLEMENT? Pamela Samuelson Berkeley Law School Feb. 12, 2010 FAIR TO WHOM?

Outsells. InStyle. Vogue, Harpers Bazaar, and Elle

MCPS distribution policy rules Contents

Document No: GSC16bis-IPR-07. Source: Association of Radio Industries and Businesses. Contact: Tadaaki YOKOO. GSC Session: IPR Working Group

DECISION. The translation of the decision was made by Språkservice Sverige AB.

BROADCAST. The following concepts help ensure the way we distribute revenue to members is equitable.

A REPORT ON HIRING ACTIVITY IN INDIA by: Location, Industry and Experience

Digital TV and DTTB in Thailand

Springhead Road, Northfleet Kent, DA11 8HN Tel: web:

700MHz Clearance Programme Information for Freeview channel providers

Marc Segar Director of Technology NEP Australia

DTG Response to Ofcom Consultation: Licensing Local Television How Ofcom would exercise its new powers and duties being proposed by Government

2-2-1 Jinnan, Shibuya-ku, Tokyo , Japan TEL FAX

TMT Conference. London, 7 th June 2006

FY 2012 Website Visits Up 19% over previous year

Measuring Variability for Skewed Distributions

Lesson 7: Measuring Variability for Skewed Distributions (Interquartile Range)

Managing the effects of 700MHz clearance on PMSE and DTT viewers

SOUTH AFRICA BROADCASTING DIGITAL MIGRATION (BDM) A Z. the doc

Code of Practice on Changes to Existing Transmission and Reception Arrangements

Policy on the syndication of BBC on-demand content

Bellingham cable television services survey

Lesson 7: Measuring Variability for Skewed Distributions (Interquartile Range)

UK 700MHz Strategy and Digital Terrestrial Television update. Chris Woolford, Director of International Affairs, Ofcom 3 rd October 2013

Connected Broadcasting

Broadcasting Decision CRTC

Free to view TV for the connected age

Digital Television Reception Predictors

report L.M. Fraile, CERN PH/IS Impact of technical issues Running statistics 2006 Planning for 2007

The value of DTT. Alex Buchan, DTG Spectrum Summit 5 th July 2017

ASIA VIDEO CONTENT DYNAMICS

200$ 186$ 189$ 196$ 198$ Jul.$2012$ Jun.$2012$ Dec.$2012$ Aug.$2012$ Jan.$2013$ Sep.$2012$ Oct.$2012$ Mar.$2013$ Feb.$2013$ Nov.$2012$ Apr.

North West Media Briefing

Transcription:

OB35 Paper 06 KPI Report KPI and SLA regime: January 2016 performance summary Ref Nov 15 Dec 15 Jan 16 Target Description KPI A 99.90% 100% 99.87% 99% green 98% amber Service Restoration within 10 working days where household is a primary DTT user KPI A1 99.60% 99.39% 99.32% 97.5% green Engineer visits completed as scheduled with viewer 95.0% amber KPI A2 94.09% 98.74% 97.01% 90% green Engineer visits completed within 3 working days 50% amber KPI A4 93.05% 98.92% 97.39% 90% green Vulnerable visits completed within 3 working days 70% amber KPI A6 91.67% 100% 100% Communal engineer visits completed as scheduled with landlord where access and liability is confirmed KPI A7 100% 100% 100% 98% green 94% amber Reactive filters issued within 3 working days [KPI A10] SLA B1 100% 100% 100% 100% green 99% amber [SUSPENDED FOR REACTIVE-ONLY TRIAL] Addresses in very high pixels mailed filters Identifiable addresses within forecast medium, high and very high risk pixels (high and very high risk only for London) to be mailed at least once no more than 12 weeks ahead of scheduled mast activation Complaints SLA C1 0.42% 0.41% 0.41% <1% green <2% amber SLA C4 Report on total number and categories of complaints SLA C5 Report on vulnerable complaints SLA D1 Measure of the numbers of mailings per report of / SLA D2 case of interference Qualitative and quantitative reports provided. No specific Measure of the number of reported cases that occur targets. outside of mailed area SLA D3 Measure of number of cases of interference per mast remaining between 0.17 and 1.66 (5k to 50k cases of interference for rollout) Page 1 of 9

KPIs January 2016: KPI and SLA performance summary, 10 February 2016 KPI A: Service Restoration within 10 working days where household is a primary DTT user (communal households and households where cable or satellite services are received are excluded). 99% (green); 98% (amber) Result: 99.87%; green Of the 767 confirmed 4G cases in January 2016, 766 were resolved within 10 working days. One cases breached this deadline, taking 14 working days to resolve Result: 99.87% In the breach case, the viewer called and a visit was booked. Though the engineer attended the job as scheduled, adverse weather coupled with hazardous on-site conditions meant that the job needed to be rescheduled. Two further visits were booked and attended, but both had to be rescheduled owing to adverse weather. A further visit was booked, and this was completed successfully, 14 working days after the viewer s initial call. The viewer is happy with the reason for the delay and appreciates at800 s ongoing contact. Although the case began in December, the 10 working day limit was hit in early January. KPI A1: Engineer visits completed as scheduled with viewer. 97.5% (green); 95% (amber) Result: 99.32%; green Of the 1,902 engineer visits originally scheduled for January 2016: o A total of 1,773 visits were undertaken and closed on schedule o Thirteen visits were cancelled or rearranged by at800 o A further 116 visits were cancelled by the viewer Total scheduled visits not missed by engineer / total visits scheduled (1,773 + 116) / 1,902 Result: 99.32% KPI A2: Engineer visits completed within 3 working days. 90% (green); 50% (amber) Result: 97.01%; green Of the 1,902 scheduled engineer visits detailed above, there were 1,786 visits scheduled where the viewer did not cancel Of these 1,786 visits: o A total of 1,617 visits were completed within three working days o A further 117 were delayed beyond three working days at the viewer s request o Thirteen visits were cancelled or rearranged by at800 o A total of 39 visits were completed outside of the three working day target (1,617 + 117) / 1,786 Result: 97.01% KPIs Page 2 of 9

January 2016: KPI and SLA performance summary, 10 February 2016 KPI A4: Vulnerable visits completed within 3 working days: 90% (green); 70% (amber) Result: 97.39%; green In January 2016, there were 919 scheduled engineer visits to people marked as eligible for additional support where the viewer did not cancel Of the 919 visits to be measured: o A total of 853 visits were completed within three working days o Forty-two visits were delayed beyond the three working day window at the viewer s request o Nine visits were cancelled by the engineer o Fifteen visits were delayed beyond the three working day target (853 + 42) / 919 Result: 97.39% KPI A6: Communal engineer visits completed as scheduled with landlord where access and liability is confirmed. Reporting only Result: 100% There were six communal jobs scheduled for January, all of which were undertaken on time and as scheduled Result: 100%. KPI A7: Reactive filters issued in 3 working days. 98% (green); 94% (amber) Result: 100%; green All of the 2,716 filter requests made in January 2016 were sent within one working day. Result: 100% KPI A10 [SUSPENDED]: 100% of identifiable addresses in very high pixels mailed proactive filter Not applicable. KPIs Page 3 of 9

SLA B Awareness January 2016: KPI and SLA performance summary, 10 February 2016 SLA B1: Identifiable addresses within forecast medium, high and very high-risk pixels (high and very high risk only for London) to be mailed at least once no more than 12 weeks ahead of scheduled mast activation. 100% (green); 99% (amber) Result: 100%; green A request was made to activate some of the masts associated with the February 2016 rollout early. The 15,626 households affected by these early activations were mailed in December and were detailed in last month s report The remaining 79,017 households eligible for mailing because of February 2016 masts were mailed during the period 4 6 January and are detailed under SLA B2 below A total of 137,466 households were identified as being eligible for mailing because of March 2016 rollout masts. These were mailed during the period 18 26 January and are detailed under SLA B2 below Result: 100% SLA B2: Report on households mailed and not mailed within forecast pixels (i.e. number of low risk households) The following table shows the breakdown of households by risk category and those confirmed as mailed. Mailing February 2016 masts March 2016 masts Mailing Date Very high High Medium London medium Low Grand Total 4 January 1,666 7,984 20,350 30,000 5 January 1,157 6,449 22,392 29,998 6 January 681 5,814 12,524 19,019 Not mailed 525 115,767 116,292 18 January 2,034 10,460 17,951 30,445 19 January 1,435 8,787 19,776 29,998 20 January 1,019 7,036 21,945 30,000 25 January 765 10,245 18,987 29,997 26 January 369 3,453 13,204 17,026 Not mailed 408 244,215 244,623 Total 9,126 60,228 147,129 933 359,982 577,398 SLA B: Awareness Page 4 of 9

January 2016: KPI and SLA performance summary, 10 February 2016 SLA B3: Report on households reporting interference within unmailed forecast pixels. Where more than 40% of total reports of interference are in these pixels at800 to address through operational adjustments (e.g. mailing low risk pixels in a certain area or adjusting the risk score for pixels), however, a de minimis threshold to apply In January 2016, at800 was contacted by a total of 3,717 households reporting interference that at800 believed could be caused by 4G. Engineers visited 1,739 properties, and filters were sent to a further 1,978. Of the 1,739 viewers to whom at800 sent engineers, 742 were confirmed as being impacted by 4G Of the 3,717 households, 344 (9.3%) were suppressed through the risk-based mailing. Mailing Status 4G confirmed Not 4G Job not complete Filter sent Grand Total Mailed 655 890 8 1,705 3,258 Suppressed 59 92 0 193 344 Not identified 28 7 0 80 115 Total 742 989 8 1,978 3,717 SLA B4: Awareness to be maintained (reminder mailings) with those viewers at continued risk of experiencing interference from masts that were not activated as scheduled. Report on reminder mailing numbers to be provided The reminder mailing associated with inactive masts from the June 2015 rollout was undertaken in December 2015. That associated with inactive masts from the July 2015 rollout will be undertaken in early February 2016. There were no reminder mailings undertaken in January. SLA B7: Report on above the line communications and research outcomes, including awareness in rollout areas During January, seven pieces of media coverage communicated at800 s messaging to a potential audience of around two million people. Three articles online and four in print were published during the month. Examples of coverage are detailed below. The Scotsman Ben Roome, chief executive of at800, said: We want to ensure that people know it s our role to fix any disruption to Freeview due to 4G at 800 MHz and that there s no charge. The Tyrone Times The Council is now reinforcing the message that there is free support and equipment available to those affected from at800, the company responsible for resolving the problem. The Falkirk Herald The at800 organisation, funded by the leading UK mobile operators, is responsible for making sure viewers can still watch Freeview through their TV aerial. SLA B: Awareness Page 5 of 9

SLA C Quality of Service January 2016: KPI and SLA performance summary, 10 February 2016 SLA C1: Percentage of households interacting with at800 that make a complaint. 1% (green); 2% (amber) Result: 0.41%; green at800 interacted with a total of 6,134 households in January 2016 Of these, 25 made a complaint that related to at800 s operational processes Result: 0.41% SLA C4: Report on total number and categories of complaints There were a total of 57 complaints made in January 25 related to at800 s operational processes; 32 to its policies. Below is a breakdown of the topics of these complaints. Operations-related Engineer: damage/quality: 7 Mailing and communication: 7 Dispute of non-4g diagnosis: 4 Appointment availability: 2 Engineer: late/missed appointment: 2 Engineer attitude/behaviour: 1 Filter-related: 1 Time to resolve issue: 1. Policy-related Support of satellite or cable viewers: 18 Support of communal properties: 7 4G rollout in general: 6 Support of set-top aerials: 1. SLA C5: Vulnerable viewer complaints Out of 1,522 viewers flagged as being eligible for additional support in January 2016, 16 made a complaint: 11 related to operational processes and five to policies. These break down as follows: Operations-related Engineer: damage/quality: 4 Mailing and communication: 3 Appointment availability: 2 Dispute of non-4g diagnosis: 1 Engineer: late or missed appointment: 1. Policy-related Support of communal properties: 2 Support of satellite or cable viewers: 2 4G rollout in general: 1. SLA C: Quality of Service Page 6 of 9

SLA D Scale January 2016: KPI and SLA performance summary, 10 February 2016 SLA D1: Measure of the numbers of mailings per report of/case of interference The table shows mailings per engineer visit and reactive filter sent, broken down by masts activated before the end of January 2016. Each case is tied to a single mast according to the rules specified in Appendix 1. Cases are associated to the month when each mast was originally scheduled and therefore drove mailing volumes, not the month in which activation occurred. Rollout month Engineer, 4G Engineer, non-4g Reactive filter Initial mailings Mailings per 4G Mailings per non-4g Mailings per reactive filter Mailings per visit or filter sent July 2013 3,315 8,176 20,479 7,205,414 2,199 888 355 253 August 2013 349 384 912 153,875 457 408 172 121 September 2013 360 428 843 183,179 515 435 220 146 October 2013 170 188 457 117,425 720 631 266 187 November 2013 113 143 312 129,946 1,171 955 430 297 December 2013 58 105 257 103,043 1,777 981 407 288 January 2014 184 365 769 534,796 2,988 1,550 723 493 February 2014 125 173 365 128,943 1,048 772 360 246 March 2014 22 48 69 5,727 260 127 83 50 April 2014 7 31 89 4,133 590 133 47 35 May 2014 6 13 44 4,606 768 354 105 81 June 2014 216 334 723 94,100 444 304 135 93 July 2014 546 1,157 2,778 320,204 583 285 117 83 August 2014 245 385 904 64,130 263 169 72 51 September 2014 509 929 2,269 142,452 283 161 64 46 October 2014 772 793 1,623 343,052 471 446 220 147 November 2014 1,152 1,009 2,633 556,165 499 572 220 159 December 2014 117 253 531 296,536 2,671 1,220 600 402 January 2015 270 390 643 187,594 739 527 314 197 February 2015 334 427 767 95,345 292 237 133 85 March 2015 495 636 1,148 172,228 370 290 161 104 April 2015 511 647 1,236 244,807 494 394 213 138 May 2015 112 216 424 116,001 1,126 598 304 202 June 2015 393 414 791 296,835 846 822 422 279 July 2015 549 570 1,261 314,797 659 621 282 194 August 2015 676 460 1,160 205,731 342 503 198 142 September 2015 518 331 887 288,602 668 1,009 374 273 October 2015 307 217 549 205,511 776 1,269 448 331 November 2015 130 143 298 111,452 986 1,004 470 320 December 2015 220 177 365 256,052 1,652 2,134 1,341 823 January 2016 73 60 174 211,254 5,710 9,602 2,374 1,903 February 2016 15 15 38 94,943 31,648 31,648 11,868 8,631 Nothing within 2km 186 718 7,450 Total 12,368 19,473 30,959 5,983,464 484 307 193 119 Note: Data is included for January and February 2016 masts as some of these masts were activated before the end of December 2015 but after mailing had completed. SLA D2: Measure of the number of reported cases that occur outside of mailed area Of the 742 households confirmed as experiencing 4G interference in January 2016: Cases not mailed due to risk profile 59 (8.0%) Cases never identified in modelling 28 (3.8%) Total cases outside mailed area 87 (11.7%) Total cases caught by mailing 655 (88.3%) SLA D: Scale Page 7 of 9

January 2016: KPI and SLA performance summary, 10 February 2016 SLA D3: Measure of number of cases of interference per mast remaining between 0.17 and 1.66 (5k to 50k cases of interference for rollout) exceeding or trending towards exceeding the range will be raised to the OB for review/action 1.80 Cumulative number of cases per active mast 1.66 1.60 1.40 1.20 1.00 0.80 0.60 1.29 1.25 1.26 1.23 1.19 1.15 1.10 1.06 1.07 1.02 1.03 1.00 1.02 1.03 0.93 0.95 0.88 0.85 0.81 0.82 0.79 0.73 0.69 0.61 0.55 0.40 0.33 0.41 0.20 0.25 0.19 0.17 0.11 0.11 - Jul 13 Aug 13 Sep 13 Oct 13 Nov Dec Jan Feb Mar Apr May Jun Jul 14 Aug Sep Oct Nov Dec Jan Feb Mar Apr May Jun Jul 15 Aug Sep 13 13 14 14 14 14 14 14 14 14 14 14 14 15 15 15 15 15 15 15 15 Monthly Cases Per Mast Range Lower Limit Range Upper Limit Poly. (Monthly Cases Per Mast) Oct 15 Nov 15 Dec 15 Jan 16 Note: The above thresholds are based on a range of between 5,000 and 50,000 cases of interference for an estimated number of total 4G at 800 MHz masts for full rollout from all MNOs. SLA D: Scale Page 8 of 9

January 2016: KPI and SLA performance summary, 10 February 2016 Appendix 1: Logic for SLA D1: Identifying the nearest mast Identifying an individual mast that is causing interference is an inexact science. Indeed two masts may individually not result in interference for a household, but when both are active at the same time, interference may result. A household that has interacted with at800 a number of times (either requesting multiple filters or receiving many engineer visits) further complicates the identification of a single affecting mast, as masts may have activated between in between their contacts with at800. For the purposes of SLA D1, the logic described below has been used to identify the dates against which households should be measured, and the logic for identifying the mast that is thought most likely to be causing the interference. In-scope households and their effective date The analysis looks separately at households that have received reactive filters and those that have had engineer visits. The few households that have received both count in both analyses. For households to which at800 has sent reactive filters, their analysis is based on the first date on which they made a request for a filter, a request that the triage process indicated warranted the dispatch of a filter. For engineer visits, each household is counted once, but all visits are analysed to inform the record. For any households that had a single visit, the date on which that visit was requested is used as the basis for analysis, and the household is categorised as 4G or not based on the outcome of that visit. For any households that had multiple visits, if one or more visits resulted in a 4G diagnosis, it is categorises as 4G and the date on which the earliest of these visits was requested is used as the basis for analysis. If all visits resulted in a non-4g diagnosis, it is categorised such and the request date of the earliest visit is used as the basis for analysis. Identifying mast most likely to be causing interference For each of the above cases, the following process is undertaken: Determine all masts that were activated on or before the household s effective date (see above), but only include masts that are within a 900 metre radius of the property. From these masts, determine the mast that was activated the soonest before the call came in. This is deemed to be the mast most likely to be the cause of the interference If the above yields no masts, undertake the same process using a 1,500 metre radius If the above yields no masts, undertake the same process using a 2,000 metre radius In the event that the above yield no masts (i.e. there was no active mast within 2,000 metres at the point at which the call came in), the case is not associated with any specific mast and is discounted from the analysis. This logic is used to tag each household with an affecting mast. The rollout month for which this mast was submitted is used as the basis for analysis. Page 9 of 9