Upload
others
View
4
Download
0
Embed Size (px)
Citation preview
Foreword
For the inhabitants of New Zealand, it is particularly interesting to see how the operators perform in metropolitan areas as well in areas of low popula-tion density.
Therefore, we have performed indi-vidual analyses for Manawatu. More than 250,000 New Zealanders live in this region.
umlaut report
2
umlaut report umlaut report
32
Testing area
530 kmmeasuring distance
Intro
The leader in mobile benchmarking, umlaut, has analyzed
the mobile networks in New Zealand with regards to
mobile network performance.
We measure smartphone voice and data performance
based on extensive drivetests.
This report has been commissioned by Vodafone.
As the de-facto industry standard, our benchmarking
methodology focuses on customer-perceived network
quality and covers a wide range of mobile services.
Today, more than 200 mobile networks in more than 120
countries are being evaluated by our unique methodology.
It allows a technical analysis that is unprecedented in its
level of detail and enables comparisons between the net-
work performance and capability of each mobile network.
Our benchmarks help network operators to demonstrate
how well they are delivering wireless connections to
consumers, business users and enterprises and reveals the
areas of improvement.
Manawatu
Drivetest Voice Data
Device Samsung Galaxy S20+5G (Exynos) SM-G986B Samsung Galaxy S20+5G (Exynos) SM-G986B
Test Cases Mobile-to-MobileSide1 (5G pref) to Side2 (5G pref) 115 sec call window70 sec call duration15 sec call setup timeoutMulti-RAB traffic injection on both sides
Data 5G preferredHTTP DL datastream 7sHTTP UL datastream 7sHTTP 10MB DL fixed file transferHTTP 5MB UL fixed file transferWeb Browsing - Kepler ETSI Ref. Page10 Live web pages 3YouTube ( videos ~ 45s)
Mobility andRoute Types
100% DrivetestSmall Country Approach
Samples ~ 1380 ~ 6240
Dates 3 measurement days11.08.2021 – 13.08.2021
The map shows the total driving area for Manawatu.
The routes were independently selected by umlaut based
on the official coverage maps provided by the network
operators.
5G Coverage Maps Vodafone:https://www.vodafone.co.nz/network/coverage/
5G Coverage Maps 2degrees:https://www.2degrees.nz/coverage/
5G Coverage Maps Spark:https://www.spark.co.nz/shop/mobile/network/
4
umlaut report umlaut report
5
Total Score Overall results
Score achieved by the networks under test.
Total Score1000 Dots
2degrees
411
243
Spark
343
157
- S
how
n to
tal s
core
s ar
e ro
und
ed.
Vodafone
416
297
Voicemax. 400
Datamax. 600
Operator
713654
500
6
umlaut report
7
umlaut report
5G availabilityMeasured from UE
The table shows the 5G availability measured in Manawatu. All data sequences from the umlaut use case are taken into
account.
5G availability is defined as the share of time a user is actually using the 5G network (represented by the percentage of
test cases during which the UE was using 5G).The graph shows the 5G availability measured in Manawatu. All data sequences from the umlaut use case are taken into
account.
Manawatu[%]
2degrees Spark
- S
how
n va
lues
are
rou
nded
.
Vodafone
49.4
04.9
Operator
5Gavailability
Technology List Unit Vodafone 2degrees Spark
Manawatu
5G [%] 33.46 0 1.32
5G-LTE Mixed Session [%] 15.94 0 3.58
LTE [%] 47.23 95.99 87.24
LTE-3G Mixed Session [%] 0.63 1.08 1.03
3G [%] 2.74 2.92 6.82
8
umlaut report umlaut report
9
Datastream DownloadAvg. & Max. Throughputs HD video class and UHD video class
The graph shows the average throughput (darker shade) and the maximum throughput (lighter shade) for all technologies.
All data sequences from the umlaut use case are taken into account.
The graph shows the number of samples at least achieving 5Mbit/s (HD video class - lighter shade) and 20Mbit/s (UHD
video class - darker shade) for all technologies. All data sequences from the umlaut use case are taken into account.
Manawatu[Mbps]
2degrees Spark
-Sh
own
valu
es a
re r
ound
ed.
Vodafone
196
440
41
89
52
119DatastreamDownload
Operator
Manawatu[%]
2degrees Spark
-Sh
own
valu
es a
re r
ound
ed.
Vodafone
89
98
66
93
65
92
HD video class andUHD video class
Operator
10
umlaut report umlaut report
11
Achieved values of all networks under test in each of the relevant Voice Key Performance Indicators (KPIs) for Manawatu.
Voice Service Group Unit Vodafone 2degrees Spark
Manawatu
Qualifier [%] 97,2 97,8 93,0
Call Setup Time (P90) [s] 3,0 6,6 4,6
Speech Quality (P10) [MOS-LQO] 3,4 3,1 3,1
Multirab connectivity [%] 99,6 99,6 99,3
KPI overview — Voice
2degrees
6.6
Spark
4.6
- S
how
n va
lues
are
rou
nded
.
Vodafone
Manawatu[s]
3.0
Operator
Call Setup Time
2degrees
3.1
Spark
3.1
- S
how
n va
lues
are
rou
nded
.
Vodafone
Manawatu[MOS-LQO]
3.4
Operator
P10 Speech Quality
Achieved values of all networks under test in Call Setup Tme for Manawatu. Achieved values of all networks under test in Speech Quality for Manawatu.
12
umlaut report umlaut report
13
Achieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) in Manawatu
from all collected test samples.
KPI overview — DataData Manawatu KPI Name Unit Vodafone 2degrees Spark
HTTP Web Page DL Smartphone
Qualifier [%] 97,6 97,6 96,9
Overall Session Time [s] 1,9 2,2 2,5
HTTP 10MB DL Smartphone
Qualifier [%] 98,4 99,5 97,8
Overall Session Time [s] 2,4 6,0 6,0
90% faster than [Mbit/s] 18,2 6,2 6,4
10% faster than [Mbit/s] 157,2 69,6 89,0
HTTP 5MB UL Smartphone
Qualifier [%] 95,0 98,9 98,3
Average Session Time [s] 5,8 5,7 9,1
90% faster than [Mbit/s] 3,4 3,0 1,9
10% faster than [kbit/s] 34,5 37,9 27,8
HTTP DL FDTT
Qualifier [%] 97,8 98,9 97,8
10% faster than [Mbit/s] 439,7 89,4 119,1
faster than 5 Mbit/s [%] 98,3 93,0 92,1
faster than 20 Mbit/s [%] 89,4 65,9 65,0
HTTP UL FDTT
Qualifier [%] 96,7 96,8 93,8
10% faster than [Mbit/s] 46,4 49,3 36,0
faster than 5 Mbit/s [%] 88,6 95,0 88,0
faster than 20 Mbit/s [%] 81,1 84,9 67,7
YouTube
Qualifier [%] 95,6 96,8 95,5
Start Time [s] 1,7 1,5 1,6
AVG Resolution [p] 1064,6 1059,8 1029,8
YouTube Live Smartphone
Qualifier [%] 93,1 92,3 86,5
Start Time [s] 3,5 4,1 4,3
AVG Resolution [p] 1080,0 1080,0 1080,0
YouTube 4K Smartphone
Qualifier [%] 97,8 95,7 92,9
Start Time [s] 2,0 1,5 1,6
AVG Resolution [p] 1740,6 1446,1 1427,6
14
umlaut report
15
umlaut report
17
Key takeaways
In the voice category, Vodafone achieves the highest score, showing the shortest call set up times and the best speech quality.
Vodafone is leading with the highest overall umlaut score in Manawatu.
Vodafone shows the widest 5G availability in Manawatu.
In the data category, Vodafone is leading with the highest overall score and has the fastest down-load throughputs.
16
umlaut report
17
umlaut report
umlaut SE
Am Kraftversorgungsturm 3 · 52070 Aachen · Germany
Hakan Ekmen · Chief Executive Officer Telecommunication
cell +49 151 571 33 235 · [email protected]
www.umlaut.com