Application, Network and Link Layer Measurements of Streaming Video over a Wireless Campus Network
Passive & Active Measurement Workshop 05Boston, MA, April 1st, 2005
Feng Li, Jae Chung, Mingzhe Li, Huahui Wu, Mark Claypool, Bob Kinicki
{lif,goos,lmz,flashine,claypool,rek}@cs.wpi.edu
Computer Science DepartmentWorcester Polytechnic Institute
Worcester, MA, 01609 USA
PAM – April 1st , 2005
2
Outline
• Introduction
• Experimental Methods– Tools and Setup– Experimental Design
• Results and Analysis
• Conclusions and Future work
PAM – April 1st , 2005
3
Motivation
• Increasingly, deployment of streaming multimedia over wireless LANs– Hardware price decreasing. – Wireless link capacity increasing:
11Mbps(802.11b), 54Mbps(802.11g).– Streaming techniques becoming
mature.
PAM – April 1st , 2005
4
Objectives
• Correlate performance for– Wireless Link Layer– Network Layer – Application Layer
• Characterize– Streaming Video Parameters
PAM – April 1st , 2005
5
Outline
• Introduction
• Experimental Methods– Tools and Setup– Experimental Design
• Results and Analysis
• Conclusions and Future work
PAM – April 1st , 2005
6
WPI Campus Network
WPI Wired Campus Network
WPI Wireless Network
100 M bps
Ethernet
WindowsStreaming Server
Access Point
Access Point
Mobile ClientMobile Client
Mobile Client
Mobile Client
IEEE 802.11g
Layer Tools Performance Measures
Application Media Tracker Frame rate, Frame Lost, Encoding bit rate
Network UDP Ping, Wget Round-Trip time, Packet loss rate, Throughput
Wireless Typeperf, WRAPI Signal Strength, Frame Retries, Capacity.
PAM – April 1st , 2005
7
Experimental Parameters
• Three access points (AP)– Three AP’s on three different floors in the WPI
CS Department.
• Three different reception locations for each AP.– Good, Fair, Bad based on Windows Wireless
signal strength indicator.
• Experiment period– Winter Break, Dec 23 – 25, Dec 28, 29, 2004
PAM – April 1st , 2005
8
Experimental Methods
• Each Experiment instance consists of – 1 Initial TCP bulk download– 8 Videos
• 2 Clips: High Motion and Low Motion • 2 Encoding method
– Single Level at 2.5M bps– Multiple Level , 11 levels, max 2.5 M bps.
• 2 Protocols: TCP and UDP
– 1 Final TCP bulk download
• Total: 360 video streaming360 = 3 APs * 3 Locations * 8 videos * 5
repetitions
PAM – April 1st , 2005
9
Outline
• Introduction
• Experimental Methods– Tools and Setup– Experimental Design
• Results and Analysis
• Conclusions and Future work
PAM – April 1st , 2005
10
High Level Analysis
TCP Streaming UDP Streaming Total
Multiple Level Video 86 85 171
Single Level Video 89 90 179
Subtotal 175 175 350
Data Collected
• 10 data sets were removed from the 360 video runs due to wireless connection failure.
TCP Streaming UDP Streaming Total
Multiple Level Video 86 + 4 85 + 5 171
Single Level Video 89 + 1 90 179
Subtotal 175 175 350
PAM – April 1st , 2005
12
Wireless Retry Fraction
Figure 8 (modified) : Wireless Retry Fraction for Upstream Traffic
PAM – April 1st , 2005
13
TCP vs UDP Analysis: Frame Rate
Figure 6: Frame Rate for TCP and UDP Streaming
PAM – April 1st , 2005
14
TCP vs UDP Analysis : Round Trip Time
Figure 10: Network Round Trip Time for TCP and UDP Streaming
PAM – April 1st , 2005
15
TCP vs UDP Analysis: Duration
Figure 11: Normalized Playout Duration for TCP and UDP Streaming
PAM – April 1st , 2005
16
Multiple vs Single Analysis: Frame Rate
Figure 4: Frame Rate for Multiple and Single Level Encoding
PAM – April 1st , 2005
17
Multiple vs Single Analysis: Encoding Rate
Fig .14 Encoding Bit Rate vs Wireless Link Capacity
PAM – April 1st , 2005
18
Conclusions
• At Good wireless reception locations:– Nearly all the video clips played out at a
high Frame Rate.– The treatment choices for streaming a
video of multiple or single encoding levels and TCP or UDP protocols do not significantly impact performance.
PAM – April 1st , 2005
19
Conclusions
• At Bad wireless reception locations:– Multiple level video streams adapt
better than single level streams. – Videos streamed using TCP play out at
a higher average frame rate than the same video streamed using UDP.
– The play out duration for TCP videos is significantly longer than UDP videos.
PAM – April 1st , 2005
20
Future work
• To develop new application layer techniques to identify and adapt to challenging wireless transmission situations.
• To study the behavior at the AP and the interaction of concurrent clients.
• To concurrently capture burst loss behavior at multiple protocol levels.
• To evaluate other commercial streaming products: Realplayer TM and Quick timeTM player.
Application, Network and Link Layer Measurements of Streaming Video over a Wireless Campus Network
Passive & Active Measurement Workshop 05
Feng Li, Jae Chung, Mingzhe Li, Huahui Wu, Mark Claypool, Bob Kinicki
{lif,goos,lmz,flashine,claypool,rek}@cs.wpi.edu
CS Department at Worcester Polytechnic Institute
Worcester, MA, 01609 USA
Thank You!