Virtual Network Performance Challenge

Embed Size (px)

Citation preview

2. Age nd aWh at is a Virtu alize d N e tworkP e rform ance b e nch m arksTu ning tip s 3. P h ys ical E nte rp ris e D atace nte rBORDER ROUTERFIREWALLVPNINTRUSION PREVENTIONSWITCH 10.0.0.0/24WEBSERVERS10.3.0.0/24APPS & STORAGE10.4.0.0/24 DATABASE 4. Virtu al N e twork Arch ite ctu re 5. P e rform ance M ile s tone s20052006 20072008 2009201020111G line rateMultiqueue NIC10G bamdwidth 1M packets / secondXen 3.0KVMHyper-Vdrivers 6. Be nch m arksF orward ing R F C 2544 m inim u m p acke tTh rou gh p u t TC P b u lk trans fe rLate ncy R e q u e s t / R e s p ons e 7. R ou te r Be nch m arkR F C 2544RouterUnder TestSpirent 8. Virtu alize d R ou te r Be nch m ark Router UnderGuestTest HypervisorBridgeBridgeSpirent 9. Router Forwarding performance1G bit/sec bidirectional 100% 80% Bare MetalFrames forwarded 60% Vmware ESX Xen 40% KVM 20%0%0 250 5007501000 1250 1500Packet size 10. E m u late d vs Virtu al N IC 11. E m u late d N e twork Inte rface Fake PCI regionGuestHypervisor PacketBuffer 12. Virtu al N ICGuest Hypervisor NetwoShared rk Memory 13. E m u late d vs Virtu al N IC 10075Throughput vs Bare Metal Emulated Tx50 Virtual Tx Emulated Rx Virtual Rx25 0Hyper-V Vmware KVM 14. VN IC ch aracte ris tics Hyper-V VmwareXenKVM vmxnet3 netfront virtio-netMTU 1500 900065521 65535Checksum YYYoffloadSegmentation YYYoffloadNAPI YYYLROYVLAN YMultiqueue Y?? 15. O ffload not always a good id e aLR O ?? 16. Tip #2:Use Jumbo MTU 17. VM to VM p e rform ance 2,000Thorouhput (10^6 bits/sec)01001,000 10,000 100,000 MTU (bytes) 18. M TU vs Brid ge 19. Tip #3: Minimize overhead 20. Virtu al S witch Typ e s 10000To HypervisorFrom HypervisorThroughput (10^6 bits/sec)7500VM to VM50002500 0 NATBridged Tap 21. Tip #4: D ont C ros s th e S tre am s 22. C ontrol flow C P UCreator:cairo 1.10.2 (http://cairographiCreationDate:Thu Oct 20 16:29:57 2011LanguageLevel:2 23. M u ltith re ad b e nch m ark 20,000 UP GuestSMP GuestTotal Transactions/sec 15,000 10,0005,000 0Packet Steering (RPS) BaselineMulti Queue NIC 24. M u ltip le Q u e u eH W or S WGuest VM ThreadDevice queueFlow ThreadDeviceclas VNICsfiqueueer ThreadDevice queue 25. Tip #5: H e lp ou t! 26. X e n P e rform ance Im p rove m e nts 1G bidirectional frame loss100%2.6.312.6.352.6.37 75%Packets forwarded 50% 25%0% 0 200 400600 80010001200 1400 1600 Packet size 27. O ngoing workIm p rove d Trans m it wake u pC op y-le s s trans fe rM u ltiqu e u e VN ICF low s te e ring 28. 5 Ways to Im p rove p e rform anceVirtu al (not e m u late d ) ne twork inte rfaceM axim ize p acke t s izeM inim ize p acke t ove rh e adS tay on s am e C P UC ontrib u te to fu tu re d e ve lop m e nts