178
Webサイト、モバイルサイトにおける データサイエンス Weサイト等のパフォーマンスの計測およ び品質統計解析をうKeynote Systemsよる事紹介 ©2013 Keynote Systems, Inc. Keynote Systems, Inc. Technical Business Representative [email protected]

Webサイト、モバイルサイトにおけるデータサイエンス 2013-11-06

Embed Size (px)

DESCRIPTION

11月6日に東京大学のコンピュータ産業研究会で講演した際の資料です。 Keynoteのサービス全般の説明と計測についての詳細な事例を掲載しています。

Citation preview

  • 1.Web We Keynote Systems Keynote Systems, Inc.Technical Business Representative [email protected] 2013 Keynote Systems, Inc.

2. Keynote SystemsTechnical Business Representative Layer17 Function PointCOCOM II Lotus Notes Windows Unix/Linux Web IT CDNWeb RMT WebUX Keynote Systems Japan http://www.keynotesystems.jp/ Keynote Web https://www.facebook.com/KeynoteSystemsJapan Keynote Systems JapanBlog http://blog.keynotesystems.jp/ http://www.slideshare.net/takehora/presentations 2013 Keynote Systems, Inc.2013 11 72 3. Keynote Systems 19951999NASDAQ, 2013(Thoma Bravo ) Web 4,000 275 7,0002013 Keynote Systems, Inc.2013 11 73 4. CEO - 2013 Umang Gupta2013 Keynote Systems, Inc..Jennifer Tejada2013 11 74 5. Thoma Bravo2013 Keynote Systems, Inc..2013 11 75 6. Velocity Web Keynote SystemsPlatinum Diamond2013 Keynote Systems, Inc..2013 11 76 7. Keynote AutomotiveBusiness-to-BusinessFinancial ServicesNew MediaPortals/MediaRetailTechnology & TelecomTravel2013 Keynote Systems, Inc.2013 11 77 8. Web WebApPCloud ComputingCApP CTxPMobile WebMWP MDPDevice AnywhereStreamingStP (Cookie) MITEMobile AppUXTxP, RUPSOAP, REST, FTP WPT KITE TsPWebEffective InsightLoadPro2013 11 78 9. Web W3C Navigation Time First Paint Time to Interactive Availability Timeout2013 11 79 10. Keynote IT SLA10 2013 11 7 11. 2013 Keynote Systems, Inc..2013 11 711 12. 2013 Keynote Systems, Inc.2013 11 712 13. 60Kg 2013 Keynote Systems, Inc.2013 11 713 14. 2013 Keynote Systems, Inc.2013 11 714 15. Web 88% 7% 1CV11% 1PV2 116% 12013 Keynote Systems, Inc..2013 11 715 16. = 250msWeb Harry Shum, Microsoft nnn10% (1) 12% (61.2 ) 5% (2)n 50%PV ()n9% (400ms) nn2%100% (2.7 )n n 25% 17. Amazon ONLINE http://toyokeizai.net/articles/-/13212 2013 Keynote Systems, Inc..2013 11 717 18. Amazon Amazon110% 2013 Keynote Systems, Inc.2013 11 718 19. Web Internet ExplorerFirefox2013 Keynote Systems, Inc.2013 11 719 20. Web iPhoneAndroid2013 Keynote Systems, Inc.2013 11 720 21. Web Internet ExplorerFirefox2013 Keynote Systems, Inc.2013 11 721 22. Web iPhoneAndroid2013 Keynote Systems, Inc.2013 11 722 23. Web Internet ExplorerFirefox2013 Keynote Systems, Inc.2013 11 723 24. Web Internet ExplorerFirefox2013 Keynote Systems, Inc.2013 11 724 25. Web iPhoneAndroid2013 Keynote Systems, Inc.2013 11 725 26. 2013 Keynote Systems, Inc.2013 11 726 27. PVCV2013 Keynote Systems, Inc.2013 11 727 28. (W.F.Reilly, 1929)P=A/D^2 P=AD 2013 Keynote Systems, Inc.2013 11 728 29. 2013 Keynote Systems, Inc.2013 11 729 30. WEB 2013 Keynote Systems, Inc..2013 11 730 31. 2013 11 7TxP (Transaction Perspective) IE9Firefox14WebW3C Navigation Time 515301NTTweb serverKDDI Last MileISPMiddle Mile AgentFirst Mile 31 32. Systems/Server side MonitoringRUM Real User MonitoringNTTweb serverKDDISynthetic MonitoringLast MileISPMiddle MileFirst Mile 2013 11 732 33. Web 2013 Keynote Systems, Inc..2013 11 733 34. 1920RA 2013 Keynote Systems, Inc.2013 11 734 35. 3 3 2013 Keynote Systems, Inc.2013 11 735 36. JavaScript JavaScript RUMJavaScript 2013 Keynote Systems, Inc.2013 11 736 37. Synthetic Monitoring 2013 Keynote Systems, Inc.2013 11 737 38. Google Analytics2013 Keynote Systems, Inc.2013 11 738 39. Google Analytics First PaintTime to Interactive2013 Keynote Systems, Inc.2013 11 739 40. Keynote2013 Keynote Systems, Inc.2013 11 740 41. KeynoteFirst PaintTime to Interactive2013 Keynote Systems, Inc.2013 11 741 42. 1 510 5871012 8.4 58710[12131214] 10.1252013 Keynote Systems, Inc.2013 11 742 43. 2 2013 Keynote Systems, Inc.2013 11 743 44. 3 1 Web PC 2013 Keynote Systems, Inc.2013 11 744 45. 20X$$$Web Content First Mile$$$20XTier 1 ISPs6X Middle Mile50X$$$Local ISPs Last Mile6X$$$Web Users 2013 11 750X 46. Internet Health Report www.internethealthreport.comPOWERING A BETTER INTERNET 47. 2013 Keynote Systems, Inc.2013 11 747 48. Big DataActionable Data 2013 Keynote Systems, Inc.2013 11 748 49. 3 2. HTML/CSS/JavaScriptNTT 1. web serverKDDI3. /Last MileISPMiddle MileFirst Mile 2013 11 749 50. 2 First Paint Time to Interactive W3C Web Performance Working GroupW3C Navigation Tim eAPI2013 Keynote Systems, Inc.2013 11 750 51. 2013 11 7W3C Navigation Time 51 52. W3C Web Performance Working Group2013 Keynote Systems, Inc.2013 11 752 53. Web2013 Keynote Systems, Inc.2013 11 753 54. Web DNS Lookup DNSTTLDNS Initial Connection Internet SSL First Byte Download Content Download 2013 Keynote Systems, Inc.2013 11 754 55. General Rule Book 2013 Keynote Systems, Inc.2013 11 755 56. 2013 Keynote Systems, Inc.2013 11 756 57. 2013 Keynote Systems, Inc.2013 11 757 58. 80:20 2013 Keynote Systems, Inc..2013 11 758 59. 2013 Keynote Systems, Inc.2013 11 759 60. 2013 Keynote Systems, Inc.2013 11 760 61. Twitter2013 Keynote Systems, Inc.2013 11 761 62. 62 63. 2013 Keynote Systems, Inc.2013 11 763 64. NTTweb serverKDDI Last Mile38ISPMiddle Mile24First Mile12 2013 11 764 65. 2013 Keynote Systems, Inc.2013 11 765 66. 2013 Keynote Systems, Inc.2013 11 766 67. E-Commerce Top20 IEFF2013 Keynote Systems, Inc.2013 11 767 68. SPDY SPDYGoogleHTTP/2.0 HTTP TLSTransport Layer Security SPDY SPDY Internet Explorer 11 Chrome 10 Firefox 13 Opera 12.10 Android 3.0 2013 Keynote Systems, Inc.2013 11 768 69. SPDY TCP/IP 3Way Handshake TLS HTTP GetKeep-Alive 1TCPSPDY24HTT P2013 Keynote Systems, Inc.2013 11 769 70. Zozo Town IEFirefoxView 2013 Keynote Systems, Inc.: 86 : 10 IP: 10 : 32 2013 11 7: 84 : 10 IP: 17 : 3470 71. Keynote Benchmarks & Research2013 Keynote Systems, Inc.2013 11 771 72. 2013 Keynote Systems, Inc.2013 11 772 73. 2013 11 7RUP (Real User Perspective) W3C Navigation TimeISPweb serverISP Last MileMiddle Mile API First Mile 73 74. Real User Perspective Time to Interactive2013 Keynote Systems, Inc.2013 11 774 75. Real User Perspective 2013 Keynote Systems, Inc.2013 11 775 76. Real User Perspective 2013 Keynote Systems, Inc.2013 11 776 77. 3 Systems/Server Side Monitoring Synthesis Monitoring Real User Monitoring 2013 Keynote Systems, Inc.2013 11 777 78. WEB API 2013 Keynote Systems, Inc..2013 11 778 79. 2013 11 7ApP (Application Perspective) KeynoteSOAPRESTFTP 515301GET /WebSite1/ WebService.asmx/ getHello? str=string HTTP/ 1.1 Host: apiserverNTTweb serverKDDI Middle MileLast Mile ISPAgentFirst Mile 79 80. WEB 2013 Keynote Systems, Inc..2013 11 780 81. 2013 11 7CApPCTxP TxPApP 515301AgentLast MileMiddle MileAgent 81GET /WebSite1/ WebService.asmx/ getHello? str=string HTTP/ 1.1 Host: apiserverFirst Mile 82. WEB2013 Keynote Systems, Inc..2013 11 782 83. 2013 11 7MWP (Mobile Web Perspective) WebKit WebSIM 515301SoftBank Gateway 3G/4G docomo Gateway web serverNTTLast MileAgentMiddle MileFirst Mile 83 84. Mobile (3G) 85. Dirty WiFi 55! 100200ms2013 Keynote Systems, Inc..2013 11 785 86. 12030Km NTT 800MHz 15MHz 12.5KHz 15MHz/12.5KHz = 1200 7 1200/7170 87. 1200300m 88. 2013 Keynote Systems, Inc..2013 11 788 89. 100 (2013 Keynote Systems, Inc.2013 11 789 90. 20%11KB 1. 100KB {100(1-0.8)}0.8=25 ={100(1-0.8)}0.8^2 =31.25 31.256 22 22(2526, 25+26)=(13, 37) 95%13372. 1,000KB {1,000(1-0.8)}0.8=250 ={1,000(1-0.8)}0.8^2 =312.5 312.518 2(250218, 250+218)=(214, 286) 95%214286 91. DoCoMo VS SoftBank2013 Keynote Systems, Inc.2013 11 791 92. 2013 Keynote Systems, Inc.2013 11 792 93. DNS ISPDNS DNS TTLDNS Lookup2013 Keynote Systems, Inc.2013 11 793 94. DNSTTL TTL102013 Keynote Systems, Inc.2013 11 794 95. DNS2013 Keynote Systems, Inc.2013 11 795 96. 2013 Keynote Systems, Inc.2013 11 796 97. DNSTTL BINDTTL TTLDNS 2013 Keynote Systems, Inc.2013 11 797 98. 2013 Keynote Systems, Inc.2013 11 798 99. SSL HTML Google SSL CSS 10 Ajax 99 100. Mobile E-Commerce Top20 SoftBank May29th June19th2013 Keynote Systems, Inc.2013 11 7100 101. Mobile E-Commerce Top20 DoCoMo May29th June19th2013 Keynote Systems, Inc.2013 11 7101 102. 2013 Keynote Systems, Inc.2013 11 7102 103. Amazon Japan2013415 11:05:266102013415 11:11:29 2013 Keynote Systems, Inc.2013 11 7103 104. Amazon Japan2013 Keynote Systems, Inc.2013 11 7104 105. Amazon20134115 2013 Keynote Systems, Inc.2013 11 7105 106. 2013 Keynote Systems, Inc.2013 11 7106 107. 20134115 2013 Keynote Systems, Inc.2013 11 7107 108. 2013 Keynote Systems, Inc.2013 11 7108 109. 30%109 110. 2013 Keynote Systems, Inc.2013 11 7110 111. Scatter Plot - 2013 Keynote Systems, Inc. 2013 11 7111 112. Waterfall Chart 2013 Keynote Systems, Inc.2013 11 7112 113. 2013 Keynote Systems, Inc.JavaScript 2013 11 7113 114. 3rd Party JavaScript2013 Keynote Systems, Inc.2013 11 7114 115. JavaScript2013 Keynote Systems, Inc.2013 11 7115 116. Scatter Plot - 2013 Keynote Systems, Inc. 2013 11 7116 117. 2013 Keynote Systems, Inc.2013 11 7117 118. 3rd Party JavaScript http:// googleads.g.doubleclick.net/ pagead/ viewthroughconversion/ 980023218/? value=0&guid=ON&script=0https://ssl.socdm.com/sa/js? said=sg11341-s&t=12013 Keynote Systems, Inc.2013 11 7118 119. JavaScript2013 Keynote Systems, Inc.2013 11 7119 120. 3rd Party JavaScript http://serv2.vizury.com/analyze/ pixel.php?account_id=VIZVRM943http://v6.advg.jp/adpv6/pv.js/ 7qb http:// googleads.g.doubleclick.net/ pagead/ viewthroughconversion/ 987798848/? value=0&guid=ON&script=0 http://b92.yahoo.co.jp/js/ s_retargeting.js http:// www.googleadservices.com/ pagead/conversion.jshttps://j.amoad.com/js/dc.jshttp://dex00.deqwas.net/dhc/ scripts/x.js? noCache=1373475746676https://s.nend.net/js/nendRt.js 2013 Keynote Systems, Inc.2013 11 7120 121. 2013 Keynote Systems, Inc.2013 11 7121 122. 3rd Party 2013/7/612DoCoMo3G11 microad.jp deqwas.net baynote.net impact-ad.jp openx.net deqwas-dsp.net advg.jp href.asia doubleclick.net dhc.co.jp gssprt.jp i-mobile.co.jp yahoo.co.jp advertising.com gsspat.jp vizury.com google.co.jp googleadservices.com amoad.com genieessp.jp nend.net socdm.com cloudfront.net omtrdc.net 2013 Keynote Systems, Inc.78 59 54 51 39 35 31 26 20 18 14 11 10 9 9 9 8 6 5 5 5 4 1 12013 11 7122 123. 3rd Party 2013/7/612SoftBank3G11advg.jp2deqwas.net1dhc.co.jp3i-mobile.co.jp1microad.jp82013 Keynote Systems, Inc.2013 11 7123 124. ? Simple is best 100KB1KB CSS 1JavaScript 1Redirect 1 20KBiPhone 1 2012 Keynote Systems, Inc.2013 11 7124 125. 1 PC PC 1 5 1 2012 Keynote Systems, Inc.2013 11 7125 126. Performance Best Practice JavaScriptHTML CSSHTML Keep aliveKeep alive HTML MIMEtext/**javascript* CSS1 JavaScript12012 Keynote Systems, Inc.2013 11 7126 127. W3C Web Mobile Best Practice http://www.w3.org/TR/mobile-bp/ Auto refresh Table input type=text) height, width ALT TableTable2012 Keynote Systems, Inc.2013 11 7127 128. Web Web UX 2012 Keynote Systems, Inc.2013 11 7128 129. FacebookTwitter 2013 Keynote Systems, Inc.2013 11 7129 130. 2013 Keynote Systems, Inc.2013 11 7130 131. Harvard Business Review 2013102013 Keynote Systems, Inc.2013 11 7131 132. 2013 Keynote Systems, Inc.2013 11 7132 133. Web Value PropositionWhy US 2012 Keynote Systems, Inc..2013 11 7133 134. 2013 Keynote Systems, Inc..2013 11 7134 135. 2013 11 7MDP (Mobile Device Perspective) SIM 515301SoftBank Gateway3G/4G docomo GatewayLast MileAgentapplication serverMiddle Mile135First Mile 136. Mobile Device Perspective (MDP) HTrouble occurs in remote location: 1. : KeynoteMDP InternetInternet3. 2. MyKeynote 4. 2012 Keynote Systems, Inc. Keynote & Client Confidential.2013 11 7 136 137. Mobile Device Perspective (MDP) H 2012 Keynote Systems, Inc. Keynote & Client Confidential.2013 11 7 137 138. MDP2012 Keynote Systems, Inc. Keynote & Client Confidential.2013 11 7 138 139. MDP6.0 : TCP/IP2013 Keynote Systems, Inc. 140. 2013 Keynote Systems, Inc..2013 11 7140 141. 2013 11 7StP (Streaming Perspective) 5153011NTTstreaming serverKDDI Middle MileLast Mile ISPFirst MileAgent 141 142. 2013 Keynote Systems, Inc.2013 11 7142 143. 2013 Keynote Systems, Inc.2013 11 7143 144. 2013 Keynote Systems, Inc.2013 11 7144 145. KITE, MITE, DEVICEANYWHERE 2013 Keynote Systems, Inc..2013 11 7145 146. KITE (Keynote Internet Testing Environment) PCIEFirefoxTxPApPCTxPCApP http://kite.keynote.com/2013 11 7146 147. MITE (Mobile Internet Testing Environment) PCMWP 2,600OS18,000 http://mite.keynote.com/2013 11 7147 148. DeviceAnywhere Studio APK2013 11 7148 149. DeviceAnywhere Studio OS 12013 11 7149 150. DeviceAnywhere Free2013 11 7150 151. TSPMANAGED TSP, LOADPRO 2013 Keynote Systems, Inc..2013 11 7151 152. 2013 11 7TsP (Test Perspective) Web 10010,000,000 VUVirtual Userweb serverVirtual UserFirst MileMiddle MileAgent 152Last Mile 153. Concurrent User HTT P Web 1 2012 Keynote Systems, Inc..2013 11 7153 154. 2012 Keynote Systems, Inc..2013 11 7154 155. 2012 Keynote Systems, Inc..2013 11 7155 156. OK Web Top 2012 Keynote Systems, Inc..2013 11 7156 157. LoadPro 52012 Keynote Systems, Inc..2013 11 7157 158. ? ? ? ? ? ? (ADSL) ? 2012 Keynote Systems, Inc..2013 11 7158 159. ISP Keynote 2012 Keynote Systems, Inc..2013 11 7159 160. JavaScript (AJAXFLASH) 2012 Keynote Systems, Inc..2013 11 7160 161. 10 ,0 0 070 09 ,0 0 060050 07,0 0 0 6 ,0 0 04005,0 0 0 3004 ,0 0 0 3 ,0 0 02002 ,0 0 0 10 01,0 0 0 08 ,0 0 00 051015202530354045505560M in u te s Us ers C oncurrent 2012 Keynote Systems, Inc../ S es s ions perH oureT ime R es pons2013 11 7161 162. (Cookie) WEB PRIVACY TRACKING2013 Keynote Systems, Inc..2013 11 7162 163. WPT (Web Privacy Tracking) Third Party Cookie2013 11 7163 164. KEYNOTE SIGOS SITE2013 Keynote Systems, Inc..2013 11 7164 165. World-wide customersCustomer Not yet a customer 166. Network Topology + SITE BSC BTS CDR CIMD GGSN GMSC GPRS GSM HLR IP ISDN ISUP LTE MGW MMSC MSC PBX PSTN RNC SGSN SITE SMPP SMSC UCP UMTSBase Station Controller Base Transceiver Station Call Detail Record Computer Interface to Message Distribution Gateway GPRS Support Node Gateway MSC General Packed Radio Service (2.5G) Global System for Mobile Communication (2G) Home Location Record Internet Protocol Integrated Service Digital Network ISDN User Part Long Term Evolution (4G) Media Gateway MMS Centre Mobile Switching Centre Private Branch Exchange Public Switched Telephone Network Radio Network Control Serving GPRS Node SIGOS Integrated Test Environment Short Message Peer to Peer Short Message Service Centre Universal Computer Protocol Universal Mobile Telecommunications System (3G) UTRAN UMTS Terrestrial Access Network VLR Visitor Location Register 167. Central SIM Multiplexing SIM Multiplexer (Basic) Call SIM card Selectio nCentral UnitLAN / WANLocal Units Interface sCore Network InterfacesVirtual SIM Card TransferCompact Local Units LTE/UMTS/HSPA+ Uu UMTS/HSPA/HSPA+ Interface Uu InterfaceRadio Interfaces 168. Anywhere + AnytimeCentral Unit ClientsSIM Multiplexerpermanent IP connectionLAN / WANMobile LUHundreds of static test locations Full internal synchronizationCentral SIM MultiplexingLocal Unit (LU)Quasi permanent IP connection Via VPN serverSelf-sufficient test executionDrive service testingWireless LU NomadicWpermanent IP connection Via VPN Server & GPRS/EDGE/ HSPA modemNomadicFCompact LU 169. Services & Interfaces S I T E Solution Tests ALL Network ServicesNetwork InterfacesSPEECHDATAMESSAGINGFIXEDRADIOIPCOREVoiceData IP (CS/PS)SMSISDN S0HSPAWLANIuCS / IuPSVoice QualityWeb / WAP BrowsingMMSISDN PRI S2mUMTS UuDSLGSM GbSuppl. ServicesWLANMobile IMPSTN a/bGSM UmEthernetGSM AIVRE-mailiPhoneEDGEMM7ISUPPush-to-TalkStreamingBlackBerryCDMA 2000SMPP, UCP, CIMPSS7VoIPVideo TelephonyGSM-RSMTP / IMAPIN / CAMELEchoVideo QualityLTE UuSYNERGIES VAS (Value Added Services), IREG Scenarios, Digital Rights ManagementMAP (HLR/VLR) LTE S1 170. Web Portal for SITE Login 171. Graphical User Interface User friendly WEB Interface: easy access via internet XML interface: integration for SITETest cases overview Tests/reports in one tree Reports overview 172. Reporting and Alarming Tree-oriented definition and scheduling Large libraries of test cases Simple and convenient dragand-drop option Single or multiple KPIs in one chart Parallel display of multiple chart windowsReport EditorToolbox for test cases and reportsReport status 173. Reporting and Alarming Matrix Report Service Alarm Map (SAM) Dashboard 174. 175. Web 2013 Keynote Systems, Inc.2013 11 7175 176. 2013 Keynote Systems, Inc.2013 11 7176 177. Slideshare http://www.slideshare.net/takehora/presentations Web http://www.keynotesystems.jp/ Facebook https://www.facebook.com/KeynoteSystemsJapan http://blog.keynotesystems.jp/ [email protected] 2013 11 7177 178. Q&A2013 Keynote Systems, Inc.2013/11/07178