Upload
vankien
View
269
Download
22
Embed Size (px)
Citation preview
0724-1601D84N4445 DOCVARIABLE \* MERGEFORMAT
DOCVARIABLE \* MERGEFORMAT
1 30
2
3
4 2
5
6
7
8
9
10 3
:
2016112420161130
0724-1601D84N4445
1
()
1
1
70
2
1
50
23
3
1
2()2
3
4
20161124201611309:0011:3014:0016:30()15050
1//
2
32
1
1
7261
020-37860612
020-37860611
2
120905690610808
020-37860613
020-37860611
20161215093000(0900)
()25726
20161215093000
25726
(8620) 37860544/37860532 (8620)81887233
(8620) 87768283 / 37860550 (8620)81887233
72618 111
510080510115
1
120905690610808
2
120905690610703
3
120905690610808
20161123
1
2()2
3
4
1
DockerDocker
1.
2. mysqlmysql
-
1.
-
1. 1GB
2. RAM1 GB
3. /Dashboard
-
1. High Availability
-
1.
2.
3. HA
4. TCP/HTTP
5. HA
6. IP
-
1.
2.
3.
-
1.
2. HAProxy
3. SSL
-
4.
5.
6.
-
1.
2.
3.
4. SHELL
-
1. Docker Compose
2.
3.
4.
5. Compose
1.
2.
3.
4.
1.
2.
3.
4.
5.
6.
7. TomcatWebLogic) ELKSplunkZabbix)
8.
-
1. IPSec OverlayVxlan Overlay
2. macvlan
3.
4. CIDR
-
1. Docker
2. NAS/NFS/Gluster/Ceph
3.
4.
-
1.
2. LDAP
3. GITHUB
-
1.
2.
-
RESTful APIRESTful API
Kerberos
1.
2. client
3. ClientServerServer
ETL
Kettle
1. Kettle
Sqoop
1. Sqoop
2. ETLMapReduceYarn
kafka
1. kafka
2. 4k
LogStash
1. LogStashSyslogRabbitMQKafkaRedis
2.
3. API
ElasticSeach
1. ElasticSeach
2. RESTful
Kibana
1. KibanaElasticsearch
2. LogstashHadoopBeatsElasticsearchApache FlumeFluentd
Flume
1. Flume
2.
3.
Hive
1. Hive
2. UDF
3. KerberosLDAP
4.
5. hadoop/mapreducemysqlderby
Spark SQL
1. Spark SQLHiveRDDParquetJSON
2.
drill
1. drill
Neo4j
1. Neo4jACID
2. RESTful
GraphX
1. GraphXRDD
Mahout
1. MahoutMapReduce
2. MapReduce Spark
3.
Spark Mllib
1. Spark Mllib
2. lower-levelhigher-levelpipeline API
Hadoop100
HDFS
1. HDFS
2. KerberosLDAP
3. HA
Yarn
1. Yarn
2.
3. KerberosLDAP
ZooKeeper
1. ZooKeeper
Spark
1. Spark
2.
HBase
1. Spark
2. ,
3. WALReplication
1. /
2.
1. /
2.
IP
//
k8s/mesos/
17*24
2
3
4
5BUGBUG
6
7
2
1
2
3
4
CPUIPMAC
5
CPU
6
vGPUNVIDIAGPULinuxWindowsvGPU
7
NetflowACL
8
IPIPIP
9
LUN
10
11
12
13
High Available
14
15
HAHA
16
Network I/OI/OI/O
17
18
I/OSR-IOVUUSB
19
USB/ISO
20
(FC SANiSCSI)
21
22
23
24
vCPUCPU
25
26
CPUvSMPNUMA
27
CPUCPU
28
BIOS
29
30
31
32
RISC
33
LUN
34
Zone
35
ADADADAD
36
37
38
39
ios
40
Excel
41
42
DDOS
43
1024
44
16TB
45
512
46
128VCPU
47
6TB
48
64TB
49
128
50
x86
51
SANNASiSCSI.
52
Windows Server 2003Windows Server 2008Windows Server 2012Redhat LinuxSuse Linux
53
VMwareWinServerVMwareWinServerDRSvMotionHA
54
PowerVMPowerVMISOCPUISOvSCSINPIVSSP
55
56
37*24
57
50CPU
17*24
2
3
4
5BUGBUG
6
7
1.
2.
3.()
4.
5.
6.
7.
8
1
1.1
2.
2.1
2.2
2.3
2.4
2.5
1)
2)
3
2.6
3.
3.1
3.2
3.3 ,
4
4.1
4.2[2002]1980[2011]534
100
1.5%
1.5%
1.0%
100-500
1.1%
0.8%
0.7%
500-1000
0.8%
0.45%
0.55%
1000-5000
0.5%
0.25%
0.35%
5000-10000
0.25%
0.1%
0.2%
10000-50000
0.05%
0.05%
0.05%
50000-100000
0.035%
0.035%
0.035%
100000-500000
0.008%
0.008%
0.008%
500000-1000000
0.006%
0.006%
0.006%
1000000
0.004%
0.004%
0.004%
350
300
450
300
1001.5%=1.5
300-1001.1%=2.2
=1.5+2.2=3.7
120905690610808
0724-1601D84N4445/
5.
5.1
1)
2)
3)
4)
5)
6)
5.2
6.
6.1
6.2
6.3
7.
7.l
7.2
7.33
8
8.1
8.2
9
10.
10.1
10.2
10.3
11.
11.1
11.2
11.3
1)
2) ()
11.4
12.
12.1
13.
13.1
13.2
14.
14.1
14.2
15.
16.
16.1
16.2
1117,084.0025,084.00
2
3
120905690610703
4
5
16.3
16.4
16.5,
16.6
1)
2)
17.
17.190
17.2
18.
18.1
18.2
18.3
18.4UWORDEXCEL
19.
19.1
19.2
0724-1601D84N4445
()
19.3
19.4
20.
20.1
20.2
20.3
21.
21.1
21.2
21.3
21.4
22.
22.1
22.2
22.3
23.
23.1
23.2
23.3
23.4
24.
24.1
24.2
25.
25.1
26.
26.1
26.2
26.3
27.
27.1
7268
020-37860711
020-87768283/37860699
27.2
28.
28.1()
29.
29.1
29.2
30.
30.1 [2011]181
30.1.1 [2011]300
30.1.2
30.1.3
30.1.4
31.2
31.3
1
2
3
4
31.
11005040102100603010
32.
1
2
,
3
190
2
3
4
52
6
7
4
()
5
6
7
8
11
13213
3
(1.5)(1)0.5
4.5
,(3)(1-2)0-1
0-1.5
4.5
ETL(3)(1-2)0-1
(3)(1-2)0-1
3
High Availability31521
13
/DashboardCPU/1
Amazon EC2AWSAzureDigitalOceanExoscaleRackspaceHyper-vOpenStackVirtualBoxVMware FusionVMware vCloud AirVMware vSphere1
Amazon EC2AWSAzureDigitalOceanexoscalerackspace1
1
SHELL1
IPSec OverlayVxlan Overlaymacvlan1
WebSphereTomcatJbossWebLogicELKSplunkZabbixNeuvector1
(F5)1
HAProxyHAProxy1
1
TCP/HTTPInitializing TimeoutCheck IntervalCheck TimeoutHealthy ThresholdUnhealthy Threshold1
NFS/glusterFS/Cephvolume1
KerberosHadoop ACLKDCClient
0-2
12
ETL
NosqlNoSqlHDFSHBaseMongoDBOracleSQLServerMysqlkafkakettle
0-2
ELKSpark Streaming
0-2.5
DrillImpalaNoSqlsql
0-2
NEO4JSpark GraphX
0-1.5
mahoutSpark MLlibGraphX
0-2
0-1
5
1
/0-1
0.5
//0.5
k8s/mesos1
(2)(0.5-1.5)
5
(1)(0.5)
(2)(0.5-1.5)
2.1
24
6
1.1055-925
2.2
3.3
4.4
14
201611/Docker
1. 8
2. 3
3. 10
8
201611508
8
(4) (0-2)(0)
4
3
1()
A. C1C16%C1
B. 30%C2C22%(1C2)
C.
D.
E.
2
3 10
4.
W[Cmin/C]10 T M
W
C
Cmin
T
M
TM
5.2
1
2-31-2(2)0-1(1)
3
2
2-31-2(2)0-1(1)
3
3
1
20
4
0.5
3
5
5
5