PBO3325BUS Implement a Container Orchestration Platform … · Srihari Angaluri (Lenovo) Tony Harvey (Lenovo) Alka Gupta (VMware) PBO3325BUS #VMworld #PBO3325BUS Implement a Container

Srihari Angaluri (Lenovo)Tony Harvey (Lenovo)Alka Gupta (VMware)

PBO3325BUS

#VMworld #PBO3325BUS

Implement a Container Orchestration Platform

VMworld 2017 Content: Not fo

r publication or distri

bution

• This presentation may contain product features that are currently under development.

• This overview of new technology represents no commitment from VMware to deliver these features in any generally available product.

• Features are subject to change, and must not be included in contracts, purchase orders, or sales agreements of any kind.

• Technical feasibility and market demand will affect final delivery.

• Pricing and packaging for any new technologies or features discussed or presented have not been determined.

Disclaimer

2#PBO3325BUS CONFIDENTIAL



bution

3© 2017 Lenovo. All rights reserved.

Outline

• Data Center and Cloud Evolution

• Software Defined Technologies

• Overview of Containers

• VMware vSphere® Integrated Containers (VIC)

• System Architecture and Implementation

• Lenovo XClarityTM for on-prem infrastructure management

• VIC Demo



bution


Did You Know…?

• 10% of VMware vSAN® deployments are on Lenovo™ hardware

• The largest vSANdeployment in the world is on Lenovo hardware

• The worlds largest Intel® Xeon® Scalable supercomputing cluster is based on Lenovo™



bution

5

Industry Evolution

Wave1:

Converged

Software Defined InfrastructureVirtualize ServerVirtualize Server and

Storage

Acquired as single entity

Faster deployment Moves storage into server IT Agility - virtualizes server, storage, network, and public cloud

resources

Management

Servers

Storage

Networking

Wave 2:

Hyper ConvergedWave 3:

Software Defined Infrastructure (SDI)

Acquired as discrete parts

Hard to deploy

Traditional

Management

Servers

Storage

Networking

Management

Servers

Storage

Networking

++

So

ftw

are

De

fin

ed

Serv

ices Management

Servers

SDS

SDN

+

++

Rapid time-to-deploymentEase of management

IT Agility

Value

Continuous and dynamic

Applications / Workloads

© 2017 Lenovo. All rights reserved.



bution


Software Defined Datacenter is the new Cloud model

compute Storage NetworkStandard x86 Specialized x86 Specialized HW & SW

Server Virtualization

(ESXi / Hyper V)Storage Virtualization

(SDS / HCI)Network Virtualization

(SDN / NFV)

Ph

ysic

al In

frastr

uctu

reV

irtu

al In

frastr

uctu

reC

lou

d M

an

age

men

t

Policy based management

Cloud Automation

Cloud Operations

Unified Hardware Management

Virtual Resource Management

1. Business vs technology focused

2. Simplifies Service delivery

3. Agile and Automated



bution

7

Designed For Future Defined Datacenter

Lenovo ThinkAgile™

Agility

• Agility of public cloud on

most reliable infrastructure

• Scale from single cluster

to multiple racks

• 80% faster Time to Value

vs. traditional setup

Simplicity

• Planning via Automation tools

• Deployed by industry experts

• Manage via intuitive

management tools

Transformative Experience

• Arrives pre integrated - connect

to network and power

• Onsite deployment and training

• ThinkAgile™ Advantage - Single

point of support for entire stack




bution

8


Lenovo VMware Solutions

ThinkAgile™ VX Series

Appliance

vSAN and VCF Ready

NodesLenovo VCF

Build Your Own

• Use Lenovo/VMware certified

HW configurations

• Integration done by customer

• Self installed and maintained

Focus on your business not on

infrastructure

• Lenovo Tested, Qualified, Proven

• Built and tested by Lenovo with only vSAN

certified components.

• Lenovo Delivered, Installed, Configured

• Professional Services leave you with a

hyperconverged solution that is ready to go

• Lenovo ThinkAgile Advantage

• Backed by a direct line to 2nd level support

that won’t hand you offvSAN Ready Node available today

VCF planned Q3/Q4

Available Q4 2017Available

Reference Architecture



bution

9

Lenovo ThinkAgile VX Series

Easy To Size

ThinkAgile Design

Automation

Easy To DeployFactory Integration

ThinkAgile Advantage

Easy To MaintainSingle Point of Contact

XClarity Management




bution


Lenovo and VMware® Container

Orchestration PlatformVMworld 2017 Content: Not fo


bution

11

Network

Storage

Server

Virtualized Server +

SDS Storage

Management

Public Cloud

CONTAINERIZED WORKLOADS

Hyperconverged & Web-Scale Infrastructure

On-premises and Public CloudConverged

Infrastructure

Network

Storage

Server

Management

Network

Storage

Server

Management

Traditional

Infrastructure

Virtualized Server Virtualized Server

CONTAINERIZED WORKLOADS

On-premises

• Maximize legacy infrastructure where cost-effective

• Enable Hybrid-Cloud infrastructure & cloud-native

tools

• Leverage “On-prem” and “Public” resources when

needed for specific applications and workloads

Hybrid-Cloud – Integrating 3-Tier, Web-Scale, Public Cloud




bution


Containers Explained

VMware Integrated Containers (VIC) Containers Vs VMs



bution

https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux_atomic_host/7/html/overview_of_containers_in_red_hat_systems/introduction_to_linux_containers


Source: https://www.sciencelogic.com/wp-content/uploads/blog-vmworld-2016-3.png



bution

https://www.sciencelogic.com/wp-content/uploads/blog-vmworld-2016-3.png


vSphere Integrated Containers

• VMware open source project for providing an enterprise grade container orchestration platform on top of VMware vSphere

• Three main components– VMware vSphere Integrated Containers Engine, a container runtime for vSphere.

– VMware vSphere Integrated Containers Registry, an enterprise-class container registry server that stores and distributes container images (VMware Harbor)

– VMware vSphere Integrated Containers Management Portal, a container management portal. (VMware Admiral)

• By leveraging their existing SDDC, customers can run container-based applications alongside existing virtual machine based workloads in production without having to build out a separate, specialized container infrastructure stack.

https://vmware.github.io/vic-product/



bution

https://vmware.github.io/vic-product/


VIC Architecture



bution


Integration with VMware vCenter®



bution


Network Architecture

ACAC

DC

AC

DC

AC

900w900w

GR

N=10G

ACT/LN

K A

GR

N=10G

ACT/LN

K B

1615

1413

1211

109

87

65

43

21

3231

3029

2827

2625

2423

2221

2019

1817

4847

4645

4443

4241

4039

3837

3635

3433

5251

5049

M

S

RackSwitch G8052

Lenovo RackSwitch G7052 (1Gbps)

ACAC

DC

AC

DC

AC

900w900w

GR

N=10G

ACT/LN

K A

GR

N=10G

ACT/LN

K B

dvSw

itch0

(1Gb

ps M

gmt)

dvSw

itch1

(10G

bp

s Data)

Lenovo RackSwitch G8272 (10Gbps)Mgmt

18 20 22 24 26 28 30 32

17 19 21 23 25 27 29 31

2 4 6 8 10 12 14 16

1 3 5 7 9 11 13 15

34 36 38 40 42 44 46 48

33 35 37 39 41 43 45 47

50 52 54

49 51 53

Mgmt

18 20 22 24 26 28 30 32

17 19 21 23 25 27 29 31

2 4 6 8 10 12 14 16

1 3 5 7 9 11 13 15

34 36 38 40 42 44 46 48

33 35 37 39 41 43 45 47

50 52 54

49 51 53

GR

N=10G

ACT/LN

K A

GR

N=10G

ACT/LN

K B

AC

900wDC

AC

2

1

1PCI

2PCI

3PCI

6PCI

7PCI

8PCI

AC

900wDC

AC

12

0G

B

GRN=10GACT/ LNK A

GRN=10GACT/ LNK B

GR

N=10G

ACT/LN

K A

GR

N=10G

ACT/LN

K B

AC

900wDC

AC

2

1

1PCI

2PCI

3PCI

6PCI

7PCI

8PCI

AC

900wDC

AC

12

0G

B

GRN=10GACT/ LNK A

GRN=10GACT/ LNK B

GR

N=10G

ACT/LN

K A

GR

N=10G

ACT/LN

K B

AC

900wDC

AC

2

1

1PCI

2PCI

3PCI

6PCI

7PCI

8PCI

AC

900wDC

AC

12

0G

B

GRN=10GACT/ LNK A

GRN=10GACT/ LNK B

GR

N=10G

ACT/LN

K A

GR

N=10G

ACT/LN

K B

AC

900wDC

AC

2

1

1PCI

2PCI

3PCI

6PCI

7PCI

8PCI

AC

900wDC

AC

12

0G

B

GRN=10GACT/ LNK A

GRN=10GACT/ LNK B

GR

N=10G

ACT/LN

K A

GR

N=10G

ACT/LN

K B

AC

900wDC

AC

2

1

1PCI

2PCI

3PCI

6PCI

7PCI

8PCI

AC

900wDC

AC

12

0G

B

GRN=10GACT/ LNK A

GRN=10GACT/ LNK B

GR

N=10G

ACT/LN

K A

GR

N=10G

ACT/LN

K B

AC

900wDC

AC

2

1

1PCI

2PCI

3PCI

6PCI

7PCI

8PCI

AC

900wDC

AC

12

0G

B

GRN=10GACT/ LNK A

GRN=10GACT/ LNK B

vSAN Cluster

GR

N=10G

ACT/LN

K A

GR

N=10G

ACT/LN

K B

AC

900wDC

AC

2

1

1PCI

2PCI

3PCI

6PCI

7PCI

8PCI

AC

900wDC

AC

12

0G

B

GRN=10GACT/ LNK A

GRN=10GACT/ LNK B

GR

N=10G

ACT/LN

K A

GR

N=10G

ACT/LN

K B

AC

900wDC

AC

2

1

1PCI

2PCI

3PCI

6PCI

7PCI

8PCI

AC

900wDC

AC

12

0G

B

GRN=10GACT/ LNK A

GRN=10GACT/ LNK B

GR

N=10G

ACT/LN

K A

GR

N=10G

ACT/LN

K B

AC

900wDC

AC

2

1

1PCI

2PCI

3PCI

6PCI

7PCI

8PCI

AC

900wDC

AC

12

0G

B

GRN=10GACT/ LNK A

GRN=10GACT/ LNK B

vSAN Cluster

vCenter, VIC, VCHs, xClarity, etc.

To customer mgmt network

To customer data network

To customer data network

Lenovo RackSwitch G8272 (10Gbps)



bution


Network Redundancy

Mgmt

18 20 22 24 26 28 30 32

17 19 21 23 25 27 29 31

2 4 6 8 10 12 14 16

1 3 5 7 9 11 13 15

34 36 38 40 42 44 46 48

33 35 37 39 41 43 45 47

50 52 54

49 51 53

Link aggregation

ISL VLAG (VL1)

VLAG (VL3)VLAG (VL2)

VLAG Peers

Nodes

Core Switches

ACAC

DC

AC

DC

AC

900w900w

GR

N=10G

ACT/LN

K A

GR

N=10G

ACT/LN

K B

Mgmt

18 20 22 24 26 28 30 32

17 19 21 23 25 27 29 31

2 4 6 8 10 12 14 16

1 3 5 7 9 11 13 15

34 36 38 40 42 44 46 48

33 35 37 39 41 43 45 47

50 52 54

49 51 53

ACAC

DC

AC

DC

AC

900w900w

GR

N=10G

ACT/LN

K A

GR

N=10G

ACT/LN

K BVMworld 2017 Content: N

ot for publicatio

n or distribution


Virtual networking setup (DVswitches)

VCH container bridge network

Host management network

Software iSCSI (vHBA) network

VCH Public, Client, and Mgmt network



bution


Creating the Virtual Container Host (VCH)



bution




bution


Listing VCHs

./vic-machine-linux ls --target $VCSA --user $USER --password $PW --thumbprint $VCSA_THUMBPRINT

[root@dev02 vic]# ./ls-vch

Aug 27 2017 12:36:09.732-04:00 INFO ### Listing VCHs ####

Aug 27 2017 12:36:09.853-04:00 INFO Validating target

ID PATH NAME VERSION UPGRADE STATUS

vm-240 /ThinkAgile-6.5-DC/host/VIC-Cluster-2/Resources vch-2 v1.1.1-10711-56a309f Up to date

vm-236 /ThinkAgile-6.5-DC/host/VIC-Cluster-2/Resources vch-1 v1.1.1-10711-56a309f Up to date



bution


./vic-machine-linux inspect \

--target $VCSA \

--user $USER \

--password $PW \

--thumbprint $VCSA_THUMBPRINT \

--compute-resource $COMPUTE_RESOURCE \

--name $VCH_NAME

[root@dev02 vic]# ./inspect-vch vch-2

Aug 27 2017 12:37:05.810-04:00 INFO ### Inspecting VCH ####

Aug 27 2017 12:37:05.945-04:00 INFO Validating target

Aug 27 2017 12:37:10.281-04:00 WARN Disabling host-46 hostd.log collection (ServerFaultCode: A general system error occurred: )

Aug 27 2017 12:37:10.289-04:00 INFO

Aug 27 2017 12:37:10.289-04:00 INFO VCH ID: VirtualMachine:vm-240

Aug 27 2017 12:37:10.297-04:00 INFO

Aug 27 2017 12:37:10.297-04:00 INFO Installer version: v1.1.1-10711-56a309f

Aug 27 2017 12:37:10.297-04:00 INFO VCH version: v1.1.1-10711-56a309f

Aug 27 2017 12:37:10.297-04:00 INFO

Aug 27 2017 12:37:10.297-04:00 INFO VCH upgrade status:

Aug 27 2017 12:37:10.297-04:00 INFO Installer has same version as VCH

Aug 27 2017 12:37:10.297-04:00 INFO No upgrade available with this installer version

Aug 27 2017 12:37:10.314-04:00 WARN Unable to identify address acceptable to host certificate

Aug 27 2017 12:37:10.314-04:00 INFO

Aug 27 2017 12:37:10.314-04:00 INFO VCH Admin Portal:

Aug 27 2017 12:37:10.314-04:00 INFO https://10.240.39.218:2378

Aug 27 2017 12:37:10.314-04:00 INFO

Aug 27 2017 12:37:10.314-04:00 INFO Published ports can be reached at:

Aug 27 2017 12:37:10.314-04:00 INFO 10.240.39.218

Aug 27 2017 12:37:10.314-04:00 INFO

Aug 27 2017 12:37:10.314-04:00 INFO Docker environment variables:

Aug 27 2017 12:37:10.314-04:00 INFO DOCKER_HOST=10.240.39.218:2376

Aug 27 2017 12:37:10.314-04:00 INFO

Aug 27 2017 12:37:10.314-04:00 INFO Connect to docker:

Aug 27 2017 12:37:10.314-04:00 INFO docker -H 10.240.39.218:2376 --tls info

Aug 27 2017 12:37:10.314-04:00 INFO Completed successfully



bution


Add VCH to the management portal



bution


VCH hosts



bution


Deploying containers[root@dev02 vic]# printenv DOCKER_HOST

10.240.39.224:2376

[root@dev02 vic]# docker --tls ps

CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES

942b8b183303 library/busybox:latest "/bin/sh" 8 hours ago Up 2 minutes 10.240.39.224:8080->80/tcp busybox_srihari-mcm14-

52234434093

[root@dev02 vic]# docker -tls attach busybox_srihari-mcm14-52234434093

flag provided but not defined: -tls

See '/usr/bin/docker-current --help'.

[root@dev02 vic]# docker --tls attach busybox_srihari-mcm14-52234434093

/ # ls

bin etc lib mnt root sbin tmp var

dev home lost+found proc run sys usr

/ # ip addr

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue qlen 1

link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00

inet 127.0.0.1/8 scope host lo

valid_lft forever preferred_lft forever

inet6 ::1/128 scope host


2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq qlen 1000

link/ether 00:50:56:ba:d2:ea brd ff:ff:ff:ff:ff:ff

inet 172.16.0.2/16 scope global eth0


inet6 fe80::250:56ff:feba:d2ea/64 scope link


/ #



bution


Installing Wordpress

[root@dev02 vic]# cat deploy-wordpress

#!/bin/bash

export DOCKER_HOST=10.240.39.218:2376

docker --tls run -d -e MYSQL_ROOT_PASSWORD=wordpress -e MYSQL_DATABASE=wordpress -e MYSQL_USER=wordpress -e

MYSQL_PASSWORD=wordpress -v mysql_data:/var/lib/mysql --name=mysql mysql:5.6

docker --tls run -d -p 8080:80 -e WORDPRESS_DB_HOST=mysql:3306 -e WORDPRESS_DB_PASSWORD=wordpress --name wordpress

wordpress:latest

[root@dev02 vic]# docker --tls ps

CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS

NAMES

f47603a28894 wordpress:latest "docker-entrypoint.sh" About an hour ago Up 25 seconds

10.240.39.218:8080->80/tcp wordpress

8eed30a1dad1 mysql:5.6 "docker-entrypoint.sh" About an hour ago Up 5 minutes

mysql



bution


Wordpress running..



bution


Container Management Portal (Admiral)



bution


Deploying image templates



bution


Provisioning..



bution

32

41

42

39

40

37

38

35

36

33

34

31

32

29

30

27

28

25

26

23

24

21

22

19

20

17

18

15

16

13

14

11

12

09

10

07

08

05

06

03

04

01

02

41

42

39

40

37

38

35

36

33

34

31

32

29

30

27

28

25

26

23

24

21

22

19

20

17

18

15

16

13

14

11

12

09

10

07

08

05

06

03

04

01

02

0 1 2 3 4 5 6 7 8 9

3550 M5

0 1 2 3 4 5 6 7 8 9

3550 M5

0 1 2 3 4 5 6 7 8 9

3550 M5

0 1 2 3 4 5 6 7 8 9

3550 M5

0 1 2 3 4 5 6 7 8 9

3550 M5

0 1 2 3 4 5 6 7 8 9

3550 M5

0 1 2 3 4 5 6 7 8 9

3550 M5

0 1 2 3 4 5 6 7 8 9

3550 M5

0 1 2 3 4 5 6 7 8 9

3550 M5

0 1 2 3 4 5 6 7 8 9

3550 M5

0 1 2 3 4 5 6 7 8 9

3550 M5

0 1 2 3 4 5 6 7 8 9

3550 M5

0 1 2 3 4 5 6 7 8 9

3550 M5

0 1 2 3 4 5 6 7 8 9

3550 M5

0 1 2 3 4 5 6 7 8 9

3550 M5

0 1 2 3 4 5 6 7 8 9

3550 M5

RackSwitch G7052

S

Mgmt

48 50 51 5225 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 481 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

Mgmt

18 20 22 24 26 28 30 32

17 19 21 23 25 27 29 31

2 4 6 8 10 12 14 16

1 3 5 7 9 11 13 15

34 36 38 40 42 44 46 48

33 35 37 39 41 43 45 47

50 52 54

49 51 53

Mgmt

18 20 22 24 26 28 30 32

17 19 21 23 25 27 29 31

2 4 6 8 10 12 14 16

1 3 5 7 9 11 13 15

34 36 38 40 42 44 46 48

33 35 37 39 41 43 45 47

50 52 54

49 51 53

0 1 4 5 16 236 7 8 9 10 11 12 13 - 15 22212019181732

3650 M5

0 1 4 5 16 236 7 8 9 10 11 12 13 - 15 22212019181732

3650 M5

0 1 4 5 16 236 7 8 9 10 11 12 13 - 15 22212019181732

3650 M5

0 1 4 5 16 236 7 8 9 10 11 12 13 - 15 22212019181732

3650 M5

0 1 4 5 16 236 7 8 9 10 11 12 13 - 15 22212019181732

3650 M5

RackSwitch G7052

S

Mgmt

48 50 51 5225 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 481 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

Seamless scaling of

compute or storage

capacity as you grow

using Lenovo

ThinkSystem™ x86

Servers

Leaf/spine switch

architecture with

Lenovo RackSwitch

switches to scale

racks horizontallyAn integrated HW and SW reference architecture,

purpose built for container applications. Easy to

deploy, easy to scale, easy to manage.

• Integrated high speed “IP fabric” with Lenovo switches

capable of delivering fast and predictable performance.

• Integrated container application platform (PaaS) reference

architecture with VMware vSAN/NSX (SDDC) + Integrated

Containers and Lenovo xClarity infrastructure management

• Highly optimized for scalability, performance and value

Lenovo/SDDC/VIC Reference Platform

Managed by Lenovo

xClarity Administrator

software




bution

33

Managing your infrastructure with

Lenovo XClarity




bution




bution




bution




bution




bution




bution


Firmware updates/compliance



bution


vSphere Integrated Containers Demo

Alka Gupta

VMware



bution




bution



bution



bution

44

ThinkAgile Design Automation

Measurecompute & storage

workloadsusing an agent-less collector

Analyzeworkload demands &

existing hardware assets(age, power, space, cooling)

Decidefrom ThinkAgile solution

designs optimized for

your IT requirements

Fast and Simple

• Workload sizing

• Capacity planning

• Optimized design

• Quote & Order




bution

45

Run Your Workloads, Where Its Best For You

Predictable Workloads

Elastic Workloads

25%

75%

Balance Owning and Renting For

Today’s Enterprise Workloads

Spin up and down resources on the public cloud

Lower costs with private cloud infrastructure

• Some are best in public cloud, some on Premise

• Depends on need – amounts, time, costs

Your % Will Vary – You Choose

© 2017 Lenovo. All rights reserved. #PBO3325BUS CONFIDENTIAL



bution

46

Traditional 3-Tiered ArchitectureComplex and Separate Silos

Evolve without RiskSeamlessly shift to HCIwith minimal changes

Lower TCOReduce CapEx and OpExby 50% or more

Scale to TomorrowReady for new hardware, apps & cloud solutions

Why HCI Powered by Lenovo & VMware vSAN?

Virtualization Compute | Storage | Network

Unified Management

Server + Storage Network

Hyper-Converged Infrastructure-Powered by vSAN & Lenovo

Traditional 3-Tiered Architecture

Complex Separate Silos

Servers

External

Storage

Networking

Virtualization


Purchase in big increments, incur

prediction risk, overprovision

Multiple management panes,

manual operations

Deployment takes weeks --

complex, big footprint

Difficult to scale quickly

Multi-hop support, lack of end-to-end

visibility, firefighting

Performance issues

#PBO3325BUS CONFIDENTIAL



bution

Documents

PBO3325BUS Implement a Container Orchestration Platform … · Srihari Angaluri (Lenovo) Tony Harvey (Lenovo) Alka Gupta (VMware) PBO3325BUS #VMworld #PBO3325BUS Implement a Container