HPE Infra as Code - Programmez!...Jenkins Server. GitHub. Use terraform instructions to deploy: -...

$ ./BaremetalasCode.py

Infra composable

Decembre 2018

DevCon #7

Infra-as-codedans une Infra Hybride

dans Infra Composable

Docker sur VM ou BM ?

Synergy Openshift scale-up & down

$ ./agenda

IaC dans une Infra Hybride

Hybrid Infrastructure Pet Clinic

Dev QA DeployDev QA DeployFrom Source Code

An example of DevOps Pipeline in action

to an new build of our app and the infrastructure to run it

Hybrid Infrastructure Pet Clinic

Dev QA DeployDev QA DeployFrom Source Code

An example of DevOps Pipeline in action

to an new build of our app and the infrastructure to run it

GitHub

Developer changes application source code and issue a Pull Request

Application Sources

(PetClinic)

Jenkins ServerGitHub

Jenkins Server automatic build procedure starts

Application Sources

(PetClinic)2

Application Sources

(PetClinic)

Team Slack channel notified3

Jenkins Server retrieves latest version and builds application

Application Sources

(PetClinic)

Latest application WAR file

Application Sources

(PetClinic)

Jenkins Server also builds latest container using new WAR file

Application Sources

(PetClinic)

Latest application container

Application Sources

(PetClinic)

Latest application containerLatest application WAR file

Jenkins ServerGitHubJenkins Server initiates deployment of infrastructure for PetClinic

Application Sources

(PetClinic)

Jenkins ServerGitHubUse terraform instructions to deploy: - Kubernetes Cluster in AWS- or Kubernetes Cluster on Premise- or Kubernetes on bare-metal- Pull latest app container- start app

Application Sources

(PetClinic) Kubernetes on Synergy

Kubernetes on VMware

neSphere API

omposable API

Kubernetes on AWS

AWS API

Application Sources

neSphere API

omposable API

Kubernetes on AWS

AWS API

Application Sources

neSphere API

omposable API

Kubernetes on AWS

AWS API

Application Sources

(PetClinic)

Latest application WAR file Latest application container

Kubernetes on Synergy

neSphere API

omposable API

AWS API

Kubernetes on AWS

Application Sources

(PetClinic)

Automatic Testing starts11

neSphere API

omposable API

AWS API

Kubernetes on AWS

Application Sources

(PetClinic)

Team Slack Channel updated12

neSphere API

omposable API

AWS API

Kubernetes on AWS

Application Sources

(PetClinic)

neSphere API

omposable API

AWS API

Kubernetes on AWSQA team check status13

Application Sources

(PetClinic)

neSphere API

omposable API

AWS API

Kubernetes on AWSLoB Manager uses bot to query infrastructure

Additional manual testing16

neSphere API

omposable API

AWS API

Kubernetes on AWS

neSphere API

omposable API

AWS API

Kubernetes on AWSTeam Slack channel notified

Application Sources

(PetClinic)

Owner check discussion

Owner approves Pull Request (or doesn’t)19

Application Sources

(PetClinic)

Docker sur VM vs BM

Impact sur le cout ?

Orchestration

Virtualization

Specific ComputeCloud Native Storage Cloud Native Network

Monitoring Security Analytics

Runtime

AutomationProvisionning

Secure Registry

Key Mgmt

Service Discovery

Service Mgmt

1 node VMManagementSécuritéRéseauStockage

€ per node

Exemple de prod50 nodes• 12 vCPU• 64 GB de RAM / • 2 TB de disque• NIC de 1 Gbps

1 node VMPour une puissance équivalente, on passe de 50 nodes VM à 6 nodes BM

Impact sur la perf?

Impact sur la performance ?

VM agent

Analytics

Master

Runtime Runtime

Virtualisation

containerDb containerDb

collector

BM agent

Perf Dashboard

Compute SY480 | 2 x E5-2680v4 (14-core) / 256GB / CNA 20Gb / 16G FC HBA

Stockage DAS | DS3940 SATA SSDHPE Synergy

mongo-bench sur VM vs BM

$ python benchrun.py -f testcases/simple_insert.js -t 5 10 20 --host 10.3.88.156 --port 27017

x4 better perf on BM vs VM on Document Operations

Infra Composable

Infrastructure Composable principles

J’ai besoin…. Cassandra4Cassandra2Cassandra1

Cassandra5Cassandra3

Oracle

DockerDockerDockerDockerDockerDocker

“Create a new Cassandra cluster”

“Create a Oracle database” “Scale-up the database”

“Scale-in/out Docker worker”

“Now with Docker GPU”

“and grow VSAN cluster”

HPEOVServerProfile -name myDB01 -template CassandraHPEOVServerProfile -name myDB03 -template OracleHPEOVServerProfile -name myDB03 -template Oracle-ExtendHPEOVServerProfile -name myDocker02 -template Docker-BMHPEOVServerProfile -name myDockerGPU04 -template Docker-GPUHPEOVServerProfile -name myVSAN01 -template VSAN

Compute Storage(DAS, SDS, SAN)

Network Fabrics(Eth, FC, FCoE)Fluid Resource Pools

Ecosystème Infrastructure Composable HPE

Cloudengine

DevOpsengine

IT Ops engine

Facilitiesengine

Developer toolkits

Unified API

StockageServeur Réseau

Composable fabric

In a Nutshell

Workload-SpecificForwarding Topologies

API-Driven Workload Definitions

High-Diversity HW/SW Fabrics

API-driven

FABRIC VISUALIZATION & UTILIZATION

END-TO-END VISIBILITY

Create a new project with bandwidth or latency constraints :

https://www.youtube.com/watch?v=gzYg5mBiCS0

You (the developer) add label “plexxi: adjacent” in your app template

App build -> Scheduler will do placement on nodes connected to nearby switches with the most available network fabric connectivity!

C O M P O S A B L E F A B R I CC O M P O S A B L E F A B R I C

C O M P O S A B L E F A B R I C

Composable storage

HPE Storage Docker Volume plugin

FeaturesLifecycleHighly-available, volume scoping, user-defined descriptions, control remove and detach behavior.

Performance ControlsPerformance PolicesQoS Limits – IOPS and Throughput

Volume PlacementPools and Folders

Protection TemplatesSnapshot schedules and retentionArray-to-array and HPE Cloud Volumes

SecurityEncrypt data at restSet mount point UNIX permissions

ProvisioningSpecify thin or thick provisioningUp to 127TB Volumes – default size 10GB

Dedupe & CompressionVariable block size

Zero-Copy ClonesReuse data from production containers

Volume ImportSeamless data migrationClone Nimble volume in a Docker Volume

description: "My Description"destroyOnRm: "true"

Parameters

perfPolicy: "SQL Server"limitIOPS: "32000"limitMBPS: "512"pool: "allflash"folder: "My Tenant"

protectionTemplate: "local-cloud"

encryption: "true"fsOwner: "8192:500"fsMode: "0755"thick: "true"sizeInGiB: "4000"

dedupe: "true"

cloneOf: "MyDockerVol1"snapshot: "MySnapshot"createSnapshot: "true"importVol: "MyNimbleVol1"importVolAsClone: "MyNimbleVol1”snapshot: ”MySnapshot”

---version: "3"services:myservice:image: myorg/myimage

volumes:- myvol1:/data

volumes:myvol1:driver: nimbledriver_opts:description: "My Description"sizeInGiB: "500"encryption: "true"limitIOPS: "1000"perfPolicy: "My Policy"protectionTemplate: "my-prot-1"

Legacy Docker

HPE Kube Storage Controller

FeatureLifecycleHighly-available, volume scoping, user-defined descriptions, control remove and detach behavior.

Parameters

dedupe: "true"

---kind: StorageClassapiVersion: storage.k8s.io/v1metadata:name: my-storage-classprovisioner: hpe.com/nimbleparameters:description: "My Description"encryption: "true"limitIOPS: "1000"perfPolicy: "My Policy"protectionTemplate: "my-prot-1"

---kind: PersistentVolumeClaimapiVersion: v1metadata:name: my-pvc

spec:accessModes:- ReadWriteOnce

resources:requests:storage: 500Gi

storageClassName: my-storage-class

Legacy Docker

HPE Storage DVDI Integration

FeatureLifecycleHighly-available, volume scoping, user-defined descriptions, control remove and detach behavior.

Parameters

dedupe: "true"

{"id": "myjob-1","cpus": 0.5,"mem": 32,"volumes": [{"containerPath": "data","external": {"name": "myvol1","provider": "dvdi","options": {"dvdi/sizeInGiB": "500","dvdi/description": "My Description","dvdi/driver": "nimble"}

},"mode": "RW"

}],"container": {"type": "MESOS","mesos": {"type": "DOCKER","image": "myorg/myimage"

Legacy Docker

HPE Synergy

Composable Fabric

Composable Compute

Composable Frame

HPE Synergy: la 1ère InfrastructureComposable du marché

Composable Storage

Start small, then Scale

Composer

Image Streamer

Gérer les serveurs physiquesaussi facilement que les VMs

Configuration complète du

serveur

Module de compute sans étatModèle

Serveur bare metal aussi facile que les

VM du cloudOS ouhyperviseur

HPE Synergy Composer

HPE Synergy Image Streamer

OpérationMachine Physique

Equivalent Machine Virtuelle

– Créer le modèle de profil avec l’OS– Activer le profile sur le compute module– Mettre à jour le server profile– Désactiver le server profile– Déplacer le server profile– Détruire le server profile

– Créer le modèle de VM avec l’OS– Déployer le modèle sur une VM– Mettre à jour la VM– Suspendre la VM– Déplacer la VM – Supprimer la VM

Gérer les interfaces reseaux des serveurs physiquesaussi facilement que celle des VMs

File File

VMWareObjectStore

FileServer

K8s Cluster

OneView

Vmwaredatastore

Object Store

FileServer

HPE Synergy Storage Module (external Storage)Composable storage > Software defined storage

Swarm Cluster

Windows

Scaling Openshift worker node withAnsible with Synergy Compute node

1.1 Ansible Tower Initial Openshift Components

1.2 Deploy new worker node

Automating RHOCP deployment on Synergy

HPE OneViewServer profile template identifies the networks, storage, and deployment plan Sets personalization parametersProvisions physical infrastructure

HPE Synergy Image Streamer

Creates Red Hat Enterprise Linux 7.5 bootable OSPersonalizes OS and prepares for Red Hat OpenShiftContainer Platform per deployment plan

Initiates OS deployment plan

HPE Synergy Compute and Storage

Compute node boots directly into a customized running OS ready for Red Hat OpenShift Container Platform deployment

Configures boot image

OS Image to Deploy

System configuration settings

AnsiblePlaybooks

Deploy Red Hat OpenShift Container Platform workers.

Deploy OpenShift

Red Hat Ansible Tower

Workflow runs playbooks to deploy Red Hat OpenShift Container Platform on HPE Synergy using Ansible Modules for HPE OneView

Initiates workflow

1.3 Provision the node on Oneview

1.4 Configure the node

1.5 integration of the node into Openshift

2. Remove the node

HPE Developer Community Program

High level Community Framework

HPE OneSphere Developer Community Program

ITOps focused developer

enablement

ISV eco-system enablement and

collaboration

DevOps focused developer

enablement

Application developer

enablement

OpenSourcedeveloper

enablement

Pan-HPE developer

enablement for OneSphere

ONE Developer Marketplace

ONE Developer Portal

ONE Developer Program

HPEDeveloperONE

High level Pan-HPE framework

• SDKs, On-Demand Services; API Management

• Developer Communities, On-Demand Training

• Blogs

• Sub Communities (Ex. Dev/Ops, Cloud, Analytics, Operations, Infrastructure, Open Source Open Compute, Open Network, SDN)

• Key HPE Platforms (OneView, Synergy, OneSphere, Nimble, Simplivity, Aruba etc )

• Community Outreach & Events

• Community Analytics and Incentives

• SDN Security and QoSapplications

• HPE OneView and Software-defined Infrastructure Integrations

• Tools integration from developers

HPE DEV

Thanks!Thank you

HPE Infra as Code - Programmez!...Jenkins Server. GitHub. Use terraform instructions to deploy: -...

Documents

Percona Kubernetes Operator for Percona XtraDB Cluster · Kubernetes and the OpenShift platform, based on Kubernetes, have added a way to manage containerized systems, including database

Cloud Native Java with Kubernetes - Burr Sutter · Cloud Native Java with Kubernetes. developers.redhat.com. We cannot solve our problems ... (env=production) Kubernetes Cluster

Kubernetes as an approach for solving bioinformatic problems1145028/... · 2017-09-27 · 5.1 Kubernetes Basics ... Kubernetes is a cluster orchestration tool used to facilitate deployment

commit => #GitHub => #CircleCI => #Docker => #Kubernetes #AWS cluster

Kubernetes – From the Firehose - webagesolutions.com · Kubernetes can be deployed on a bare-metal cluster (real machines) or on a cluster of virtual machines. 1.2 Container Orchestration

Introduction to Kubernetes ( Cluster Containers ...arnaud-nauwynck.github.io/docs/Intro-Kubernetes.pdf · Kubernetes = Docker + ... Docker Already have (Toy) Docker Swarm (Docker

KUBERNETES CLUSTER IN THE FIRST COLO DATA CENTER …

Programmez N116

Dear IT...I'd Like A Kubernetes Cluster

Kubernetes Cluster Wide Security Policy Configuration

Kubernetes Ingress Services by VMware NSX® Advanced Load ... · Kubernetes/OpenShift Cluster Integration using Avi Kubernetes Operator Avi Kubernetes Ingress Services can be used

TIBCO BusinessEvents Cloud Deployment Guide · TIBCO BusinessEvents on Minikube Based Kubernetes..... 75 Appendix: Sample YAML Files for Kubernetes Cluster..... 76. Sample Kubernetes

Red Hat Advanced Cluster Management for Kubernetes 2.1 APIs · 2021. 2. 18. · Red Hat Advanced Cluster Management for Kubernetes 2.1 APIs APIs Last Updated: 2021-02-18

A guide to setup your own Kubernetes Cluster With ......A guide to setup your own Kubernetes Cluster... With GestiClean Up! Documentation, Release 1.0.0 could with alternatives that

Programmez Eclipse

Create Kubernetes cluster Login to portal and select ... · Create Kubernetes cluster Login to portal and select kubernetes service On the Basics page, configure the following options:

Blockchain on Kubernetes - VMware€¦ · Blockchain on Kubernetes (BoK) provides a command line tool and a GUI tool to quickly deploy Hyperledger Fabric v1.0.5 in a Kubernetes cluster

Things to consider to operate a Multi-Tenant Kubernetes ... · 2020.06.10 Things to consider to operate a Multi-Tenant Kubernetes Cluster Multi-Tenant Kubernetes Cluster를 운영하기위해고려할사항

Performance evaluation of wireguard in kubernetes cluster

A Million ways of Deploying a Kubernetes Cluster