24
2/26/2018 COMP4442 Cloud Computing Lab 06 © George Baciu 2018 1 COMP4442 Service and Cloud Computing Lab 06:OpenStack Services [email protected] PQ838 Prof. George Baciu www.comp.polyu.edu.hk/~ csgeorge/comp4442

Main title - Hong Kong Polytechnic University€¦ · Cloud Computing Lab 06:OpenStack Services [email protected] ... control node compute node blockst node enp0s10 enp0s3

  • Upload
    ngokiet

  • View
    249

  • Download
    1

Embed Size (px)

Citation preview

Page 1: Main title - Hong Kong Polytechnic University€¦ · Cloud Computing Lab 06:OpenStack Services csgeorge@comp.polyu.edu.hk ... control node compute node blockst node enp0s10 enp0s3

2/26/2018 COMP4442 Cloud Computing Lab 06 © George Baciu 2018 1

COMP4442Service and

Cloud ComputingLab 06:OpenStack Services

[email protected]

PQ838Prof. George Baciu

www.comp.polyu.edu.hk/~csgeorge/comp4442

Page 2: Main title - Hong Kong Polytechnic University€¦ · Cloud Computing Lab 06:OpenStack Services csgeorge@comp.polyu.edu.hk ... control node compute node blockst node enp0s10 enp0s3

Contents

2/26/2018 COMP4442 Cloud Computing Lab 06 © George Baciu 2018 2

• Server vs Services

• Control Node Server “control”

• Compute Node Server “compute”

• Block Storage Node Server “blockst”

Page 3: Main title - Hong Kong Polytechnic University€¦ · Cloud Computing Lab 06:OpenStack Services csgeorge@comp.polyu.edu.hk ... control node compute node blockst node enp0s10 enp0s3

OpenStack Preliminaries

2/26/2018 COMP4442 Cloud Computing Lab 06 © George Baciu 2018 3

Page 4: Main title - Hong Kong Polytechnic University€¦ · Cloud Computing Lab 06:OpenStack Services csgeorge@comp.polyu.edu.hk ... control node compute node blockst node enp0s10 enp0s3

OpenStack Releases

2/26/2018 COMP4442 Cloud Computing Lab 06 © George Baciu 2018 4

More Information: http://docs.openstack.org/releases/

Series Status Release Date

Newton Stable 2016.1.0 OCT 06, 2016

Mitaka Stable 2016.3.0 Apr 07, 2016

Liberty Stable 2015.1.0 OCT 15, 2015

Kilo Security-supported 2015.1.0 APR 30, 2015

Juno Security-supported 2015.2.0 OCT 16, 2014

Icehouse EOL 2014.1.0 APR 17, 2014

Page 5: Main title - Hong Kong Polytechnic University€¦ · Cloud Computing Lab 06:OpenStack Services csgeorge@comp.polyu.edu.hk ... control node compute node blockst node enp0s10 enp0s3

OpenStack Releases

2/26/2018 COMP4442 Cloud Computing Lab 06 © George Baciu 2018 5

More Information: http://docs.openstack.org/releases/

Series Status Release Date

Newton Stable 2016.1.0 OCT 06, 2016

Mitaka Stable 2016.3.0 Apr 07, 2016

Liberty Stable 2015.1.0 OCT 15, 2015

Kilo Security-supported 2015.1.0 APR 30, 2015

Juno Security-supported 2015.2.0 OCT 16, 2014

Icehouse EOL 2014.1.0 APR 17, 2014

Distinguished by:

Keystone, Glance,

Nova, Swift,

Horizon

Page 6: Main title - Hong Kong Polytechnic University€¦ · Cloud Computing Lab 06:OpenStack Services csgeorge@comp.polyu.edu.hk ... control node compute node blockst node enp0s10 enp0s3

OpenStack Newton

2/26/2018 COMP4442 Cloud Computing Lab 06 © George Baciu 2018 6

14th release of OpenStack

Nova: Large scale deployment

Glance: Better security

Keystone: Easier hybrid cloud management

Swift: Improved operator capabilities

New Features

Page 7: Main title - Hong Kong Polytechnic University€¦ · Cloud Computing Lab 06:OpenStack Services csgeorge@comp.polyu.edu.hk ... control node compute node blockst node enp0s10 enp0s3

OpenStack Installation Environment

2/26/2018 COMP4442 Cloud Computing Lab 06 © George Baciu 2018 7

Page 8: Main title - Hong Kong Polytechnic University€¦ · Cloud Computing Lab 06:OpenStack Services csgeorge@comp.polyu.edu.hk ... control node compute node blockst node enp0s10 enp0s3

Major Steps

•Design the network (i.e. setup the IPs)

•Build the machines (i.e. the VMs)

•Start the control machine

• Install services

•For each service provided by other nodesConfigure those nodes

Verify control – and the other node config

2/26/2018 COMP4442 Cloud Computing Lab 06 © George Baciu 2018 8

Page 9: Main title - Hong Kong Polytechnic University€¦ · Cloud Computing Lab 06:OpenStack Services csgeorge@comp.polyu.edu.hk ... control node compute node blockst node enp0s10 enp0s3

Basic Services•MariaDB – backend mysql database

•RabbitMQ – queueing service

• Keystone – identity service

•Glance – image service

•Nova – compute service for cloud VMs

•Neutron – network service

•Horizon – dashboard and apache2

•Cinder – block storage linked into LVM2/26/2018 COMP4442 Cloud Computing Lab 06 © George Baciu 2018 9

control VM only

control VM only

control VM only

control VM only

control VM only

control & compute nodes

control & blockst nodes

control VM only

Page 10: Main title - Hong Kong Polytechnic University€¦ · Cloud Computing Lab 06:OpenStack Services csgeorge@comp.polyu.edu.hk ... control node compute node blockst node enp0s10 enp0s3

Design the network

2/26/2018 COMP4442 Cloud Computing Lab 06 © George Baciu 2018 10

v

v

v

v

v

v

v

v

v

v

v

v v

control node compute node

blockst node

enp0s10

enp0s3

enp0s10

enp0s3 enp0s8

enp0s3

enp0s8

enp0s10

VirtualBox Host

vboxnet1

vboxnet2

vboxnet3

Management Network (internal)

Data Network (internal for VMs)

vIn

ternet (extern

al)

vvboxNAT

venp0s9

v

Inte

rnal

Net

wo

rk2

–fo

r ad

van

ced

bri

dgi

ng

Adapter 1

Adapter 3 Adapter 4

Adapter 1 Adapter 2

Adapter 4

Adapter 1

Adapter 2

Adapter 4

venp0s8

Adapter 2

venp0s9

Adapter 3

venp0s9

Adapter 3

e.g. 10.10.10.0

e.g. 10.20.20.0

e.g. 10.0.2.0e.g. 192.168.100.0

Page 11: Main title - Hong Kong Polytechnic University€¦ · Cloud Computing Lab 06:OpenStack Services csgeorge@comp.polyu.edu.hk ... control node compute node blockst node enp0s10 enp0s3

Building the machines

•Build control node

• Install network, chrony, openstack client

•Clone control node to compute node

•Configure compute node network

•Build a new blockst node – disk partition

•Configure blockst node network and LVM

2/26/2018 COMP4442 Cloud Computing Lab 06 © George Baciu 2018 11

Page 12: Main title - Hong Kong Polytechnic University€¦ · Cloud Computing Lab 06:OpenStack Services csgeorge@comp.polyu.edu.hk ... control node compute node blockst node enp0s10 enp0s3

Install Services

•Back to control node

• Install mariaDB mysql database

• Install RabbitMQ

• Install Keystone

• Install Glance

2/26/2018 COMP4442 Cloud Computing Lab 06 © George Baciu 2018 12

Page 13: Main title - Hong Kong Polytechnic University€¦ · Cloud Computing Lab 06:OpenStack Services csgeorge@comp.polyu.edu.hk ... control node compute node blockst node enp0s10 enp0s3

Install Services (2)

•On the control node Install Nova compute service

•On the compute node Install Nova compute service

•On the control node Install Neutron network service

•On the compute node Install Neutron network service

2/26/2018 COMP4442 Cloud Computing Lab 06 © George Baciu 2018 13

Page 14: Main title - Hong Kong Polytechnic University€¦ · Cloud Computing Lab 06:OpenStack Services csgeorge@comp.polyu.edu.hk ... control node compute node blockst node enp0s10 enp0s3

Install Services (3)

•On the control node Install Horizon dashboard

•On the control node Install Cinder block storage service

•On the blockst node Install Cinder block storage service

2/26/2018 COMP4442 Cloud Computing Lab 06 © George Baciu 2018 14

Page 15: Main title - Hong Kong Polytechnic University€¦ · Cloud Computing Lab 06:OpenStack Services csgeorge@comp.polyu.edu.hk ... control node compute node blockst node enp0s10 enp0s3

Service Installation Loop

2/26/2018 COMP4442 Cloud Computing Lab 06 © George Baciu 2018 15

Register the service forauthentication in MariaDB

Start service

OKNOK

Verify installation Done

Get and installservice software

Set configuration parameters in/etc/<service>/*.conf

Sync the configurationin service DB

*** should perform this only ONCE!

Page 16: Main title - Hong Kong Polytechnic University€¦ · Cloud Computing Lab 06:OpenStack Services csgeorge@comp.polyu.edu.hk ... control node compute node blockst node enp0s10 enp0s3

Service Files

• /etc/<service>/*.conf

• /etc/<service>/plugins/*/*

• /var/log/<service>/*.log

• where <service> is one of:

rabbitmq, keystone, glance, nova, cinder, neutron, horizon

2/26/2018 COMP4442 Cloud Computing Lab 06 © George Baciu 2018 16

Page 17: Main title - Hong Kong Polytechnic University€¦ · Cloud Computing Lab 06:OpenStack Services csgeorge@comp.polyu.edu.hk ... control node compute node blockst node enp0s10 enp0s3

Use Virtual Share Folder

• For each node in {control, compute, blockst}

The service configuration files are in:

/media/vsh/SYS/UBU/config/<node>/<service>/etc/<service>

The service installation scripts are in:

/media/vsh/SYS/UBU/config/<node>/<service>/bsh/install

In each install folder, the main installation script is 00-install.bash

2/26/2018 COMP4442 Cloud Computing Lab 06 © George Baciu 2018 17

Page 18: Main title - Hong Kong Polytechnic University€¦ · Cloud Computing Lab 06:OpenStack Services csgeorge@comp.polyu.edu.hk ... control node compute node blockst node enp0s10 enp0s3

The Global Script

•For each VM, the main script for installing all

the services on the node is in:

/media/vsh/SYS/UBU/config/<node>/allinstall.bash

2/26/2018 COMP4442 Cloud Computing Lab 06 © George Baciu 2018 18

Page 19: Main title - Hong Kong Polytechnic University€¦ · Cloud Computing Lab 06:OpenStack Services csgeorge@comp.polyu.edu.hk ... control node compute node blockst node enp0s10 enp0s3

Final Notes!• Some steps require manual query in order to adjust the settings,

e.g. LVM in cinder service – must enquire the VM system to see

which device the LVM is on e.g. /dev/sda5

• Some steps should not be performed more than once e.g.

adding a DB/Table/User to the sql database.

• First read, then understand, then do!

• At last: every step should be verified!

• Problems: check the /var/log/<service>/* files

2/26/2018 COMP4442 Cloud Computing Lab 06 © George Baciu 2018 19

Page 20: Main title - Hong Kong Polytechnic University€¦ · Cloud Computing Lab 06:OpenStack Services csgeorge@comp.polyu.edu.hk ... control node compute node blockst node enp0s10 enp0s3

OpenStack Dashboard

•To access your cloud:Open a browser (Chrome, Firefox)

Type in the address bar:

http://10.10.10.10/horizon

2/26/2018 COMP4442 Cloud Computing Lab 06 © George Baciu 2018 20

Page 21: Main title - Hong Kong Polytechnic University€¦ · Cloud Computing Lab 06:OpenStack Services csgeorge@comp.polyu.edu.hk ... control node compute node blockst node enp0s10 enp0s3

Tools for VM Monitoring

• top # displays the top processes

• free –m # shows the memory allocation

• htop # a better version of all the above

•watch –n 5 free -m

2/26/2018 COMP4442 Cloud Computing Lab 06 © George Baciu 2018 21

Page 22: Main title - Hong Kong Polytechnic University€¦ · Cloud Computing Lab 06:OpenStack Services csgeorge@comp.polyu.edu.hk ... control node compute node blockst node enp0s10 enp0s3

$ top

2/26/2018 COMP4442 Cloud Computing Lab 06 © George Baciu 2018 22

Note:> 4.5GB

Page 23: Main title - Hong Kong Polytechnic University€¦ · Cloud Computing Lab 06:OpenStack Services csgeorge@comp.polyu.edu.hk ... control node compute node blockst node enp0s10 enp0s3

2/26/2018 23

END

Page 24: Main title - Hong Kong Polytechnic University€¦ · Cloud Computing Lab 06:OpenStack Services csgeorge@comp.polyu.edu.hk ... control node compute node blockst node enp0s10 enp0s3

2/26/2018 COMP4442 Cloud Computing Lab 06 © George Baciu 2018 24