Virtualization for autonomous administration of servers

PlanContextClient SpecificationsXen setting up

Preliminary studyRequirementsArchitecture

Test SchemeIntegration in TUNe

Introduction to TUNeArchitectureWrappers and Reconf diagrams

Project ManagementConclusion

Context

Context

Context Servers cost Electrical Consumption Distributed Servers

Metric Server reservation price Per server electrical consumption

Network load and servers distances

Goal

Minimizing costs =

Bringing together low CPU consumers

minimizing electrical consumption

= Shutting down low CPU

consumers

minimizing communication times

= Bringing together highly communicating servers

ContextVi

rtual

Mac

hine

1

Virtu

al M

achi

ne 2

ExpansionCriteria

ShrinkCriteria

Clients Specification

Client Specifications

Xen Paravirtualization ToolsTUNeNFSA working scenario

Client SpecificationsVi

rtual

Mac

hine

1

Virtu

al M

achi

ne 2

Request number rising

Request number reduction

Hardware

Domain 0

Abstraction LayerXen Control

InterfaceModified Drivers

User Applications

Xen Control Software

Preliminary Study

User Domain 1

Abstraction Layer

Modified Drivers

User Applications

Xen Hypervisor

User Domain 2

Abstraction Layer

Modified Drivers

User Applications

Dom0-1

DomU

Dom0-2

xm m

igra

te

Preliminary Study

Physical Machine

DomU-1

Dom0

xenbr0

vif2.0vif1.0 vif2.0

vif0.0

eth0

DomU-2

eth0 eth1 eth0

peth0

Preliminary Study

Preliminary Study

Dom0-1

DomU

Dom0-2

xm m

igra

te

NFS server

Requirements

Migration requirements:no task interruptionTCP connection keepingResults consistencyCPU load independence

Migration performance study:Interruption durationMigration durationDelay

Integration in TUNe

A-204-06

DHCP ServerNFS Server

Switch

A-204-02

DNS ServerNTP Server

Architecture

A-204-03 A-204-04

A-204-05

Architecture

dom0

Ubuntu Gutsy Gibbon / Xen Management

Xend Daemon

domU-1

Ubuntu Dapper Drake / NFS root

domU-1

GNU/Linux Debian Etch / NFS root

Tests

Test SchemeTCP connections preservation Migration of streaming server

Results integrity Writting in a file

CPU load independency Migration with different CPU loads

Interruption duration Ping probing

Delay Comparison with local execution of LU factorizations

Migration duration Comparison with equivalent RMI calls

Migration

Test SchemeResults consistency

Dom0-1

DomU

Dom0-2

Writtingin a file

Migration

Test SchemeCPU Load Independence

Dom0-1

DomU

Dom0-2

CPU loading

Migration

Test SchemeInterruption Duration

Dom0-1

DomU

Dom0-2

Pings

Results: 1s

Monitor Computer

Migration

Test SchemeDelay

DomU

Dom0-2Dom0-1

LUFactorizations

Test SchemeDelay

DomU

Dom0-2

Dom0-1

Chrono

Ping pong Migration

Migration

Test SchemeTCP Connection Preservation

Dom0-1

DomU

Dom0-2

StreamingServer

Streaming Client

Test SchemeTCP Connection Preservation

Streaming Client Output

Dom0 Source Dom0 Destination

Network Traffic Monitor

TUNe

TUNe PresentationComponent-Based Architecture

Fractal Components ADLArchitecture Description Languague

TUNe Presentation High Level management tools

Tune Wrapper

Stubs

Legacy Software

Wrappers

TUNe Presentation Deployment diagrams

S1.configure S2.configure

S1.start

S2.start

S2

+wrapper : String = S2.xml+legacyFile : String = S2.tgz+host-family : String = localhost

1

1

S2

+wrapper : String = S2.xml+legacyFile : String = S2.tgz+host-family : String = localhost

TUNe Presentation Reconfiguration diagrams

this.stop

this.start

this.reconfigure

event

Migration

Pool Architecture

Dom0-1 Dom0-2

DomU

Event

Migrate

TUNe Administrator

Probe0-1 Probe0-2

Pool ArchitectureTUNe wrappers

domU wrapper

StartStop

Migrate

domUProbe wrapper

StartStop

Pool ArchitectureTUNe Diagrams

this.probed.migrate

Migrate

etch1-1.start

etch1-1-Probe.start

Start

etch1-1.stop

etch1-1-Probe.stop

Stop

Project Management

Google Code version control softwareSpecification documentArchitecture documentRisk AnalysisAction ListScheduleTutorials

Project Management

Project ManagementSpecification document

R3

Requirement Formulation

Calculation results will not be affected by virtual machine migration.

RationalMigration should keep virtual machine memory state and hosted applications execution background.

Priority P0

Demand Reference

D4

Test Reference

T3

Project ManagementRisk Analysis

Risk Probability Criticality Product Preventive Actions Corrective Actions

Data loss (large size) 2 1 2 Copy on external hard drive Backup

Data loss (small size) 2 3 6 Copy on SVN repository Backup

Network breakdown 1 2 2Local copy of

documentation and API

Schedule adaptation

System crash (OS, VM) 1 2 2 Installation guide Reinstall

Project ManagementAction List

Deadline Whole team(Xen Attitune Team)

Julien C(Doudou)

Julien L(Juju)

Ezequiel(L’Argentin)

Hery Mathieu(Le J)

Project ManagementSchedule

Project ManagementTutorials

Xen installation and setting upNFS serverDNS serverDHCP serverNTP serverTUNe

Conclusion

Conclusion

Further improvementsTotal AutonomyKdeploy -> GridJ2EEOther administration policies

ConclusionTests TUNe Improvements

CPU Load OKMigration OKInterruption OKIntegrity OKDelay NOKStreaming NOK

Network Architecture

Hardware ArchitectureXen 3.1

Kernel 19-6

Kernel 18.8NFS root (domU)

DHCP Server

NFS Server

BugFilesystem

NFS Boot on DomU

Functionnal configuration

Kernel 22-14

Kernel 18.8Xen (dom0) Wrappers,

Deployment diagram

Reconf Diagram,Probe TUNe modifications

Streaming scenario

kdeployJ2EE

Policies

NTP Server

DNS Server

Clock issues

Synchronisationissues

Issues resolved

Name resolution

Delay OKStreaming OK

Network Architecture

Hardware Architecture

Tests

CPU Load OKMigration OKInterruption OKIntegrity OKDelay NOKStreaming NOK

Kernel 18.8Xen (dom0)

NTP Server

Clock issues

Synchronisationissues

Issues resolved

Functionnal configuration

Delay OKStreaming OK

ConclusionTUNe Improvements

Wrappers,Deployment diagram

Reconf Diagram,Probe TUNe modifications

Streaming scenario

kdeployJ2EE

Policies

DNS Server

Name resolution

Xen 3.1

Kernel 19-6

Kernel 18.8NFS root (domU)

DHCP Server

NFS Server

BugFilesystem

NFS Boot on DomU

Kernel 22-14

Network Architecture

Tests TUNe Improvements

Wrappers,Deployment diagram

Reconf Diagram,Probe TUNe modifications

Streaming scenario

kdeployJ2EE

Policies

DNS Server

Name resolution

Delay OKStreaming OK

ConclusionHardware

Architecture

CPU Load OKMigration OKInterruption OKIntegrity OKDelay NOKStreaming NOK

Kernel 18.8Xen (dom0)

NTP Server

Clock issues

Synchronisationissues

Issues resolved

Xen 3.1

Kernel 19-6

Kernel 18.8NFS root (domU)

DHCP Server

NFS Server

BugFilesystem

NFS Boot on DomU

Functionnal configuration

Kernel 22-14

Network Architecture

ConclusionHardware

ArchitectureTests TUNe Improvements

CPU Load OKMigration OKInterruption OKIntegrity OKDelay NOKStreaming NOK

Kernel 18.8Xen (dom0) Wrappers,

Deployment diagram

Reconf Diagram,Probe TUNe modifications

Streaming scenario

kdeployJ2EE

Policies

NTP Server

DNS Server

Clock issues

Synchronisationissues

Issues resolved

Name resolution

Xen 3.1

Kernel 19-6

Kernel 18.8NFS root (domU)

DHCP Server

NFS Server

BugFilesystem

NFS Boot on DomU

Functionnal configuration

Kernel 22-14

Delay OKStreaming OK

Questions