FUJITSU Technical Computing Solution UNCAI Technical Computing Solution UNCAI Copyright 2016 FUJITSU LIMITED “UNCAI(雲海)” means the cloud sea in Japanese. UNCAI at a Glance

UNCAI=Unified Clouds' Advanced Infrastructure

FUJITSU Technical Computing Solution

UNCAI

Copyright 2016 FUJITSU LIMITED

“UNCAI(雲海)” means the cloud sea in Japanese.

UNCAI at a Glance


雲海

Cloud management software for HPC

• UNCAI enables your HPC systems to be used as a private cloud.

Easy customizable tenant templates

• Various tenant templates help you to create optimized tenants. Ex.) CAE, Deep Learning, Big Data, …

Easy Web Portal

• User can get his own tenant as a “My HPC” without any skills to build HPC systems.

Cloud Management Software for HPC


UNCAI is a software package which your HPC systems to use as a private cloud.

User can create a hybrid tenant which consists of VM and bare-metal nodes.

InfiniBand is supported.

Customer’s site

UNCAI

Po

rtals

PaaS Portal

CAE Portal

Resource Management

Deploying

System Monitoring

・・・

UNCAI Core

Job Management

Shared Storage

Remote Desktop

VM

Bare-metal

Storage

Tenant Management

Template Function

Services for Adminis

Services for users

Accounting/ Billing

Media Library

(VM) / ISM

(bare-m

etal)

・・・

・・・

Resource pool

Tenant-A

Tenant-B

Tenant-C

HPC system

Resource

System Administrator

Tenant Administrator/ End users

Template Function (1/2)


Various tenants can be deployed by 3 layered templates.

Tenant Templates configurations for the tenant (type of node, networks, …) (YAML)

Node Templates resource definitions of the node (YAML)

Application Templates installation procedure of applications , OS settings (Ansible role)

caetenant01

Login

Compute

Pre-post

NFS Server

Deploy

×1 vmM

bmL

vmL

1TB

×5

×1

×1

CentOS 6.6

CentOS 6.6

Windows 10

RHEL 7.2

PBS Server vmM ×1 CentOS 6.6

caetenant01

Tenant templates (CAE, Big Data, Deep Learning,…)

Node templates (Login, Compute, Pre-post, …)

Application templates (NFS, PBSPro, system settings, …)

OS images, Applications

Template Functions (2/2)


The tenant template also realizes the easy customization of tenant designing GUI without any programing skills.

x-i18n: en: enum_label: node_size: login: - “Virtual-SSS (1core, 2G Mem)” - "Virtual-SS (2core, 4G Mem)" - "Virtual-S (4core, 8G Mem)" - "Virtual-M (8core, 32G Mem)“ ～ login_node: &login_table title: '{$ i18n.label.login $}' description: '{$ i18n.comment.login $}' type: array format: table items: type: object properties: size: title: '{$ i18n.label.size $}' type: string enum: *login_size options: enum_titles: '{$ i18n.enum_label.node_size.login $}' default: "vmSS" os: *os_list_redhat numberOf: *number_of

Easy Web Portal (1/2)


PaaS Portal for administrators

Simplified user interface helps you to easily deploy a tenant without skills to install HPC system.

PaaS Portal also has following functions: display resource usage / start & stop tenant and node / report accounting & billing / user registration/ role management / password management/ allocating floating IP / firewall settings / media library (templates, OS images , applications, licenses) / backup tenant / queue settings (PBS Professional ) / error monitoring & notice

Easy Web Portal (2/2)


CAE Portal (HPC Portal) for CAE users

CAE Portal has following functions: file management/ upload & download files / job submission/ monitoring job status / canceling job / monitoring queue status/ searching job histories / calling remote desktop (FTCP Remote Desktop) / job submission for CAE applications (easy customizable GUI)

Flexible resource expansion


On demand auto scaling Scale-in/out tenant resource automatically by workload of batch jobs.

Multi-tenant Management Deploy, manage and monitor the whole resources of multi-tenants (on both private and public clouds)

from a single view of PaaS Portal.

Resource pool

UNCAI

tenant-A

FUJITSU Cloud Service K5

UNCAI

UNCAI

UNCAI

Auto Scaling Multi-tenant

Management

Multi-tenant Management

Multi-tenant Management

Other Sites

Public Clouds

tenant-B

Auto Scaling

・・・

Flexible customizability by plug-in framework


Following functions have high flexibilities by templates or plug-ins. So UNCAI can provide the environment optimized for customer’s policies.

Tenant information

• Template of fill-in form to register the tenant informations(tenant administrator, mail address, and so on )

User registration

• Template of fill-in form to add users

• Plug-in program to check the user management policies (ex. user name, UID and GID).

Billing

• Plug-in program for daily/monthly billing.

• Plug-in program to check the usage and stop the tenant when it exceeds the limit.

Queue management

• templates of queue setting form

Auto scaling

• plug-in program to check the workload of batch jobs and estimate nodes required for scale-in/out.

[Option] Container Management Template


Container management template includes Apache Mesos / Kubernetes.

Currently Marathon and Chronos are supported on Apache Mesos.

Capable of being supported other framework of Apache Mesos and other eco system.

Framework (Marathon, Chronos)

Tenant

Docker-Engine

Select Container Management Template.

Docker images

[Option] Deep Learning Template


Deep learning template has bare-metal nodes which has GPU.

The Docker container which communicates GPU has been installed.

It also includes the essential software for deep learning such as CUDA, cuDNN, frameworks and tools.

We support Caffe, Tensorflow, Keras and Chainer.

GPU

Docker Images Jupyter Notebook

Deep Learning Frameworks

Middleware

CUDA / cuDNN

Select Deep Learning Template

Bare-metal Node

[Option] Big Data Template


Big data template implements Cloudera software stack and build ready-to-use data processing cluster.

Able to expand worker nodes corresponding to increase of workload.

Master Node

Worker Node

Select Big Data Template

New nodes

participate in.

Tenant

Tenant Type


PaaS (UNCAI)

SaaS

IaaS OpenStack/ISM ,OS and hardwares

Node template (Resource definitions of each node type)

Tenant template (Tenant configuration of each tenant type)

Application template (Ansible role for installation and settings)

PBSPro

Intel Compiler/MPI

CAE tenant Container Management

tenant

Docker-Engine

Framework (Marathon, Chronos)

CAE applications

Deep Leaning tenant

Jupyter Notebook

CUDA / cuDNN

Big Data tenant

Cloudera

Docker-Engine

13 Copyright 2016 FUJITSU LIMITED

Documents

FUJITSU Technical Computing Solution UNCAI Technical Computing Solution UNCAI Copyright 2016 FUJITSU LIMITED “UNCAI(雲海)” means the cloud sea in Japanese. UNCAI at a Glance