12
ZFS file system in deskt op l a b envir onment Dr . Al exei Kot el nikov & Tr ent Ha ndlovsky

ZFS file system inNeed for both Windows and Linux. Why Linux and ZFS Smaller OS install size, shorter install times PXE tftp NFS. Why Linux and ZFS Large Installs are also much faster

  • Upload
    others

  • View
    17

  • Download
    0

Embed Size (px)

Citation preview

Page 1: ZFS file system inNeed for both Windows and Linux. Why Linux and ZFS Smaller OS install size, shorter install times PXE tftp NFS. Why Linux and ZFS Large Installs are also much faster

ZFS file system in deskt op l a b envir onment

Dr . Al exei Kot el nikov & Tr ent Ha ndl ovsky

Page 2: ZFS file system inNeed for both Windows and Linux. Why Linux and ZFS Smaller OS install size, shorter install times PXE tftp NFS. Why Linux and ZFS Large Installs are also much faster

Motivation for the Lab Envir onment

✘ Over 5,000 user accounts in Engineering Kerberos

✘ Approximately 240 desktops across many labs

✘ Customizable Installation✘ Quickly Deployable✘ Easily Upgradeable

✘ All previous user data wiped.

✘ Need for both Windows and Linux.

Page 3: ZFS file system inNeed for both Windows and Linux. Why Linux and ZFS Smaller OS install size, shorter install times PXE tftp NFS. Why Linux and ZFS Large Installs are also much faster

Why Linux and ZFS✘ Smaller OS install size, shorter install times

PXEtftpNFS

Page 4: ZFS file system inNeed for both Windows and Linux. Why Linux and ZFS Smaller OS install size, shorter install times PXE tftp NFS. Why Linux and ZFS Large Installs are also much faster

Why Linux and ZFS✘ Large Installs are also much faster.

ZFS has the ability to send and receive datasets over the network using a service like SSH or netcat .

Page 5: ZFS file system inNeed for both Windows and Linux. Why Linux and ZFS Smaller OS install size, shorter install times PXE tftp NFS. Why Linux and ZFS Large Installs are also much faster

What is ZFS?✘ ZFS is a combined file system and logical volume

manager.✘ Developed by Sun Microsystems in 2005.✘ Now there are two main implementations: by Oracle and

by the OpenZFSproject.✘ Supported operating systems: Solaris flavors, FreeBSD,

NetBSD, Mac OS, and Linux

Main features:✘ High storage capacity: large volume size (2^128 bytes),

file size (2^64 bytes), 2^48 files per directory

✘ Data management and integrity: snapshots and replication , continuous integrity checking and automatic repair.

Page 6: ZFS file system inNeed for both Windows and Linux. Why Linux and ZFS Smaller OS install size, shorter install times PXE tftp NFS. Why Linux and ZFS Large Installs are also much faster

Desktop Configuration✘ Smaller OS install size, shorter install times

ZFS /home

ext4 /

UbuntuLinux

VMplayer

MatLabModeFrontierGCC/G++Siemens NX Android Studio

SolidworksAnsysComsolOfficeAutoCAD

Windows 10Virtual Machine

ZFS /vmwareVMDK

Hardware

Operating System

Application

Page 7: ZFS file system inNeed for both Windows and Linux. Why Linux and ZFS Smaller OS install size, shorter install times PXE tftp NFS. Why Linux and ZFS Large Installs are also much faster

The Installation✘ Follows an installation/management procedure similar to that of a Linux cluster✘ Total Installation time is about 5 minutes per machine

Salt

NFS

tftp

DHCP/pxe

Management

Base Image

Installer

Boot

Page 8: ZFS file system inNeed for both Windows and Linux. Why Linux and ZFS Smaller OS install size, shorter install times PXE tftp NFS. Why Linux and ZFS Large Installs are also much faster

Virtual Machine Deployment via replication

Vir t ua l Ma chine Upda t e via incr ement a l

ZFS ZFS

Image

ZFS send/receive -R Empty

ZFS

ZFS ZFS

Snapshot

ZFS send/receive -i

Snapshot

Page 9: ZFS file system inNeed for both Windows and Linux. Why Linux and ZFS Smaller OS install size, shorter install times PXE tftp NFS. Why Linux and ZFS Large Installs are also much faster

Distributed Deployment✘ Each machine that has a copy of the dataset is able to send it out to multiple

machines simultaneously.

✘ Machines that have finished receiving the image are then able to send it to others.

✘ As the image is being distributed the computers with the image increase in an exponential form.

Page 10: ZFS file system inNeed for both Windows and Linux. Why Linux and ZFS Smaller OS install size, shorter install times PXE tftp NFS. Why Linux and ZFS Large Installs are also much faster

Sandbox User Environment✘ ZFS uses snapshots to create

checkpoints of a filesystem, and has the ability to return, or “rollback”

✘ Updates can be easily saved by admins and any changes made by users are undone as the filesystem rolls back to the last saved snapshot upon the next login.

✘ This is accomplished by a script that is executed by a PAM module upon successful authentication with the Kerberos server.

/etc/pam.d/common - session

/usr/share/ libpam- script/ pam_script_ses_open

Page 11: ZFS file system inNeed for both Windows and Linux. Why Linux and ZFS Smaller OS install size, shorter install times PXE tftp NFS. Why Linux and ZFS Large Installs are also much faster

Virtual Lab Extension✘ The Virtual Lab

allows access to the desktops remotely via a web browser.

✘ When the physical computer labs close, access to the desktops in these computer labs becomes available through.

✘ ZFS rollback still works when each user logs in.

Page 12: ZFS file system inNeed for both Windows and Linux. Why Linux and ZFS Smaller OS install size, shorter install times PXE tftp NFS. Why Linux and ZFS Large Installs are also much faster

Summary✘ Base install of Linux that supports ZFS

○ Inst a lled through a PXE boot s session○ Desktop to Desktop; 20GB Linux inst a ll ~ 5mins,○ La b Inst a ll (60 Desktops); ~ 4 hours

✘ Home pa rt it ion a nd 2nd drive a re forma t t ed a s ZFS○ ZFS filesyst em is t hen sent t hrough ZFS send/ receive

■ This propa ga t ion ca n occur a t exponent ia l ra t es○ Desktop to Desktop; 150GB Linux inst a ll ~ 15mins,○ La b Inst a ll (60 Desktops); ~ 4 hours

✘ Script is crea t ed so tha t a s users log in, t he filesyst em is returned to it ’s sa ved st a t e

✘ This process sa fely, securely, a nd quickly prot ect s users informa t ion, a nd is a ble t o be extended to other use ca ses.

Tha nk you