Overview - Open Source Backup Conference · 2014. 4. 1. · Philipp Storz, bareos GmbH & Co.KG Introduction What is Bareos? People Building news in stable New in Beta Future Project

bareos

Philipp Storz,bareos GmbH

& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Overview

1 Introduction

2 What is Bareos?

3 People

4 Building

5 news in stable

6 New in Beta

7 Future Project

Philipp Storz · bareos 1/50

bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Overview

What can you expect?

1 What is Bareos?2 Who are the persons behind Bareos?3 How is bareos build?4 What is new in Bareos?5 What is planned for the future?


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Overview

1 Introduction

2 What is Bareos?

3 People

4 Building

5 news in stable

6 New in Beta

7 Future Project


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

What is Bareos?

Networkbased multi-platform backup solutionbacula forkLicense: AGPLMassive code cleanupSourcecode hosted at GitHub


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Why Bareos?

bacula.org project leader did not accept patchesNew things only in closed source "Bacula EnterpriseEdition"Activity of bacula community declining


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Goals

100% free softwarecontinuous developmentcompatible to bacula as far as possiblecleanup the configuration where needed


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Goals 2

orientation on user’s requirementsoffer support and subscription to business usersfair pricemodel and good product to enable continuousdevelopmentoffer packages for all common OSes


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Overview

1 Introduction

2 What is Bareos?

3 People

4 Building

5 news in stable

6 New in Beta

7 Future Project


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Who stands behind Bareos?

Marco van Wieringen

Philipp Storz

Maik Außendorf

Stephan Dühr

Jörg Steffens

Open Source affine crew100% AGPL100% owner-financed100% made in europeno NSA backdoors


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Overview

1 Introduction

2 What is Bareos?

3 People

4 Building

5 news in stable

6 New in Beta

7 Future Project


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Sourcecode

Sourcecode on GitHub

https://github.com/bareos/bareosPhilipp Storz · bareos 11/50

bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Sourcecode

Sourcecode, regressions and Docs at GitHubgit clone git://github.com/bareos/bareosgit clone git://github.com/bareos/bareos-regressgit clone git://github.com/bareos/bareos-docs


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Sourcecode Documentation

Doxygen Documentation

http://regress.bareos.org/doxygen/html/Philipp Storz · bareos 13/50

bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Sourcecode Documentation

Doxygen Documentation created dailyhttp://regress.bareos.org/doxygen/html/call/caller graphgood introduction to sourcecode


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Bug- und featuretracking

Mantis Bugtracker with anonymous access

http://bugs.bareos.org/Philipp Storz · bareos 15/50

bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Bug- und featuretracking

Bugs und Features are followed hereFeature Process

regression testdocumentationpublishing


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Regression Tests

cdash regression tests

http://regress.bareos.orgPhilipp Storz · bareos 17/50

bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Regression Tests

130 regression testsare being run on thesourcecode nightlyxen vms and solaristhanks to mhvtl alsotape- and changertests


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Package creation

Open Build Service

internal Buildsystem based on OBSPhilipp Storz · bareos 19/50

bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Package building

Open Build Service8 x 2 BuildJob WorkerDistributions (32 und64Bit)

Rhel und CentOS 5/6Debian 5/6Fedora 16-19SLES11 - SP3Univention 3.1Ubuntu 10.04, 12.04OpenSUSE 11.4-12.3

Windows cross-compiledreal 32 / 64Bit programs

filedaemon + dllsbconsolebatNSIS installerOPSI package


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Continuous Integration

CI based on Jenkins

automatic package testsPhilipp Storz · bareos 21/50

bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Continuous Integration

XEN VM for every distributiontests for all databasesinstallation of the packages from the repostestbackups and restoresdeinstallation


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Publishing

repos are published via scriptsnightly repo automatically, others manually


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Appliance

Bareos Appliance created with Suse Studio

automatic creation of the VM with nightly packagesPhilipp Storz · bareos 24/50

bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Appliance

full-features bareos enstallation with postgres catalogwebacula and bacula-webmhvtl with tapechangerDisk-2-Disk-2-Tape preconfiguredFormats: Disk Image, ISO Image, Preload ISO, OVF, vmdk,vhd, XEN ,KVM


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

overview build process

Building and testing fully automated

Featuresprocess tracks tests and docs for new features


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Overview

1 Introduction

2 What is Bareos?

3 People

4 Building

5 news in stable

6 New in Beta

7 Future Project


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Windows

Windows Installer completely renewed64 Bit packages are 100% 64 Bit Softwaretray-monitor renewed, now really shows somethingall drivessilent install/uninstallMS-SQL Plugin


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Configuration engine

Defaultvalues for Strings”Working Directory” and ”Pid Directory” not neededanymorecatalog is automatically chosen”Catalog = MyCatalog” not needed anymore in every clientresource”AutoPrune = no” is now the default for clients”Cleaning Prefix = CLN” is default


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

LTO HW Encryption

Standard since LTO-4AES256-GCMvirtually no speed impacttape cannot be read without keycomplete bareos integration incl. bextract


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Client Quota Support

originally a patch form Mathew Ife for baculawas never accepted to baculaClient QuotasHard- und Softquotasoptionally do not count failed jobsif over quota no backup is possible anymore


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Import/Export for tapelibraries

Libraries have import/export slotsTapes can be imported and exported thereBefore that had to be done manuallywith the export command this is done automaticallyimport commands puts new tapes automatically in free slotsexport can be called inside of post-backup scripts


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Bandwidth Limitation

was originally in the bacula git repowas announced for bacula 5.2after some month it ”disappeared” in a commitwas ported to bareos and improved


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Console Commands

rerunrestart failed jobs exactly as they were configuredstatus schedulerpreview of future scheduler triggersbackview possible if negative values given


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

NDMP

NDMP Data Management Application (DMA) in DirectorNDMP Tape Agent in StorageTAPE AGENT / ROBOT AGENT not supportedBackup goes directly into the SD and then on tapenow only possible to backup and restore whole volumes


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Compression

bacula supports gzip and LZO compressionnow also possible lzfast, lz4 und lz4hcfull integration into bareosnew streamtypes were defined


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

SD-SD Replikation

Before only copy and migration inside of one SD waspossibleNow we can copy and migrate between two SDs.Data can be moved or copied over the network alsoremotely


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Passive Client

Before: init of data channel from FD to SDfd needs name resolutionNAT/Firewall requires setup of back channel


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Passive Client2

passive client option reverses the init of the data channelall problems solved


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Overview

1 Introduction

2 What is Bareos?

3 People

4 Building

5 news in stable

6 New in Beta

7 Future Project


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Standard configuration

New standardconfiguration for Disk-Only BackupHelp for parametrizing3 Pools with preconfigured retensionsExample filesets für Linux und Windowsautomatic labellingsending bootstrap per mailqueryfile is installed


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Standard configuration 2

## Default Bareos Director configuration file for disk-only backup# (C) 2013 Bareos GmbH & Co.KG## Each configuration item has a reference number that shows# where this property can be changed in the configuration file.# Search for the number to find the correct line.## You have to configure the following accoring to your environment:## (#01)Email Address for bareos disaster recovery.# Specify a mailaddress outside of your backupserver.# There will be one mail per day.## (#02)Email Address for bareos reports. (Mail Command)# This mail address will recieve a report about each backup job.# It will be sent after the backupjob is complete.# Has to be configured twice ("Standard" and "Daemon" Message Ressources)## (#03)Email Address for bareos operator. (Operator Command)# This mail address will recieve a mail immediately when the# bareos system needs an operator intervention.# May be the same address as in (#02)## This disk-only setup stores all data into @archivedir@## The preconfigured backup scheme is as follows:## Full Backups are done on first Saturday at 21:00 (#04)# Full Backups are written into the "Full" Pool (#05)# Full Backups are kept for 365 Days (#06)## Differential Backups are done on 2nd to 5th Saturday at 21:00 (#07)# Differential Backups are written into the "Differential" Pool (#08)# Differential Backups are kept for 90 Days (#09)## Incremental Backups are done monday to friday at 21:00 (#10)# Incremental Backups are written into the "Incremental" Pool (#11)# Incremental Backups are kept for 30 Days (#12)## What you also have to do is to change the default fileset (#13)# to either one of the demo filesets given or create our own fileset


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Standard configuration 3

more standard configs are planned:Tape Changer onlyDisk-2-Disk-2-TapeSingle Tape Only


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Security Enhancements

Allowed Job CommandBefore: Client can perform every bareos operationNow client can only do the operations that are allowedoperations are: backup, restore, verify, estimate, runscript


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Security Enhancements 2

Allowed Script DirBefore: FD can executa any program/script on clientNow: only programs and scripts in the specified directorycan be executedBig security enhancement


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Overview

1 Introduction

2 What is Bareos?

3 People

4 Building

5 news in stable

6 New in Beta

7 Future Project


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

VMware

Image Backup is possible via VCBvStorage API allows blockbased backupprogramming examples are problematic


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Windows

Encrypted File System (EFS)needs special calls during backpu

Mountpoints: Support for VSSSnapshots shall be also created of subvolumesalready works in lab

Deduplicated Volumesdeduped files have to be opened specially, otherwise theyare always 4kbworks in the lab


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

Configuration engine

Persistent configurationDirector also writes out the configAPI for confgurationGood Webtool for administration and configuration


bareos


& Co.KG

Introduction

What isBareos?

People

Building

news in stable

New in Beta

Future Project

How to help

buy a Subscription / Supportcreate bugreportswrite documentationtestingprogramming

c/c++Web


IntroductionWhat is Bareos?PeopleBuildingnews in stableNew in BetaFuture Project

Documents

Overview - Open Source Backup Conference · 2014. 4. 1. · Philipp Storz, bareos GmbH & Co.KG Introduction What is Bareos? People Building news in stable New in Beta Future Project