Introduction to Bacula

Bacula® - The Open Source Network Backup Solution Open Source, enterprise ready, network based backup program Hemant Shah E-mail: [email_address] Linked In Profile: http://www.linkedin.com/in/shahhemant It comes by night and sucks the vital essence from your computers. NetSecure’09

Presentation Goals bacula history bacula Features OS/Hardware supported by bacula bacula architecture bacula components Sample configuration files Future projects

What is Bacula? It is a network backup solution It is opensource Hosted at www.sourceforge.net Web site is www.bacula.org There is online documentation at www.bacula.org Wiki at wiki.bacula.org User and developer Mailing list Along with command line, there is a GTK GUI front-end (bat) and web interface, webmin plugin

Bacula History Bacula = Bac kup + Drac ula January 2000 - P roject started by Kern Sibbald 14 April 2002 -F irst release to Source Forge (version 1.16) 29 June 2006 -R elease 1.38.11 January 2007 -R elease 2.0.0 August 2007 - Release 2.2.0 November 2008 - Release 2.4.3 Soon version 3.0

Project Goals Backup any client from Palm to Mainframe Provide “Enterprise” features similar to commercial products Assure compatibility for 30 years Open source Scalable (upto 10,000 machines)

Features A central server and catalog with distributed backup All components communicate via the network. Internal scheduler for automatic and simultaneous job execution with priorities. Backup to single or multiple tape drives Backup to autochangers Backup to disk Backup to removable media (e.g. DVD, USB flash drives, etc.) Migrate data from one pool to another Catalog database, supports multiple databases Track Jobs run, Volumes used, File locations, etc.

Features Very fast restores Interactive restore with many options From most recent backup Prior backup of time and date List of files/directories Restore by job id …… Labeled volumes prevents accidental overwriting Support for ANSI/IBM labels Machine independent data format - extensible Support for Unicode on win32 and UTF-8 on Unix Bare metal recovery

Features Supports bar code readers Supports compression using zlib Backups can span multiple volumes Multiple backups on same volume You can run scripts Before job After job After failed job Professional support through Bacula Systems SA

Security Features Daemon authorization with CRAM-MD5 Director and storage daemon can be run non-root MD5, SHA1 signatures for each file CRC checksum for each volume block Restricted consoles and tray-monitors Communication encryption using TLS Data encryption using PKI Intrusion detection (Verify)

Supported Operating Systems Linux AIX HP-UX Solaris FreeBSD, OpenBSD Irix True64 Mac OS X Windows (Win98/Me, WinNT/2K/XP, Vista) Client The bacula server binaries for Windows are available but not supported MS Exchange agent available (not developed by Bacula team)

Supported tape drives and autochangers Any tape drive that is supported by your OS will work with bacula Any autochanger that is supported by your OS will work with bacula List of tape drives and autochangers being used by bacula users is available on the web site

Other requirements One of these databases MySQL 4.1 or higher PostgreSQL 7.4 or higher SQLite 2.8.16 or higher Gnome 2.x for gnome console GTK+ 2.x for GUI front end (bat) OS must support pthreads dvd+rw-tools with bacula patches applied, if you want to use DVDs as backup medium PHP 4 or above if you want to use webacula

Bacula Application Interactions File Server Port 9102 Bacula File Daemon Database Server Port 3106 mySQL, SQLLite or postgresql Backup Server Port 9101 Bacula director daemon Admin Workstation Command Console GUI Console Admin Workstation Tray monitor Gnome/KDE status monitor Storage Server Port 9103 Bacula storage daemon

Bacula Architecture File Attributes + Data Authenticate User Commands Console Director Catalog RDBMS File Daemon Storage Daemon File Attributes + Data File Attributes + Storage Location Authenticate + Job Info + Key Key + SD info Physical Media Authenticate + Job Info Enabling key for the job File Attributes + Storage Location

Bacula Components Director File Daemon (client) Storage Daemon Console Catalog They could run on one machine or multiple machines

Director Supervise all operations Schedule jobs Start jobs Cancel jobs Maintain catalog Typically only one director is used It runs as a daemon Can be run non-root

File Daemon Installed on systems to be backed up Runs backup, restore, verify as requested by director Responsible for determining which files to backup Provides file attributes and data Communicates with director and storage daemon Needs access all files, so it must run as root or administrator One per client Runs as daemon on Unix and as service on Windows

Storage Daemon Read/writes data to physical media Accepts file attributes and data from file daemon and writes to physical media Reads file attributes and data from physical media and returns it to file daemon Sends file attributes and location to the director which sends it to catalog Runs as daemon Can be run non-root Can have more than one storage daemons Can have multiple devices per storage daemon Typically one storage daemon per director but with multiple devices

Console Allows administrator and users communicate with director Can be used for Starting jobs Canceling jobs Review job output Query/modify catalog Restore files Can accept input from stdin Restricted console can allow users to restore their own files Available as Text-based (bconsole) bat (GUI using QT4) for Unix, Linux bwx-console (GUI using wxWidgets) for Linux, Unix and Win32 Web ( bweb, webacula)

Catalog Only component not written by Bacula team Responsible for mainta ining file indexes and volume databases Used to quickly locate and restore file(s) Can be used to generate reports of when and where files were backed up Supports three databases MySQL, PostgreSQL, and SQLite Old data can be automatically pruned by Director

Process Privileges No Database No Console No Storage Daemon Yes File Daemon No Director Require root/admin privilege Process

Bacula Configuration Files bacula-dir.conf - Director configuration bacula-sd.conf - Storage daemon configuration bacula-fd.conf - File daemon configuration file bconsole.conf - Console configuration file Other configuration files bat.conf - bat configuration file tray-monitor.conf - Tray monitor configuration file

Director config - bacula-dir.conf Director One Director definition. Job Backup definition of one FileSet from a single Client backed up according to a Schedule to a Pool of Storage devices. Pool Collection of backup media (Tapes/Files). May have multiple pools for rotations. Client Client definition. Storage Backup device definition. Schedule When backup will run and type of backup. FileSet List of files to backup Messages Setup e-mail notification and message log. Catalog Database setup

Bacula Jobs Basic unifying structure Name - unique name Type - Backup, Restore, Admin, ….. Level - Full, Differential, Incremental FileSet - Which files to backup/restore Client - Which client to backup Storage - Where to store the files Pool - Which volume(s) (tapes, disk) to use Schedule - When to do it

Sample bacula-dir.conf file Director { Name = backupserv-dir DIRport = 9101 QueryFile = "/usr/local/etc/query.sql" WorkingDirectory = "/backups/working" PidDirectory = "/var/run" Maximum Concurrent Jobs = 1 Password = ”SecretPassword" }

Sample bacula-dir.conf file Catalog { Name = MyCatalog QueryFile = “/usr/local/etc/query.sql” dbname = bacula user = bacula password = ”SecretPassword" }

Sample bacula-dir.conf file Messages { Name = Standard mail = root@localhost = all, !skipped, !restore operator = root@localhost = mount console = all, !skipped }

Sample bacula-dir.conf file Client { Name = client1-fd Address = FDhostname FDPort = 9102 Catalog = MyCatalog Password = ”SecretPassword" Job Retention = 1y AutoPrune = yes }

Sample bacula-dir.conf file Storage { Name = DLTDrive Address = SDhostname SDPort = 9103 Password = ”SecretPassword” Device = “HP-920” Media Type “LTO3” }

Sample bacula-dir.conf file Pool { Name = TapePool Pool Type = Backup Recycle = yes AutoPrune = yes Storage = DLTDrive }

Sample bacula-dir.conf file Schedule { Name = BackupCycle Run = level=Full 1st fri at 18:00 Run = level=Differential 2nd-5th fri at 18:00 Run = level=Incremental sat-thu at 22:00 }

Sample bacula-dir.conf file FileSet { Name = “Client 1 Full Set” Include { Options { signature = MD5 } File = / } Exclude { File = /tmp File = /proc } }

Sample bacula-dir.conf file Job { Name = Client1-Backup Enabled = yes Type = Backup Level = Incremental # default level Client = Client1-fd File Set = “Client 1 Full Set” Schedule = BackupCycle Pool = TapePool Messages = Standard }

Storage Daemon config - bacula-sd.conf Storage One storage daemon definition. Director Authentication information of the Director allowed to control this Storage Daemon. Messages Which messages should be sent to Director. Device Storage device (file/tape) definition. One per storage device.

Sample bacula-sd.conf file Storage { Name = backupserv-sd SDPort = 9103 WorkingDirectory = ”/backups/working” PID Directory = “/var/run” }

Sample bacula-sd.conf file Director { Name = backupserv-dir Password = “SecretPassword” }

Sample bacula-sd.conf file Messages { Name = Standard director = backupserv-dir = all }

Sample bacula-sd.conf file Storage { Name = DLTDrive Device Type = Tape Media Type “LTO3” Drive Index = 0 Archive Device = /dev/nst0 Automatic Mount = yes Removable Media = yes Random Access = no Auto Changer = no }

File Daemon config - bacula-fd.conf Client One Client definition. Director Authentication information of the Director allowed to control this File Daemon. Messages Which messages should be sent to Director.

Sample bacula-fd.conf file FileDaemon { Name = client1-fd FDport = 9102 WorkingDirectory = “/usr/local/etc” PidDirectory “/var/run” }

Sample bacula-fd.conf file Director { Name = backupserv-dir Password = “SecretPassword” }

Sample bacula-fd.conf file Messages { Name = Standard director = backupserv-dir = all, !skipped }

Console config - bconsole.conf Director Definition of the director that this Console can connect to.

Sample bconsole.conf file Director { Name = “backupserv-dir DIRport = 9101 Address = backupserv Password = “SecretPassword” }

Including Files You can include other configuration files @/full/path/to/file You can use output of a command Execute command on director “ | command” Execute command on client “ \\| command”

List of current resource types No Yes No Yes Storage No No No Yes Schedule No No No Yes Pool No Yes Yes Yes Messages No No No Yes JobDefs No No No Yes Job No No No Yes FileSet Yes Yes Yes Yes Director No Yes No No Device Yes No No Yes Console No No Yes Yes Client No No No Yes Catalog No Yes No No Autochanger Console Storage Client Director Resources

Future Projects Accurate restoration of renamed/deleted files Merge multiple backups (Synthetic backup or consolidation) Exclude directories containing certain file Copy data from one pool to another Add plugins to the FileSet include statements Database driver (LIBDBI) to support more SQL engines Better job scheduling conflict resolution Certificate based authentication

Volume Utilities Tools bls - “ls” type listing of bacula tape or file bextract - extract file(s) from a bacula tape of file (restore does not wotk) bscan - used to re-create bacula catalog database from bacula tape or file bcopy - copy bacula one archive to to another (e.g. from file to tape). Information about new volume is not stored in database btape - test tape drives bsmtp - SMTP client, runs on Unix and Windows dbcheck - check/repair bacula catalog database bregex - allows you to test regular expressions bwild - allows you to test wildcard expressions testfind - file listing using same search engine that is used in include statement

Resources Presentation by Kern Sibbald at BSDCan, May 2008 Bacula users guide http://www.bacula.org Bacula wiki http://wiki.bacula.org Bacula users mailing list [email_address] Bacula developers mailing list [email_address] Bug reports http://bugs.bacula.org SVN at source forge

Introduction to Bacula

More Related Content

Viewers also liked (8)

Similar to Introduction to Bacula (20)

Introduction to Bacula