I stopped working on bakthat, I'm now working on another backup-related project: blobstash/blobsnap. If somebody want to be a collaborator and continue development, please open an issue.
Bakthat is a MIT licensed backup framework written in Python, it's both a command line tool and a Python module that helps you manage backups on Amazon S3/Glacier and OpenStack Swift. It automatically compress, encrypt (symmetric encryption) and upload your files.
Here are some features:
- Compress with tarfile
- Encrypt with beefish (optional)
- Upload/download to S3 or Glacier with boto
- Local backups inventory stored in a SQLite database with peewee
- Delete older than, and Grandfather-father-son backup rotation supported
- Possibility to sync backups database between multiple clients via a centralized server
- Exclude files using .gitignore like file
- Extendable with plugins
You can restore backups with or without bakthat, you just have to download the backup, decrypt it with Beefish command-line tool and untar it.
Check out the documentation to get started.
$ pip install bakthat $ bakthat configure $ bakthat backup mydir Backing up mydir Password (blank to disable encryption): Password confirmation: Compressing... Encrypting... Uploading... Upload completion: 0% Upload completion: 100% or $ cd mydir $ bakthat backup $ bakthat show 2013-03-05T19:36:15 s3 3.1 KB mydir.20130305193615.tgz.enc $ bakthat restore mydir Restoring mydir.20130305193615.tgz.enc Password: Downloading... Decrypting... Uncompressing... $ bakthat delete mydir.20130305193615.tgz.enc Deleting mydir.20130305193615.tgz.enc
import logging
import sh
logging.basicConfig(level=logging.INFO)
from bakthat.helper import BakHelper
BACKUP_NAME = "myhost_mysql"
BACKUP_PASSWORD = "mypassword"
MYSQL_USER = "root"
MYSQL_PASSWORD = "mypassword"
with BakHelper(BACKUP_NAME, password=BACKUP_PASSWORD, tags=["mysql"]) as bh:
sh.mysqldump("-p{0}".format(MYSQL_PASSWORD),
u=MYSQL_USER,
all_databases=True,
_out="dump.sql")
bh.backup()
bh.rotate()Not released yet, developed in the develop branch.
- Incremental backups support, with Incremental-Backups-Tools.
- Revamped configuration handling
- Stronger unit tests
- Plugin architecture improved
- Switch from aaargh to cliff for the CLI handling
June 5 2013
- Event hooks handling
- Support for plugin
May 26 2013
- Support for excluding files, using .bakthatexclude/.gitignore file, or a custom file.
- Added support for reduced redundancy when using S3
May 8 2013
- Better log handling
- Allow more complex rotation scheme
May 6 2013
- Bugfix config
May 6 2013
- new BAKTHAT_PASSWORD environment variable to set password from command line.
May 5 2013
- New -c/--config argument.
- New periodic_backups command tied to BakManager API.
April 21 2013
- New Swift backend, thanks to @yoyama
- ls command removed in favor of the show command
- Compression can now be disabled with the compress setting
- Bugfix default destination
Mars 20 2013
- bugfix configure (cancel of configure cmd cause empty yml), thanks to @yoyama
- new bakthat.helper.KeyValue
- BakSyncer improvement
Mars 10 2013
- bugfix (forgot to remove a dumptruck import)
Mars 10 2013
- bakthat show bugfix
Mars 10 2013
- Using peewee instead of dumptruck, should be Python2.6 compatible again.
Mars 8 2013
- small bugfix when restoring from glacier
- bakhelper now support custom configuration and profiles
- aligned date in show command
If you come from bakthat 0.3.x, you need to run:
$ bakthat upgrade_to_dump_truck
And you also need to run again bakthat configure.
$ cat ~/.bakthat.conf $ bakthat configure
Changes:
- The filename is now a positional argument for all command
- Using DumpTruck instead of shelve
- Save backups metadata for both backends
- BakHelper to help build backup scripts
- BakSyncer to help keep you list sync over a custom REST API
- Now adding a dot between the original filename and the date component
- Tags support (-t/--tags argument)
- Profiles support (-p/--profile argument)
- New show command, with search support (tags/filename/destination)
- Hosted documentation
- bug fix glacier upload
- small bug fixes (when updating an existing configuration)
- Added delete_older_than command
- Added rotate_backups command (Grandfather-father-son backup rotation scheme)
- Eric Chamberlain
- Darius Braziunas
- Sławomir Żak
- Andreyev Dias de Melo
- Jake McGraw
- You Yamagata
- Jordi Funollet
Copyright (c) 2012 Thomas Sileo
Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.