TrueCloudLab/restic
16
0
Fork 2
Code Issues Pull requests 1 Projects Releases Packages Wiki Activity Actions
Fast, secure, efficient backup program
392 commits 9 branches 49 tags 79 MiB
Go 99.8%
Shell 0.2%
Find a file
Alexander Neumann 24b14e21cc Remove pools for nodes and IDs 
This removes the allocation pools for nodes and IDs. I feel they aren't
really needed. Benchmarks:

    benchmark                         old ns/op      new ns/op      delta
    BenchmarkChunkEncrypt             197890867      198616293      +0.37%
    BenchmarkChunkEncryptParallel     196127004      198819818      +1.37%
    BenchmarkArchiveDirectory         1098848419     1087237723     -1.06%
    BenchmarkPreload                  30464455       29910239       -1.82%
    BenchmarkLoadTree                 3265092        3088543        -5.41%
    BenchmarkEncryptWriter            37213511       37134683       -0.21%
    BenchmarkEncrypt                  36037879       36166546       +0.36%
    BenchmarkDecryptReader            38165659       38556734       +1.02%
    BenchmarkEncryptDecryptReader     77027044       77194987       +0.22%
    BenchmarkDecrypt                  36017602       35937888       -0.22%
    BenchmarkSaveJSON                 47906          50270          +4.93%
    BenchmarkSaveFrom                 49775973       50520969       +1.50%
    BenchmarkLoadJSONID               105290245      107281849      +1.89%
    BenchmarkChunkerWithSHA256        151501430      148264078      -2.14%
    BenchmarkChunkerWithMD5           93606346       94036392       +0.46%
    BenchmarkChunker                  74285431       75933882       +2.22%
    BenchmarkPipelineWalker           387689         346467         -10.63%

    benchmark                         old MB/s     new MB/s     speedup
    BenchmarkChunkEncrypt             52.99        52.79        1.00x
    BenchmarkChunkEncryptParallel     53.46        52.74        0.99x
    BenchmarkEncryptWriter            225.42       225.90       1.00x
    BenchmarkEncrypt                  232.77       231.94       1.00x
    BenchmarkDecryptReader            219.79       217.57       0.99x
    BenchmarkEncryptDecryptReader     108.90       108.67       1.00x
    BenchmarkDecrypt                  232.90       233.42       1.00x
    BenchmarkSaveFrom                 84.26        83.02        0.99x
    BenchmarkChunkerWithSHA256        69.21        70.72        1.02x
    BenchmarkChunkerWithMD5           112.02       111.51       1.00x
    BenchmarkChunker                  141.15       138.09       0.98x

    benchmark                         old allocs     new allocs     delta
    BenchmarkChunkEncrypt             110            110            +0.00%
    BenchmarkChunkEncryptParallel     100            100            +0.00%
    BenchmarkArchiveDirectory         475591         476635         +0.22%
    BenchmarkPreload                  28059          24182          -13.82%
    BenchmarkLoadTree                 3124           2889           -7.52%
    BenchmarkEncryptWriter            19             19             +0.00%
    BenchmarkEncrypt                  13             13             +0.00%
    BenchmarkDecryptReader            16             15             -6.25%
    BenchmarkEncryptDecryptReader     39             39             +0.00%
    BenchmarkDecrypt                  11             11             +0.00%
    BenchmarkSaveJSON                 74             74             +0.00%
    BenchmarkSaveFrom                 109            112            +2.75%
    BenchmarkLoadJSONID               103630         97849          -5.58%
    BenchmarkChunkerWithSHA256        13             13             +0.00%
    BenchmarkChunkerWithMD5           12             12             +0.00%
    BenchmarkChunker                  6              6              +0.00%
    BenchmarkPipelineWalker           212            165            -22.17%

    benchmark                         old bytes     new bytes     delta
    BenchmarkChunkEncrypt             64697         64697         +0.00%
    BenchmarkChunkEncryptParallel     64681         64681         +0.00%
    BenchmarkArchiveDirectory         193385504     193790864     +0.21%
    BenchmarkPreload                  4064701       3942000       -3.02%
    BenchmarkLoadTree                 344954        325396        -5.67%
    BenchmarkEncryptWriter            12793         12793         +0.00%
    BenchmarkEncrypt                  1950          1950          +0.00%
    BenchmarkDecryptReader            3120          2774          -11.09%
    BenchmarkEncryptDecryptReader     1528036       1528036       +0.00%
    BenchmarkDecrypt                  1919          1919          +0.00%
    BenchmarkSaveJSON                 5524          5524          +0.00%
    BenchmarkSaveFrom                 31353         40804         +30.14%
    BenchmarkLoadJSONID               12872020      16010968      +24.39%
    BenchmarkChunkerWithSHA256        26821         26821         +0.00%
    BenchmarkChunkerWithMD5           13554         13554         +0.00%
    BenchmarkChunker                  13458         13458         +0.00%
    BenchmarkPipelineWalker           58584         55560         -5.16%
2015-03-28 16:51:37 +01:00
backend Remove pools for nodes and IDs 2015-03-28 16:51:37 +01:00
chunker Slightly improve performance for chunker 2015-02-13 20:03:40 +01:00
cmd Correct plen for snapshots 2015-03-28 16:16:19 +01:00
debug DebugIf: only test function when tag is enabled 2015-03-15 14:19:37 +01:00
doc Design.md: Minor fixes 2015-03-22 22:53:29 +01:00
pipe Do not archive non-existing items 2015-03-28 16:35:46 +01:00
testsuite Add test for backing up non-existing files 2015-03-28 16:16:19 +01:00
.travis.yml Run sftp integration test in a subshell 2015-03-28 15:53:33 +01:00
archiver.go Remove pools for nodes and IDs 2015-03-28 16:51:37 +01:00
archiver_int_test.go Fix comparison for new files with '.' 2015-03-10 14:17:50 +01:00
archiver_test.go Add checks for Server.Load(), use Blob for load 2015-03-28 15:07:08 +01:00
blob.go Remove pools for nodes and IDs 2015-03-28 16:51:37 +01:00
cache.go Add checks for Server.Load(), use Blob for load 2015-03-28 15:07:08 +01:00
cache_darwin.go Fix darwin support 2015-03-08 14:32:49 +01:00
cache_linux.go Add local cache 2015-03-02 10:04:01 +01:00
cache_test.go Add checks for Server.Load(), use Blob for load 2015-03-28 15:07:08 +01:00
crypto.go Document crypto and master key JSON struct 2015-03-22 21:03:01 +01:00
crypto_int_test.go Rename keys to MasterKeys 2015-03-22 19:19:33 +01:00
crypto_test.go Fix benchmark for EncryptWriter 2015-03-14 22:42:30 +01:00
generic_test.go Rename khepri -> restic 2014-12-05 21:45:49 +01:00
key.go Remove unused vars and const 2015-03-28 15:28:08 +01:00
key_test.go Refactor backends 2015-03-28 14:36:50 +01:00
LICENSE LICENSE: Add email address 2014-09-18 21:10:30 +02:00
Makefile Refactor testsuite 2015-01-17 16:32:24 +01:00
map.go Recreate blob cache if missing (closes #104) 2015-03-14 18:15:47 +01:00
map_test.go Refactor repository structure 2015-01-14 16:34:30 +01:00
node.go Remove pools for nodes and IDs 2015-03-28 16:51:37 +01:00
node_darwin.go Fix darwin support 2015-03-08 14:32:49 +01:00
node_linux.go Bugfix: Backup changed data in incremental mode 2015-03-22 15:09:54 +01:00
node_windows.go Move platform specific code to different files 2015-02-03 21:18:19 +01:00
pools.go Remove pools for nodes and IDs 2015-03-28 16:51:37 +01:00
progress.go Progress: Add function that is called on Start() 2015-03-22 14:19:16 +01:00
README.md Add "Golang" keyword to README 2015-03-15 16:13:03 +01:00
restorer.go Add checks for Server.Load(), use Blob for load 2015-03-28 15:07:08 +01:00
server.go Go1.3: Fix range over channel 2015-03-28 15:52:15 +01:00
server_test.go Add checks for Server.Load(), use Blob for load 2015-03-28 15:07:08 +01:00
snapshot.go Add checks for Server.Load(), use Blob for load 2015-03-28 15:07:08 +01:00
snapshot_darwin.go Introduce UserID, GroupID for snapshot 2015-02-03 22:04:09 +01:00
snapshot_linux.go Introduce UserID, GroupID for snapshot 2015-02-03 22:04:09 +01:00
snapshot_test.go Add walk for trees, restructure 2015-03-02 19:58:06 +01:00
snapshot_windows.go Introduce UserID, GroupID for snapshot 2015-02-03 22:04:09 +01:00
testsuite.sh wip 2015-02-15 15:17:24 +01:00
tree.go Add checks for Server.Load(), use Blob for load 2015-03-28 15:07:08 +01:00
tree_test.go Allow configuring temp dir for tests 2015-02-21 16:53:14 +01:00
walk.go Add checks for Server.Load(), use Blob for load 2015-03-28 15:07:08 +01:00
walk_test.go Add checks for Server.Load(), use Blob for load 2015-03-28 15:07:08 +01:00
zerrors_linux.go Rename khepri -> restic 2014-12-05 21:45:49 +01:00

README.md

Stories in Ready Build Status sourcegraph status

WARNING

WARNING: At the moment, consider restic as alpha quality software, it is not yet finished. Do not use it for real data!

Restic

Restic is a program that does backups right. The design goals are:

  • Easy: Doing backups should be a frictionless process, otherwise you are tempted to skip it. Restic should be easy to configure and use, so that in the unlikely event of a data loss you can just restore it. Likewise, restoring data should not be complicated.

  • Fast: Backing up your data with restic should only be limited by your network or harddisk bandwidth so that you can backup your files every day. Nobody does backups if it takes too much time. Restoring backups should only transfer data that is needed for the files that are to be restored, so that this process is also fast.

  • Verifiable: Much more important than backup is restore, so restic enables you to easily verify that all data can be restored.

  • Secure: Restic uses cryptography to guarantee confidentiality and integrity of your data. The location the backup data is stored is assumed not to be a trusted environment (e.g. a shared space where others like system administrators are able to access your backups). Restic is built to secure your data against such attackers.

  • Efficient: With the growth of data, additional snapshots should only take the storage of the actual increment. Even more, duplicate data should be de-duplicated before it is actually written to the storage backend to save precious backup space.

Building

Install Go/Golang (at least 1.3), then run:

export GOPATH=~/src/go
go get github.com/restic/restic/cmd/restic
$GOPATH/bin/restic --help

Contribute

Contributions are welcome! Please make sure that all code submitted in pull-requests is properly formatted with gofmt. Installing the script fmt-check from https://github.com/edsrzf/gofmt-git-hook locally as a pre-commit hook checks formatting before commiting, just copy this script to .git/hooks/pre-commit.

If you are unsure what to do, please have a look at the github issues, especially those tagged minor complexity.

Contact

If you discover a bug or find something surprising, please feel free to open a github issue. If you would like to chat about restic, there is also the IRC channel #restic on irc.freenode.net. Or just write me an email :)

License

Restic is licensed under "BSD 2-Clause License". You can find the complete text in the file LICENSE.