Commit graph

7908 commits

Author SHA1 Message Date
Alexander Neumann
c6901af5aa Add streaming encrypt functions 2015-02-11 18:05:43 +01:00
Alexander Neumann
93abaf204a Fix get_random for count != 4k, add randomReader() 2015-02-11 17:38:51 +01:00
Alexander Neumann
3bf66d24fa chunker: Add test, only pass hash.Hash to New() 2015-02-11 13:12:36 +01:00
Alexander Neumann
869ba83c6d Add Benchmarks for Scanner and Archiver 2015-02-10 21:59:18 +01:00
Alexander Neumann
9fcd23bd38 Add parallel benchmark for chunk+encrypt 2015-02-09 23:39:16 +01:00
Alexander Neumann
bbb3145f11 Add chunker pool 2015-02-09 23:38:50 +01:00
Alexander Neumann
3daeee8e2c Make chunker resettable 2015-02-09 23:37:33 +01:00
Alexander Neumann
bda33e612c Implement streaming chunker using io.Reader 2015-02-09 00:28:54 +01:00
Alexander Neumann
a5c33d80d8 Chunker: remove pool, buf and make bufsize an option 2015-02-08 19:32:12 +01:00
Alexander Neumann
8dc5c2296a debug: do not seek after creating log file 2015-02-08 14:46:29 +01:00
Alexander Neumann
c884704bce Refactor pool stats 2015-02-08 13:46:51 +01:00
Alexander Neumann
d5dccd746e Progress: Add convenience functions 2015-02-07 17:05:49 +01:00
Alexander Neumann
7558e99dd5 Add newline to debug output 2015-02-07 17:04:20 +01:00
Alexander Neumann
57b8373bc9 Progress: Rename functions, fix documentation 2015-02-07 15:27:09 +01:00
Alexander Neumann
2b7af4a1c1 tree: Add concurrent traversing functions 2015-02-04 22:36:49 +01:00
Alexander Neumann
316e761f27 fsck: Check minimal set of blobs 2015-02-04 22:33:48 +01:00
Alexander Neumann
d44eb9d794 Always cast link counter to uint64 2015-02-03 22:06:17 +01:00
Alexander Neumann
84ad6cf4d2 Return error on backup 2015-02-03 22:05:46 +01:00
Alexander Neumann
26d3949c8b Use file size from FileInfo 2015-02-03 22:05:25 +01:00
Alexander Neumann
bb777d9a58 Introduce UserID, GroupID for snapshot
Use the fields UID and GID for Unix user and group ID, and the fields
UserID and GroupID for Windows user and group strings.
2015-02-03 22:04:09 +01:00
Alexander Neumann
d1fee28ae5 Extend darwin support 2015-02-03 21:32:01 +01:00
Alexander Neumann
b7b9c7750d Merge branch 'support-other-platforms' 2015-02-03 21:19:02 +01:00
Alexander Neumann
1da693a7d7 Move platform specific code to different files 2015-02-03 21:18:19 +01:00
Alexander Neumann
460ebebeef Split out Node and Blob from tree.go 2015-02-03 21:07:55 +01:00
Alexander Neumann
79e065596f Make CreateAtNodeAt() independend from Tree 2015-02-03 21:04:51 +01:00
Alexander Neumann
9101044941 Merge pull request #84 from moho1/patch-82
This should fix #82
2015-02-02 19:00:17 +01:00
Moritz Holtz
1cf3564dc1 This should fix #82
Sockets where just not created, but CreateNodeAt still tried
to run chmod on them.
Now, CreateNodeAt directly returns when finding a socket.
2015-02-02 14:50:31 +01:00
Alexander Neumann
1635f072ec Merge pull request #83 from rubenv/patch-1
Remove duplicate paragraphs
2015-02-02 13:58:06 +01:00
Ruben Vermeersch
750326eab2 Remove duplicate paragraphs 2015-02-02 08:41:53 +01:00
Alexander Neumann
d3bdc9c0d6 Merge pull request #81 from kamudadreieck/patch-1
Order of parameters fixed.
2015-02-01 10:15:56 +01:00
Robert Kamuda
d923abff7c Order of parameters fixed
restic -r /tmp/backup_loaction <command>
2015-01-31 22:52:02 +01:00
Alexander Neumann
e2a407babb Create large buffer when encrypting a large tree
This fixes #80
2015-01-31 21:18:51 +01:00
Alexander Neumann
56105489a8 Update documentation 2015-01-19 20:14:35 +01:00
Alexander Neumann
dc3e97adc7 Update documentation 2015-01-17 16:57:16 +01:00
Alexander Neumann
fb95f02af6 Refactor testsuite 2015-01-17 16:32:24 +01:00
Alexander Neumann
25a214809b Refactor debug into debug module 2015-01-17 16:32:13 +01:00
Alexander Neumann
bcb19c811b Add 'version' command 2015-01-16 21:26:33 +01:00
Alexander Neumann
9c742c7b4b Output bash version on test error 2015-01-14 21:34:21 +01:00
Alexander Neumann
333b514d7b Simplify test 2015-01-14 20:20:47 +01:00
Alexander Neumann
6732938e7e Merge branch 'refactor-repository' 2015-01-14 20:19:20 +01:00
Alexander Neumann
8c4af2af70 Remove test from default make target 2015-01-14 17:49:17 +01:00
Alexander Neumann
af43fb3dda Fix handling vanished files 2015-01-14 17:48:23 +01:00
Alexander Neumann
4e54c6af2c Fix calls to debug() 2015-01-14 17:48:10 +01:00
Alexander Neumann
219c0e82bb Add test for files vanishing between scan and backup 2015-01-14 17:43:41 +01:00
Alexander Neumann
7af11eaaae Refactor tests, integrate debug break points 2015-01-14 17:32:37 +01:00
Alexander Neumann
7f9e81431f Reduce time spent in tests
Make testing crypto functions with large buffers optional, use the flag
'-test.largecrypto'.
2015-01-14 16:34:30 +01:00
Alexander Neumann
48751e1935 Introduce debug tags and debug breaks
The environment variable DEBUG_TAGS can be used to control what is
printed on stderr. Example:

    DEBUG_TAGS="+all,-Archiver.*" ./restic backup foo

The variable DEBUG_BREAK can be used to set a breakpoint (implemented
using SIGSTOP):

    DEBUG_BREAK=Archiver.Snapshot ./restic backup foo
2015-01-14 16:34:30 +01:00
Alexander Neumann
203a911de9 Refactor repository structure
Merge Map data type into Tree.
2015-01-14 16:34:30 +01:00
Alexander Neumann
bdcdcdea7d Optimize chunker
Skip MinSize bytes at the beginning of each chunk. This increases
throughput about 30% percent.

Before:
    $ go test -v -bench . ./chunker
    === RUN TestChunker
    --- PASS: TestChunker (0.60s)
    === RUN TestChunkerReuse
    --- PASS: TestChunkerReuse (2.18s)
    PASS
    BenchmarkChunker          10     111229642 ns/op      94.27 MB/s
    --- BENCH: BenchmarkChunker
        chunker_test.go:168: 6 chunks, average chunk size: 1747626 bytes
        chunker_test.go:168: 6 chunks, average chunk size: 1747626 bytes
    ok      github.com/restic/restic/chunker    4.120s

After:
    $ go test -v -bench . ./chunker
    === RUN TestChunker
    --- PASS: TestChunker (0.48s)
    === RUN TestChunkerReuse
    --- PASS: TestChunkerReuse (1.75s)
    PASS
    BenchmarkChunker          20      81468596 ns/op     128.71 MB/s
    --- BENCH: BenchmarkChunker
        chunker_test.go:168: 6 chunks, average chunk size: 1747626 bytes
        chunker_test.go:168: 6 chunks, average chunk size: 1747626 bytes
    ok      github.com/restic/restic/chunker    4.061s
2015-01-14 16:33:41 +01:00
Alexander Neumann
cdf3336e7a Improve error message for newer files 2015-01-08 20:49:32 +01:00