4156 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Alexander Neumann	21c83b1725	archiver: Add high-level documentation	2018-05-12 23:55:54 +02:00
Alexander Neumann	581c62ee72	archiver: Improve error handling ... This commit changes how the worker goroutines for saving e.g. blobs interact. Before, it was possible to get stuck sending an instruction to archive a file or dir when no worker goroutines were available any more. This commit introduces a `done` channel for each of the worker pools, which is set to the channel returned by `tomb.Dying()`, so it is closed when the first worker returned an error.	2018-05-12 23:55:54 +02:00
Alexander Neumann	ef7747313d	backup: Use absolute paths for allowed devices	2018-05-11 21:32:44 +02:00
Alexander Neumann	18d4ac2fd9	backup: Always use cleaned path for excludes	2018-05-11 21:32:41 +02:00
Alexander Neumann	9180e2c48a	Remove unneeded file excludes	2018-05-11 21:26:10 +02:00
Gaige Lama	a63989afcd	Ran gofmt on backend.go ... I ran gofmt on backend.go, this appears to valid edit.	2018-05-11 11:07:16 -04:00
Gaige Lama	d3c0bd6d0e	Fix small typo ... "explicitely" should be "explicitly"	2018-05-11 10:55:12 -04:00
Alexander Neumann	fcfa6f0355	build: Add option to enable PIE build mode	2018-05-11 09:50:10 +02:00
Alexander Neumann	580f90d745	Merge pull request #1770 from restic/handle-blob-save-errors ... archiver: Correct error handling	2018-05-10 22:36:00 +02:00
Alexander Neumann	c7b624ba0d	Merge pull request #1769 from McKael/cat_snapshot_stacktrace ... cat snapshot: Do not display a stack trace with invalid IDs	2018-05-10 21:41:04 +02:00
Alexander Neumann	ca4af43c03	archiver: Return low-level errors ... This commit changes the archiver so that low-level errors saving data to the repo are returned to the caller (instead of being handled by the error callback function). This correctly bubbles up errors like a full temp file system and makes restic abort early and makes all other worker goroutines exit.	2018-05-10 21:30:09 +02:00
Alexander Neumann	1f2463f42e	archiver: Return correct error	2018-05-10 20:48:00 +02:00
Alexander Neumann	157c854d04	backup: Remove errored files from status display	2018-05-10 20:48:00 +02:00
Mikael Berthe	ffc276a603	cat: Do not display a stack trace ... Don't show a stack trace when "restic cat snapshot" is invoked with invalid/nonexistent IDs.	2018-05-10 19:22:46 +02:00
Alexander Neumann	e42b7db008	Merge pull request #1767 from restic/update-blazer ... Update github.com/kurin/blazer	2018-05-08 22:48:54 +02:00
Alexander Neumann	024148cac9	Update github.com/kurin/blazer	2018-05-08 22:33:55 +02:00
Alexander Neumann	8943741a0b	Fix code block	2018-05-08 20:36:58 +02:00
Alexander Neumann	95c5517c35	Merge pull request #1765 from restic/update-deps ... Update golang.org/x/{sys,crypto}	2018-05-08 19:34:30 +02:00
Alexander Neumann	06179a7e81	Change URL for Travis	2018-05-08 19:13:39 +02:00
Alexander Neumann	cf1fb50f9c	Merge pull request #1764 from restic/fix-display ... Fix display	2018-05-07 23:30:50 +02:00
Alexander Neumann	6793300850	Raise minimum Go version to 1.9 ... The golang.org/sys/crypto library uses math/bits, which was only introduced in Go 1.9.	2018-05-07 23:28:48 +02:00
Alexander Neumann	2cbdfbf652	Update golang.org/x/{sys,crypto}	2018-05-07 22:47:39 +02:00
Alexander Neumann	b2208bb9c2	Rework termstatus ... This now keeps the cursor at the first column of the first status line so that messages printed to stdout or stderr by some other part of the progarm will still be visible. The message will overwrite the status lines, but those are easily reprinted on the next status update.	2018-05-07 21:40:07 +02:00
Alexander Neumann	4c25495d68	backup: Hide percent until total size is known	2018-05-06 20:20:25 +02:00
Alexander Neumann	abdd59ea1b	Merge pull request #1757 from restic/fix-debug-1755 ... Fix panic for nil-pointer dereference	2018-05-03 21:11:37 +02:00
Alexander Neumann	05ca903d48	Mention that first backup will take longer	2018-05-03 20:57:30 +02:00
Alexander Neumann	fd77646f8b	Fix panic for nil-pointer dereference ... Closes #1755	2018-05-03 20:49:30 +02:00
Alexander Neumann	2a67258867	Merge pull request #1754 from restic/fix-quiet ... backup: Disable status output for --quiet	2018-05-02 21:42:17 +02:00
Alexander Neumann	fca4fe4459	backup: Disable status output for --quiet	2018-05-02 21:24:18 +02:00
Alexander Neumann	26757ae2e5	Merge pull request #1750 from restic/archiver-fix-small-things ... backup: Tune user interface a bit	2018-05-01 23:15:54 +02:00
Alexander Neumann	9d6890a236	Merge pull request #1751 from restic/fix-archiver ... archiver: Use lstat before open/fstat	2018-05-01 23:15:32 +02:00
Alexander Neumann	2218ecd049	archiver: Use lstat before open/fstat ... The previous code tried to be as efficient as possible and only do a single open() on an item to save, and then fstat() on the fd to find out what the item is (file, dir, other). For normal files, it would then start reading the data without opening the file again, so it could not be exchanged for e.g. a symlink. This behavior starts the watchdog on my machine when /dev is saved with restic, and after a few seconds, the machine reboots. This commit reverts the behavior to the strategy the old archiver code used: run lstat(), then decide what to do. For normal files, open the file and then run fstat() on the fd to verify it's still a normal file, then start reading the data. The downside is that for normal files we now do two stat() calls (lstat+fstat) instead of only one. On the upside, this does not start the watchdog. :)	2018-05-01 23:05:50 +02:00
Alexander Neumann	d0974c155d	backup: Tune user interface a bit ... Make non-verbose mode a bit more verbose.	2018-05-01 22:18:32 +02:00
Alexander Neumann	8026e6fdfb	Merge pull request #1749 from restic/add-cache-cmd ... Add 'cache' command to list and cleanup cache dirs	2018-05-01 21:25:52 +02:00
Alexander Neumann	01f9662614	Merge pull request #1748 from restic/detect-bom ... Respect Encoding and Byte Order Mark when reading text files	2018-05-01 21:25:46 +02:00
Alexander Neumann	f928aeec34	Add 'cache' command	2018-05-01 16:27:44 +02:00
Alexander Neumann	f77bc0fae8	Use textfile.Read() to read files ... This converts the text to UTF-8 and removes a Byte Order Mark.	2018-05-01 16:25:53 +02:00
Alexander Neumann	eb6650b201	Add textfile	2018-05-01 14:38:59 +02:00
Alexander Neumann	bc68d55e94	fs: Add TestTempFile	2018-05-01 14:38:41 +02:00
Alexander Neumann	ecbbd851a1	Merge pull request #1744 from restic/fix-parent-detect ... backup: Clean target paths before finding parent	2018-05-01 11:13:19 +02:00
Alexander Neumann	336719b058	Merge pull request #1746 from brycied00d/fix_tls-client-cert_argument_parsing ... http backend: Parse the correct argument when loading --tls-client-cert	2018-05-01 10:22:10 +02:00
Bryce Chidester	e9f1721678	http backend: Parse the correct argument when loading --tls-client-cert ... Previously, the function read from ARGV[1] (hardcoded) rather than the value passed to it, the command-line argument as it exists in globalOptions. Resolves #1745	2018-04-30 15:21:09 -07:00
Alexander Neumann	64d98945a6	backup: Clean target paths before finding parent ... This resolves an issue described in the forum where restic could not find a parent snapshot if the target path ends with a slash: https://forum.restic.net/t/new-archiver-code-please-test/623/23	2018-04-30 22:03:11 +02:00
Alexander Neumann	84f82dae1a	Correct typo ... Closes #1743	2018-04-30 21:41:30 +02:00
Alexander Neumann	6bfd9f833b	Merge pull request #1742 from tbm/typos ... Fix typos in section on rclone	2018-04-30 19:21:19 +02:00
Martin Michlmayr	bb1a22d1e6	Fix typos in section on rclone	2018-04-30 18:32:10 +02:00
Alexander Neumann	438719f269	Merge pull request #1741 from restic/improve-archiver ... Improve archiver, fix hang on fifos	2018-04-30 16:00:10 +02:00
Alexander Neumann	c83c03ed63	archiver: Fix blocking on pipes	2018-04-30 15:34:58 +02:00
Alexander Neumann	19b9c881ca	fs: Add O_NONBLOCK	2018-04-30 15:34:58 +02:00
Alexander Neumann	4e34325035	archiver: Process dirs concurrently	2018-04-30 15:13:28 +02:00