rclone/cmd/bisync/testdata/test_resync_modes/golden/test.log at 11ad2a1316a2320be43150e5e1da6bdd124e8f95

nielash 2bebbfaded bisync: add to integration tests - fixes #7665

This change officially adds bisync to the nightly integration tests for all
backends.

This will be part of giving us the confidence to take bisync out of beta.

A number of fixes have been added to account for features which can differ on
different backends -- for example, hash types / modtime support, empty
directories, unicode normalization, and unimportant differences in log output.
We will likely find that more of these are needed once we start running these
with the full set of remotes.

Additionally, bisync's extremely sensitive tests revealed a few bugs in other
backends that weren't previously covered by other tests. Fixes for those issues
have been submitted on the following separate PRs (and bisync test failures will
be expected until they are merged):

- #7670 memory: fix deadlock in operations.Purge
- #7688 memory: fix incorrect list entries when rooted at subdirectory
- #7690 memory: fix dst mutating src after server-side copy
- #7692 dropbox: fix chunked uploads when size <= chunkSize

Relatedly, workarounds have been put in place for the following backend
limitations that are unsolvable for the time being:

- #3262 drive is sometimes aware of trashed files/folders when it shouldn't be
- #6199 dropbox can't handle emojis and certain other characters
- #4590 onedrive API has longstanding bug for conflictBehavior=replace in
	server-side copy/move

2024-03-27 10:50:14 -04:00

8.8 KiB

Raw Blame History

(01) : test resync-mode

(02) : test changed on both paths and NOT identical - file1 (file1R, file1L)
(03) : touch-glob 2001-01-02 {datadir/} file1R.txt
(04) : copy-as {datadir/}file1R.txt {path2/} file1.txt
(05) : touch-glob 2001-03-04 {datadir/} file1L.txt
(06) : copy-as {datadir/}file1L.txt {path1/} file1.txt

(07) : test bisync run with --resync-mode=newer
(08) : bisync resync resync-mode=newer
INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
INFO : Bisyncing with Comparison Settings:
{
"Modtime": true,
"Size": true,
"Checksum": false,
"NoSlowHash": false,
"SlowHashSyncOnly": false,
"DownloadHash": false
}
INFO : Synching Path1 "{path1/}" with Path2 "{path2/}"
INFO : Copying Path2 files to Path1
INFO : - Path2 Resync is copying files to - Path1
INFO : - Path1 Resync is copying files to - Path2
INFO : Resync updating listings
INFO : Validating listings for Path1 "{path1/}" vs Path2 "{path2/}"
INFO : Bisync successful

(09) : test changed on both paths and NOT identical - file1 (file1R, file1L)
(10) : touch-glob 2001-07-23 {datadir/} file1R.txt
(11) : copy-as {datadir/}file1R.txt {path2/} file1.txt
(12) : touch-glob 2001-08-26 {datadir/} file1L.txt
(13) : copy-as {datadir/}file1L.txt {path1/} file1.txt

(14) : test bisync run with --resync-mode=path2
(15) : bisync resync resync-mode=path2
INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
INFO : Bisyncing with Comparison Settings:
{
"Modtime": true,
"Size": true,
"Checksum": false,
"NoSlowHash": false,
"SlowHashSyncOnly": false,
"DownloadHash": false
}
INFO : Synching Path1 "{path1/}" with Path2 "{path2/}"
INFO : Copying Path2 files to Path1
INFO : - Path2 Resync is copying files to - Path1
INFO : - Path1 Resync is copying files to - Path2
INFO : Resync updating listings
INFO : Validating listings for Path1 "{path1/}" vs Path2 "{path2/}"
INFO : Bisync successful

(16) : test changed on both paths and NOT identical - file1 (file1R, file1L)
(17) : touch-glob 2002-07-23 {datadir/} file1R.txt
(18) : copy-as {datadir/}file1R.txt {path2/} file1.txt
(19) : touch-glob 2002-08-26 {datadir/} file1L.txt
(20) : copy-as {datadir/}file1L.txt {path1/} file1.txt

(21) : test bisync run with --resync-mode=larger
(22) : bisync resync resync-mode=larger
INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
INFO : Bisyncing with Comparison Settings:
{
"Modtime": true,
"Size": true,
"Checksum": false,
"NoSlowHash": false,
"SlowHashSyncOnly": false,
"DownloadHash": false
}
INFO : Synching Path1 "{path1/}" with Path2 "{path2/}"
INFO : Copying Path2 files to Path1
INFO : - Path2 Resync is copying files to - Path1
INFO : file1.txt: Path2 is larger. Path1: 33, Path2: 42, Difference: 9
INFO : - Path1 Resync is copying files to - Path2
INFO : Resync updating listings
INFO : Validating listings for Path1 "{path1/}" vs Path2 "{path2/}"
INFO : Bisync successful

(23) : test changed on both paths and NOT identical - file1 (file1R, file1L)
(24) : touch-glob 2003-07-23 {datadir/} file1R.txt
(25) : copy-as {datadir/}file1R.txt {path2/} file1.txt
(26) : touch-glob 2003-09-04 {datadir/} file1L.txt
(27) : copy-as {datadir/}file1L.txt {path1/} file1.txt

(28) : test bisync run with --resync-mode=older
(29) : bisync resync resync-mode=older
INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
INFO : Bisyncing with Comparison Settings:
{
"Modtime": true,
"Size": true,
"Checksum": false,
"NoSlowHash": false,
"SlowHashSyncOnly": false,
"DownloadHash": false
}
INFO : Synching Path1 "{path1/}" with Path2 "{path2/}"
INFO : Copying Path2 files to Path1
INFO : - Path2 Resync is copying files to - Path1
INFO : file1.txt: Path2 is older. Path1: 2003-09-04 00:00:00 +0000 UTC, Path2: 2003-07-23 00:00:00 +0000 UTC, Difference: 1032h0m0s
INFO : - Path1 Resync is copying files to - Path2
INFO : Resync updating listings
INFO : Validating listings for Path1 "{path1/}" vs Path2 "{path2/}"
INFO : Bisync successful

(30) : test changed on both paths and NOT identical - file1 (file1R, file1L)
(31) : touch-glob 2004-07-23 {datadir/} file1R.txt
(32) : copy-as {datadir/}file1R.txt {path2/} file1.txt
(33) : touch-glob 2004-07-23 {datadir/} file1L.txt
(34) : copy-as {datadir/}file1L.txt {path1/} file1.txt

(35) : test bisync run with --resync-mode=smaller
(36) : bisync resync resync-mode=smaller
INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
INFO : Bisyncing with Comparison Settings:
{
"Modtime": true,
"Size": true,
"Checksum": false,
"NoSlowHash": false,
"SlowHashSyncOnly": false,
"DownloadHash": false
}
INFO : Synching Path1 "{path1/}" with Path2 "{path2/}"
INFO : Copying Path2 files to Path1
INFO : - Path2 Resync is copying files to - Path1
INFO : file1.txt: Path1 is smaller. Path1: 33, Path2: 42, Difference: 9
INFO : - Path1 Resync is copying files to - Path2
INFO : file1.txt: Path1 is smaller. Path1: 33, Path2: 42, Difference: 9
INFO : Resync updating listings
INFO : Validating listings for Path1 "{path1/}" vs Path2 "{path2/}"
INFO : Bisync successful

(37) : test changed on both paths and NOT identical - file1 (file1R, file1L)
(38) : touch-glob 2005-01-02 {datadir/} file1R.txt
(39) : copy-as {datadir/}file1R.txt {path2/} file1.txt
(40) : copy-as {datadir/}file1R.txt {path1/} file2.txt
(41) : touch-glob 2006-03-04 {datadir/} file1L.txt
(42) : copy-as {datadir/}file1L.txt {path1/} file1.txt
(43) : copy-as {datadir/}file1L.txt {path2/} file2.txt

(44) : test bisync run with --resync-mode=path1
(45) : bisync resync resync-mode=path1
INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
INFO : Bisyncing with Comparison Settings:
{
"Modtime": true,
"Size": true,
"Checksum": false,
"NoSlowHash": false,
"SlowHashSyncOnly": false,
"DownloadHash": false
}
INFO : Synching Path1 "{path1/}" with Path2 "{path2/}"
INFO : Copying Path2 files to Path1
INFO : - Path2 Resync is copying files to - Path1
INFO : - Path1 Resync is copying files to - Path2
INFO : Resync updating listings
INFO : Validating listings for Path1 "{path1/}" vs Path2 "{path2/}"
INFO : Bisync successful

(46) : test no winner
(47) : touch-glob 2022-02-22 {datadir/} file1R.txt
(48) : copy-as {datadir/}file1R.txt {path2/} file1.txt
(49) : copy-as {datadir/}file1R.txt {path1/} file2.txt
(50) : touch-glob 2022-02-22 {datadir/} file1L.txt
(51) : copy-as {datadir/}file1L.txt {path1/} file1.txt
(52) : copy-as {datadir/}file1L.txt {path2/} file2.txt

(53) : test bisync run with --resync-mode=newer
(54) : bisync resync resync-mode=newer
INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
INFO : Bisyncing with Comparison Settings:
{
"Modtime": true,
"Size": true,
"Checksum": false,
"NoSlowHash": false,
"SlowHashSyncOnly": false,
"DownloadHash": false
}
INFO : Synching Path1 "{path1/}" with Path2 "{path2/}"
INFO : Copying Path2 files to Path1
INFO : - Path2 Resync is copying files to - Path1
INFO : - Path1 Resync is copying files to - Path2
INFO : Resync updating listings
INFO : Validating listings for Path1 "{path1/}" vs Path2 "{path2/}"
INFO : Bisync successful

8.8 KiB Raw Blame History

8.8 KiB

Raw Blame History