rclone/fs/operations
Saksham Khanna 4d8ef7bca7
cmd/dedupe: make largest directory primary to minimize data moved (#3648)
This change makes dedupe recursively count elements in same-named directories
and make the largest one primary. This allows to minimize the amount of data
moved (or at least the amount of API calls) when dedupe merges them.
It also adds a new fs.Object interface `ParentIDer` with function `ParentID` and
implements it for the drive and opendrive backends. This function returns
parent directory ID for objects on filesystems that allow same-named dirs.
We use it to correctly count sizes of same-named directories.

Fixes #2568

Co-authored-by: Ivan Andreev <ivandeex@gmail.com>
2021-03-11 20:40:29 +03:00
..
check.go fs: deglobalise the config #4685 2020-11-26 16:40:12 +00:00
check_test.go fs: deglobalise the config #4685 2020-11-26 16:40:12 +00:00
dedupe.go cmd/dedupe: make largest directory primary to minimize data moved (#3648) 2021-03-11 20:40:29 +03:00
dedupe_test.go dedupe: add --by-hash to dedupe on hash not file name - fixes #1674 2020-12-02 16:52:12 +00:00
listdirsorted_test.go filter: deglobalise to put filter config into the context #4685 2020-11-27 17:28:42 +00:00
lsjson.go fs: deglobalise the config #4685 2020-11-26 16:40:12 +00:00
multithread.go fs: deglobalise the config #4685 2020-11-26 16:40:12 +00:00
multithread_test.go fs: deglobalise the config #4685 2020-11-26 16:40:12 +00:00
operations.go delete,rmdirs: make --rmdirs obey the filters 2021-02-19 10:32:28 +00:00
operations_internal_test.go fs: deglobalise the config #4685 2020-11-26 16:40:12 +00:00
operations_test.go delete,rmdirs: make --rmdirs obey the filters 2021-02-19 10:32:28 +00:00
rc.go fs: Add context to NewFs #3257 #4685 2020-11-09 18:05:54 +00:00
rc_test.go fs: add context.Context to fs.GetModifyWindow #3257 #4685 2020-11-09 18:05:54 +00:00
reopen.go fs: add UploadHeaders, DownloadHeaders to Update/Put/Open options 2020-04-23 11:07:21 +01:00
reopen_test.go doc: fix typos throughout docs and code 2020-05-20 15:54:51 +01:00