TrueCloudLab/rclone
16
0
Fork 2
Code Issues Pull requests 1 Projects Releases Packages Wiki Activity Actions 1
"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Azure Blob, Azure Files, Yandex Files
4581 commits 181 branches 114 tags 335 MiB
Go 98.6%
HTML 0.4%
Shell 0.3%
Python 0.3%
JavaScript 0.2%
Other 0.1%
Find a file
Nick Craig-Wood 2adc057d95 vfs: fix very high load caused by slow directory listings 
In this commit (released in v1.52.0)

6ca7198f mount: fix disappearing cwd problem

SetSys was introduced to cache node lookups.

Unfortunately taking the vfs.(*Dir) lock in SetSys causes any FUSE
operations on a directory to pile up behind slow directory listings.

In some situations this leads to very high load.

This commit fixes it by using atomic operations to read and write the
Sys value make it independent of the lock.

See: https://forum.rclone.org/t/high-cpu-load-with-rclone-mount/17604
See: #4104
2020-07-15 16:22:12 +01:00
.github build: drop xgo builds for macOS, Linux and Windows 2020-06-29 14:51:16 +01:00
backend s3: fix bucket Region auto detection when Region unset in config #2915 2020-07-10 17:16:59 +01:00
bin make_manual: Support SOURCE_DATE_EPOCH 2020-07-15 13:23:08 +01:00
cmd mkdir: warn when using mkdir on remotes which can't have empty directories 2020-07-08 17:55:58 +01:00
contrib/docker Contrib: Add sample WebDAV server Docker Compose manifest. 2019-09-15 16:06:54 +01:00
docs ftp: add note to docs about home vs root directory selection 2020-07-15 15:27:47 +01:00
fs fs/accounting: sort transfers by start time 2020-07-07 15:42:06 +01:00
fstest fstest: add ability for mock objects and filesystems to have hashes 2020-06-30 12:01:36 +01:00
graphics build: Add file properties and icon to Windows executable (fixes #4304) 2020-06-11 09:26:14 +01:00
lib lib/ranges: ranges libary for dealing with partially downloaded files 2020-06-30 12:01:36 +01:00
vendor vendor: drop unused github.com/djherbis/times 2020-07-06 14:29:42 +01:00
vfs vfs: fix very high load caused by slow directory listings 2020-07-15 16:22:12 +01:00
.gitattributes build: add azure pipelines build 2019-08-06 10:31:32 +01:00
.gitignore s3: Add StackPath Object Storage Support 2020-01-31 16:05:44 +00:00
.golangci.yml build: move linter build tags into Makefile to fix golangci-lint 2019-04-12 15:48:36 +01:00
CONTRIBUTING.md docs: add how to squash to contributing 2020-06-16 15:06:03 +01:00
COPYING Initial commit - some small parts working 2012-11-18 17:32:31 +00:00
Dockerfile build: fix custom timezone in Docker image 2020-06-17 10:43:03 +01:00
go.mod vendor: drop unused github.com/djherbis/times 2020-07-06 14:29:42 +01:00
go.sum vendor: update goftp.io/server to v0.3.5-master to fix auth proxy #4394 2020-06-30 09:16:43 +01:00
MAINTAINERS.md doc: fix typos throughout docs and code 2020-05-25 11:23:58 +01:00
Makefile build: add btest Makefile target for pasteable download message 2020-06-26 16:26:29 +01:00
MANUAL.html Version v1.52.0 2020-05-27 17:31:10 +01:00
MANUAL.md Version v1.52.0 2020-05-27 17:31:10 +01:00
MANUAL.txt Version v1.52.0 2020-05-27 17:31:10 +01:00
notes.txt Replace test_all.sh with test_all.go which is cross platform and parallel 2015-12-30 09:26:34 +00:00
rclone.1 Version v1.52.0 2020-05-27 17:31:10 +01:00
rclone.go lib: add plugin support 2019-09-29 11:05:10 +01:00
README.md Tardigrade Backend 2020-05-12 15:56:50 +00:00
RELEASE.md build: fix docker release build action 2020-06-10 17:00:33 +01:00
VERSION Start v1.52.2-DEV development 2020-06-24 14:35:12 +01:00

README.md

rclone logo

Website | Documentation | Download | Contributing | Changelog | Installation | Forum

Build Status Go Report Card GoDoc Docker Pulls

Rclone

Rclone ("rsync for cloud storage") is a command line program to sync files and directories to and from different cloud storage providers.

Storage providers

Please see the full list of all storage providers and their features

Features

  • MD5/SHA-1 hashes checked at all times for file integrity
  • Timestamps preserved on files
  • Partial syncs supported on a whole file basis
  • Copy mode to just copy new/changed files
  • Sync (one way) mode to make a directory identical
  • Check mode to check for file hash equality
  • Can sync to and from network, e.g. two different cloud accounts
  • Optional large file chunking (Chunker)
  • Optional encryption (Crypt)
  • Optional cache (Cache)
  • Optional FUSE mount (rclone mount)
  • Multi-threaded downloads to local disk
  • Can serve local or remote files over HTTP/WebDav/FTP/SFTP/dlna

Installation & documentation

Please see the rclone website for:

Downloads

License

This is free software under the terms of MIT the license (check the COPYING file included in this package).