KurlesHS/rclone
1
0
Fork 0
forked from TrueCloudLab/rclone
Code Pull requests Activity
"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Azure Blob, Azure Files, Yandex Files
6917 commits 184 branches 6 tags 345 MiB
Go 98.6%
HTML 0.4%
Shell 0.3%
Python 0.3%
JavaScript 0.2%
Other 0.1%
Find a file
Nick Craig-Wood 2e2451f8ec lib/rest: fix problems re-using HTTP connections 
Before this fix, it was noticed that the rclone webdav client did not
re-use HTTP connections when it should have been.

This turned out to be because rclone was not draining the HTTP bodies
when it was not expecting a response.

From the Go docs:

> If the returned error is nil, the Response will contain a non-nil
> Body which the user is expected to close. If the Body is not both
> read to EOF and closed, the Client's underlying RoundTripper
> (typically Transport) may not be able to re-use a persistent TCP
> connection to the server for a subsequent "keep-alive" request.

This fixes the problem by draining up to 10MB of data from an HTTP
response if the NoResponse flag is set, or at the end of a JSON or XML
response (which could have some whitespace on the end).

See: https://forum.rclone.org/t/webdav-with-persistent-connections/37024/
2023-03-26 17:19:48 +01:00
.github build: remove duplicate linux/arm64 build 2023-03-21 16:25:46 +00:00
backend crypt: reduce allocations 2023-03-26 14:28:15 +02:00
bin build: set Rclone as file description since it is shown as process name in task manager 2023-03-23 18:55:57 +01:00
cmd mount: replace deprecated bazil/fuse specific constants with syscall constants 2023-03-26 14:28:15 +02:00
cmdtest cmdtest: fix typos found by codespell 2023-03-24 20:44:25 +00:00
contrib docker volume plugin: add missing fuse3 dependency #6844 2023-03-15 15:57:53 +00:00
docs docs: fix typos found by codespell 2023-03-24 20:49:00 +00:00
fs build: add exclude for misspell linter 2023-03-26 17:05:24 +02:00
fstest fstest: fix typo found by codespell 2023-03-25 09:34:10 +01:00
graphics build: Add file properties and icon to Windows executable (fixes #4304) 2020-06-11 09:26:14 +01:00
lib lib/rest: fix problems re-using HTTP connections 2023-03-26 17:19:48 +01:00
librclone librclone:Added example on using librclone with golang. 2023-03-17 12:00:27 +00:00
vfs vfs: ignore false positive from the unused linter 2023-03-26 14:28:15 +02:00
.gitattributes build: add azure pipelines build 2019-08-06 10:31:32 +01:00
.gitignore chunker: fix md5all test for no-meta test remotes 2021-10-18 18:04:07 +03:00
.golangci.yml build: enable misspell linter 2023-03-26 17:05:24 +02:00
CONTRIBUTING.md all: fix spelling across the project 2022-08-30 11:16:26 +02:00
COPYING Initial commit - some small parts working 2012-11-18 17:32:31 +00:00
Dockerfile docker: add missing fuse3 dependency - fixes #6844 2023-03-15 10:54:30 +00:00
go.mod build(deps): bump github.com/aws/aws-sdk-go from 1.44.227 to 1.44.228 2023-03-24 20:49:50 +00:00
go.sum build(deps): bump github.com/aws/aws-sdk-go from 1.44.227 to 1.44.228 2023-03-24 20:49:50 +00:00
MAINTAINERS.md storj: rename tardigrade backend to storj backend #5616 2022-02-11 11:04:15 +00:00
Makefile Add compiletest target to compile all the tests only 2022-12-15 12:38:09 +00:00
MANUAL.html Version v1.62.0 2023-03-14 12:42:23 +00:00
MANUAL.md Version v1.62.0 2023-03-14 12:42:23 +00:00
MANUAL.txt Version v1.62.0 2023-03-14 12:42:23 +00:00
notes.txt docs: spelling: etc. 2020-10-28 18:16:23 +00:00
rclone.1 Version v1.62.0 2023-03-14 12:42:23 +00:00
rclone.go lib: add plugin support 2019-09-29 11:05:10 +01:00
README.md webdav: add "fastmail" provider for Fastmail Files 2023-03-16 14:20:29 +00:00
RELEASE.md build: update release docs to be more careful with the tag 2023-03-15 14:53:21 +00:00
VERSION Start v1.63.0-DEV development 2023-03-14 15:18:54 +00:00

README.md

rclone logo rclone logo

Website | Documentation | Download | Contributing | Changelog | Installation | Forum

Build Status Go Report Card GoDoc Docker Pulls

Rclone

Rclone ("rsync for cloud storage") is a command-line program to sync files and directories to and from different cloud storage providers.

Storage providers

Please see the full list of all storage providers and their features

Virtual storage providers

These backends adapt or modify other storage providers

  • Alias: rename existing remotes 📄
  • Cache: cache remotes (DEPRECATED) 📄
  • Chunker: split large files 📄
  • Combine: combine multiple remotes into a directory tree 📄
  • Compress: compress files 📄
  • Crypt: encrypt files 📄
  • Hasher: hash files 📄
  • Union: join multiple remotes to work together 📄

Features

  • MD5/SHA-1 hashes checked at all times for file integrity
  • Timestamps preserved on files
  • Partial syncs supported on a whole file basis
  • Copy mode to just copy new/changed files
  • Sync (one way) mode to make a directory identical
  • Check mode to check for file hash equality
  • Can sync to and from network, e.g. two different cloud accounts
  • Optional large file chunking (Chunker)
  • Optional transparent compression (Compress)
  • Optional encryption (Crypt)
  • Optional FUSE mount (rclone mount)
  • Multi-threaded downloads to local disk
  • Can serve local or remote files over HTTP/WebDAV/FTP/SFTP/DLNA

Installation & documentation

Please see the rclone website for:

Downloads

License

This is free software under the terms of the MIT license (check the COPYING file included in this package).