2015-07-30 19:26:29 +00:00
|
|
|
---
|
|
|
|
title: "FAQ"
|
|
|
|
description: "Rclone Frequently Asked Questions"
|
2015-08-27 18:46:28 +00:00
|
|
|
date: "2015-08-27"
|
2015-07-30 19:26:29 +00:00
|
|
|
---
|
|
|
|
|
|
|
|
Frequently Asked Questions
|
|
|
|
--------------------------
|
|
|
|
|
|
|
|
### Do all cloud storage systems support all rclone commands ###
|
|
|
|
|
|
|
|
Yes they do. All the rclone commands (eg `sync`, `copy` etc) will
|
|
|
|
work on all the remote storage systems.
|
|
|
|
|
2015-08-27 18:46:28 +00:00
|
|
|
### Can I copy the config from one machine to another ###
|
|
|
|
|
|
|
|
Sure! Rclone stores all of its config in a single file. If you want
|
2019-01-13 17:56:57 +00:00
|
|
|
to find this file, run `rclone config file` which will tell you where
|
|
|
|
it is.
|
2015-08-27 18:46:28 +00:00
|
|
|
|
2016-01-07 15:20:32 +00:00
|
|
|
See the [remote setup docs](/remote_setup/) for more info.
|
2015-08-27 18:46:28 +00:00
|
|
|
|
2016-01-07 15:20:32 +00:00
|
|
|
### How do I configure rclone on a remote / headless box with no browser? ###
|
2015-08-27 18:46:28 +00:00
|
|
|
|
2016-01-07 15:20:32 +00:00
|
|
|
This has now been documented in its own [remote setup page](/remote_setup/).
|
2015-08-27 18:46:28 +00:00
|
|
|
|
2015-07-30 19:26:29 +00:00
|
|
|
### Can rclone sync directly from drive to s3 ###
|
|
|
|
|
|
|
|
Rclone can sync between two remote cloud storage systems just fine.
|
|
|
|
|
|
|
|
Note that it effectively downloads the file and uploads it again, so
|
|
|
|
the node running rclone would need to have lots of bandwidth.
|
|
|
|
|
|
|
|
The syncs would be incremental (on a file by file basis).
|
|
|
|
|
|
|
|
Eg
|
|
|
|
|
2015-08-17 16:14:05 +00:00
|
|
|
rclone sync drive:Folder s3:bucket
|
2015-07-30 19:26:29 +00:00
|
|
|
|
|
|
|
|
2015-08-16 13:07:13 +00:00
|
|
|
### Using rclone from multiple locations at the same time ###
|
|
|
|
|
|
|
|
You can use rclone from multiple places at the same time if you choose
|
|
|
|
different subdirectory for the output, eg
|
|
|
|
|
|
|
|
```
|
|
|
|
Server A> rclone sync /tmp/whatever remote:ServerA
|
|
|
|
Server B> rclone sync /tmp/whatever remote:ServerB
|
|
|
|
```
|
|
|
|
|
|
|
|
If you sync to the same directory then you should use rclone copy
|
|
|
|
otherwise the two rclones may delete each others files, eg
|
|
|
|
|
|
|
|
```
|
|
|
|
Server A> rclone copy /tmp/whatever remote:Backup
|
|
|
|
Server B> rclone copy /tmp/whatever remote:Backup
|
|
|
|
```
|
|
|
|
|
|
|
|
The file names you upload from Server A and Server B should be
|
|
|
|
different in this case, otherwise some file systems (eg Drive) may
|
|
|
|
make duplicates.
|
2015-08-31 11:47:07 +00:00
|
|
|
|
|
|
|
### Why doesn't rclone support partial transfers / binary diffs like rsync? ###
|
|
|
|
|
|
|
|
Rclone stores each file you transfer as a native object on the remote
|
|
|
|
cloud storage system. This means that you can see the files you
|
|
|
|
upload as expected using alternative access methods (eg using the
|
|
|
|
Google Drive web interface). There is a 1:1 mapping between files on
|
|
|
|
your hard disk and objects created in the cloud storage system.
|
|
|
|
|
|
|
|
Cloud storage systems (at least none I've come across yet) don't
|
|
|
|
support partially uploading an object. You can't take an existing
|
|
|
|
object, and change some bytes in the middle of it.
|
|
|
|
|
|
|
|
It would be possible to make a sync system which stored binary diffs
|
|
|
|
instead of whole objects like rclone does, but that would break the
|
|
|
|
1:1 mapping of files on your hard disk to objects in the remote cloud
|
|
|
|
storage system.
|
|
|
|
|
|
|
|
All the cloud storage systems support partial downloads of content, so
|
|
|
|
it would be possible to make partial downloads work. However to make
|
|
|
|
this work efficiently this would require storing a significant amount
|
|
|
|
of metadata, which breaks the desired 1:1 mapping of files to objects.
|
2015-09-02 07:33:18 +00:00
|
|
|
|
|
|
|
### Can rclone do bi-directional sync? ###
|
|
|
|
|
|
|
|
No, not at present. rclone only does uni-directional sync from A ->
|
|
|
|
B. It may do in the future though since it has all the primitives - it
|
|
|
|
just requires writing the algorithm to do it.
|
2015-10-30 11:06:11 +00:00
|
|
|
|
|
|
|
### Can I use rclone with an HTTP proxy? ###
|
|
|
|
|
2018-11-23 19:58:32 +00:00
|
|
|
Yes. rclone will follow the standard environment variables for
|
|
|
|
proxies, similar to cURL and other programs.
|
2015-10-30 11:06:11 +00:00
|
|
|
|
2018-11-23 19:58:32 +00:00
|
|
|
In general the variables are called `http_proxy` (for services reached
|
|
|
|
over `http`) and `https_proxy` (for services reached over `https`). Most
|
|
|
|
public services will be using `https`, but you may wish to set both.
|
2015-10-30 11:06:11 +00:00
|
|
|
|
2018-11-23 19:58:32 +00:00
|
|
|
The content of the variable is `protocol://server:port`. The protocol
|
|
|
|
value is the one used to talk to the proxy server, itself, and is commonly
|
|
|
|
either `http` or `socks5`.
|
|
|
|
|
|
|
|
Slightly annoyingly, there is no _standard_ for the name; some applications
|
|
|
|
may use `http_proxy` but another one `HTTP_PROXY`. The `Go` libraries
|
|
|
|
used by `rclone` will try both variations, but you may wish to set all
|
|
|
|
possibilities. So, on Linux, you may end up with code similar to
|
|
|
|
|
|
|
|
export http_proxy=http://proxyserver:12345
|
|
|
|
export https_proxy=$http_proxy
|
|
|
|
export HTTP_PROXY=$http_proxy
|
|
|
|
export HTTPS_PROXY=$http_proxy
|
2015-10-30 11:06:11 +00:00
|
|
|
|
|
|
|
The `NO_PROXY` allows you to disable the proxy for specific hosts.
|
|
|
|
Hosts must be comma separated, and can contain domains or parts.
|
|
|
|
For instance "foo.com" also matches "bar.foo.com".
|
2015-11-05 18:07:37 +00:00
|
|
|
|
2018-11-23 19:58:32 +00:00
|
|
|
e.g.
|
|
|
|
|
|
|
|
export no_proxy=localhost,127.0.0.0/8,my.host.name
|
|
|
|
export NO_PROXY=$no_proxy
|
|
|
|
|
2019-01-29 09:47:16 +00:00
|
|
|
Note that the ftp backend does not support `ftp_proxy` yet.
|
|
|
|
|
2015-11-05 18:07:37 +00:00
|
|
|
### Rclone gives x509: failed to load system roots and no roots provided error ###
|
|
|
|
|
|
|
|
This means that `rclone` can't file the SSL root certificates. Likely
|
2016-04-22 10:53:56 +00:00
|
|
|
you are running `rclone` on a NAS with a cut-down Linux OS, or
|
|
|
|
possibly on Solaris.
|
2015-11-05 18:07:37 +00:00
|
|
|
|
|
|
|
Rclone (via the Go runtime) tries to load the root certificates from
|
|
|
|
these places on Linux.
|
|
|
|
|
|
|
|
"/etc/ssl/certs/ca-certificates.crt", // Debian/Ubuntu/Gentoo etc.
|
|
|
|
"/etc/pki/tls/certs/ca-bundle.crt", // Fedora/RHEL
|
|
|
|
"/etc/ssl/ca-bundle.pem", // OpenSUSE
|
|
|
|
"/etc/pki/tls/cacert.pem", // OpenELEC
|
|
|
|
|
|
|
|
So doing something like this should fix the problem. It also sets the
|
|
|
|
time which is important for SSL to work properly.
|
|
|
|
|
|
|
|
```
|
|
|
|
mkdir -p /etc/ssl/certs/
|
|
|
|
curl -o /etc/ssl/certs/ca-certificates.crt https://raw.githubusercontent.com/bagder/ca-bundle/master/ca-bundle.crt
|
|
|
|
ntpclient -s -h pool.ntp.org
|
|
|
|
```
|
2016-02-16 14:55:26 +00:00
|
|
|
|
2018-01-15 21:32:37 +00:00
|
|
|
The two environment variables `SSL_CERT_FILE` and `SSL_CERT_DIR`, mentioned in the [x509 pacakge](https://godoc.org/crypto/x509),
|
|
|
|
provide an additional way to provide the SSL root certificates.
|
|
|
|
|
2016-02-16 14:55:26 +00:00
|
|
|
Note that you may need to add the `--insecure` option to the `curl` command line if it doesn't work without.
|
|
|
|
|
|
|
|
```
|
|
|
|
curl --insecure -o /etc/ssl/certs/ca-certificates.crt https://raw.githubusercontent.com/bagder/ca-bundle/master/ca-bundle.crt
|
|
|
|
```
|
2016-02-21 13:59:24 +00:00
|
|
|
|
|
|
|
### Rclone gives Failed to load config file: function not implemented error ###
|
|
|
|
|
|
|
|
Likely this means that you are running rclone on Linux version not
|
|
|
|
supported by the go runtime, ie earlier than version 2.6.23.
|
|
|
|
|
|
|
|
See the [system requirements section in the go install
|
|
|
|
docs](https://golang.org/doc/install) for full details.
|
2016-04-12 20:41:24 +00:00
|
|
|
|
|
|
|
### All my uploaded docx/xlsx/pptx files appear as archive/zip ###
|
|
|
|
|
|
|
|
This is caused by uploading these files from a Windows computer which
|
|
|
|
hasn't got the Microsoft Office suite installed. The easiest way to
|
|
|
|
fix is to install the Word viewer and the Microsoft Office
|
|
|
|
Compatibility Pack for Word, Excel, and PowerPoint 2007 and later
|
|
|
|
versions' file formats
|
2017-07-27 16:20:25 +00:00
|
|
|
|
|
|
|
### tcp lookup some.domain.com no such host ###
|
|
|
|
|
|
|
|
This happens when rclone cannot resolve a domain. Please check that
|
|
|
|
your DNS setup is generally working, e.g.
|
|
|
|
|
|
|
|
```
|
|
|
|
# both should print a long list of possible IP addresses
|
|
|
|
dig www.googleapis.com # resolve using your default DNS
|
|
|
|
dig www.googleapis.com @8.8.8.8 # resolve with Google's DNS server
|
|
|
|
```
|
|
|
|
|
|
|
|
If you are using `systemd-resolved` (default on Arch Linux), ensure it
|
|
|
|
is at version 233 or higher. Previous releases contain a bug which
|
|
|
|
causes not all domains to be resolved properly.
|
2018-01-15 21:32:37 +00:00
|
|
|
|
|
|
|
Additionally with the `GODEBUG=netdns=` environment variable the Go
|
|
|
|
resolver decision can be influenced. This also allows to resolve certain
|
|
|
|
issues with DNS resolution. See the [name resolution section in the go docs](https://golang.org/pkg/net/#hdr-Name_Resolution).
|