Version v1.59.1

This commit is contained in:
Nick Craig-Wood 2022-08-08 18:10:58 +01:00
parent f675da9053
commit 5f710a2d48
8 changed files with 421 additions and 121 deletions

100
MANUAL.html generated
View file

@ -19,7 +19,7 @@
<header id="title-block-header">
<h1 class="title">rclone(1) User Manual</h1>
<p class="author">Nick Craig-Wood</p>
<p class="date">Jul 09, 2022</p>
<p class="date">Aug 08, 2022</p>
</header>
<h1 id="rclone-syncs-your-files-to-cloud-storage">Rclone syncs your files to cloud storage</h1>
<p><img width="50%" src="https://rclone.org/img/logo_on_light__horizontal_color.svg" alt="rclone logo" style="float:right; padding: 5px;" ></p>
@ -300,7 +300,7 @@ go build</code></pre>
<p>Run the <a href="https://rclone.org/commands/rclone_config_paths/">config paths</a> command to see the locations that rclone will use.</p>
<p>To override them set the corresponding options (as command-line arguments, or as <a href="https://rclone.org/docs/#environment-variables">environment variables</a>): - <a href="https://rclone.org/docs/#config-config-file">--config</a> - <a href="https://rclone.org/docs/#cache-dir-dir">--cache-dir</a> - <a href="https://rclone.org/docs/#temp-dir-dir">--temp-dir</a></p>
<h2 id="autostart">Autostart</h2>
<p>After installing and configuring rclone, as described above, you are ready to use rclone as an interactive command line utility. If your goal is to perform <em>periodic</em> operations, such as a regular <a href="https://rclone.org/commands/rclone_sync/">sync</a>, you will probably want to configure your rclone command in your operating system's scheduler. If you need to expose <em>service</em>-like features, such as <a href="https://rclone.org/rc/">remote control</a>, <a href="https://rclone.org/gui/">GUI</a>, <a href="https://rclone.org/commands/rclone_serve/">serve</a> or <a href="https://rclone.org/commands/rclone_move/">mount</a>, you will often want an rclone command always running in the background, and configuring it to run in a service infrastructure may be a better option. Below are some alternatives on how to achieve this on different operating systems.</p>
<p>After installing and configuring rclone, as described above, you are ready to use rclone as an interactive command line utility. If your goal is to perform <em>periodic</em> operations, such as a regular <a href="https://rclone.org/commands/rclone_sync/">sync</a>, you will probably want to configure your rclone command in your operating system's scheduler. If you need to expose <em>service</em>-like features, such as <a href="https://rclone.org/rc/">remote control</a>, <a href="https://rclone.org/gui/">GUI</a>, <a href="https://rclone.org/commands/rclone_serve/">serve</a> or <a href="https://rclone.org/commands/rclone_mount/">mount</a>, you will often want an rclone command always running in the background, and configuring it to run in a service infrastructure may be a better option. Below are some alternatives on how to achieve this on different operating systems.</p>
<p>NOTE: Before setting up autorun it is highly recommended that you have tested your command manually from a Command Prompt first.</p>
<h3 id="autostart-on-windows">Autostart on Windows</h3>
<p>The most relevant alternatives for autostart on Windows are: - Run at user log on using the Startup folder - Run at user log on, at system startup or at schedule using Task Scheduler - Run at system startup using Windows service</p>
@ -309,7 +309,7 @@ go build</code></pre>
<p>Example command to run a sync in background:</p>
<pre><code>c:\rclone\rclone.exe sync c:\files remote:/files --no-console --log-file c:\rclone\logs\sync_files.txt</code></pre>
<h4 id="user-account">User account</h4>
<p>As mentioned in the <a href="https://rclone.org/commands/rclone_move/">mount</a> documentation, mounted drives created as Administrator are not visible to other accounts, not even the account that was elevated as Administrator. By running the mount command as the built-in <code>SYSTEM</code> user account, it will create drives accessible for everyone on the system. Both scheduled task and Windows service can be used to achieve this.</p>
<p>As mentioned in the <a href="https://rclone.org/commands/rclone_mount/">mount</a> documentation, mounted drives created as Administrator are not visible to other accounts, not even the account that was elevated as Administrator. By running the mount command as the built-in <code>SYSTEM</code> user account, it will create drives accessible for everyone on the system. Both scheduled task and Windows service can be used to achieve this.</p>
<p>NOTE: Remember that when rclone runs as the <code>SYSTEM</code> user, the user profile that it sees will not be yours. This means that if you normally run rclone with configuration file in the default location, to be able to use the same configuration when running as the system user you must explicitely tell rclone where to find it with the <a href="https://rclone.org/docs/#config-config-file"><code>--config</code></a> option, or else it will look in the system users profile path (<code>C:\Windows\System32\config\systemprofile</code>). To test your command manually from a Command Prompt, you can run it with the <a href="https://docs.microsoft.com/en-us/sysinternals/downloads/psexec">PsExec</a> utility from Microsoft's Sysinternals suite, which takes option <code>-s</code> to execute commands as the <code>SYSTEM</code> user.</p>
<h4 id="start-from-startup-folder">Start from Startup folder</h4>
<p>To quickly execute an rclone command you can simply create a standard Windows Explorer shortcut for the complete rclone command you want to run. If you store this shortcut in the special "Startup" start-menu folder, Windows will automatically run it at login. To open this folder in Windows Explorer, enter path <code>%APPDATA%\Microsoft\Windows\Start Menu\Programs\Startup</code>, or <code>C:\ProgramData\Microsoft\Windows\Start Menu\Programs\StartUp</code> if you want the command to start for <em>every</em> user that logs in.</p>
@ -469,6 +469,7 @@ destpath/sourcepath/two.txt</code></pre>
<p>Note that files in the destination won't be deleted if there were any errors at any point. Duplicate objects (files with the same name, on those providers that support it) are also not yet handled.</p>
<p>It is always the contents of the directory that is synced, not the directory itself. So when source:path is a directory, it's the contents of source:path that are copied, not the directory name and contents. See extended explanation in the <a href="https://rclone.org/commands/rclone_copy/">copy</a> command if unsure.</p>
<p>If dest:path doesn't exist, it is created and the source:path contents go there.</p>
<p>It is not possible to sync overlapping remotes. However, you may exclude the destination from the sync with a filter rule or by putting an exclude-if-present file inside the destination directory and sync to a destination that is inside the source directory.</p>
<p><strong>Note</strong>: Use the <code>-P</code>/<code>--progress</code> flag to view real-time transfer statistics</p>
<p><strong>Note</strong>: Use the <code>rclone dedupe</code> command to deal with "Duplicate object/directory found in source/destination - ignoring" errors. See <a href="https://forum.rclone.org/t/sync-not-clearing-duplicates/14372">this forum post</a> for more info.</p>
<pre><code>rclone sync source:path dest:path [flags]</code></pre>
@ -4236,7 +4237,7 @@ rclone sync -i /path/to/files remote:current-backup</code></pre>
<h3 id="backup-dirdir">--backup-dir=DIR</h3>
<p>When using <code>sync</code>, <code>copy</code> or <code>move</code> any files which would have been overwritten or deleted are moved in their original hierarchy into this directory.</p>
<p>If <code>--suffix</code> is set, then the moved files will have the suffix added to them. If there is a file with the same path (after the suffix has been added) in DIR, then it will be overwritten.</p>
<p>The remote in use must support server-side move or copy and you must use the same remote as the destination of the sync. The backup directory must not overlap the destination directory.</p>
<p>The remote in use must support server-side move or copy and you must use the same remote as the destination of the sync. The backup directory must not overlap the destination directory without it being excluded by a filter rule.</p>
<p>For example</p>
<pre><code>rclone sync -i /path/to/local remote:current --backup-dir remote:old</code></pre>
<p>will sync <code>/path/to/local</code> to <code>remote:current</code>, but for any files which would have been updated or deleted will be stored in <code>remote:old</code>.</p>
@ -8378,7 +8379,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total
--use-json-log Use json log format
--use-mmap Use mmap allocator (see docs)
--use-server-modtime Use server modified time instead of object metadata
--user-agent string Set the user-agent to a specified string (default &quot;rclone/v1.59.0&quot;)
--user-agent string Set the user-agent to a specified string (default &quot;rclone/v1.59.1&quot;)
-v, --verbose count Print lots more stuff (repeat for more)</code></pre>
<h2 id="backend-flags">Backend Flags</h2>
<p>These flags are available for every command. They control the backends and may be set in the config file.</p>
@ -17156,7 +17157,7 @@ remote = drive,team_drive=0ABCDEFabcdefghijkl,root_folder_id=:
[AllDrives]
type = combine
remote = &quot;My Drive=My Drive:&quot; &quot;Test Drive=Test Drive:&quot;</code></pre>
upstreams = &quot;My Drive=My Drive:&quot; &quot;Test Drive=Test Drive:&quot;</code></pre>
<p>If you then add that config to your config file (find it with <code>rclone config file</code>) then you can access all the shared drives in one place with the <code>AllDrives:</code> remote.</p>
<p>See <a href="https://rclone.org/drive/#drives">the Google Drive docs</a> for full info.</p>
<h3 id="standard-options-11">Standard options</h3>
@ -19657,7 +19658,7 @@ remote = drive,team_drive=0ABCDEFabcdefghijkl,root_folder_id=:
[AllDrives]
type = combine
remote = &quot;My Drive=My Drive:&quot; &quot;Test Drive=Test Drive:&quot;</code></pre>
upstreams = &quot;My Drive=My Drive:&quot; &quot;Test Drive=Test Drive:&quot;</code></pre>
<p>Adding this to the rclone config file will cause those team drives to be accessible with the aliases shown. Any illegal charactes will be substituted with "_" and duplicate names will have numbers suffixed. It will also add a remote called AllDrives which shows all the shared drives combined into one directory tree.</p>
<h3 id="untrash">untrash</h3>
<p>Untrash files and directories</p>
@ -20952,8 +20953,8 @@ y/e/d&gt; y</code></pre>
<p>The Internet Archive backend utilizes Items on <a href="https://archive.org/">archive.org</a></p>
<p>Refer to <a href="https://archive.org/services/docs/api/ias3.html">IAS3 API documentation</a> for the API this backend uses.</p>
<p>Paths are specified as <code>remote:bucket</code> (or <code>remote:</code> for the <code>lsd</code> command.) You may put subdirectories in too, e.g. <code>remote:item/path/to/dir</code>.</p>
<p>Once you have made a remote (see the provider specific section above) you can use it like this:</p>
<p>Unlike S3, listing up all items uploaded by you isn't supported.</p>
<p>Once you have made a remote, you can use it like this:</p>
<p>Make a new item</p>
<pre><code>rclone mkdir remote:item</code></pre>
<p>List the contents of a item</p>
@ -20965,7 +20966,7 @@ y/e/d&gt; y</code></pre>
<p>You can optionally wait for the server's processing to finish, by setting non-zero value to <code>wait_archive</code> key. By making it wait, rclone can do normal file comparison. Make sure to set a large enough value (e.g. <code>30m0s</code> for smaller files) as it can take a long time depending on server's queue.</p>
<h2 id="about-metadata">About metadata</h2>
<p>This backend supports setting, updating and reading metadata of each file. The metadata will appear as file metadata on Internet Archive. However, some fields are reserved by both Internet Archive and rclone.</p>
<p>The following are reserved by Internet Archive: - <code>name</code> - <code>source</code> - <code>size</code> - <code>md5</code> - <code>crc32</code> - <code>sha1</code> - <code>format</code> - <code>old_version</code> - <code>viruscheck</code></p>
<p>The following are reserved by Internet Archive: - <code>name</code> - <code>source</code> - <code>size</code> - <code>md5</code> - <code>crc32</code> - <code>sha1</code> - <code>format</code> - <code>old_version</code> - <code>viruscheck</code> - <code>summation</code></p>
<p>Trying to set values to these keys is ignored with a warning. Only setting <code>mtime</code> is an exception. Doing so make it the identical behavior as setting ModTime.</p>
<p>rclone reserves all the keys starting with <code>rclone-</code>. Setting value for these keys will give you warnings, but values are set according to request.</p>
<p>If there are multiple values for a key, only the first one is returned. This is a limitation of rclone, that supports one value per one key. It can be triggered when you did a server-side copy.</p>
@ -21138,42 +21139,42 @@ y/e/d&gt; y</code></pre>
<td>CRC32 calculated by Internet Archive</td>
<td>string</td>
<td>01234567</td>
<td>N</td>
<td><strong>Y</strong></td>
</tr>
<tr class="even">
<td>format</td>
<td>Name of format identified by Internet Archive</td>
<td>string</td>
<td>Comma-Separated Values</td>
<td>N</td>
<td><strong>Y</strong></td>
</tr>
<tr class="odd">
<td>md5</td>
<td>MD5 hash calculated by Internet Archive</td>
<td>string</td>
<td>01234567012345670123456701234567</td>
<td>N</td>
<td><strong>Y</strong></td>
</tr>
<tr class="even">
<td>mtime</td>
<td>Time of last modification, managed by Rclone</td>
<td>RFC 3339</td>
<td>2006-01-02T15:04:05.999999999Z</td>
<td>N</td>
<td><strong>Y</strong></td>
</tr>
<tr class="odd">
<td>name</td>
<td>Full file path, without the bucket part</td>
<td>filename</td>
<td>backend/internetarchive/internetarchive.go</td>
<td>N</td>
<td><strong>Y</strong></td>
</tr>
<tr class="even">
<td>old_version</td>
<td>Whether the file was replaced and moved by keep-old-version flag</td>
<td>boolean</td>
<td>true</td>
<td>N</td>
<td><strong>Y</strong></td>
</tr>
<tr class="odd">
<td>rclone-ia-mtime</td>
@ -21201,28 +21202,35 @@ y/e/d&gt; y</code></pre>
<td>SHA1 hash calculated by Internet Archive</td>
<td>string</td>
<td>0123456701234567012345670123456701234567</td>
<td>N</td>
<td><strong>Y</strong></td>
</tr>
<tr class="odd">
<td>size</td>
<td>File size in bytes</td>
<td>decimal number</td>
<td>123456</td>
<td>N</td>
<td><strong>Y</strong></td>
</tr>
<tr class="even">
<td>source</td>
<td>The source of the file</td>
<td>string</td>
<td>original</td>
<td>N</td>
<td><strong>Y</strong></td>
</tr>
<tr class="odd">
<td>summation</td>
<td>Check https://forum.rclone.org/t/31922 for how it is used</td>
<td>string</td>
<td>md5</td>
<td><strong>Y</strong></td>
</tr>
<tr class="even">
<td>viruscheck</td>
<td>The last time viruscheck process was run for the file (?)</td>
<td>unixtime</td>
<td>1654191352</td>
<td>N</td>
<td><strong>Y</strong></td>
</tr>
</tbody>
</table>
@ -27757,6 +27765,60 @@ $ tree /tmp/b
<li>"error": return an error based on option value</li>
</ul>
<h1 id="changelog">Changelog</h1>
<h2 id="v1.59.1---2022-08-08">v1.59.1 - 2022-08-08</h2>
<p><a href="https://github.com/rclone/rclone/compare/v1.59.0...v1.59.1">See commits</a></p>
<ul>
<li>Bug Fixes
<ul>
<li>accounting: Fix panic in core/stats-reset with unknown group (Nick Craig-Wood)</li>
<li>build: Fix android build after GitHub actions change (Nick Craig-Wood)</li>
<li>dlna: Fix SOAP action header parsing (Joram Schrijver)</li>
<li>docs: Fix links to mount command from install docs (albertony)</li>
<li>dropox: Fix ChangeNotify was unable to decrypt errors (Nick Craig-Wood)</li>
<li>fs: Fix parsing of times and durations of the form "YYYY-MM-DD HH:MM:SS" (Nick Craig-Wood)</li>
<li>serve sftp: Fix checksum detection (Nick Craig-Wood)</li>
<li>sync: Add accidentally missed filter-sensitivity to --backup-dir option (Nick Naumann)</li>
</ul></li>
<li>Combine
<ul>
<li>Fix docs showing <code>remote=</code> instead of <code>upstreams=</code> (Nick Craig-Wood)</li>
<li>Throw error if duplicate directory name is specified (Nick Craig-Wood)</li>
<li>Fix errors with backends shutting down while in use (Nick Craig-Wood)</li>
</ul></li>
<li>Dropbox
<ul>
<li>Fix hang on quit with --dropbox-batch-mode off (Nick Craig-Wood)</li>
<li>Fix infinite loop on uploading a corrupted file (Nick Craig-Wood)</li>
</ul></li>
<li>Internetarchive
<ul>
<li>Ignore checksums for files using the different method (Lesmiscore)</li>
<li>Handle hash symbol in the middle of filename (Lesmiscore)</li>
</ul></li>
<li>Jottacloud
<ul>
<li>Fix working with whitelabel Elgiganten Cloud</li>
<li>Do not store username in config when using standard auth (albertony)</li>
</ul></li>
<li>Mega
<ul>
<li>Fix nil pointer exception when bad node received (Nick Craig-Wood)</li>
</ul></li>
<li>S3
<ul>
<li>Fix --s3-no-head panic: reflect: Elem of invalid type s3.PutObjectInput (Nick Craig-Wood)</li>
</ul></li>
<li>SFTP
<ul>
<li>Fix issue with WS_FTP by working around failing RealPath (albertony)</li>
</ul></li>
<li>Union
<ul>
<li>Fix duplicated files when using directories with leading / (Nick Craig-Wood)</li>
<li>Fix multiple files being uploaded when roots don't exist (Nick Craig-Wood)</li>
<li>Fix panic due to misalignment of struct field in 32 bit architectures (r-ricci)</li>
</ul></li>
</ul>
<h2 id="v1.59.0---2022-07-09">v1.59.0 - 2022-07-09</h2>
<p><a href="https://github.com/rclone/rclone/compare/v1.58.0...v1.59.0">See commits</a></p>
<ul>

84
MANUAL.md generated
View file

@ -1,6 +1,6 @@
% rclone(1) User Manual
% Nick Craig-Wood
% Jul 09, 2022
% Aug 08, 2022
# Rclone syncs your files to cloud storage
@ -506,7 +506,7 @@ such as a regular [sync](https://rclone.org/commands/rclone_sync/), you will pro
to configure your rclone command in your operating system's scheduler. If you need to
expose *service*-like features, such as [remote control](https://rclone.org/rc/),
[GUI](https://rclone.org/gui/), [serve](https://rclone.org/commands/rclone_serve/)
or [mount](https://rclone.org/commands/rclone_move/), you will often want an rclone
or [mount](https://rclone.org/commands/rclone_mount/), you will often want an rclone
command always running in the background, and configuring it to run in a service infrastructure
may be a better option. Below are some alternatives on how to achieve this on
different operating systems.
@ -539,7 +539,7 @@ c:\rclone\rclone.exe sync c:\files remote:/files --no-console --log-file c:\rclo
#### User account
As mentioned in the [mount](https://rclone.org/commands/rclone_move/) documentation,
As mentioned in the [mount](https://rclone.org/commands/rclone_mount/) documentation,
mounted drives created as Administrator are not visible to other accounts, not even the
account that was elevated as Administrator. By running the mount command as the
built-in `SYSTEM` user account, it will create drives accessible for everyone on
@ -897,6 +897,11 @@ extended explanation in the [copy](https://rclone.org/commands/rclone_copy/) com
If dest:path doesn't exist, it is created and the source:path contents
go there.
It is not possible to sync overlapping remotes. However, you may exclude
the destination from the sync with a filter rule or by putting an
exclude-if-present file inside the destination directory and sync to a
destination that is inside the source directory.
**Note**: Use the `-P`/`--progress` flag to view real-time transfer statistics
**Note**: Use the `rclone dedupe` command to deal with "Duplicate object/directory found in source/destination - ignoring" errors.
@ -8735,7 +8740,8 @@ been added) in DIR, then it will be overwritten.
The remote in use must support server-side move or copy and you must
use the same remote as the destination of the sync. The backup
directory must not overlap the destination directory.
directory must not overlap the destination directory without it being
excluded by a filter rule.
For example
@ -14336,7 +14342,7 @@ These flags are available for every command.
--use-json-log Use json log format
--use-mmap Use mmap allocator (see docs)
--use-server-modtime Use server modified time instead of object metadata
--user-agent string Set the user-agent to a specified string (default "rclone/v1.59.0")
--user-agent string Set the user-agent to a specified string (default "rclone/v1.59.1")
-v, --verbose count Print lots more stuff (repeat for more)
```
@ -25136,7 +25142,7 @@ This would produce something like this:
[AllDrives]
type = combine
remote = "My Drive=My Drive:" "Test Drive=Test Drive:"
upstreams = "My Drive=My Drive:" "Test Drive=Test Drive:"
If you then add that config to your config file (find it with `rclone
config file`) then you can access all the shared drives in one place
@ -28343,7 +28349,7 @@ drives found and a combined drive.
[AllDrives]
type = combine
remote = "My Drive=My Drive:" "Test Drive=Test Drive:"
upstreams = "My Drive=My Drive:" "Test Drive=Test Drive:"
Adding this to the rclone config file will cause those team drives to
be accessible with the aliases shown. Any illegal charactes will be
@ -30495,11 +30501,10 @@ Refer to [IAS3 API documentation](https://archive.org/services/docs/api/ias3.htm
Paths are specified as `remote:bucket` (or `remote:` for the `lsd`
command.) You may put subdirectories in too, e.g. `remote:item/path/to/dir`.
Once you have made a remote (see the provider specific section above)
you can use it like this:
Unlike S3, listing up all items uploaded by you isn't supported.
Once you have made a remote, you can use it like this:
Make a new item
rclone mkdir remote:item
@ -30536,6 +30541,7 @@ The following are reserved by Internet Archive:
- `format`
- `old_version`
- `viruscheck`
- `summation`
Trying to set values to these keys is ignored with a warning.
Only setting `mtime` is an exception. Doing so make it the identical behavior as setting ModTime.
@ -30741,19 +30747,20 @@ Here are the possible system metadata items for the internetarchive backend.
| Name | Help | Type | Example | Read Only |
|------|------|------|---------|-----------|
| crc32 | CRC32 calculated by Internet Archive | string | 01234567 | N |
| format | Name of format identified by Internet Archive | string | Comma-Separated Values | N |
| md5 | MD5 hash calculated by Internet Archive | string | 01234567012345670123456701234567 | N |
| mtime | Time of last modification, managed by Rclone | RFC 3339 | 2006-01-02T15:04:05.999999999Z | N |
| name | Full file path, without the bucket part | filename | backend/internetarchive/internetarchive.go | N |
| old_version | Whether the file was replaced and moved by keep-old-version flag | boolean | true | N |
| crc32 | CRC32 calculated by Internet Archive | string | 01234567 | **Y** |
| format | Name of format identified by Internet Archive | string | Comma-Separated Values | **Y** |
| md5 | MD5 hash calculated by Internet Archive | string | 01234567012345670123456701234567 | **Y** |
| mtime | Time of last modification, managed by Rclone | RFC 3339 | 2006-01-02T15:04:05.999999999Z | **Y** |
| name | Full file path, without the bucket part | filename | backend/internetarchive/internetarchive.go | **Y** |
| old_version | Whether the file was replaced and moved by keep-old-version flag | boolean | true | **Y** |
| rclone-ia-mtime | Time of last modification, managed by Internet Archive | RFC 3339 | 2006-01-02T15:04:05.999999999Z | N |
| rclone-mtime | Time of last modification, managed by Rclone | RFC 3339 | 2006-01-02T15:04:05.999999999Z | N |
| rclone-update-track | Random value used by Rclone for tracking changes inside Internet Archive | string | aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa | N |
| sha1 | SHA1 hash calculated by Internet Archive | string | 0123456701234567012345670123456701234567 | N |
| size | File size in bytes | decimal number | 123456 | N |
| source | The source of the file | string | original | N |
| viruscheck | The last time viruscheck process was run for the file (?) | unixtime | 1654191352 | N |
| sha1 | SHA1 hash calculated by Internet Archive | string | 0123456701234567012345670123456701234567 | **Y** |
| size | File size in bytes | decimal number | 123456 | **Y** |
| source | The source of the file | string | original | **Y** |
| summation | Check https://forum.rclone.org/t/31922 for how it is used | string | md5 | **Y** |
| viruscheck | The last time viruscheck process was run for the file (?) | unixtime | 1654191352 | **Y** |
See the [metadata](https://rclone.org/docs/#metadata) docs for more info.
@ -39413,6 +39420,43 @@ Options:
# Changelog
## v1.59.1 - 2022-08-08
[See commits](https://github.com/rclone/rclone/compare/v1.59.0...v1.59.1)
* Bug Fixes
* accounting: Fix panic in core/stats-reset with unknown group (Nick Craig-Wood)
* build: Fix android build after GitHub actions change (Nick Craig-Wood)
* dlna: Fix SOAP action header parsing (Joram Schrijver)
* docs: Fix links to mount command from install docs (albertony)
* dropox: Fix ChangeNotify was unable to decrypt errors (Nick Craig-Wood)
* fs: Fix parsing of times and durations of the form "YYYY-MM-DD HH:MM:SS" (Nick Craig-Wood)
* serve sftp: Fix checksum detection (Nick Craig-Wood)
* sync: Add accidentally missed filter-sensitivity to --backup-dir option (Nick Naumann)
* Combine
* Fix docs showing `remote=` instead of `upstreams=` (Nick Craig-Wood)
* Throw error if duplicate directory name is specified (Nick Craig-Wood)
* Fix errors with backends shutting down while in use (Nick Craig-Wood)
* Dropbox
* Fix hang on quit with --dropbox-batch-mode off (Nick Craig-Wood)
* Fix infinite loop on uploading a corrupted file (Nick Craig-Wood)
* Internetarchive
* Ignore checksums for files using the different method (Lesmiscore)
* Handle hash symbol in the middle of filename (Lesmiscore)
* Jottacloud
* Fix working with whitelabel Elgiganten Cloud
* Do not store username in config when using standard auth (albertony)
* Mega
* Fix nil pointer exception when bad node received (Nick Craig-Wood)
* S3
* Fix --s3-no-head panic: reflect: Elem of invalid type s3.PutObjectInput (Nick Craig-Wood)
* SFTP
* Fix issue with WS_FTP by working around failing RealPath (albertony)
* Union
* Fix duplicated files when using directories with leading / (Nick Craig-Wood)
* Fix multiple files being uploaded when roots don't exist (Nick Craig-Wood)
* Fix panic due to misalignment of struct field in 32 bit architectures (r-ricci)
## v1.59.0 - 2022-07-09
[See commits](https://github.com/rclone/rclone/compare/v1.58.0...v1.59.0)

157
MANUAL.txt generated
View file

@ -1,6 +1,6 @@
rclone(1) User Manual
Nick Craig-Wood
Jul 09, 2022
Aug 08, 2022
Rclone syncs your files to cloud storage
@ -857,6 +857,11 @@ extended explanation in the copy command if unsure.
If dest:path doesn't exist, it is created and the source:path contents
go there.
It is not possible to sync overlapping remotes. However, you may exclude
the destination from the sync with a filter rule or by putting an
exclude-if-present file inside the destination directory and sync to a
destination that is inside the source directory.
Note: Use the -P/--progress flag to view real-time transfer statistics
Note: Use the rclone dedupe command to deal with "Duplicate
@ -8332,7 +8337,8 @@ added) in DIR, then it will be overwritten.
The remote in use must support server-side move or copy and you must use
the same remote as the destination of the sync. The backup directory
must not overlap the destination directory.
must not overlap the destination directory without it being excluded by
a filter rule.
For example
@ -13887,7 +13893,7 @@ These flags are available for every command.
--use-json-log Use json log format
--use-mmap Use mmap allocator (see docs)
--use-server-modtime Use server modified time instead of object metadata
--user-agent string Set the user-agent to a specified string (default "rclone/v1.59.0")
--user-agent string Set the user-agent to a specified string (default "rclone/v1.59.1")
-v, --verbose count Print lots more stuff (repeat for more)
Backend Flags
@ -24544,7 +24550,7 @@ This would produce something like this:
[AllDrives]
type = combine
remote = "My Drive=My Drive:" "Test Drive=Test Drive:"
upstreams = "My Drive=My Drive:" "Test Drive=Test Drive:"
If you then add that config to your config file (find it with
rclone config file) then you can access all the shared drives in one
@ -27752,7 +27758,7 @@ found and a combined drive.
[AllDrives]
type = combine
remote = "My Drive=My Drive:" "Test Drive=Test Drive:"
upstreams = "My Drive=My Drive:" "Test Drive=Test Drive:"
Adding this to the rclone config file will cause those team drives to be
accessible with the aliases shown. Any illegal charactes will be
@ -29886,11 +29892,10 @@ Refer to IAS3 API documentation for the API this backend uses.
Paths are specified as remote:bucket (or remote: for the lsd command.)
You may put subdirectories in too, e.g. remote:item/path/to/dir.
Once you have made a remote (see the provider specific section above)
you can use it like this:
Unlike S3, listing up all items uploaded by you isn't supported.
Once you have made a remote, you can use it like this:
Make a new item
rclone mkdir remote:item
@ -29929,7 +29934,7 @@ file. The metadata will appear as file metadata on Internet Archive.
However, some fields are reserved by both Internet Archive and rclone.
The following are reserved by Internet Archive: - name - source - size -
md5 - crc32 - sha1 - format - old_version - viruscheck
md5 - crc32 - sha1 - format - old_version - viruscheck - summation
Trying to set values to these keys is ignored with a warning. Only
setting mtime is an exception. Doing so make it the identical behavior
@ -30140,65 +30145,52 @@ including them.
Here are the possible system metadata items for the internetarchive
backend.
----------------------------------------------------------------------------------------------------------------------
Name Help Type Example Read Only
--------------------- ------------------ ----------- -------------------------------------------- --------------------
crc32 CRC32 calculated string 01234567 N
by Internet
Archive
--------------------------------------------------------------------------------------------------------------------------------------
Name Help Type Example Read Only
--------------------- ---------------------------------- ----------- -------------------------------------------- --------------------
crc32 CRC32 calculated by Internet string 01234567 Y
Archive
format Name of format string Comma-Separated Values N
identified by
Internet Archive
format Name of format identified by string Comma-Separated Values Y
Internet Archive
md5 MD5 hash string 01234567012345670123456701234567 N
calculated by
Internet Archive
md5 MD5 hash calculated by Internet string 01234567012345670123456701234567 Y
Archive
mtime Time of last RFC 3339 2006-01-02T15:04:05.999999999Z N
modification,
managed by Rclone
mtime Time of last modification, managed RFC 3339 2006-01-02T15:04:05.999999999Z Y
by Rclone
name Full file path, filename backend/internetarchive/internetarchive.go N
without the bucket
part
name Full file path, without the bucket filename backend/internetarchive/internetarchive.go Y
part
old_version Whether the file boolean true N
was replaced and
moved by
keep-old-version
flag
old_version Whether the file was replaced and boolean true Y
moved by keep-old-version flag
rclone-ia-mtime Time of last RFC 3339 2006-01-02T15:04:05.999999999Z N
modification,
managed by
Internet Archive
rclone-ia-mtime Time of last modification, managed RFC 3339 2006-01-02T15:04:05.999999999Z N
by Internet Archive
rclone-mtime Time of last RFC 3339 2006-01-02T15:04:05.999999999Z N
modification,
managed by Rclone
rclone-mtime Time of last modification, managed RFC 3339 2006-01-02T15:04:05.999999999Z N
by Rclone
rclone-update-track Random value used string aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa N
by Rclone for
tracking changes
inside Internet
Archive
rclone-update-track Random value used by Rclone for string aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa N
tracking changes inside Internet
Archive
sha1 SHA1 hash string 0123456701234567012345670123456701234567 N
calculated by
Internet Archive
sha1 SHA1 hash calculated by Internet string 0123456701234567012345670123456701234567 Y
Archive
size File size in bytes decimal 123456 N
number
size File size in bytes decimal 123456 Y
number
source The source of the string original N
file
source The source of the file string original Y
viruscheck The last time unixtime 1654191352 N
viruscheck process
was run for the
file (?)
----------------------------------------------------------------------------------------------------------------------
summation Check string md5 Y
https://forum.rclone.org/t/31922
for how it is used
viruscheck The last time viruscheck process unixtime 1654191352 Y
was run for the file (?)
--------------------------------------------------------------------------------------------------------------------------------------
See the metadata docs for more info.
@ -38939,6 +38931,59 @@ Options:
Changelog
v1.59.1 - 2022-08-08
See commits
- Bug Fixes
- accounting: Fix panic in core/stats-reset with unknown group
(Nick Craig-Wood)
- build: Fix android build after GitHub actions change (Nick
Craig-Wood)
- dlna: Fix SOAP action header parsing (Joram Schrijver)
- docs: Fix links to mount command from install docs (albertony)
- dropox: Fix ChangeNotify was unable to decrypt errors (Nick
Craig-Wood)
- fs: Fix parsing of times and durations of the form "YYYY-MM-DD
HH:MM:SS" (Nick Craig-Wood)
- serve sftp: Fix checksum detection (Nick Craig-Wood)
- sync: Add accidentally missed filter-sensitivity to --backup-dir
option (Nick Naumann)
- Combine
- Fix docs showing remote= instead of upstreams= (Nick Craig-Wood)
- Throw error if duplicate directory name is specified (Nick
Craig-Wood)
- Fix errors with backends shutting down while in use (Nick
Craig-Wood)
- Dropbox
- Fix hang on quit with --dropbox-batch-mode off (Nick Craig-Wood)
- Fix infinite loop on uploading a corrupted file (Nick
Craig-Wood)
- Internetarchive
- Ignore checksums for files using the different method
(Lesmiscore)
- Handle hash symbol in the middle of filename (Lesmiscore)
- Jottacloud
- Fix working with whitelabel Elgiganten Cloud
- Do not store username in config when using standard auth
(albertony)
- Mega
- Fix nil pointer exception when bad node received (Nick
Craig-Wood)
- S3
- Fix --s3-no-head panic: reflect: Elem of invalid type
s3.PutObjectInput (Nick Craig-Wood)
- SFTP
- Fix issue with WS_FTP by working around failing RealPath
(albertony)
- Union
- Fix duplicated files when using directories with leading / (Nick
Craig-Wood)
- Fix multiple files being uploaded when roots don't exist (Nick
Craig-Wood)
- Fix panic due to misalignment of struct field in 32 bit
architectures (r-ricci)
v1.59.0 - 2022-07-09
See commits

View file

@ -5,6 +5,43 @@ description: "Rclone Changelog"
# Changelog
## v1.59.1 - 2022-08-08
[See commits](https://github.com/rclone/rclone/compare/v1.59.0...v1.59.1)
* Bug Fixes
* accounting: Fix panic in core/stats-reset with unknown group (Nick Craig-Wood)
* build: Fix android build after GitHub actions change (Nick Craig-Wood)
* dlna: Fix SOAP action header parsing (Joram Schrijver)
* docs: Fix links to mount command from install docs (albertony)
* dropox: Fix ChangeNotify was unable to decrypt errors (Nick Craig-Wood)
* fs: Fix parsing of times and durations of the form "YYYY-MM-DD HH:MM:SS" (Nick Craig-Wood)
* serve sftp: Fix checksum detection (Nick Craig-Wood)
* sync: Add accidentally missed filter-sensitivity to --backup-dir option (Nick Naumann)
* Combine
* Fix docs showing `remote=` instead of `upstreams=` (Nick Craig-Wood)
* Throw error if duplicate directory name is specified (Nick Craig-Wood)
* Fix errors with backends shutting down while in use (Nick Craig-Wood)
* Dropbox
* Fix hang on quit with --dropbox-batch-mode off (Nick Craig-Wood)
* Fix infinite loop on uploading a corrupted file (Nick Craig-Wood)
* Internetarchive
* Ignore checksums for files using the different method (Lesmiscore)
* Handle hash symbol in the middle of filename (Lesmiscore)
* Jottacloud
* Fix working with whitelabel Elgiganten Cloud
* Do not store username in config when using standard auth (albertony)
* Mega
* Fix nil pointer exception when bad node received (Nick Craig-Wood)
* S3
* Fix --s3-no-head panic: reflect: Elem of invalid type s3.PutObjectInput (Nick Craig-Wood)
* SFTP
* Fix issue with WS_FTP by working around failing RealPath (albertony)
* Union
* Fix duplicated files when using directories with leading / (Nick Craig-Wood)
* Fix multiple files being uploaded when roots don't exist (Nick Craig-Wood)
* Fix panic due to misalignment of struct field in 32 bit architectures (r-ricci)
## v1.59.0 - 2022-07-09
[See commits](https://github.com/rclone/rclone/compare/v1.58.0...v1.59.0)

View file

@ -37,6 +37,11 @@ extended explanation in the [copy](/commands/rclone_copy/) command if unsure.
If dest:path doesn't exist, it is created and the source:path contents
go there.
It is not possible to sync overlapping remotes. However, you may exclude
the destination from the sync with a filter rule or by putting an
exclude-if-present file inside the destination directory and sync to a
destination that is inside the source directory.
**Note**: Use the `-P`/`--progress` flag to view real-time transfer statistics
**Note**: Use the `rclone dedupe` command to deal with "Duplicate object/directory found in source/destination - ignoring" errors.

View file

@ -160,7 +160,7 @@ These flags are available for every command.
--use-json-log Use json log format
--use-mmap Use mmap allocator (see docs)
--use-server-modtime Use server modified time instead of object metadata
--user-agent string Set the user-agent to a specified string (default "rclone/v1.59.0")
--user-agent string Set the user-agent to a specified string (default "rclone/v1.59.1")
-v, --verbose count Print lots more stuff (repeat for more)
```

2
go.sum
View file

@ -591,8 +591,6 @@ github.com/stretchr/testify v1.7.0/go.mod h1:6Fq8oRcR53rry900zMqJjRRixrwX3KX962/
github.com/stretchr/testify v1.7.1/go.mod h1:6Fq8oRcR53rry900zMqJjRRixrwX3KX962/h/Wwjteg=
github.com/stretchr/testify v1.7.2 h1:4jaiDzPyXQvSd7D0EjG45355tLlV3VOECpq10pLC+8s=
github.com/stretchr/testify v1.7.2/go.mod h1:R6va5+xMeoiuVRoj+gSkQ7d3FALtqAAGI1FQKckRals=
github.com/t3rm1n4l/go-mega v0.0.0-20200416171014-ffad7fcb44b8 h1:IGJQmLBLYBdAknj21W3JsVof0yjEXfy1Q0K3YZebDOg=
github.com/t3rm1n4l/go-mega v0.0.0-20200416171014-ffad7fcb44b8/go.mod h1:XWL4vDyd3JKmJx+hZWUVgCNmmhZ2dTBcaNDcxH465s0=
github.com/t3rm1n4l/go-mega v0.0.0-20220725095014-c4e0c2b5debf h1:Y43S3e9P1NPs/QF4R5/SdlXj2d31540hP4Gk8VKNvDg=
github.com/t3rm1n4l/go-mega v0.0.0-20220725095014-c4e0c2b5debf/go.mod h1:c+cGNU1qi9bO7ZF4IRMYk+KaZTNiQ/gQrSbyMmGFq1Q=
github.com/tarm/serial v0.0.0-20180830185346-98f6abe2eb07/go.mod h1:kDXzergiv9cbyO7IOYJZWg1U88JhDg3PB6klq9Hg2pA=

155
rclone.1 generated
View file

@ -1,7 +1,7 @@
.\"t
.\" Automatically generated by Pandoc 2.9.2.1
.\"
.TH "rclone" "1" "Jul 09, 2022" "User Manual" ""
.TH "rclone" "1" "Aug 08, 2022" "User Manual" ""
.hy
.SH Rclone syncs your files to cloud storage
.PP
@ -732,9 +732,9 @@ system\[aq]s scheduler.
If you need to expose \f[I]service\f[R]-like features, such as remote
control (https://rclone.org/rc/), GUI (https://rclone.org/gui/),
serve (https://rclone.org/commands/rclone_serve/) or
mount (https://rclone.org/commands/rclone_move/), you will often want an
rclone command always running in the background, and configuring it to
run in a service infrastructure may be a better option.
mount (https://rclone.org/commands/rclone_mount/), you will often want
an rclone command always running in the background, and configuring it
to run in a service infrastructure may be a better option.
Below are some alternatives on how to achieve this on different
operating systems.
.PP
@ -770,7 +770,7 @@ c:\[rs]rclone\[rs]rclone.exe sync c:\[rs]files remote:/files --no-console --log-
.fi
.SS User account
.PP
As mentioned in the mount (https://rclone.org/commands/rclone_move/)
As mentioned in the mount (https://rclone.org/commands/rclone_mount/)
documentation, mounted drives created as Administrator are not visible
to other accounts, not even the account that was elevated as
Administrator.
@ -1271,6 +1271,11 @@ copy (https://rclone.org/commands/rclone_copy/) command if unsure.
If dest:path doesn\[aq]t exist, it is created and the source:path
contents go there.
.PP
It is not possible to sync overlapping remotes.
However, you may exclude the destination from the sync with a filter
rule or by putting an exclude-if-present file inside the destination
directory and sync to a destination that is inside the source directory.
.PP
\f[B]Note\f[R]: Use the \f[C]-P\f[R]/\f[C]--progress\f[R] flag to view
real-time transfer statistics
.PP
@ -10973,7 +10978,8 @@ in DIR, then it will be overwritten.
.PP
The remote in use must support server-side move or copy and you must use
the same remote as the destination of the sync.
The backup directory must not overlap the destination directory.
The backup directory must not overlap the destination directory without
it being excluded by a filter rule.
.PP
For example
.IP
@ -19707,7 +19713,7 @@ These flags are available for every command.
--use-json-log Use json log format
--use-mmap Use mmap allocator (see docs)
--use-server-modtime Use server modified time instead of object metadata
--user-agent string Set the user-agent to a specified string (default \[dq]rclone/v1.59.0\[dq])
--user-agent string Set the user-agent to a specified string (default \[dq]rclone/v1.59.1\[dq])
-v, --verbose count Print lots more stuff (repeat for more)
\f[R]
.fi
@ -34701,7 +34707,7 @@ remote = drive,team_drive=0ABCDEFabcdefghijkl,root_folder_id=:
[AllDrives]
type = combine
remote = \[dq]My Drive=My Drive:\[dq] \[dq]Test Drive=Test Drive:\[dq]
upstreams = \[dq]My Drive=My Drive:\[dq] \[dq]Test Drive=Test Drive:\[dq]
\f[R]
.fi
.PP
@ -39081,7 +39087,7 @@ remote = drive,team_drive=0ABCDEFabcdefghijkl,root_folder_id=:
[AllDrives]
type = combine
remote = \[dq]My Drive=My Drive:\[dq] \[dq]Test Drive=Test Drive:\[dq]
upstreams = \[dq]My Drive=My Drive:\[dq] \[dq]Test Drive=Test Drive:\[dq]
\f[R]
.fi
.PP
@ -41682,11 +41688,10 @@ Paths are specified as \f[C]remote:bucket\f[R] (or \f[C]remote:\f[R] for
the \f[C]lsd\f[R] command.) You may put subdirectories in too, e.g.
\f[C]remote:item/path/to/dir\f[R].
.PP
Once you have made a remote (see the provider specific section above)
you can use it like this:
.PP
Unlike S3, listing up all items uploaded by you isn\[aq]t supported.
.PP
Once you have made a remote, you can use it like this:
.PP
Make a new item
.IP
.nf
@ -41741,7 +41746,7 @@ However, some fields are reserved by both Internet Archive and rclone.
The following are reserved by Internet Archive: - \f[C]name\f[R] -
\f[C]source\f[R] - \f[C]size\f[R] - \f[C]md5\f[R] - \f[C]crc32\f[R] -
\f[C]sha1\f[R] - \f[C]format\f[R] - \f[C]old_version\f[R] -
\f[C]viruscheck\f[R]
\f[C]viruscheck\f[R] - \f[C]summation\f[R]
.PP
Trying to set values to these keys is ignored with a warning.
Only setting \f[C]mtime\f[R] is an exception.
@ -41999,7 +42004,7 @@ string
T}@T{
01234567
T}@T{
N
\f[B]Y\f[R]
T}
T{
format
@ -42010,7 +42015,7 @@ string
T}@T{
Comma-Separated Values
T}@T{
N
\f[B]Y\f[R]
T}
T{
md5
@ -42021,7 +42026,7 @@ string
T}@T{
01234567012345670123456701234567
T}@T{
N
\f[B]Y\f[R]
T}
T{
mtime
@ -42032,7 +42037,7 @@ RFC 3339
T}@T{
2006-01-02T15:04:05.999999999Z
T}@T{
N
\f[B]Y\f[R]
T}
T{
name
@ -42043,7 +42048,7 @@ filename
T}@T{
backend/internetarchive/internetarchive.go
T}@T{
N
\f[B]Y\f[R]
T}
T{
old_version
@ -42054,7 +42059,7 @@ boolean
T}@T{
true
T}@T{
N
\f[B]Y\f[R]
T}
T{
rclone-ia-mtime
@ -42098,7 +42103,7 @@ string
T}@T{
0123456701234567012345670123456701234567
T}@T{
N
\f[B]Y\f[R]
T}
T{
size
@ -42109,7 +42114,7 @@ decimal number
T}@T{
123456
T}@T{
N
\f[B]Y\f[R]
T}
T{
source
@ -42120,7 +42125,18 @@ string
T}@T{
original
T}@T{
N
\f[B]Y\f[R]
T}
T{
summation
T}@T{
Check https://forum.rclone.org/t/31922 for how it is used
T}@T{
string
T}@T{
md5
T}@T{
\f[B]Y\f[R]
T}
T{
viruscheck
@ -42131,7 +42147,7 @@ unixtime
T}@T{
1654191352
T}@T{
N
\f[B]Y\f[R]
T}
.TE
.PP
@ -53965,6 +53981,99 @@ Options:
.IP \[bu] 2
\[dq]error\[dq]: return an error based on option value
.SH Changelog
.SS v1.59.1 - 2022-08-08
.PP
See commits (https://github.com/rclone/rclone/compare/v1.59.0...v1.59.1)
.IP \[bu] 2
Bug Fixes
.RS 2
.IP \[bu] 2
accounting: Fix panic in core/stats-reset with unknown group (Nick
Craig-Wood)
.IP \[bu] 2
build: Fix android build after GitHub actions change (Nick Craig-Wood)
.IP \[bu] 2
dlna: Fix SOAP action header parsing (Joram Schrijver)
.IP \[bu] 2
docs: Fix links to mount command from install docs (albertony)
.IP \[bu] 2
dropox: Fix ChangeNotify was unable to decrypt errors (Nick Craig-Wood)
.IP \[bu] 2
fs: Fix parsing of times and durations of the form \[dq]YYYY-MM-DD
HH:MM:SS\[dq] (Nick Craig-Wood)
.IP \[bu] 2
serve sftp: Fix checksum detection (Nick Craig-Wood)
.IP \[bu] 2
sync: Add accidentally missed filter-sensitivity to --backup-dir option
(Nick Naumann)
.RE
.IP \[bu] 2
Combine
.RS 2
.IP \[bu] 2
Fix docs showing \f[C]remote=\f[R] instead of \f[C]upstreams=\f[R] (Nick
Craig-Wood)
.IP \[bu] 2
Throw error if duplicate directory name is specified (Nick Craig-Wood)
.IP \[bu] 2
Fix errors with backends shutting down while in use (Nick Craig-Wood)
.RE
.IP \[bu] 2
Dropbox
.RS 2
.IP \[bu] 2
Fix hang on quit with --dropbox-batch-mode off (Nick Craig-Wood)
.IP \[bu] 2
Fix infinite loop on uploading a corrupted file (Nick Craig-Wood)
.RE
.IP \[bu] 2
Internetarchive
.RS 2
.IP \[bu] 2
Ignore checksums for files using the different method (Lesmiscore)
.IP \[bu] 2
Handle hash symbol in the middle of filename (Lesmiscore)
.RE
.IP \[bu] 2
Jottacloud
.RS 2
.IP \[bu] 2
Fix working with whitelabel Elgiganten Cloud
.IP \[bu] 2
Do not store username in config when using standard auth (albertony)
.RE
.IP \[bu] 2
Mega
.RS 2
.IP \[bu] 2
Fix nil pointer exception when bad node received (Nick Craig-Wood)
.RE
.IP \[bu] 2
S3
.RS 2
.IP \[bu] 2
Fix --s3-no-head panic: reflect: Elem of invalid type s3.PutObjectInput
(Nick Craig-Wood)
.RE
.IP \[bu] 2
SFTP
.RS 2
.IP \[bu] 2
Fix issue with WS_FTP by working around failing RealPath (albertony)
.RE
.IP \[bu] 2
Union
.RS 2
.IP \[bu] 2
Fix duplicated files when using directories with leading / (Nick
Craig-Wood)
.IP \[bu] 2
Fix multiple files being uploaded when roots don\[aq]t exist (Nick
Craig-Wood)
.IP \[bu] 2
Fix panic due to misalignment of struct field in 32 bit architectures
(r-ricci)
.RE
.SS v1.59.0 - 2022-07-09
.PP
See commits (https://github.com/rclone/rclone/compare/v1.58.0...v1.59.0)