TrueCloudLab/rclone
16
0
Fork 2
Code Issues Pull requests 1 Projects Releases Packages Wiki Activity Actions 1
rclone/docs/content
History
Thomas Kriechbaumer 584e705c0c s3: introduce list_chunk option for bucket listing 
The S3 ListObject API returns paginated bucket listings, with
"MaxKeys" items for each GET call.

The default value is 1000 entries, but for buckets with millions of
objects it might make sense to request more elements per request, if
the backend supports it. This commit adds a "list_chunk" option for
the user to specify a lower or higher value.

This commit does not add safe guards around this value - if a user
decides to request a too large list, it might result in connection
timeouts (on the server or client).

In AWS S3, there is a fixed limit of 1000, some other services might
have one too.  In Ceph, this can be configured in RadosGW.
2020-01-02 12:15:01 +00:00
..
commands mount: document remotes as network shares on Windows 2019-11-27 11:40:24 +00:00
about.md New backend for Citrix Sharefile - Fixes #1543 2019-09-30 12:28:33 +01:00
alias.md docs: make the config walkthroughs consistent for each backend 2019-08-26 10:47:17 +01:00
amazonclouddrive.md amazonclouddrive: use lib/encoder 2019-09-30 22:00:24 +01:00
authors.md Add Outvi V to contributors 2020-01-02 11:52:43 +00:00
azureblob.md azureblob: use lib/encoder 2019-09-30 22:00:24 +01:00
b2.md b2: use lib/encoder 2019-09-30 22:00:24 +01:00
box.md Version v1.50.0 2019-10-26 11:04:54 +01:00
bugs.md docs: GitHub has a capital H 2019-09-13 18:39:23 +01:00
cache.md docs: make the config walkthroughs consistent for each backend 2019-08-26 10:47:17 +01:00
changelog.md Start v1.50.2-DEV development 2019-11-19 16:51:32 +00:00
chunker.md chunker: reduce length of temporary suffix 2019-12-09 16:56:32 +00:00
contact.md docs: update fontawesome free to 5.10.2 and fixup broken images 2019-08-25 11:09:19 +01:00
crypt.md docs: make the config walkthroughs consistent for each backend 2019-08-26 10:47:17 +01:00
docs.md sync: add --no-check-dest flag - fixes #3616 2019-12-29 16:47:57 +00:00
donate.md Add paypal.me link to donate page 2017-10-23 12:56:48 +01:00
downloads.md build: fix up package paths after repo move 2019-07-28 18:47:38 +01:00
drive.md Version v1.50.0 2019-10-26 11:04:54 +01:00
dropbox.md docs: add instructions to create your own dropbox app ID 2019-10-28 16:49:16 +00:00
faq.md docs: typo fix in faq.md 2019-10-14 17:07:29 +01:00
fichier.md ficher: use lib/encoder 2019-09-30 22:00:25 +01:00
filtering.md Docs: Fix typos in filtering demonstrations 2019-07-28 12:32:53 +01:00
flags.md Version v1.50.0 2019-10-26 11:04:54 +01:00
ftp.md Version v1.50.0 2019-10-26 11:04:54 +01:00
googlecloudstorage.md googlecloudstorage: use lib/encoder 2019-09-30 22:00:24 +01:00
googlephotos.md mount: allow files of unkown size to be read properly 2019-09-14 13:22:33 +01:00
gui.md docs: correct typo in gui docs 2019-12-04 12:08:52 +00:00
http.md Version v1.50.0 2019-10-26 11:04:54 +01:00
hubic.md docs: make the config walkthroughs consistent for each backend 2019-08-26 10:47:17 +01:00
install.md docs/install: explain how to workaround macOS Gatekeeper requiring notarization 2019-11-26 12:33:30 +00:00
install.sh docs: fix template argument for mktemp in install.sh 2019-09-02 13:01:45 +08:00
jottacloud.md jottacloud: add URL to generate Login Token to config wizard 2019-11-28 10:03:48 +00:00
koofr.md koofr: use lib/encoder 2019-09-30 22:00:25 +01:00
licence.md docs: update fontawesome free to 5.10.2 and fixup broken images 2019-08-25 11:09:19 +01:00
local.md Version v1.50.0 2019-10-26 11:04:54 +01:00
mailru.md Version v1.50.0 2019-10-26 11:04:54 +01:00
mega.md mega: use lib/encoder 2019-09-30 22:00:24 +01:00
onedrive.md docs: update onedrive/sharepoint docs on some known issues 2019-10-12 12:08:22 +01:00
opendrive.md opendrive: use lib/encoder 2019-09-30 14:05:49 +01:00
overview.md encodings: add . and .. to all backends, except Drive 2019-09-30 14:05:49 +01:00
pcloud.md pcloud: use lib/encoder 2019-09-30 22:00:24 +01:00
premiumizeme.md premiumizeme: use lib/encoder 2019-10-02 11:34:08 +01:00
privacy.md Update references from HTTP to HTTPS where possible 2017-03-29 05:38:34 -07:00
putio.md putio: use lib/encoder 2019-10-02 11:34:08 +01:00
qingstor.md qingstor: use lib/encoder 2019-09-30 22:00:25 +01:00
rc.md accounting: clear finished transfer in stats-reset 2019-11-18 14:25:32 +00:00
remote_setup.md docs: rclone config file instead of rclone -h to find config file 2019-01-13 17:56:57 +00:00
s3.md s3: introduce list_chunk option for bucket listing 2020-01-02 12:15:01 +00:00
sftp.md Version v1.50.0 2019-10-26 11:04:54 +01:00
sharefile.md New backend for Citrix Sharefile - Fixes #1543 2019-09-30 12:28:33 +01:00
swift.md swift: use lib/encoder 2019-09-30 22:00:24 +01:00
union.md Version v1.49.0 2019-08-26 15:25:20 +01:00
webdav.md docs: update onedrive/sharepoint docs on some known issues 2019-10-12 12:08:22 +01:00
yandex.md yandex: use lib/encoder 2019-10-05 10:22:43 +01:00