TrueCloudLab/rclone
16
0
Fork 2
Code Issues 1 Pull requests 1 Projects Releases Packages Wiki Activity Actions
rclone/fstest/test_all/config.yaml

502 lines
14 KiB
YAML
Raw Normal View History

fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 13:48:29 +00:00
tests:
- path: backend
fstest/test_all: fix directories that tests are run in - Don't build a binary for backend tests - Run tests in their relevant directories
2018-10-23 16:31:11 +00:00
addbackend: true
nobinary: true
allow usage of -short in the testing framework
2019-08-29 05:10:10 +00:00
short: true
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 13:48:29 +00:00
- path: fs/operations
fastlist: true
- path: fs/sync
fastlist: true
bisync: add to integration tests - fixes #7665 This change officially adds bisync to the nightly integration tests for all backends. This will be part of giving us the confidence to take bisync out of beta. A number of fixes have been added to account for features which can differ on different backends -- for example, hash types / modtime support, empty directories, unicode normalization, and unimportant differences in log output. We will likely find that more of these are needed once we start running these with the full set of remotes. Additionally, bisync's extremely sensitive tests revealed a few bugs in other backends that weren't previously covered by other tests. Fixes for those issues have been submitted on the following separate PRs (and bisync test failures will be expected until they are merged): - #7670 memory: fix deadlock in operations.Purge - #7688 memory: fix incorrect list entries when rooted at subdirectory - #7690 memory: fix dst mutating src after server-side copy - #7692 dropbox: fix chunked uploads when size <= chunkSize Relatedly, workarounds have been put in place for the following backend limitations that are unsolvable for the time being: - #3262 drive is sometimes aware of trashed files/folders when it shouldn't be - #6199 dropbox can't handle emojis and certain other characters - #4590 onedrive API has longstanding bug for conflictBehavior=replace in server-side copy/move
2024-03-08 22:53:33 +00:00
- path: cmd/bisync
test_all: add the vfs tests to the integration tests Fix failing tests for some remotes
2019-02-27 17:14:32 +00:00
- path: vfs
test_all: run restic integration tests against local backend
2019-05-01 10:46:42 +00:00
- path: cmd/serve/restic
localonly: true
build: add the serve docker tests to the integration tester These had been disabled on CI for being unreliable, so test them in the integration tests framework which will retry them.
2023-10-18 10:32:01 +00:00
- path: cmd/serve/docker
localonly: true
selfupdate: fix "invalid hashsum signature" error This was caused by a change to the upstream library ProtonMail/go-crypto checking the flags on the keys more strictly. However the signing key for rclone is very old and does not have those flags. Adding those flags using `gpg --edit-key` and then the `change-usage` subcommand to remove, save, quite then re-add, save quit the signing capabilities caused the key to work. This also adds tests for the verification and adds the selfupdate tests into the integration test harness as they had been disabled on CI because they rely on external sources and are sometimes unreliable. Fixes #7373
2023-10-18 10:25:32 +00:00
- path: cmd/selfupdate
localonly: true
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 13:48:29 +00:00
backends:
test_all: run restic integration tests against local backend
2019-05-01 10:46:42 +00:00
- backend: "local"
remote: ""
fastlist: false
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 13:48:29 +00:00
- backend: "b2"
remote: "TestB2:"
fastlist: true
test: add ListRetries config parameter to integration tests Occasionally the b2 tests fail because the integration tests don't retry hard enough with their new setting of -list-retries 3. Override this setting to 5 for the b2 tests only.
2020-10-25 16:15:41 +00:00
listretries: 5
test_all: ignore Rmdirs test failure on b2 as it fails because of versions
2023-09-05 14:47:14 +00:00
ignore:
# This test fails because B2 versions make the empty bucket undeleteable.
# It isn't possible to turn off versions, and setting hard_delete doesn't stop
# versions being made on overwrite.
- TestRmdirsNoLeaveRoot
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 13:48:29 +00:00
- backend: "crypt"
remote: "TestCryptDrive:"
fastlist: true
test: ignore integration test TestCopyFileMaxTransfer on Google Drive The test fails because it expects a copy with MaxTransfer and CutoffModeHard should return fatal error, because this is thrown from accounting (ErrorMaxTransferLimitReachedFatal), but in case of Google Drive the external google API catches and replaces it with a non-fatal error: pw.CloseWithError(fmt.Errorf("googleapi: Copy failed: %v", err)) (https://github.com/googleapis/google-api-go-client/blob/7290f25351cc90fdeb492127c98cc3fb023793d4/internal/gensupport/media.go#L140)
2021-10-20 08:11:09 +00:00
ignore:
- TestCopyFileMaxTransfer
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 13:48:29 +00:00
- backend: "crypt"
remote: "TestCryptSwift:"
fastlist: false
tests/config: integration tests for chunker Recommended `rclone.conf` snippets for this `config.yaml`: ``` [TestChunkerLocal] type = chunker meta_format = simplejson remote = /tmp/rclone-chunker-test [TestChunkerChunk3bLocal] type = chunker chunk_size = 3b meta_format = simplejson remote = /tmp/rclone-chunker-test [TestChunkerNometaLocal] type = chunker meta_format = none remote = /tmp/rclone-chunker-test [TestChunkerChunk3bNometaLocal] type = chunker chunk_size = 3b meta_format = none remote = /tmp/rclone-chunker-test [TestChunkerCompatLocal] type = chunker meta_format = wdmrcompat remote = /tmp/rclone-chunker-test ```
2019-09-16 17:49:47 +00:00
## chunker
- backend: "chunker"
remote: "TestChunkerLocal:"
fastlist: true
- backend: "chunker"
remote: "TestChunkerNometaLocal:"
fastlist: true
- backend: "chunker"
remote: "TestChunkerChunk3bLocal:"
fastlist: true
maxfile: 6k
- backend: "chunker"
remote: "TestChunkerChunk3bNometaLocal:"
fastlist: true
maxfile: 6k
chunker: partially implement no-rename transactions (#4675) Some storage providers e.g. S3 don't have an efficient rename operation. Before this change, when chunker finished an upload, the server-side copy and delete operations that renamed temporary chunks to their final names could take a significant amount of time. This PR records transaction identifier (versioning) in the metadata of chunker composite objects striving to remove the need for rename operations on such backends. This approach will be triggered be the new "transactions" configuration option, which can be "rename" (the default) or "norename". We implement the new approach for uploads (Put operations). The chunker Move operation still uses the rename operation of underlying backend. Filling this gap is left for a later PR. Co-authored-by: Ivan Andreev <ivandeex@gmail.com>
2020-10-30 20:30:04 +00:00
- backend: "chunker"
remote: "TestChunkerChunk3bNoRenameLocal:"
fastlist: true
maxfile: 6k
mailru: re-enable fixed chunker tests This reverts commit 9d3d397f50fe94df0f723a571507e2ce72428ab6.
2020-09-17 19:44:03 +00:00
- backend: "chunker"
remote: "TestChunkerMailru:"
fastlist: true
mailru: add override for TestApplyTransforms - #7591 mailru is unable to handle filenames with certain combining characters (for example: йěáñ), and is therefore incapable of testing ApplyTransforms. (It is also therefore incapable of fully supporting --no-unicode-normalization.) The same override is applied to chunker when wrapping mailru.
2024-02-18 10:29:20 +00:00
ignore:
- TestApplyTransforms
mailru: re-enable fixed chunker tests This reverts commit 9d3d397f50fe94df0f723a571507e2ce72428ab6.
2020-09-17 19:44:03 +00:00
- backend: "chunker"
remote: "TestChunkerChunk50bMailru:"
fastlist: true
maxfile: 10k
mailru: add override for TestApplyTransforms - #7591 mailru is unable to handle filenames with certain combining characters (for example: йěáñ), and is therefore incapable of testing ApplyTransforms. (It is also therefore incapable of fully supporting --no-unicode-normalization.) The same override is applied to chunker when wrapping mailru.
2024-02-18 10:29:20 +00:00
ignore:
- TestApplyTransforms
tests/config: integration tests for chunker Recommended `rclone.conf` snippets for this `config.yaml`: ``` [TestChunkerLocal] type = chunker meta_format = simplejson remote = /tmp/rclone-chunker-test [TestChunkerChunk3bLocal] type = chunker chunk_size = 3b meta_format = simplejson remote = /tmp/rclone-chunker-test [TestChunkerNometaLocal] type = chunker meta_format = none remote = /tmp/rclone-chunker-test [TestChunkerChunk3bNometaLocal] type = chunker chunk_size = 3b meta_format = none remote = /tmp/rclone-chunker-test [TestChunkerCompatLocal] type = chunker meta_format = wdmrcompat remote = /tmp/rclone-chunker-test ```
2019-09-16 17:49:47 +00:00
- backend: "chunker"
remote: "TestChunkerChunk50bYandex:"
fastlist: true
maxfile: 1k
- backend: "chunker"
remote: "TestChunkerChunk50bBox:"
fastlist: true
maxfile: 1k
- backend: "chunker"
remote: "TestChunkerS3:"
fastlist: true
- backend: "chunker"
remote: "TestChunkerChunk50bS3:"
fastlist: true
maxfile: 1k
chunker: finish meta-format before release changes: - chunker: remove GetTier and SetTier - remove wdmrcompat metaformat - remove fastopen strategy - make hash_type option non-advanced - adverise hash support when possible - add metadata field "ver", run strict checks - describe internal behavior in comments - improve documentation note: wdmrcompat used to write file name in the metadata, so maximum metadata size was 1K; removing it allows to cap size by 200 bytes now.
2019-09-24 23:18:30 +00:00
- backend: "chunker"
remote: "TestChunkerChunk50bMD5HashS3:"
fastlist: true
maxfile: 1k
- backend: "chunker"
remote: "TestChunkerChunk50bSHA1HashS3:"
fastlist: true
maxfile: 1k
Merge pull request #4608 from ivandeex/pr-chunker-crypt chunker: fix upload over crypt (fixes #4570)
2020-09-18 14:58:44 +00:00
- backend: "chunker"
remote: "TestChunkerOverCrypt:"
fastlist: true
maxfile: 6k
chunker: finish meta-format before release changes: - chunker: remove GetTier and SetTier - remove wdmrcompat metaformat - remove fastopen strategy - make hash_type option non-advanced - adverise hash support when possible - add metadata field "ver", run strict checks - describe internal behavior in comments - improve documentation note: wdmrcompat used to write file name in the metadata, so maximum metadata size was 1K; removing it allows to cap size by 200 bytes now.
2019-09-24 23:18:30 +00:00
- backend: "chunker"
remote: "TestChunkerChunk50bMD5QuickS3:"
fastlist: true
maxfile: 1k
- backend: "chunker"
remote: "TestChunkerChunk50bSHA1QuickS3:"
fastlist: true
maxfile: 1k
tests/config: integration tests for chunker Recommended `rclone.conf` snippets for this `config.yaml`: ``` [TestChunkerLocal] type = chunker meta_format = simplejson remote = /tmp/rclone-chunker-test [TestChunkerChunk3bLocal] type = chunker chunk_size = 3b meta_format = simplejson remote = /tmp/rclone-chunker-test [TestChunkerNometaLocal] type = chunker meta_format = none remote = /tmp/rclone-chunker-test [TestChunkerChunk3bNometaLocal] type = chunker chunk_size = 3b meta_format = none remote = /tmp/rclone-chunker-test [TestChunkerCompatLocal] type = chunker meta_format = wdmrcompat remote = /tmp/rclone-chunker-test ```
2019-09-16 17:49:47 +00:00
## end chunker
combine: backend to combine multiple remotes in one directory tree Fixes #5600
2022-04-20 16:57:43 +00:00
- backend: "combine"
remote: "TestCombine:dir1"
fastlist: false
compress: improve testing
2021-01-17 01:21:33 +00:00
## begin compress
compress: add integration tests
2020-11-23 18:00:42 +00:00
- backend: "compress"
remote: "TestCompress:"
fastlist: false
compress: improve testing
2021-01-17 01:21:33 +00:00
- backend: "compress"
remote: "TestCompressSwift:"
fastlist: false
- backend: "compress"
remote: "TestCompressDrive:"
fastlist: false
- backend: "compress"
remote: "TestCompressS3:"
fastlist: false
## end compress
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 13:48:29 +00:00
- backend: "drive"
remote: "TestDrive:"
fastlist: true
test: ignore integration test TestCopyFileMaxTransfer on Google Drive The test fails because it expects a copy with MaxTransfer and CutoffModeHard should return fatal error, because this is thrown from accounting (ErrorMaxTransferLimitReachedFatal), but in case of Google Drive the external google API catches and replaces it with a non-fatal error: pw.CloseWithError(fmt.Errorf("googleapi: Copy failed: %v", err)) (https://github.com/googleapis/google-api-go-client/blob/7290f25351cc90fdeb492127c98cc3fb023793d4/internal/gensupport/media.go#L140)
2021-10-20 08:11:09 +00:00
ignore:
# Test with CutoffModeHard does not result in ErrorMaxTransferLimitReachedFatal
# because googleapi replaces it with a non-fatal error
- TestCopyFileMaxTransfer
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 13:48:29 +00:00
- backend: "dropbox"
remote: "TestDropbox:"
fastlist: false
dropbox: stop public link test complaining on non-enterprise account The TestIntegration/FsMkdir/FsPutFiles/PublicLink test doesn't work on a standard dropbox account, only on an enterprise account because it sets expiry dates. See: #5734
2021-10-20 16:10:46 +00:00
ignore:
# This test doesn't work on a standard dropbox account because it
# tries to set the expiry of the link
- TestIntegration/FsMkdir/FsPutFiles/PublicLink
test_all: remove filefabric from integration tests The filefabric test server doesn't seem to be working at all so remove it from the integration tests pending revitalization.
2023-09-08 13:47:33 +00:00
# - backend: "filefabric"
# remote: "TestFileFabric:"
# fastlist: false
# extratime: 2.0
Implement Gofile backend - fixes #4632
2024-07-25 15:53:19 +00:00
- backend: "gofile"
remote: "TestGoFile:"
fastlist: true
filescom: add Files.com backend
2024-07-23 15:41:40 +00:00
- backend: "filescom"
remote: "TestFilesCom:"
fastlist: false
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 13:48:29 +00:00
- backend: "googlecloudstorage"
remote: "TestGoogleCloudStorage:"
fastlist: true
gcs: empty directory markers #3453 - Report correct feature flag - Fix test failures due to that - don't output the root directory marker - Don't create the directory marker if it is the bucket or root - Create directories when uploading files
2023-04-26 16:53:48 +00:00
- backend: "googlecloudstorage"
remote: "TestGoogleCloudStorage,directory_markers:"
fastlist: true
googlephotos: Backend for accessing Google Photos #369
2019-06-17 16:50:58 +00:00
- backend: "googlephotos"
remote: "TestGooglePhotos:"
tests:
- backend
new backend: hidrive - fixes #1069
2022-07-07 17:58:22 +00:00
- backend: "hidrive"
remote: "TestHiDrive:"
fastlist: false
imagekit: Added ImageKit backend
2023-11-24 18:18:01 +00:00
- backend: "imagekit"
remote: "TestImageKit:"
fastlist: false
backend/internetarchive: add support for Internet Archive This adds support for Internet Archive (archive.org) Items.
2022-04-12 09:38:44 +00:00
- backend: "internetarchive"
test_all: correct path for Internet Archive test This is to make it use the rclone project's account and to remove the / in the remote name which was crashing the integration tester!
2022-05-12 19:37:36 +00:00
remote: "TestIA:rclone-integration-test"
backend/internetarchive: add support for Internet Archive This adds support for Internet Archive (archive.org) Items.
2022-04-12 09:38:44 +00:00
fastlist: true
test_all: Only run backend tests for Internet Archive as it is too slow
2022-06-17 14:02:49 +00:00
tests:
- backend
test_all: allow internet archive backend more time
2022-06-18 14:13:18 +00:00
extratime: 2.0
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 13:48:29 +00:00
- backend: "jottacloud"
remote: "TestJottacloud:"
fastlist: true
The memory backend This is a bucket based remote
2018-05-03 15:31:06 +00:00
- backend: "memory"
remote: ":memory:"
fastlist: true
Add Akamai Netstorage as a new backend.
2021-10-14 22:01:46 +00:00
- backend: "netstorage"
remote: "TestnStorage:"
fastlist: true
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 13:48:29 +00:00
- backend: "onedrive"
remote: "TestOneDrive:"
fastlist: false
onedrive: stop public link test complaining on non-business account The TestIntegration/FsMkdir/FsPutFiles/PublicLink test doesn't work on a standard onedrive account, it returns accessDenied: accountUpgradeRequired: Account Upgrade is required for this operation. See: #5734
2021-10-20 16:14:44 +00:00
ignore:
# This test doesn't work on a standard Onedrive account returning
# accessDenied: accountUpgradeRequired: Account Upgrade is required for this operation.
- TestIntegration/FsMkdir/FsPutFiles/PublicLink
fstest: add Onedrive Business and Onedrive China to the integration tests
2021-01-30 16:32:32 +00:00
- backend: "onedrive"
remote: "TestOneDriveBusiness:"
fastlist: false
onedrive: remove onedrive China from integration tests as we no longer have an account
2022-04-15 16:44:29 +00:00
# - backend: "onedrive"
# remote: "TestOneDriveCn:"
# fastlist: false
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 13:48:29 +00:00
- backend: "s3"
remote: "TestS3:"
fastlist: true
s3: empty directory markers further work #3453 - Report correct feature flag - Fix test failures due to that - don't output the root directory marker - Don't create the directory marker if it is the bucket or root - Create directories when uploading files
2023-04-26 09:59:17 +00:00
- backend: "s3"
remote: "TestS3,directory_markers:"
fastlist: true
test_all: make integration test for serve s3
2023-11-24 17:08:04 +00:00
- backend: "s3"
remote: "TestS3Rclone:"
fastlist: true
fstest/test_all: add alternate s3 and swift providers to the integration tests
2019-01-12 18:33:31 +00:00
- backend: "s3"
remote: "TestS3Minio:"
fastlist: true
test_all: add ignores for tests which will never pass - s3 backends which don't support SetTier - mega which makes a duplicate for TestDirRename
2019-09-15 12:16:15 +00:00
ignore:
- TestIntegration/FsMkdir/FsPutFiles/SetTier
test_all: mark expected failures for minio, wasabi and FTP
2019-10-01 14:40:32 +00:00
- TestIntegration/FsMkdir/FsEncoding/control_chars
- TestIntegration/FsMkdir/FsEncoding/leading_LF
- TestIntegration/FsMkdir/FsEncoding/leading_VT
- TestIntegration/FsMkdir/FsEncoding/punctuation
- TestIntegration/FsMkdir/FsEncoding/trailing_LF
- TestIntegration/FsMkdir/FsEncoding/trailing_VT
test: add TestS3MinioEdge to test leading edge minio too #3934
2020-02-13 10:55:05 +00:00
- backend: "s3"
remote: "TestS3MinioEdge:"
fastlist: true
ignore:
- TestIntegration/FsMkdir/FsPutFiles/SetTier
fstest/test_all: add alternate s3 and swift providers to the integration tests
2019-01-12 18:33:31 +00:00
- backend: "s3"
remote: "TestS3Wasabi:"
fastlist: true
test_all: mark expected failures for minio, wasabi and FTP
2019-10-01 14:40:32 +00:00
ignore:
- TestIntegration/FsMkdir/FsEncoding/leading_CR
- TestIntegration/FsMkdir/FsEncoding/leading_LF
- TestIntegration/FsMkdir/FsEncoding/leading_HT
- TestIntegration/FsMkdir/FsEncoding/leading_VT
test_all: ignore TestIntegration/FsMkdir/FsPutFiles/FsPutStream/0 on wasabi This has been reported to Wasabi and they've confirmed as a known issue that multipart uploads can't be 0 sized even though that is incompatible with AWS S3.
2020-01-13 09:47:11 +00:00
- TestIntegration/FsMkdir/FsPutFiles/FsPutStream/0
s3: fix GCS provider after SDKv2 update #4989 This also adds GCS via S3 to the integration tester.
2024-08-05 14:48:29 +00:00
- backend: "s3"
remote: "TestS3GCS:"
fastlist: true
ignore:
- TestIntegration/FsMkdir/FsEncoding/control_chars
- TestIntegration/FsMkdir/FsEncoding/leading_CR
- TestIntegration/FsMkdir/FsEncoding/leading_LF
- TestIntegration/FsMkdir/FsEncoding/trailing_CR
- TestIntegration/FsMkdir/FsEncoding/trailing_LF
- TestIntegration/FsMkdir/FsPutFiles/PublicLink
- TestIntegration/FsMkdir/FsPutFiles/SetTier
- TestIntegration/FsMkdir/FsPutFiles/Internal/Metadata/GzipEncoding
- TestIntegration/FsMkdir/FsPutFiles/Internal/Versions/VersionAt/AfterDelete/List
- TestIntegration/FsMkdir/FsPutFiles/Internal/Versions/VersionAt/AfterDelete/NewObject
- TestIntegration/FsMkdir/FsPutFiles/Internal/Versions/VersionAt/AfterTwo/List
- TestIntegration/FsMkdir/FsPutFiles/Internal/Versions/VersionAt/AfterTwo/NewObject
- TestBisyncRemoteRemote/extended_filenames
test_all: remove Digital Ocean s3 integration tests due to excessive rate limiting This is what I wrote to Digital Ocean support on July 10, 2020 - alas it didn't result in the rate limits dropping, so reluctantly I'm going to remove DO from the integration tests since they never pass and have no hope of ever passing while this rate limit is in effect. ---- Somewhere towards the end of June 2020 or the start of July 2020 my integration tests between rclone ( https://rclone.org ) and Digital Ocean started failing. I tried moving the tests to different regions (currently they are using AMS1 because I'm in Europe) with no improvement. Rclone seems to be hitting this rate limit as documented here: https://www.digitalocean.com/docs/spaces/#limits - 2 COPYs per 5 minutes on any individual object in a Space Rclone creates small objects about 100 bytes in size and renames them a few times - this involves using the COPY call as S3 does not have a rename API. The tests do this more than twice per object so hit the 5 minute timeout I think. Rclone does exponential backoff and fails after 10 retries not having reached 5 minutes delay after 10 retries. Having a 5 minute lockout on an S3 compatible API is surprising! Rclone integration tests with about 30 other providers, none of which have a rate limit like this. I understand the need for a COPY rate limit as server side copying large files can be resource intensive. However a 5 minute lockout for copying 100 byte files seems excessive! Might I humbly suggest that you reduce or eliminate this rate limit for small files? ---- This was the reply Unfortunately it is not possible to raise this limit or remove it currently on our platform. I do see how this would interfere with type of applications that need to copy many small files and will be happy to take the feedback to our engineering team to see how we can improve the spaces system in the future
2020-08-20 11:43:43 +00:00
# Disabled due to excessive rate limiting at DO which cause the tests never to pass
# This hits the rate limit as documented here: https://www.digitalocean.com/docs/spaces/#limits
# 2 COPYs per 5 minutes on any individual object in a Space
# - backend: "s3"
# remote: "TestS3DigitalOcean:"
# fastlist: true
# ignore:
# - TestIntegration/FsMkdir/FsPutFiles/FsCopy
# - TestIntegration/FsMkdir/FsPutFiles/SetTier
test: remove TestS3Ceph: and TestSwiftCeph: from integration tests Unfortunately we don't have access to this server any more
2020-10-25 08:48:23 +00:00
# - backend: "s3"
# remote: "TestS3Ceph:"
# fastlist: true
# ignore:
# - TestIntegration/FsMkdir/FsPutFiles/FsCopy
# - TestIntegration/FsMkdir/FsPutFiles/SetTier
s3: Add Alibaba OSS to integration tests and fix storage classes
2019-01-12 20:41:47 +00:00
- backend: "s3"
remote: "TestS3Alibaba:"
fastlist: true
s3: add Qiniu KODO to s3 provider list - fixes #6195
2022-10-13 14:49:22 +00:00
# - backend: "s3"
# remote: "TestS3Qiniu:"
# fastlist: true
# ignore:
# - TestIntegration/FsMkdir/FsEncoding/control_chars
# - TestIntegration/FsMkdir/FsEncoding/leading_VT
# - TestIntegration/FsMkdir/FsEncoding/trailing_VT
# - TestIntegration/FsMkdir/FsPutFiles/FromRoot/ListR
# - TestIntegration/FsMkdir/FsPutFiles/SetTier
# - TestIntegration/FsMkdir/FsPutFiles/FsPutStream/0
# - TestIntegration/FsMkdir/FsPutFiles/Internal/Metadata
s3: Support Cloudflare R2 - fixes #5642
2022-05-06 11:09:29 +00:00
- backend: "s3"
remote: "TestS3R2:"
fastlist: true
ignore:
- TestIntegration/FsMkdir/FsPutFiles/SetTier
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 13:48:29 +00:00
- backend: "sftp"
build: implement a framework for starting test servers during tests Test servers are implemented by docker containers and run real servers for rclone to test against.
2019-10-04 15:51:07 +00:00
remote: "TestSFTPOpenssh:"
fastlist: false
- backend: "sftp"
remote: "TestSFTPRclone:"
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 13:48:29 +00:00
fastlist: false
sftp: add --sftp-ssh to specify an external ssh binary to use This allows using an external ssh binary instead of the built in ssh library for making SFTP connections. This makes another integration test target TestSFTPRcloneSSH: Fixes #7012
2023-06-09 10:02:40 +00:00
- backend: "sftp"
remote: "TestSFTPRcloneSSH:"
fastlist: false
test: add sftp to rsync.net to integration tests
2021-04-12 14:51:42 +00:00
- backend: "sftp"
remote: "TestSFTPRsyncNet:"
fastlist: false
sftp: ignore failing entries in rsync.net integration tests
2022-04-15 16:43:10 +00:00
ignore:
- TestIntegration/FsMkdir/FsEncoding/trailing_space
- TestIntegration/FsMkdir/FsEncoding/trailing_CR
- TestIntegration/FsMkdir/FsEncoding/trailing_LF
- TestIntegration/FsMkdir/FsEncoding/trailing_HT
- TestIntegration/FsMkdir/FsEncoding/trailing_VT
- TestIntegration/FsMkdir/FsEncoding/trailing_dot
- TestIntegration/FsMkdir/FsEncoding/invalid_UTF-8
- TestIntegration/FsMkdir/FsEncoding/URL_encoding
sugarsync: new backend - fixes #622
2019-10-24 11:35:50 +00:00
- backend: "sugarsync"
remote: "TestSugarSync:Test"
fastlist: false
ignore:
- TestIntegration/FsMkdir/FsPutFiles/PublicLink
build: implement a framework for starting test servers during tests Test servers are implemented by docker containers and run real servers for rclone to test against.
2019-10-04 15:51:07 +00:00
- backend: "swift"
remote: "TestSwiftAIO:"
fastlist: true
swift: implement --swift-use-segments-container to allow >5G files on Blomp This switches between storing chunks in a separate container suffixed with `_segments` (the default) and a directory in the root `.file-segments`) By default the `.file-segments` mode will be auto selected if `auth_url`s that require it are detected. If the `.file-segments` mode is in use then rclone will omit that directory from listings. See: https://forum.rclone.org/t/blomp-unable-to-upload-5gb-files/42498/
2024-03-11 18:33:11 +00:00
- backend: "swift"
swift: fix integration tester with use_segments_container=false
2024-06-08 15:10:07 +00:00
remote: "TestSwiftAIOsegments:"
swift: implement --swift-use-segments-container to allow >5G files on Blomp This switches between storing chunks in a separate container suffixed with `_segments` (the default) and a directory in the root `.file-segments`) By default the `.file-segments` mode will be auto selected if `auth_url`s that require it are detected. If the `.file-segments` mode is in use then rclone will omit that directory from listings. See: https://forum.rclone.org/t/blomp-unable-to-upload-5gb-files/42498/
2024-03-11 18:33:11 +00:00
fastlist: true
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 13:48:29 +00:00
- backend: "swift"
remote: "TestSwift:"
fastlist: true
test: remove TestS3Ceph: and TestSwiftCeph: from integration tests Unfortunately we don't have access to this server any more
2020-10-25 08:48:23 +00:00
# - backend: "swift"
# remote: "TestSwiftCeph:"
# fastlist: true
# ignore:
# - TestIntegration/FsMkdir/FsPutFiles/FsCopy
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 13:48:29 +00:00
- backend: "yandex"
remote: "TestYandex:"
fastlist: false
- backend: "ftp"
build: implement a framework for starting test servers during tests Test servers are implemented by docker containers and run real servers for rclone to test against.
2019-10-04 15:51:07 +00:00
remote: "TestFTPProftpd:"
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 13:48:29 +00:00
fastlist: false
build: implement a framework for starting test servers during tests Test servers are implemented by docker containers and run real servers for rclone to test against.
2019-10-04 15:51:07 +00:00
- backend: "ftp"
remote: "TestFTPPureftpd:"
ftp: update encoding in integration tests with ProFtpd, PureFtpd, VsFtpd PR #5589 established recommended encodings to use with major FTP servers. This patch updates integration tests correspondingly.
2021-10-03 15:15:45 +00:00
fastlist: false
- backend: "ftp"
remote: "TestFTPVsftpd:"
build: implement a framework for starting test servers during tests Test servers are implemented by docker containers and run real servers for rclone to test against.
2019-10-04 15:51:07 +00:00
fastlist: false
- backend: "ftp"
remote: "TestFTPRclone:"
fastlist: false
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 13:48:29 +00:00
- backend: "box"
remote: "TestBox:"
fastlist: false
fichier: 1fichier support - fixes #2908 This was started by Fionera, finished off by Laura with fixes and more docs from Nick. Co-authored-by: Fionera <fionera@fionera.de> Co-authored-by: Nick Craig-Wood <nick@craig-wood.com>
2019-06-26 18:39:01 +00:00
- backend: "fichier"
remote: "TestFichier:"
fastlist: false
fichier: allow more list retries for the integration tests #5734
2021-10-20 16:45:54 +00:00
listretries: 5
test_all: only run the backend tests for 1fichier Running all the tests for 1fichier takes too long due to the directory reading rate limiter. The backend tests do complete in a reasonable time (21 mins).
2020-09-01 15:13:47 +00:00
tests:
- backend
qingstor: disable integration tests as test account suspended QingStor support have disabled the integration test account with this message 尊敬的用户您好：依据监管部门相关内容安全合规要求，QingStor即日起限制对 个人客户提供对象存储服务，您的对象存储服务将被系统置于禁用状态，如需继 续使用QingsStor对象存储服务，您可以通过工单或者拨打400热线申请开通，未 解封期间您的数据将不受影响，感谢您的谅解和支持。 Which google translate renders as > Dear user: In accordance with the relevant content security > compliance requirements of the regulatory authorities, QingStor will > limit the provision of object storage services to individual > customers from now on. Your object storage service will be disabled > by the system. If you need to continue to use the QingsStor object > storage service, you can apply for activation through a work order > or by calling the 400 hotline. Your data will not be affected during > the period of unblocking. Thank you for your understanding and > support.
2024-06-13 11:50:35 +00:00
# Disabled due to account cancellation - no longer available to me
# - backend: "qingstor"
# remote: "TestQingStor:"
# fastlist: false
# oneonly: true
# cleanup: true
# ignore:
# # This test fails because of a broken bucket in the account!
# - TestIntegration/FsMkdir/FsPutFiles/FromRoot/ListR
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 13:48:29 +00:00
- backend: "azureblob"
remote: "TestAzureBlob:"
fastlist: true
azureblob: empty directory markers #3453
2023-04-28 16:24:19 +00:00
- backend: "azureblob"
remote: "TestAzureBlob,directory_markers:"
fastlist: true
azurefiles: finish docs and implementation and add optional interfaces - use rclone's http Transport - fix handling of 0 length files - combine into one file and remove uneeded abstraction - make `chunk_size` and `upload_concurrency` settable - make auth the same as azureblob - set the Features correctly - implement `--azurefiles-max-stream-size` - remove arbitrary sleep on Mkdir - implement `--header-upload` - implement read and write MimeType for objects - implement optional methods - About - Copy - DirMove - Move - OpenWriterAt - PutStream - finish documentation - disable build on plan9 and js Fixes #365 Fixes #7378
2023-11-15 09:37:57 +00:00
- backend: "azurefiles"
remote: "TestAzureFiles:"
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 13:48:29 +00:00
- backend: "pcloud"
remote: "TestPcloud:"
pcloud: add support for recursive list
2021-11-26 19:55:50 +00:00
fastlist: true
pikpak: new backend Fixes #6429
2023-04-04 15:33:48 +00:00
- backend: "pikpak"
remote: "TestPikPak:"
fastlist: false
ignore:
# fs/operations
- TestCheckSum
- TestHashSums/Md5
# fs/sync
- TestSyncWithTrackRenames
# integration
- TestIntegration/FsMkdir/FsPutFiles/ObjectMimeType
pikpak: remove PublicLink from integration tests This commit removes the test for PublicLink as it is not currently supported in the test environment. This removes it from the integration tests to avoid meaningless retries.
2024-06-11 19:43:49 +00:00
# This test fails with message
# "share_status_prohibited" (9): Sorry, the sharing service is under maintenance in the current region.
- TestIntegration/FsMkdir/FsPutFiles/PublicLink
Add pixeldrain backend This commit adds support for pixeldrain's experimental filesystem API.
2024-08-12 12:35:44 +00:00
- backend: "pixeldrain"
remote: "TestPixeldrain:"
ignore:
- TestIntegration/FsMkdir/FsEncoding/invalid_UTF-8
fastlist: false
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 13:48:29 +00:00
- backend: "webdav"
build: implement a framework for starting test servers during tests Test servers are implemented by docker containers and run real servers for rclone to test against.
2019-10-04 15:51:07 +00:00
remote: "TestWebdavNextcloud:"
ignore:
- TestIntegration/FsMkdir/FsEncoding/punctuation
- TestIntegration/FsMkdir/FsEncoding/invalid_UTF-8
fastlist: false
- backend: "webdav"
remote: "TestWebdavOwncloud:"
test_all: ignore some encoding tests with nextcloud integration test
2019-10-02 10:33:53 +00:00
ignore:
- TestIntegration/FsMkdir/FsEncoding/punctuation
- TestIntegration/FsMkdir/FsEncoding/invalid_UTF-8
build: implement a framework for starting test servers during tests Test servers are implemented by docker containers and run real servers for rclone to test against.
2019-10-04 15:51:07 +00:00
fastlist: false
- backend: "webdav"
remote: "TestWebdavRclone:"
ignore:
- TestFileReadAtZeroLength
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 13:48:29 +00:00
fastlist: false
- backend: "cache"
remote: "TestCache:"
fastlist: false
- backend: "mega"
remote: "TestMega:"
fastlist: false
test_all: make a way of ignoring integration test failures Use this to ignore known failures
2019-01-12 20:18:05 +00:00
ignore:
- TestIntegration/FsMkdir/FsPutFiles/PublicLink
test_all: add ignores for tests which will never pass - s3 backends which don't support SetTier - mega which makes a duplicate for TestDirRename
2019-09-15 12:16:15 +00:00
- TestDirRename
fstest/test_all: rework integration tests to improve output - Make integration tests use a config file - Output individual logs for each test - Make HTML report and open browser - Optionally email and upload results
2018-09-29 13:48:29 +00:00
- backend: "opendrive"
remote: "TestOpenDrive:"
fastlist: false
- backend: "union"
remote: "TestUnion:"
fastlist: false
koofr: implemented a backend for Koofr cloud storage service. Implemented a Koofr REST API backend. Added said backend to tests. Added documentation for said backend.
2019-02-22 15:50:04 +00:00
- backend: "koofr"
remote: "TestKoofr:"
fastlist: false
koofr: remove digistorage from integration tests as no account
2022-04-15 16:48:44 +00:00
# - backend: "koofr"
# remote: "TestDigiStorage:"
# fastlist: false
backend: add Linkbox backend Add backend for linkbox.io with read and write capabilities fixes #6960 #6629
2023-10-20 11:35:56 +00:00
- backend: "linkbox"
remote: "TestLinkbox:"
fastlist: false
ignore:
- TestIntegration/FsMkdir/FsEncoding/invalid_UTF-8
linkbox: pre-merge fixes - convert to directoryCache - makes backend much more efficient - don't force --low-level-retries to 2 - don't wrap paced calls in pacer - fix shouldRetry - fix file list searching mechanism
2023-11-17 09:28:05 +00:00
- TestRWFileHandleWriteNoWrite
- TestCaseInsensitiveMoveFile
linkbox: add override for TestFixCase - #7591 linkbox already has an override for TestCaseInsensitiveMoveFile, and being able to handle case-insensitive moves is a prerequisite for TestFixCase.
2024-02-18 10:17:34 +00:00
- TestFixCase
linkbox: ignore TestListDirSorted test until encoding is implemented
2024-06-11 08:34:32 +00:00
- TestListDirSorted # Can't upload files starting with . - FIXME fix with encoding
test_all: mark linkbox fs/sync test TestSyncOverlapWithFilter as ignore This gives the error > Update second step failed: Linkbox error 500: The file name needs to include a suffix, such as xxx.mp4 As linkbox can't have files starting with "." and we are trying to save a file called ".ignore".
2024-09-07 11:22:59 +00:00
- TestSyncOverlapWithFilter # Can't upload files starting with . - FIXME fix with encoding
premiumizeme: new backend for premiumize.me - Fixes #3063
2019-07-05 23:16:57 +00:00
- backend: "premiumizeme"
remote: "TestPremiumizeMe:"
fastlist: false
protondrive: add protondrive backend - fixes #6072
2023-07-22 09:46:21 +00:00
- backend: "protondrive"
remote: "TestProtonDrive:"
fastlist: false
putio: add new backend
2019-08-06 12:47:52 +00:00
- backend: "putio"
remote: "TestPutio:"
New backend for Citrix Sharefile - Fixes #1543 Many thanks to Bob Droog for organizing a test account and extensive testing.
2019-08-27 21:50:07 +00:00
fastlist: false
putio: allow integration tests double time as they keep timing out #5734
2021-10-20 16:35:16 +00:00
extratime: 2.0
putio: ignore URL encoded files as these fail in the integration tests
2022-04-15 16:55:43 +00:00
ignore:
- TestIntegration/FsMkdir/FsEncoding/URL_encoding
New backend for Citrix Sharefile - Fixes #1543 Many thanks to Bob Droog for organizing a test account and extensive testing.
2019-08-27 21:50:07 +00:00
- backend: "sharefile"
remote: "TestSharefile:"
putio: add new backend
2019-08-06 12:47:52 +00:00
fastlist: false
sia: add backend for sia decentralized cloud #4514
2019-10-03 00:02:44 +00:00
- backend: "sia"
remote: "TestSia:"
fastlist: false
mailru: backend for mail.ru
2019-09-09 20:56:16 +00:00
- backend: "mailru"
remote: "TestMailru:"
subdir: false
fastlist: false
mailru: add override for TestApplyTransforms - #7591 mailru is unable to handle filenames with certain combining characters (for example: йěáñ), and is therefore incapable of testing ApplyTransforms. (It is also therefore incapable of fully supporting --no-unicode-normalization.) The same override is applied to chunker when wrapping mailru.
2024-02-18 10:29:20 +00:00
ignore:
- TestApplyTransforms
seafile: New backend for seafile server
2020-04-25 17:55:18 +00:00
- backend: "seafile"
remote: "TestSeafileV6:"
fastlist: false
ignore:
- TestIntegration/FsMkdir/FsPutFiles/FsDirMove
- backend: "seafile"
remote: "TestSeafile:"
fastlist: true
- backend: "seafile"
remote: "TestSeafileEncrypted:"
fastlist: true
sia: fix and enable integration tests #4514 - setup correct path encoding (fixes backend test FsEncoding) - ignore range option if file is empty (fixes VFS test TestFileReadAtZeroLength) - cleanup stray files left after failed upload (fixes test FsPutError) - rebase code on master, adapt backend for rclone context passing - translate Siad errors to rclone native FS errors in sia errorHandler - TestSia: return proper backend options from the script - TestSia: use uptodate AntFarm image, nebulouslabs/siaantfarm is stale
2021-02-14 22:29:28 +00:00
- backend: "sia"
remote: "TestSia:"
fastlist: false
smb: backend to support SMB - fixes #2042
2022-09-30 15:10:57 +00:00
- backend: "smb"
remote: "TestSMB:rclone"
fastlist: false
storj: rename tardigrade backend to storj backend #5616 This adds an alias for backwards compatibility and leaves a stub documentation page to redirect people to the new documentation.
2022-02-04 17:58:04 +00:00
- backend: "storj"
remote: "TestStorj:"
Tardigrade Backend
2020-05-11 18:56:41 +00:00
fastlist: true
new backend: zoho workdrive - fixes #4533
2020-10-07 22:17:50 +00:00
- backend: "zoho"
remote: "TestZoho:"
fastlist: false
test_all: limit the Zoho tests to just the backend The free account has a very ungenerous 1000 api calls per day limit and the full integration test suite breaches that so limit the integration tests to just the backend.
2023-11-21 12:06:31 +00:00
tests:
- backend
HDFS (Hadoop Distributed File System) implementation - #42 This includes an HDFS docker image to use with the integration tests. Co-authored-by: Ivan Andreev <ivandeex@gmail.com> Co-authored-by: Nick Craig-Wood <nick@craig-wood.com>
2020-09-28 17:29:44 +00:00
- backend: "hdfs"
remote: "TestHdfs:"
fastlist: false
ignore:
- TestSyncUTFNorm
test_all: remove uptobox from integration tests The uptobox service hasn't running since 20 September 2023. This removes it from the integration tests to save noise.
2023-11-21 11:49:39 +00:00
# - backend: "uptobox"
# remote: "TestUptobox:"
# fastlist: false
# ignore:
# - TestRWFileHandleWriteNoWrite
Add a native backend for oracle object storage - fixes #6299
2022-10-13 12:04:56 +00:00
- backend: "oracleobjectstorage"
remote: "TestOracleObjectStorage:"
fastlist: true
ignore:
- TestIntegration/FsMkdir/FsEncoding/control_chars
- TestIntegration/FsMkdir/FsEncoding/leading_CR
- TestIntegration/FsMkdir/FsEncoding/leading_LF
- TestIntegration/FsMkdir/FsEncoding/trailing_CR
- TestIntegration/FsMkdir/FsEncoding/trailing_LF
- TestIntegration/FsMkdir/FsEncoding/leading_HT
oracleobjectstorage: implement OpenChunkWriter and multi-thread uploads #7056
2023-08-22 04:18:27 +00:00
- TestIntegration/FsMkdir/FsPutFiles/FsPutStream/0
quatrix: add backend to support Quatrix Co-authored-by: Volodymyr Kit <v.kit@maytech.net>
2023-09-08 13:31:29 +00:00
- backend: "quatrix"
remote: "TestQuatrix:"
fastlist: false
Add a new backend for uloz.to Note that this temporarily skips uploads of files over 2.5 GB. See https://github.com/rclone/rclone/pull/7552#issuecomment-1956316492 for details.
2024-03-26 09:46:47 +00:00
- backend: "ulozto"
remote: "TestUlozto:"
fastlist: false
Reference in a new issue Copy permalink