dkirillov/s3-tests
1
0
Fork 0
forked from TrueCloudLab/s3-tests
Code Pull requests Activity
921 commits 127 branches 0 tags 8.9 MiB
Commit graph

534 commits

Author SHA1 Message Date
Casey Bodley
651ecd20dd boto2: copy configured_storage_classes() fix from boto3 
some boto2 storage class tests are failing because the list returned by
configured_storage_classes() included an empty string

the boto3 version had an extra line that removes empty values; copy that
for boto2

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2023-09-22 11:15:09 -04:00
Casey Bodley
3023080509 boto2: fix byte vs. string comparison in verify_object 
the storage class tests were failing on comparisons between the input
data and output data:

AssertionError: assert 'oFbdZvtRj' == b'oFbdZvtRj'

convert the byte representation back to string for comparison

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2023-09-22 11:15:09 -04:00
Casey Bodley
ac25acfddb s3website: collections.Container removed from python3.10 
Fixes: https://tracker.ceph.com/issues/58960

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 97c0338adf)
 2023-03-21 17:09:29 -04:00
Casey Bodley
acec6abe78 test_headers: add custom marks for auth_common/aws2/aws4 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 7993dd02a5)
 2023-01-25 18:04:31 -05:00
Casey Bodley
b4bb9afb52 nose: remove nose attrs and imports 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 4c75fba0de)
 2023-01-25 18:03:58 -05:00
Casey Bodley
8186dd7561 pytest: replace nose eq() with assert == 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit f5d0bc9be3)
 2023-01-25 18:03:50 -05:00
Casey Bodley
5396b04f1b pytest: replace nose SkipTest with pytest.skip() 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 7e7e8d5a42)
 2023-01-25 18:03:42 -05:00
Casey Bodley
e8d56603a3 pytest: replace @nose.with_setup with fixtures 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit c80e9d2118)
 2023-01-25 18:01:16 -05:00
Casey Bodley
b6dcf111fa pytest: add custom marks for each nose @attr 
and register them in pytest.ini

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 4864dbc340)
 2023-01-25 18:00:37 -05:00
Casey Bodley
c749452fd0 pytest: add global configfile and autouse teardown fixtures 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 672a123348)
 2023-01-25 18:00:17 -05:00
Priya Sehgal
78ce27ae27 sse s3 jumbo patch - all in one fixes for sse-s3 logic 
original tests by Priya Sehgal <priya.sehgal@flipkart.com>:
rgw/s3_boto3: Tests added for SSE-S3 (GET, PUT, HEAD, MPU).

Additions by Casey Bodley <cbodley@redhat.com>:
add 'sse-s3' tag to test cases
sse: add _put_bucket_encryption() helper function
sse: document test cases with default bucket encryption
sse: expects encryption response header on put/get
sse: add 8MB default-encrypted upload
sse: test uploads that request x-amz-server-side-encryption=AES256

Lastly all my changes (Marcus Watts <mwatts@redhat.com>):

remove obsolete test - do it only in boto3 now.

Combine or rename duplicated function names.
Giving more than one test the same name is a Bad Thing(tm).

sse: expand test_bucket_policy_put_obj_enc, and _put_bucket_encryption

test_bucket_policy_put_obj_enc was testing too many things at once.
new tests:

* customer encryption and sse-s3: should fail
* customer encryption and sse-kms: should fail
* deny if not sse-s3: no-enc fails, sse-s3 succeeds.
* deny if not sse-s3: kms fails
  deny if not sse-ksm: no-enc fails, sse-kms succeeds.
  deny if not sse-ksm: s3 fails

_put_bucket_encryption was only testing sse-s3.
* test both these variations: sse-s3 and sse-kms

Note:
* these tests will fail on pre-sse-s3 ceph.

python3: comment out all boto3.set_stream_logger() calls
They made too much output.

Signed-off-by: Marcus Watts <mwatts@redhat.com>
(cherry picked from commit dd7cac25f5)
 2022-05-02 17:02:11 -04:00
Soumya Koduri
73f458da05 Tag testcases failing on dbstore with 'fails_on_dbstore' attr 
To be able to successfully run s3tests on dbstore backend in teuthology,
mark all the s3-tests currently failing on it with 'fails_on_dbstore' attr

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
 2022-04-28 23:32:22 +05:30
Soumya Koduri
e5617b783f Add testcases for rgw cloudtransition feature 
Feature PR: https://github.com/ceph/ceph/pull/35100

Also ported lc testcases from boto2 to boto3

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
 2022-02-04 11:02:28 -05:00
Ilsoo Byun
3698d093bf Check if invalid payload is added after serving errordoc 
Signed-off-by: Ilsoo Byun <ilsoobyun@linecorp.com>
(cherry picked from commit c08de72d55)
 2020-11-19 10:24:30 -05:00
Ali Maredia
024e74c469 remove all non-functional tests and infra 
Signed-off-by: Ali Maredia <amaredia@redhat.com>
 2020-01-14 12:20:07 -05:00
Adam C. Emerson
be9935ba1a Port functional tests from python 2 to python 3 
Add fails_on_rgw to tests not passing. Some
tests from the master branch do not pass on the
rgw yet. Others waiting on rgw tracker issues to
be resolved.

Signed-off-by: Ali Maredia <amaredia@redhat.com>
 2020-01-14 12:20:05 -05:00
Casey Bodley
4a053e1640
Merge pull request #296 from gaul/can-test-website-501 
Do not run website tests when server emits 501

Reviewed-by: Casey Bodley <cbodley@redhat.com>
 2019-11-13 11:54:33 -05:00
Casey Bodley
5a67bab487 boto2: tag more tests with fails_with_subdomain 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2019-09-10 15:14:49 -04:00
Andrew Gaul
d6090edb82 Do not run website tests when server emits 501 
Signed-off-by: Andrew Gaul <andrew@gaul.org>
 2019-07-29 14:16:38 -07:00
Casey Bodley
28b793271f nuke_prefixed_buckets() ignores 404 from bucket delete 
if a bucket delete request times out, the retry will likely get a 404
NoSuchBucket response. ignore that error and treat this as a success

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2019-04-22 15:35:12 -04:00
Ali Maredia
d54b8d1d9b remove boto2 tests already passing in boto3 
Signed-off-by: Ali Maredia <amaredia@redhat.com>
 2019-04-02 13:29:24 -04:00
Tianshan Qu
0634d6ee50 add case test for read not exist null version 
http://tracker.ceph.com/issues/38811

Signed-off-by: Tianshan Qu <tianshan@xsky.com>
 2019-03-19 19:32:43 +08:00
Casey Bodley
e89b53f0c7
Merge pull request #247 from zhangsw/append-object 
Add test case for appending object.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
 2019-02-26 13:28:13 -05:00
zhang Shaowen
e92835a00b add https support in apppend object test cases 
Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
 2019-02-26 10:10:29 +08:00
Yehuda Sadeh
b3d9487f14 s3tests: test copy objects (storage class) 
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
 2019-01-10 11:50:02 -08:00
Yehuda Sadeh
06d0e3d398 s3tests: more object class related tests 
modify object's storage_class, multipart

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
 2019-01-10 11:50:02 -08:00
Yehuda Sadeh
4cfbece929 s3tests: test create object with storage class 
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
 2019-01-05 10:23:55 -08:00
Yehuda Sadeh
5522ac93fc s3tests: lifecycle transitions: configurable storage classes 
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
 2019-01-04 10:26:50 -08:00
Yehuda Sadeh
d024de76f8 s3tests: tests for lifecycle transitions 
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
 2019-01-04 10:26:50 -08:00
zhang Shaowen
e064dc6a85 Add test case for appending object. 
Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
 2018-11-20 21:05:57 +08:00
Casey Bodley
24ab8ecf07
Merge pull request #192 from joke-lee/cors_option_header_check 
rgw: test cors option request with Access-Control-Request-Headers

Reviewed-by: Casey Bodley <cbodley@redhat.com>
 2018-04-23 09:01:53 -04:00
Casey Bodley
ab0acde0f2
Merge pull request #220 from joke-lee/max-keys-test 
enable test for https://github.com/ceph/ceph/pull/21285

Reviewed-by: Casey Bodley <cbodley@redhat.com>
 2018-04-12 11:18:14 -04:00
Ali Maredia
7ccdadb37a
Merge pull request #182 from gaul/versioning 
Add missing versioning tag
 2018-04-10 02:20:30 +08:00
yuliyang
abbd9f17e6 enable test for https://github.com/ceph/ceph/pull/21285 
Signed-off-by: yuliyang <yuliyang@cmss.chinamobile.com>
 2018-04-09 12:19:31 -04:00
Casey Bodley
23c99318e6 cors: allow None to match missing headers 
this is apparently needed to run against newer versions of the requests
library

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2018-03-27 13:45:11 -04:00
Casey Bodley
bb65f38ad9
Merge pull request #209 from fangyuxiangGL/compression 
compression: add case to download range from big object

Reviewed-by: Casey Bodley <cbodley@redhat.com>
 2018-02-16 11:34:00 -05:00
Ali Maredia
5fb7f7a709
Merge pull request #205 from malc0lm/multipartcopy-no-range 
Add test for muiltpart copy without 'x-amz-copy-source-range' header
 2018-02-13 14:03:15 -05:00
fang yuxiang
e93443ac07 compression: add case to download range from big object 
Signed-off-by: fang yuxiang <fang.yuxiang@eisoo.com>
 2018-02-07 16:16:39 +08:00
Malcolm Lee
800a9a758f Add test for muiltpart copy without 'x-amz-copy-source-range' header 2018-01-24 13:56:02 +08:00
Abhishek Lekshmanan
5da742036e policy: refactor make_json_policy to use the new Policy classes 
since make_json_policy is redundantly doing most of the same work,
refactor to use the new policy classes instead

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
 2018-01-17 10:56:33 +01:00
Abhishek Lekshmanan
47e3772e0b policy: test existingobject tag on get acl 
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
 2018-01-17 10:56:33 +01:00
Abhishek Lekshmanan
a7e619b7ca policy: test put object with reqeust object tag 2018-01-17 10:56:32 +01:00
Abhishek Lekshmanan
ebb31e02f9 policy: test policy with sse-c encryption 
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
 2018-01-17 10:56:32 +01:00
Abhishek Lekshmanan
afa108d742 typo fix for pub_obj_acl 
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
 2018-01-17 10:56:32 +01:00
Abhishek Lekshmanan
fc0e55f7e1 policy: add S3 tests for grants conditionals 
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
 2018-01-17 10:56:32 +01:00
Abhishek Lekshmanan
26adb84b30 move ListBucket to new policy class 2018-01-17 10:56:32 +01:00
Abhishek Lekshmanan
ecea466666 policy: add a new policy class to make creation of complex policies 
Since policies can have allow/deny rules etc

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
 2018-01-17 10:56:32 +01:00
Abhishek Lekshmanan
ef827b745e policy: test put object with canned acl 
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
 2018-01-17 10:56:32 +01:00
Abhishek Lekshmanan
35c9fcd6ae policy: test metadta copy key 
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
 2018-01-17 10:56:32 +01:00
Abhishek Lekshmanan
35cd3f77af policy: test put obj using copy conditionals 
Test s3:x-amz-copy-source conditional on put obj with x-amz-copy-source

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
 2018-01-17 10:56:32 +01:00