TrueCloudLab/s3-tests
7
0
Fork 1
mirror of https://github.com/ceph/s3-tests.git synced 2024-11-28 09:31:38 +00:00
Code Issues 1 Projects Releases Packages Wiki Activity
972 commits 126 branches 0 tags 15 MiB
Commit graph

52 commits

Author SHA1 Message Date
galsalomon66
d5facc6e63 fix comments 
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit 6a775cb445)
 2024-09-09 12:50:48 +00:00
Gal Salomon
0802a6f1f8 fix the assert per empty results 
Signed-off-by: Gal Salomon <gal.salomon@gmail.com>
(cherry picked from commit 9444c29674)
 2024-09-09 12:50:15 +00:00
Ali Maredia
d776898f61 Merge pull request #513 from galsalomon66/using_get_bucket_name 
Using get bucket name

(cherry picked from commit 28009bf7d3)
 2024-09-09 12:42:56 +00:00
Seena Fallah
06a5851a92 s3select: align error codes with the new AWS format 
ref. https://github.com/ceph/ceph/pull/56864

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
(cherry picked from commit 2e395d78ea)
 2024-07-30 13:33:12 -04:00
Gal Salomon
565e5c8b9b add handling for EventStreamError exception 
Signed-off-by: Gal Salomon <gal.salomon@gmail.com>
(cherry picked from commit 77f1334571)
 2024-07-05 10:11:44 -04:00
Gal Salomon
f4e362dc3c a change is the RGW error-response require changes in s3-tests 
Signed-off-by: Gal Salomon <gal.salomon@gmail.com>
(cherry picked from commit c4c5a247eb)
 2024-07-05 10:11:44 -04:00
galsalomon66
6919f63324 adding tests per JSON input types, which includes various SQL operators. 
alignment of some of the test routines upon removing the XML tags(<Payload><Records><Payload>) from the s3select results. (Json s3tests #506)

Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
 2023-05-16 00:26:19 +03:00
Casey Bodley
b4bb9afb52 nose: remove nose attrs and imports 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 4c75fba0de)
 2023-01-25 18:03:58 -05:00
Casey Bodley
8186dd7561 pytest: replace nose eq() with assert == 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit f5d0bc9be3)
 2023-01-25 18:03:50 -05:00
Casey Bodley
b6dcf111fa pytest: add custom marks for each nose @attr 
and register them in pytest.ini

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 4864dbc340)
 2023-01-25 18:00:37 -05:00
Casey Bodley
c749452fd0 pytest: add global configfile and autouse teardown fixtures 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 672a123348)
 2023-01-25 18:00:17 -05:00
galsalomon66
def95c2968 remove comment 
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit 60b26f210e)
 2022-10-19 15:46:02 -04:00
galsalomon66
5eadd6d08c the use of std::to_string change the double presentation(not accuracy) 
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit b200013565)
 2022-10-19 15:46:02 -04:00
galsalomon66
89b10274dd the upgraded CSV parser has some impact on engine result. (redundant comma, quote behavior) 
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit 89f97ed35c)
 2022-10-19 15:46:02 -04:00
gal salomon
0b8e554dd1 revert the arrow installation(causing failure on some distro"s, such as fedora) 
Signed-off-by: gal salomon <gal.salomon@gmail.com>
 2022-01-17 12:12:18 -05:00
gal salomon
70b928269f fix output-serialization tests(upon comparing query results need to remove redundant columns) 
skip output-serial test. the results from both queries are not equal, thus it raise an assert. the problem seems to be the formatting before the comparision

remove test_output_serial_expressions until fixing the test

experiment pyarrow for parquet testing, adding arrow/parquet to bootstrap, installing pyarrow,pandas for reading/writing parquet

Signed-off-by: gal salomon <gal.salomon@gmail.com>
 2022-01-17 12:12:18 -05:00
gal salomon
cfa805efe9 merging master tests into parquet branch 
Signed-off-by: gal salomon <gal.salomon@gmail.com>
 2022-01-17 12:12:18 -05:00
gal salomon
090fbfbead fix for assert of error messages 
Signed-off-by: gal salomon <gal.salomon@gmail.com>
 2022-01-17 12:12:18 -05:00
gal salomon
4143ec30f3 remove redundant comma. s3select-engine produced redundant result column before its last fix, s3tests should align with that 
Signed-off-by: gal salomon <gal.salomon@gmail.com>
 2022-01-17 12:12:18 -05:00
galsalomon66
5e0cea1c07 adding datatime queries from #395 
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit 23be1160f5)
 2021-12-20 10:43:49 -05:00
galsalomon66
d44879544d rollback to use like without escape syntax (explore valgrind issue) 
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit eef8d0fa67)
 2021-12-20 10:43:31 -05:00
galsalomon66
7f21baaea6 modify the queries syntax to like-escape; the queries semantics is the same; results are the same; it is a part of exploring valgrind issue around like-operator 
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit f51101d752)
 2021-12-20 10:43:19 -05:00
galsalomon66
3c1de4acc3 add output-serialization tests; add syntax-error tests; run_s3select_output should merge into run_s3select 
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit 749e29185b)
 2021-12-20 10:43:07 -05:00
gal salomon
de683cd665 remove comments from the like-expressions 
Signed-off-by: gal salomon <gal.salomon@gmail.com>
(cherry picked from commit 7c07bad930)
 2021-12-20 10:42:48 -05:00
galsalomon66
6f9becf5b9 search for the cause of the valgrind issue; remove the like expression that may cause it 
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit 723853fd18)
 2021-12-20 10:42:19 -05:00
Albin Antony
f4c19c9389 s3select: test progress stats 
Signed-off-by: Albin Antony <aantony@redhat.com>
(cherry picked from commit a3447c50df)
 2021-12-20 10:41:12 -05:00
Albin Antony
89363e8fef s3select: align s3select tests with ceph 
Update s3-tests to handle the error-response (return 400, and error-description)

Signed-off-by: Albin Antony <aantony@redhat.com>
 2021-12-20 10:40:50 -05:00
gal salomon
aea3f6b4c3 modifying tests to be align with change of s3select compare sign( == -> = ) 
Signed-off-by: gal salomon <gal.salomon@gmail.com>
(cherry picked from commit 1572fbc87b)
 2021-05-21 20:10:14 -04:00
Albin Antony
6f74f2af07 tests 
Signed-off-by: Albin Antony <aantony@redhat.com>
(cherry picked from commit c6a4ab9d12)
 2021-05-21 20:10:14 -04:00
Albin Antony
6b412b509b tests 
Signed-off-by: Albin Antony <aantony@redhat.com>
(cherry picked from commit e7102e8cb0)
 2021-05-21 20:10:14 -04:00
Albin Antony
87993f147d tests 
Signed-off-by: Albin Antony <aantony@redhat.com>
(cherry picked from commit 60dd3444b3)
 2021-05-21 20:10:14 -04:00
Albin Antony
ecc4cbc5c4 s3select: align s3-tests with new changes in s3select 
Fix when then, date functions and NULL, add escape, trim tests

Signed-off-by: Albin Antony <aantony@redhat.com>
(cherry picked from commit 4a86ebbe8b)
 2021-05-21 20:09:48 -04:00
galsalomon66
287acbc6e7 change test_s3select.py permission; add s3select attribute 
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit ea7d5fb563)
 2021-01-14 00:08:50 -05:00
galsalomon66
68f1939942 reduce object size for test_like_expression, it may cause timeouts in teuthology runs 
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
 2020-12-22 00:32:18 -05:00
galsalomon66
a0aa55d4ae rename charlength and character_length function names 
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
 2020-12-22 00:32:07 -05:00
Albin Antony
a5108a7d69 s3select tests for coalesce and case 
Signed-off-by: Albin Antony <aantony@redhat.com>
 2020-12-03 01:04:02 -05:00
gal salomon
3be10d722f per each new uploaded file(for test), it got unique name(random), and uploaded file is verified for its content 
Signed-off-by: gal salomon <gal.salomon@gmail.com>

Signed-off-by: gal salomon <gal.salomon@gmail.com>
 2020-12-03 01:03:55 -05:00
Albin Antony
adad16121f s3select predicate tests 
Signed-off-by: Albin Antony <aantony@redhat.com>
 2020-12-03 00:59:32 -05:00
gal salomon
6ea6cb6467 add filter for s3select tests 
Signed-off-by: gal salomon <gal.salomon@gmail.com>
(cherry picked from commit fce9a52ef4)
 2020-07-07 07:38:41 -04:00
gal salomon
10c801a2e0 fix comments;remove non-used imports;enable test for projection;using get_client() 
(cherry picked from commit 72e251ed69)
 2020-06-25 13:42:23 -04:00
gal salomon
9d670846a3 adding radom-generated tests, one for where clause , the second for prjection. random arithmetical expression is generated and used for building s3-select query; result is compared to python-engine 
(cherry picked from commit fb39ac4829)
 2020-06-25 13:42:23 -04:00
gal salomon
bb801b8625 python linter; replace assert with assert_equal; add complex query test(sum,count,where); add test-schema ; 
(cherry picked from commit e006dd4753)
 2020-06-25 13:42:23 -04:00
gal salomon
652619f46f using config parameters 
(cherry picked from commit 1a9d3677f7)
 2020-06-25 13:42:23 -04:00
gal salomon
b1ddeee6eb add tests to validate csv-header-info functionalities is correct 
(cherry picked from commit 5dc8bc75ab)
 2020-06-25 13:42:23 -04:00
gal salomon
ca9cb5cc2c adding test cases for processing CSV objects with different CSV definitions; validate null,escape-rules and quotes are processed correctly 
(cherry picked from commit 94b1986228)
 2020-06-25 13:42:23 -04:00
gal salomon
e010c4cfec adding utcnow test 
(cherry picked from commit 4c7c279f70)
 2020-06-25 13:42:23 -04:00
gal salomon
edea887e9c adding tests for date-time functionalities 
(cherry picked from commit 5925f0fb3f)
 2020-06-25 13:42:23 -04:00
gal salomon
cd4f7e1a7a add complex expression tests; for nested function calls; and different where-clause which create the same group of values 
(cherry picked from commit c1bce6ac70)
 2020-06-25 13:42:23 -04:00
gal salomon
048f9297a1 adding test for detection of cyclic reference to alias 
(cherry picked from commit d543619e71)
 2020-06-25 13:42:23 -04:00
gal salomon
8bd6158054 adding aggregation tests 
(cherry picked from commit f42872fd53)
 2020-06-25 13:42:23 -04:00