dkirillov/s3-tests
1
0
Fork 0
forked from TrueCloudLab/s3-tests
Code Pull requests Activity
873 commits 127 branches 0 tags 8.9 MiB
Commit graph

39 commits

Author SHA1 Message Date
galsalomon66
89b10274dd the upgraded CSV parser has some impact on engine result. (redundant comma, quote behavior) 
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit 89f97ed35c)
 2022-10-19 15:46:02 -04:00
gal salomon
0b8e554dd1 revert the arrow installation(causing failure on some distro"s, such as fedora) 
Signed-off-by: gal salomon <gal.salomon@gmail.com>
 2022-01-17 12:12:18 -05:00
gal salomon
70b928269f fix output-serialization tests(upon comparing query results need to remove redundant columns) 
skip output-serial test. the results from both queries are not equal, thus it raise an assert. the problem seems to be the formatting before the comparision

remove test_output_serial_expressions until fixing the test

experiment pyarrow for parquet testing, adding arrow/parquet to bootstrap, installing pyarrow,pandas for reading/writing parquet

Signed-off-by: gal salomon <gal.salomon@gmail.com>
 2022-01-17 12:12:18 -05:00
gal salomon
cfa805efe9 merging master tests into parquet branch 
Signed-off-by: gal salomon <gal.salomon@gmail.com>
 2022-01-17 12:12:18 -05:00
gal salomon
090fbfbead fix for assert of error messages 
Signed-off-by: gal salomon <gal.salomon@gmail.com>
 2022-01-17 12:12:18 -05:00
gal salomon
4143ec30f3 remove redundant comma. s3select-engine produced redundant result column before its last fix, s3tests should align with that 
Signed-off-by: gal salomon <gal.salomon@gmail.com>
 2022-01-17 12:12:18 -05:00
galsalomon66
5e0cea1c07 adding datatime queries from #395 
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit 23be1160f5)
 2021-12-20 10:43:49 -05:00
galsalomon66
d44879544d rollback to use like without escape syntax (explore valgrind issue) 
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit eef8d0fa67)
 2021-12-20 10:43:31 -05:00
galsalomon66
7f21baaea6 modify the queries syntax to like-escape; the queries semantics is the same; results are the same; it is a part of exploring valgrind issue around like-operator 
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit f51101d752)
 2021-12-20 10:43:19 -05:00
galsalomon66
3c1de4acc3 add output-serialization tests; add syntax-error tests; run_s3select_output should merge into run_s3select 
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit 749e29185b)
 2021-12-20 10:43:07 -05:00
gal salomon
de683cd665 remove comments from the like-expressions 
Signed-off-by: gal salomon <gal.salomon@gmail.com>
(cherry picked from commit 7c07bad930)
 2021-12-20 10:42:48 -05:00
galsalomon66
6f9becf5b9 search for the cause of the valgrind issue; remove the like expression that may cause it 
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit 723853fd18)
 2021-12-20 10:42:19 -05:00
Albin Antony
f4c19c9389 s3select: test progress stats 
Signed-off-by: Albin Antony <aantony@redhat.com>
(cherry picked from commit a3447c50df)
 2021-12-20 10:41:12 -05:00
Albin Antony
89363e8fef s3select: align s3select tests with ceph 
Update s3-tests to handle the error-response (return 400, and error-description)

Signed-off-by: Albin Antony <aantony@redhat.com>
 2021-12-20 10:40:50 -05:00
gal salomon
aea3f6b4c3 modifying tests to be align with change of s3select compare sign( == -> = ) 
Signed-off-by: gal salomon <gal.salomon@gmail.com>
(cherry picked from commit 1572fbc87b)
 2021-05-21 20:10:14 -04:00
Albin Antony
6f74f2af07 tests 
Signed-off-by: Albin Antony <aantony@redhat.com>
(cherry picked from commit c6a4ab9d12)
 2021-05-21 20:10:14 -04:00
Albin Antony
6b412b509b tests 
Signed-off-by: Albin Antony <aantony@redhat.com>
(cherry picked from commit e7102e8cb0)
 2021-05-21 20:10:14 -04:00
Albin Antony
87993f147d tests 
Signed-off-by: Albin Antony <aantony@redhat.com>
(cherry picked from commit 60dd3444b3)
 2021-05-21 20:10:14 -04:00
Albin Antony
ecc4cbc5c4 s3select: align s3-tests with new changes in s3select 
Fix when then, date functions and NULL, add escape, trim tests

Signed-off-by: Albin Antony <aantony@redhat.com>
(cherry picked from commit 4a86ebbe8b)
 2021-05-21 20:09:48 -04:00
galsalomon66
287acbc6e7 change test_s3select.py permission; add s3select attribute 
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit ea7d5fb563)
 2021-01-14 00:08:50 -05:00
galsalomon66
68f1939942 reduce object size for test_like_expression, it may cause timeouts in teuthology runs 
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
 2020-12-22 00:32:18 -05:00
galsalomon66
a0aa55d4ae rename charlength and character_length function names 
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
 2020-12-22 00:32:07 -05:00
Albin Antony
a5108a7d69 s3select tests for coalesce and case 
Signed-off-by: Albin Antony <aantony@redhat.com>
 2020-12-03 01:04:02 -05:00
gal salomon
3be10d722f per each new uploaded file(for test), it got unique name(random), and uploaded file is verified for its content 
Signed-off-by: gal salomon <gal.salomon@gmail.com>

Signed-off-by: gal salomon <gal.salomon@gmail.com>
 2020-12-03 01:03:55 -05:00
Albin Antony
adad16121f s3select predicate tests 
Signed-off-by: Albin Antony <aantony@redhat.com>
 2020-12-03 00:59:32 -05:00
gal salomon
6ea6cb6467 add filter for s3select tests 
Signed-off-by: gal salomon <gal.salomon@gmail.com>
(cherry picked from commit fce9a52ef4)
 2020-07-07 07:38:41 -04:00
gal salomon
10c801a2e0 fix comments;remove non-used imports;enable test for projection;using get_client() 
(cherry picked from commit 72e251ed69)
 2020-06-25 13:42:23 -04:00
gal salomon
9d670846a3 adding radom-generated tests, one for where clause , the second for prjection. random arithmetical expression is generated and used for building s3-select query; result is compared to python-engine 
(cherry picked from commit fb39ac4829)
 2020-06-25 13:42:23 -04:00
gal salomon
bb801b8625 python linter; replace assert with assert_equal; add complex query test(sum,count,where); add test-schema ; 
(cherry picked from commit e006dd4753)
 2020-06-25 13:42:23 -04:00
gal salomon
652619f46f using config parameters 
(cherry picked from commit 1a9d3677f7)
 2020-06-25 13:42:23 -04:00
gal salomon
b1ddeee6eb add tests to validate csv-header-info functionalities is correct 
(cherry picked from commit 5dc8bc75ab)
 2020-06-25 13:42:23 -04:00
gal salomon
ca9cb5cc2c adding test cases for processing CSV objects with different CSV definitions; validate null,escape-rules and quotes are processed correctly 
(cherry picked from commit 94b1986228)
 2020-06-25 13:42:23 -04:00
gal salomon
e010c4cfec adding utcnow test 
(cherry picked from commit 4c7c279f70)
 2020-06-25 13:42:23 -04:00
gal salomon
edea887e9c adding tests for date-time functionalities 
(cherry picked from commit 5925f0fb3f)
 2020-06-25 13:42:23 -04:00
gal salomon
cd4f7e1a7a add complex expression tests; for nested function calls; and different where-clause which create the same group of values 
(cherry picked from commit c1bce6ac70)
 2020-06-25 13:42:23 -04:00
gal salomon
048f9297a1 adding test for detection of cyclic reference to alias 
(cherry picked from commit d543619e71)
 2020-06-25 13:42:23 -04:00
gal salomon
8bd6158054 adding aggregation tests 
(cherry picked from commit f42872fd53)
 2020-06-25 13:42:23 -04:00
gal salomon
aca68a9d39 adding alias test case 
(cherry picked from commit 74daf86fe5)
 2020-06-25 13:42:23 -04:00
gal salomon
537431c686 commit first tests for s3select and initial framework 
(cherry picked from commit dac38694ef)
 2020-06-25 13:42:23 -04:00