galsalomon66
6919f63324
adding tests per JSON input types, which includes various SQL operators.
...
alignment of some of the test routines upon removing the XML tags(<Payload><Records><Payload>) from the s3select results. (Json s3tests #506 )
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
2023-05-16 00:26:19 +03:00
Casey Bodley
b4bb9afb52
nose: remove nose attrs and imports
...
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 4c75fba0de
2023-01-25 18:03:58 -05:00
Casey Bodley
8186dd7561
pytest: replace nose eq() with assert ==
...
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit f5d0bc9be3
2023-01-25 18:03:50 -05:00
Casey Bodley
b6dcf111fa
pytest: add custom marks for each nose @attr
...
and register them in pytest.ini
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 4864dbc340
2023-01-25 18:00:37 -05:00
Casey Bodley
c749452fd0
pytest: add global configfile and autouse teardown fixtures
...
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 672a123348
2023-01-25 18:00:17 -05:00
galsalomon66
def95c2968
remove comment
...
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit 60b26f210e
2022-10-19 15:46:02 -04:00
galsalomon66
5eadd6d08c
the use of std::to_string change the double presentation(not accuracy)
...
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit b200013565
2022-10-19 15:46:02 -04:00
galsalomon66
89b10274dd
the upgraded CSV parser has some impact on engine result. (redundant comma, quote behavior)
...
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit 89f97ed35c
2022-10-19 15:46:02 -04:00
gal salomon
0b8e554dd1
revert the arrow installation(causing failure on some distro"s, such as fedora)
...
Signed-off-by: gal salomon <gal.salomon@gmail.com>
2022-01-17 12:12:18 -05:00
gal salomon
70b928269f
fix output-serialization tests(upon comparing query results need to remove redundant columns)
...
skip output-serial test. the results from both queries are not equal, thus it raise an assert. the problem seems to be the formatting before the comparision
remove test_output_serial_expressions until fixing the test
experiment pyarrow for parquet testing, adding arrow/parquet to bootstrap, installing pyarrow,pandas for reading/writing parquet
Signed-off-by: gal salomon <gal.salomon@gmail.com>
2022-01-17 12:12:18 -05:00
gal salomon
cfa805efe9
merging master tests into parquet branch
...
Signed-off-by: gal salomon <gal.salomon@gmail.com>
2022-01-17 12:12:18 -05:00
gal salomon
090fbfbead
fix for assert of error messages
...
Signed-off-by: gal salomon <gal.salomon@gmail.com>
2022-01-17 12:12:18 -05:00
gal salomon
4143ec30f3
remove redundant comma. s3select-engine produced redundant result column before its last fix, s3tests should align with that
...
Signed-off-by: gal salomon <gal.salomon@gmail.com>
2022-01-17 12:12:18 -05:00
galsalomon66
5e0cea1c07
adding datatime queries from #395
...
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit 23be1160f5
2021-12-20 10:43:49 -05:00
galsalomon66
d44879544d
rollback to use like without escape syntax (explore valgrind issue)
...
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit eef8d0fa67
2021-12-20 10:43:31 -05:00
galsalomon66
7f21baaea6
modify the queries syntax to like-escape; the queries semantics is the same; results are the same; it is a part of exploring valgrind issue around like-operator
...
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit f51101d752
2021-12-20 10:43:19 -05:00
galsalomon66
3c1de4acc3
add output-serialization tests; add syntax-error tests; run_s3select_output should merge into run_s3select
...
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit 749e29185b
2021-12-20 10:43:07 -05:00
gal salomon
de683cd665
remove comments from the like-expressions
...
Signed-off-by: gal salomon <gal.salomon@gmail.com>
(cherry picked from commit 7c07bad930
2021-12-20 10:42:48 -05:00
galsalomon66
6f9becf5b9
search for the cause of the valgrind issue; remove the like expression that may cause it
...
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit 723853fd18
2021-12-20 10:42:19 -05:00
Albin Antony
f4c19c9389
s3select: test progress stats
...
Signed-off-by: Albin Antony <aantony@redhat.com>
(cherry picked from commit a3447c50df
2021-12-20 10:41:12 -05:00
Albin Antony
89363e8fef
s3select: align s3select tests with ceph
...
Update s3-tests to handle the error-response (return 400, and error-description)
Signed-off-by: Albin Antony <aantony@redhat.com>
2021-12-20 10:40:50 -05:00
gal salomon
aea3f6b4c3
modifying tests to be align with change of s3select compare sign( == -> = )
...
Signed-off-by: gal salomon <gal.salomon@gmail.com>
(cherry picked from commit 1572fbc87b
2021-05-21 20:10:14 -04:00
Albin Antony
6f74f2af07
tests
...
Signed-off-by: Albin Antony <aantony@redhat.com>
(cherry picked from commit c6a4ab9d12
2021-05-21 20:10:14 -04:00
Albin Antony
6b412b509b
tests
...
Signed-off-by: Albin Antony <aantony@redhat.com>
(cherry picked from commit e7102e8cb0
2021-05-21 20:10:14 -04:00
Albin Antony
87993f147d
tests
...
Signed-off-by: Albin Antony <aantony@redhat.com>
(cherry picked from commit 60dd3444b3
2021-05-21 20:10:14 -04:00
Albin Antony
ecc4cbc5c4
s3select: align s3-tests with new changes in s3select
...
Fix when then, date functions and NULL, add escape, trim tests
Signed-off-by: Albin Antony <aantony@redhat.com>
(cherry picked from commit 4a86ebbe8b
2021-05-21 20:09:48 -04:00
galsalomon66
287acbc6e7
change test_s3select.py permission; add s3select attribute
...
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit ea7d5fb563
2021-01-14 00:08:50 -05:00
galsalomon66
68f1939942
reduce object size for test_like_expression, it may cause timeouts in teuthology runs
...
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
2020-12-22 00:32:18 -05:00
galsalomon66
a0aa55d4ae
rename charlength and character_length function names
...
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
2020-12-22 00:32:07 -05:00
Albin Antony
a5108a7d69
s3select tests for coalesce and case
...
Signed-off-by: Albin Antony <aantony@redhat.com>
2020-12-03 01:04:02 -05:00
gal salomon
3be10d722f
per each new uploaded file(for test), it got unique name(random), and uploaded file is verified for its content
...
Signed-off-by: gal salomon <gal.salomon@gmail.com>
Signed-off-by: gal salomon <gal.salomon@gmail.com>
2020-12-03 01:03:55 -05:00
Albin Antony
adad16121f
s3select predicate tests
...
Signed-off-by: Albin Antony <aantony@redhat.com>
2020-12-03 00:59:32 -05:00
gal salomon
6ea6cb6467
add filter for s3select tests
...
Signed-off-by: gal salomon <gal.salomon@gmail.com>
(cherry picked from commit fce9a52ef4
2020-07-07 07:38:41 -04:00
gal salomon
10c801a2e0
fix comments;remove non-used imports;enable test for projection;using get_client()
...
(cherry picked from commit 72e251ed69
2020-06-25 13:42:23 -04:00
gal salomon
9d670846a3
adding radom-generated tests, one for where clause , the second for prjection. random arithmetical expression is generated and used for building s3-select query; result is compared to python-engine
...
(cherry picked from commit fb39ac4829
2020-06-25 13:42:23 -04:00
gal salomon
bb801b8625
python linter; replace assert with assert_equal; add complex query test(sum,count,where); add test-schema ;
...
(cherry picked from commit e006dd4753
2020-06-25 13:42:23 -04:00
gal salomon
652619f46f
using config parameters
...
(cherry picked from commit 1a9d3677f7
2020-06-25 13:42:23 -04:00
gal salomon
b1ddeee6eb
add tests to validate csv-header-info functionalities is correct
...
(cherry picked from commit 5dc8bc75ab
2020-06-25 13:42:23 -04:00
gal salomon
ca9cb5cc2c
adding test cases for processing CSV objects with different CSV definitions; validate null,escape-rules and quotes are processed correctly
...
(cherry picked from commit 94b1986228
2020-06-25 13:42:23 -04:00
gal salomon
e010c4cfec
adding utcnow test
...
(cherry picked from commit 4c7c279f70
2020-06-25 13:42:23 -04:00
gal salomon
edea887e9c
adding tests for date-time functionalities
...
(cherry picked from commit 5925f0fb3f
2020-06-25 13:42:23 -04:00
gal salomon
cd4f7e1a7a
add complex expression tests; for nested function calls; and different where-clause which create the same group of values
...
(cherry picked from commit c1bce6ac70
2020-06-25 13:42:23 -04:00
gal salomon
048f9297a1
adding test for detection of cyclic reference to alias
...
(cherry picked from commit d543619e71
2020-06-25 13:42:23 -04:00
gal salomon
8bd6158054
adding aggregation tests
...
(cherry picked from commit f42872fd53
2020-06-25 13:42:23 -04:00
gal salomon
aca68a9d39
adding alias test case
...
(cherry picked from commit 74daf86fe5
2020-06-25 13:42:23 -04:00
gal salomon
537431c686
commit first tests for s3select and initial framework
...
(cherry picked from commit dac38694ef
2020-06-25 13:42:23 -04:00
