Commit graph

53 commits

Author SHA1 Message Date
Tommi Virtanen
3fe595abd4 Whitespace cleanup. 2011-07-11 13:29:35 -07:00
Tommi Virtanen
e91a3aea66 Pyflakes cleanup. 2011-07-11 13:29:35 -07:00
Kyle Marsh
31d9032ea5 remove generate_objects.conf
generate_objects.conf is obsolete; its functionality is now part of
config.yml in the file_generation.groups section.
2011-07-11 13:11:05 -07:00
Tommi Virtanen
012b94f8ee Typo. 2011-07-11 11:54:04 -07:00
Tommi Virtanen
81be846c3c Do pseudorandom string generation 1 MB at a time.
This gives it a ~10x speedup.
2011-07-11 11:53:49 -07:00
Tommi Virtanen
2edd78ebbc Merge remote branch 'newdream/utilities' 2011-07-11 11:53:31 -07:00
Wesley Spikes
90d0f06522 Removing dead code (generate_objects:connect_s3) 2011-07-08 15:04:22 -07:00
Steven Berler
99ef831a0d dho qa: update rand readwrite for file generator
Now works correctly again after the changes to the random file
generator.  Also now gets the true size of files when generating
using a stddev != 0 (rather than just assuming all files were
the mean size).
2011-07-08 14:52:22 -07:00
Kyle Marsh
e5f9783053 dho-qa: disentangle file generation from uploading
Static load test script now provides separate functions for generating a
list of random-file pointers and uploading those files to an S3 store.  When
run as a script it still does both, but you can call each function
individually from a different script after loading the module.
2011-07-08 14:41:41 -07:00
Steven Berler
88c9b56c8b Revert "atomic read tests"
This reverts commit c75fb48e81.
2011-07-08 14:15:47 -07:00
Steven Berler
a1e5c50dc6 dho qa: rand_readwrite
Adds the rand_readwrite utility.
Updates realistic.py with a file verifier class.
Updates generate_objects.py to allow the filename seed to be set.
2011-07-08 13:14:49 -07:00
Steven Berler
c75fb48e81 atomic read tests
NOT DONE YET
2011-07-08 11:31:05 -07:00
Kyle Marsh
a4e5be5f41 dho-qa: static file generator updated to use common
Updated generate_objects.py to use Wes's common setup and configuration
stuff.  Can still override config on the command line.
2011-07-08 11:27:56 -07:00
Kyle Marsh
951dc0fcdb dho-qa: Add siege config file and document running siege
Adds siege.conf file for siege configuration options
Adds docstring to main function in generate_objects.py describing how to run
the static content load test.
2011-07-08 11:27:56 -07:00
Kyle Marsh
3a3cbb3d25 DHO QA: Random Object Generation Script
Script to generate garbage objects and push them to a bucket.

Script takes a config file on the command line (and some other command line
options using optparse) and generates a bunch of objects in an S3 bucket.
Also prints public URLs to stdout.

Number and sizes of the objects are determined by a yaml config file with each line
looking like this:
- [A, B, C]
A: Number of files in this group
B: Mean size of files in this group (in bytes)
C: Standard deviation (normal distribution) of file sizes in this group

command line options are:
 - S3 access key
 - S3 secret key
 - seed for PRNG
 - output file to write URLs to
 - flag to add md5 checksum to url list
2011-07-08 11:27:56 -07:00
Colin Patrick McCabe
015bc308af add tests for setting wacky metadata
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
2011-07-07 19:41:03 -07:00
Wesley Spikes
262f1eecd1 Add teardown to common. 2011-07-07 17:34:43 -07:00
Wesley Spikes
3ee10d3dbe test_s3 should reset permissions prior to attempting delete 2011-07-07 17:34:43 -07:00
Wesley Spikes
82693cea22 Adding common, and a sample config.yml
Introduces a new dependancy on PyYAML
2011-07-07 17:34:43 -07:00
Steven Berler
d81e2d40e6 atomic dual-write tests
refactors so the FakeFile and Verifier classes can be used in multiple
tests and adds a helper function to verify data.

adds new tests similar to the previous atomic write tests, but this time
does a second write in the middle of writing (rather than doing a read
in the middle)
2011-07-07 13:35:17 -07:00
Steven Berler
9279998aa6 fix atomic write test
the interrupt() now shouldn't be getting called extra times
after the file has been read completely
2011-07-07 12:11:41 -07:00
Steven Berler
d65a33421a atomic write test
The atomic write test writes a large file of all A's followed by
overwriting the file with B's. The file is verified (to be either
all A's or all B's) after each write and just before the overwrite
is complete.

The test is performed 3 times, with sizes of 1 MB, 4 MB, and 8 MB.
2011-07-06 17:22:10 -07:00
Yehuda Sadeh
d061f44e74 fix a botched cleanup 2011-06-29 14:14:51 -07:00
Yehuda Sadeh
abcb67dec0 test for 100-continue 2011-06-28 12:49:20 -07:00
Yehuda Sadeh
5412934ec7 multipart tests 2011-06-17 15:12:47 -07:00
Tommi Virtanen
dca19e595a Remove flawed test.
It never tested 3-character bucket names; it was prefixed by
the 30-character uniqueness mechanism. I highly doubt
3-letter bucket names will stay available for very long anyway,
so if this is wanted back, it'll need to avoid the prefix, do
it's own cleanup, and be flagged as not to be executed on
AWS, DreamHost Objects, or any production system; it'll only
work on local dev instances with a clean slate.
2011-06-10 11:53:37 -07:00
Tommi Virtanen
6de4806faa Add tests for alphanumerics as bucket name initial character.
Need to do ugly things to get the bucket prefix logic right,
cleanup manually.

This fills the hole in coverage left by
79d54ac071.
2011-06-10 11:51:18 -07:00
Tommi Virtanen
c4f820fcf0 Remove old rgw bug workaround.
test_bucket_delete_nonowner says rgw works right now.
2011-06-10 11:05:34 -07:00
Tommi Virtanen
9da6d2c87b Use assert_raises, check details of the error. 2011-06-10 10:23:57 -07:00
Tommi Virtanen
279e0fd324 Whitespace cleanup. 2011-06-10 10:21:24 -07:00
Tommi Virtanen
a85204a0e5 Refactor nonexistent bucket tests.
They can use a fixed name, nuke_prefixed_buckets guarantees the
bucket doesn't exist. Use assert_raises and check details of the
error. Move near existing non-existent bucket test.
2011-06-10 10:20:36 -07:00
Tommi Virtanen
c7816632b9 Refactor to share code, hide counter implementation. 2011-06-10 10:15:47 -07:00
Tommi Virtanen
19ac38791c Whitespace cleanup. 2011-06-10 10:11:58 -07:00
Tommi Virtanen
79d54ac071 Remove bucket name initial character tests that gave potentially false positives.
check_good_bucket_name explicitly said it cannot be used to test
the initial character. This is because of cleanup and bucket name
uniqueness limitations.

This leaves a hole in the test coverage: buckets with both letters
and digits as initial characters must work. This needs to be fixed
later.
2011-06-10 10:11:26 -07:00
Tommi Virtanen
138a83c911 Remove dead code. 2011-06-10 09:59:52 -07:00
Tommi Virtanen
35e2b3dec5 Simplify test and output problematic bucket name on failure. 2011-06-10 09:57:41 -07:00
Tommi Virtanen
53596480f2 More tests from Wesley Spikes. 2011-06-10 09:43:18 -07:00
Tommi Virtanen
818523f48c Add a test that uses Key.set_contents_from_file, to trigger 100 Continue. 2011-06-07 10:47:27 -07:00
Colin Patrick McCabe
e8a5077913 s3-tests: add test_object_giveaway
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
2011-05-26 16:26:24 -07:00
Colin Patrick McCabe
75136b58b8 test_s3: fix test_object_set_valid_acl
Fix the XML in test_object_set_valid_acl to work with Amazon.

Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
2011-05-04 15:13:45 -07:00
Colin Patrick McCabe
aca962dac2 test_s3: add test_object_set_valid_acl
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
2011-05-04 12:18:27 -07:00
Yehuda Sadeh
5861b129bc add a test for setting metadata 2011-04-29 11:11:27 -07:00
Yehuda Sadeh
db70e893e5 a few more rgw tests pass now 2011-04-28 16:00:19 -07:00
Tommi Virtanen
3f0828b855 Refactor grant checking to ignore order of grants. 2011-04-18 09:58:10 -07:00
Yehuda Sadeh
344b182260 a few rgw tests work now 2011-04-15 11:41:40 -07:00
Tommi Virtanen
9b39add43f boto set_acl() works on radosgw now.
rgw bug #981 is fixed in commit 6f730af1926f9d4fe5904ac10dbe019c0a6aef8d.

Many tests now fail at the next step; did not file tickets.
2011-04-14 15:40:16 -07:00
Tommi Virtanen
fd323907f9 test_bucket_create_naming_bad_short_empty works on radosgw now.
rgw bug #983 is fixed in commit 5c06fc1c8b4e983acd7f01f7b908ba8f357621b2.
2011-04-13 16:58:23 -07:00
Tommi Virtanen
18185b4826 test_bucket_create_exists works on radosgw now.
rgw bug #978 is fixed in commit 59309b376c5356afd97a2e72f126159d2a4877ba.
2011-04-13 16:22:25 -07:00
Tommi Virtanen
7d6cb51c74 test_bucket_notexist and test_bucket_create_delete work on radosgw now.
rgw bug #976 is fixed in commit fd0290a00ac76bbfe15bb12ee35e54dc58cf074f.
2011-04-13 16:21:58 -07:00
Tommi Virtanen
d62cbf1252 Note down radosgw bugs triggered. 2011-04-05 11:10:49 -07:00