Wesley Spikes
ce6c57841a
Now that we no longer have the need to retry, get rid of that logic.
...
Also fix a typo -- s/neads_first_read/needs_first_read/
2011-07-18 16:15:40 -07:00
Wesley Spikes
c154d98b96
Resolve the random AssertionError
...
By doing a copy-new on the key, it seems to work around the random
AssertionError's I've been seeing. Here's hoping this fully
resolves it.
2011-07-18 16:15:40 -07:00
Wesley Spikes
44cb2f256e
Adding unlimited=bool to files_varied -- if set to true, it will never issue StopIteration
2011-07-18 16:15:40 -07:00
Wesley Spikes
43b2f8695d
Cleanup output just a little bit more.
2011-07-18 16:15:40 -07:00
Wesley Spikes
841b098619
Refactor/cleanup TransferResults class. Also cleans the output to be in the format TV seems to want.
2011-07-18 16:15:40 -07:00
Wesley Spikes
3c07a4a363
Update roundtrip._main -- while loop should auto-replenish all pools,
...
and not ones so named.
2011-07-18 16:15:40 -07:00
Wesley Spikes
fb8f110e69
Add assert to RandomContentFile, ensure size >= digest_size
...
It clearly will not work to have the size smaller than the digest
size, so we shouldn't allow it.
2011-07-18 16:15:40 -07:00
Wesley Spikes
d0bb148dea
Rename _call_doit to _real_run -- it's a bit more clear that way, IMHO
2011-07-18 16:15:40 -07:00
Stephon Striplin
5136608e76
fix test_bucket_acl_grant_nonexist_user
...
* Change user_id to avoid name conflict
* Check for error_code
2011-07-15 14:57:46 -07:00
Stephon Striplin
03a80e6121
add acl grant userid tests
...
* Refactor some acl grant user_id code and run through the full suite of
acls
2011-07-15 14:34:08 -07:00
Wesley Spikes
653c2b2200
Adding new testing tool, roundtrip
2011-07-15 12:06:02 -07:00
Wesley Spikes
6afc7fdcdb
Adding last_read to RandomContentFile and first_write to FileVerifier, so we can measure latency.
2011-07-15 12:05:02 -07:00
Wesley Spikes
12716d854b
Adding generator files_varied to s3tests.realistic
...
Given a tuple of tuples, construct several files() generators, and
yield from those randomly. Randomness is weighted based on the number
of files remaining in each group.
2011-07-15 12:03:23 -07:00
Wesley Spikes
4959c5e1a4
Work-around for RGW failing to send IsTruncated on listing all keys.
...
Without this, it fails to delete the bucket when there's more than 1000 keys.
2011-07-15 11:47:57 -07:00
Wesley Spikes
b6e0287810
Add context, get_next_key, and fill_pools to s3tests.common
...
context is a generic Bunch that we can store items in to be shared
across modules, without invoking the wrath of the globals -- yuck!
get_next_key will generate a sequentially numbered key for us to use
fill_pools will take a variable list of gevent.pool.Pool objects and
top them all off
2011-07-15 11:45:38 -07:00
Wesley Spikes
298bc99c5d
Packagify s3tests.common so we can add more magic into it later.
2011-07-15 11:44:05 -07:00
Wesley Spikes
e4effe5479
realistic.names shouldn't return a 0-length filename
2011-07-15 11:08:38 -07:00
Yehuda Sadeh
3303b0f33b
fix 100-continue test to support https
2011-07-14 16:26:46 -07:00
Steven Berler
c312832c70
use time.time() instead of time.clock()
...
We want to measure actual time, not cpu time.
2011-07-14 11:40:26 -07:00
Kyle Marsh
3d13883f62
dhq-qa: remove query auth from generated urls
...
Object generation for static load testing now sets the ACL on the test
bucket and keys to 'public-read' so we don't need an expiring, temp url.
2011-07-14 11:37:54 -07:00
Steven Berler
7b51f55a1b
fix zero devision error in readwrite test
...
Was dividing by 0 if somehow it managed to upload or download a file
in under .01 seconds.
2011-07-14 11:00:48 -07:00
Steven Berler
91c4f88860
fix random file verifier with small files
...
The file verifier will now correctly verify small files (smaller than
the md5 digest size), as long as the data that is there matches what
the digest would be.
2011-07-13 15:59:38 -07:00
Tommi Virtanen
91a39caf46
Fix bug where prefix was None.
...
Accessing a non-constant global from another module is tricky,
as the import binds to the original object. Rebinding the name
in the original module does not change it in importers. Use a
getter as a quick workaround.
2011-07-13 14:49:07 -07:00
Tommi Virtanen
02a4c82dfa
Make generate_objects.py and rand_readwrite.py inside the package.
...
Handle dependencies properly. Now e.g. "./bootstrap &&
./virtualenv/bin/s3tests-test-readwrite" should just work.
2011-07-13 13:52:54 -07:00
Tommi Virtanen
33b25c577e
Move setup/teardown into s3tests.functional __init__, to share across modules.
2011-07-11 15:24:39 -07:00
Tommi Virtanen
e9ad6f7ee6
Move test_s3 into s3tests.functional, so it can be split to multiple files nicely.
2011-07-11 15:24:39 -07:00
Stephon Striplin
e253e328a7
remove unused variable
2011-07-11 14:57:46 -07:00
Stephon Striplin
83830e2951
add xml-based acl tests
2011-07-11 14:22:31 -07:00
Stephon Striplin
cd84d65e9c
add test_object_acl_* and test_bucket_acl_* tests
2011-07-11 14:22:31 -07:00
Stephon Striplin
f929069189
add several test_object_set_get_metadata_* tests
2011-07-11 14:22:31 -07:00
Stephon Striplin
bb3f214369
add test_object_set_get_metadata_empty
2011-07-11 14:20:14 -07:00
Stephon Striplin
bbbe6c45c3
add test_object_copy_not_owned_bucket
2011-07-11 14:18:46 -07:00
Stephon Striplin
1132698605
add test_bucket_delete_nonempty
2011-07-11 14:18:46 -07:00
Tommi Virtanen
c4f95efc70
Cleanup: remove unneeded parens.
2011-07-11 13:29:36 -07:00
Tommi Virtanen
9600fd10d9
Cleanup: avoid using "file" as identifier.
2011-07-11 13:29:36 -07:00
Tommi Virtanen
c07409ef6e
Cleanup: no need to listify sum() input.
2011-07-11 13:29:36 -07:00
Tommi Virtanen
deb898161b
Cleanup: don't look before you leap.
2011-07-11 13:29:36 -07:00
Tommi Virtanen
016febc40a
Cleanup: new-style raise.
2011-07-11 13:29:36 -07:00
Tommi Virtanen
99dcf267ea
Cleanup: non-Python semicolon infection.
2011-07-11 13:29:36 -07:00
Tommi Virtanen
21893e51b3
Cleanup: has_key is deprecated.
2011-07-11 13:29:36 -07:00
Tommi Virtanen
3fe595abd4
Whitespace cleanup.
2011-07-11 13:29:35 -07:00
Tommi Virtanen
e91a3aea66
Pyflakes cleanup.
2011-07-11 13:29:35 -07:00
Kyle Marsh
31d9032ea5
remove generate_objects.conf
...
generate_objects.conf is obsolete; its functionality is now part of
config.yml in the file_generation.groups section.
2011-07-11 13:11:05 -07:00
Tommi Virtanen
012b94f8ee
Typo.
2011-07-11 11:54:04 -07:00
Tommi Virtanen
81be846c3c
Do pseudorandom string generation 1 MB at a time.
...
This gives it a ~10x speedup.
2011-07-11 11:53:49 -07:00
Tommi Virtanen
2edd78ebbc
Merge remote branch 'newdream/utilities'
2011-07-11 11:53:31 -07:00
Wesley Spikes
90d0f06522
Removing dead code (generate_objects:connect_s3)
2011-07-08 15:04:22 -07:00
Steven Berler
99ef831a0d
dho qa: update rand readwrite for file generator
...
Now works correctly again after the changes to the random file
generator. Also now gets the true size of files when generating
using a stddev != 0 (rather than just assuming all files were
the mean size).
2011-07-08 14:52:22 -07:00
Kyle Marsh
e5f9783053
dho-qa: disentangle file generation from uploading
...
Static load test script now provides separate functions for generating a
list of random-file pointers and uploading those files to an S3 store. When
run as a script it still does both, but you can call each function
individually from a different script after loading the module.
2011-07-08 14:41:41 -07:00
Steven Berler
88c9b56c8b
Revert "atomic read tests"
...
This reverts commit c75fb48e81
2011-07-08 14:15:47 -07:00
