Commit graph

10 commits

Author SHA1 Message Date
Tommi Virtanen
99dcf267ea Cleanup: non-Python semicolon infection. 2011-07-11 13:29:36 -07:00
Tommi Virtanen
3fe595abd4 Whitespace cleanup. 2011-07-11 13:29:35 -07:00
Tommi Virtanen
e91a3aea66 Pyflakes cleanup. 2011-07-11 13:29:35 -07:00
Tommi Virtanen
012b94f8ee Typo. 2011-07-11 11:54:04 -07:00
Wesley Spikes
90d0f06522 Removing dead code (generate_objects:connect_s3) 2011-07-08 15:04:22 -07:00
Kyle Marsh
e5f9783053 dho-qa: disentangle file generation from uploading
Static load test script now provides separate functions for generating a
list of random-file pointers and uploading those files to an S3 store.  When
run as a script it still does both, but you can call each function
individually from a different script after loading the module.
2011-07-08 14:41:41 -07:00
Steven Berler
a1e5c50dc6 dho qa: rand_readwrite
Adds the rand_readwrite utility.
Updates realistic.py with a file verifier class.
Updates generate_objects.py to allow the filename seed to be set.
2011-07-08 13:14:49 -07:00
Kyle Marsh
a4e5be5f41 dho-qa: static file generator updated to use common
Updated generate_objects.py to use Wes's common setup and configuration
stuff.  Can still override config on the command line.
2011-07-08 11:27:56 -07:00
Kyle Marsh
951dc0fcdb dho-qa: Add siege config file and document running siege
Adds siege.conf file for siege configuration options
Adds docstring to main function in generate_objects.py describing how to run
the static content load test.
2011-07-08 11:27:56 -07:00
Kyle Marsh
3a3cbb3d25 DHO QA: Random Object Generation Script
Script to generate garbage objects and push them to a bucket.

Script takes a config file on the command line (and some other command line
options using optparse) and generates a bunch of objects in an S3 bucket.
Also prints public URLs to stdout.

Number and sizes of the objects are determined by a yaml config file with each line
looking like this:
- [A, B, C]
A: Number of files in this group
B: Mean size of files in this group (in bytes)
C: Standard deviation (normal distribution) of file sizes in this group

command line options are:
 - S3 access key
 - S3 secret key
 - seed for PRNG
 - output file to write URLs to
 - flag to add md5 checksum to url list
2011-07-08 11:27:56 -07:00