TrueCloudLab/distribution
13
0
Fork 3
Code Issues 2 Pull requests Projects Releases 2 Packages Wiki Activity Actions
671 commits 2 branches 61 tags 129 MiB
Commit graph

163 commits

Author SHA1 Message Date
Aaron Schlesinger
091ad89197 Remove the example 
Instead, direct users to the one in the factory package

Signed-off-by: Aaron Schlesinger <aschlesinger@deis.com>
 2016-03-29 14:42:28 -07:00
Aaron Schlesinger
0f09bcd16a Add documentation for how to register new StorageDrivers 
This commit adds context-specific documentation on StorageDriver,
StorageDriverFactory, and the factory’s Register func, explaining how
the internal registration mechanism should be used.

This documentation follows from the thread starting at
https://github.com/deis/builder/pull/262/files#r56720200.

cc/ @stevvooe

Signed-off-by: Aaron Schlesinger <aschlesinger@deis.com>
 2016-03-29 14:42:19 -07:00
Richard Scothern
e7ad3ced86 Merge pull request #1532 from RichardScothern/azure-error-types 
Update missing blob error checking with latest Azure API
 2016-03-15 10:08:36 -07:00
Richard Scothern
98140ca0ab Update missing blob error checking with latest Azure API 
Signed-off-by: Richard Scothern <richard.scothern@docker.com>
 2016-03-14 15:59:03 -07:00
Matt Duch
789c90ac42 registry/storage/driver/s3-aws kms support 
Signed-off-by: Matt Duch <matt@learnmetrics.com>
 2016-03-11 17:19:01 -06:00
Brian Bland
4c2edee417 Merge pull request #1438 from BrianBland/newStorageDriverWriter 
Adds new StorageDriver.FileWriter interface
 2016-03-11 15:06:07 -08:00
Brian Bland
eea043dc7b Removes ceph rados driver in favor of Swift API gateway support 
Signed-off-by: Brian Bland <brian.bland@docker.com>
 2016-03-10 16:49:08 -08:00
Keerthan Mala
19cfa36ec8 Added support to specifiy custom endpoint 
Signed-off-by: Keerthan Reddy Mala <keerthan.mala@gmail.com>
 2016-03-09 16:12:20 -07:00
Brian Bland
490a2f5a55 Updates Swift driver to support new storagedriver.FileWriter interface 
Signed-off-by: Brian Bland <brian.bland@docker.com>
 2016-03-08 16:38:39 -08:00
Li Yi
5b48c81545 Support FileWriter interface for OSS storage driver 
Change-Id: Ie5533ad85f944800499ca1040fd67bf1378815e0
Signed-off-by: Li Yi <denverdino@gmail.com>
 2016-03-08 16:38:39 -08:00
Arthur Baars
9432b18e30 Storagedriver: GCS: add chunksize parameter 
Signed-off-by: Arthur Baars <arthur@semmle.com>
 2016-03-08 16:38:39 -08:00
Arthur Baars
115a6e5803 Storagedriver: GCS: implement resumable uploads 
Signed-off-by: Arthur Baars <arthur@semmle.com>
 2016-03-08 16:38:39 -08:00
Arthur Baars
34891eb7ab StorageDriver: Testsuite: call Close before getting Size 
Signed-off-by: Arthur Baars <arthur@semmle.com>
 2016-03-08 16:38:38 -08:00
Brian Bland
c69c8a3286 Adds new storagedriver.FileWriter interface 
Updates registry storage code to use this for better resumable writes.
Implements this interface for the following drivers:
 + Inmemory
 + Filesystem
 + S3
 + Azure

Signed-off-by: Brian Bland <brian.bland@docker.com>
 2016-03-08 16:37:44 -08:00
Aaron Lehmann
5ca3b61609 Fix two misspellings in source code comments 
Signed-off-by: Aaron Lehmann <aaron.lehmann@docker.com>
 2016-03-08 15:13:24 -08:00
Brian Bland
2494c28e1f [driver/s3aws] Update s3aws driver parameter parsing to match s3goamz 
Mirrors changes from #1414 into the newer driver

Signed-off-by: Brian Bland <brian.bland@docker.com>
 2016-03-07 11:52:34 -08:00
Richard Scothern
becdd83131 Merge pull request #1388 from aibaars/gcs-simplify-move 
StorageDriver: GCS: remove support for directory Moves
 2016-03-03 10:20:51 -08:00
Arthur Baars
396a73deb7 StorageDriver: GCS: remove support for directory Moves 
The Move operation is only used to move uploaded blobs
to their final destination. There is no point in implementing
Move on "folders". Apart from simplifying the code, this also
saves an HTTP request.

Signed-off-by: Arthur Baars <arthur@semmle.com>
 2016-03-03 13:28:13 +00:00
Stefan Weil
d16f3046c6 Fix some typos in comments and strings 
All of them were found and fixed by codespell.

Signed-off-by: Stefan Weil <sw@weilnetz.de>
 2016-02-23 22:33:38 +01:00
Anton Tiurin
2e8244822c Fix description of StorageDriver.WriteStream 
Offset can be more than CurrentSize as long as this case is checked
by DriverSuite.testContinueStreamAppend.

Signed-off-by: Anton Tiurin <noxiouz@yandex.ru>
 2016-02-17 13:57:20 +03:00
Brian Bland
c6871737bc [driver/s3aws] Fix TestStorageClass 
Fixes bug in TestStorageClass for s3aws driver where the "standard" file
was checked for reduced-redundnancy storage.

Signed-off-by: Brian Bland <brian.bland@docker.com>
 2016-02-16 17:50:55 -08:00
Brian Bland
881ef1096f Merge pull request #1385 from BrianBland/s3UseAWSLibrary 
[driver/s3] Use aws/aws-sdk-go instead of goamz for s3 driver and cloudfront
 2016-02-16 11:19:15 -08:00
liuchang0812
7ca24a7f5a fix gofmt 
Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
 2016-02-16 11:42:09 +08:00
liuchang0812
ad6a0735d2 closes #1461, enhance log message of oss driver 
Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
 2016-02-16 11:17:09 +08:00
Brian Bland
d5a38e4c5f Adds new s3 driver using aws-sdk-go instead of goamz 
Keeps old s3 driver, renames to s3goamz, registers new s3 driver as both
"s3" and "s3aws"

Changes cloudfront middleware to use aws-sdk-go

Signed-off-by: Brian Bland <brian.bland@docker.com>
 2016-02-12 15:59:26 -08:00
Aaron Lehmann
f77c82ebb3 Typo fixes in comments 
Correct spelling of words in source code comments.

Signed-off-by: Aaron Lehmann <aaron.lehmann@docker.com>
 2016-02-10 16:26:29 -08:00
Brian Bland
4bb5f80885 Improves flexibility of configuration handling for S3 driver 
Treats nil parameters the same as unprovided parameters (fixes issues
where certain parameters are printed to "<nil>").
Accepts "true" and "false" string values for boolean parameters.

Signed-off-by: Brian Bland <brian.bland@docker.com>
 2016-02-09 17:27:16 -08:00
Richard Scothern
def3e430bb Merge pull request #1401 from BrianBland/s3StorageClass 
Adds "storageclass" configuration parameter for S3 driver.
 2016-02-04 16:44:13 -08:00
yuzou
95b9c7281b read the actual number of bytes according to the initial size. 
Signed-off-by: yuzou <zouyu7@huawei.com>
 2016-02-04 16:14:35 +08:00
Brian Bland
a2ade36ecf Adds test for S3 storage class configuration option 
Signed-off-by: Brian Bland <brian.bland@docker.com>
 2016-02-01 16:01:55 -08:00
Brian Bland
8e7910826e Adds "storageclass" configuration parameter for S3 driver. 
Defaults to STANDARD, also supports REDUCED_REDUNDANCY.

Signed-off-by: Brian Bland <brian.bland@docker.com>
 2016-02-01 16:01:19 -08:00
Aaron Lehmann
6417c05a27 Merge pull request #1381 from BrianBland/s3CustomUAString 
Adds custom registry User-Agent header to s3 HTTP requests
 2016-02-01 15:40:36 -08:00
Brian Bland
f41a408e34 Adds custom registry User-Agent header to s3 HTTP requests 
Uses docker/goamz instead of AdRoll/goamz

Adds a registry UA string param to the storage parameters when
constructing the storage driver for the registry App.
This could be used by other storage drivers as well

Signed-off-by: Brian Bland <brian.bland@docker.com>
 2016-02-01 13:43:46 -08:00
Arthur Baars
59a9607783 StorageDriver: GCS: retry all api calls 
Signed-off-by: Arthur Baars <arthur@semmle.com>
 2016-01-20 13:24:09 +00:00
Arthur Baars
ffc9527782 StorageDriver: Test suite: improve cleanup 
Verify that the file(s) have been deleted after calling Delete,
and retry if this is not the case. Furthermore, report the error
if a Delete operation fails.

Signed-off-by: Arthur Baars <arthur@semmle.com>
 2016-01-20 13:24:09 +00:00
Richard Scothern
b2876674f3 Merge pull request #1355 from hopkings2008/master 
In testsuites.go, enlarge the size of randomBytes to 128M to fix the …
 2016-01-18 12:38:26 -08:00
Arthur Baars
985c0d602f StorageDriver GCS: try google.DefaultTokenSource first 
Signed-off-by: Arthur Baars <arthur@semmle.com>
 2016-01-15 11:47:47 +00:00
yuzou
d3d9282a30 In testsuites.go, enlarge the size of randomBytes to 128M to fix the crash of running TestConcurrentStreamReads 
Signed-off-by: yuzou <zouyu7@huawei.com>
 2016-01-15 17:22:43 +08:00
Richard Scothern
5d35fa34c1 Change the parameters to the GCS drivers to allow CircleCI testing. 
Remove the requirement of file system access to run GCS unit tests.  Deconstruct
the input parameters to take the private key and email which can be specified on
the build system via environment variables.

Signed-off-by: Richard Scothern <richard.scothern@gmail.com>
 2016-01-13 18:00:59 -08:00
Richard Scothern
e5e0e2cc2a Merge pull request #1276 from denverdino/oss-test 
Support large layer for OSS driver
 2016-01-08 13:26:09 -08:00
Richard Scothern
6a248e115b Merge pull request #1321 from aibaars/gcs-fix-retry 
GCS storage driver: fix retry function
 2016-01-06 12:00:12 -08:00
Arthur Baars
5c6fdc710f GCS Storagedriver: fix test failure caused by #1187 
Signed-off-by: Arthur Baars <arthur@semmle.com>
 2016-01-06 18:36:28 +00:00
Arthur Baars
bf1e41a9f2 GCS driver: fix retry function 
Signed-off-by: Arthur Baars <arthur@semmle.com>
 2016-01-06 17:57:22 +00:00
weiyuan.yl
5dc714b347 Replace 404 to http.StatusNotFound 
Change-Id: Ia100975cb93c0a6d94ea5542b1c9ce386bc87649
Signed-off-by: weiyuan.yl <weiyuan.yl@alibaba-inc.com>
 2015-12-29 12:09:04 +08:00
Brian Bland
165507a622 Relaxes filesystem driver permissions to 0777 (dirs) and 0666 (files) 
Leaves any further permissions restrictions to the process umask

Signed-off-by: Brian Bland <brian.bland@docker.com>
 2015-12-28 15:22:28 -08:00
weiyuan.yl
dc6944d91d In HEAD request for missing resource, only 404 NOT FOUND is returned 
Change-Id: I73caf67b59519e6f4f82f7d78f5d4fd4ad9affcd
Signed-off-by: weiyuan.yl <weiyuan.yl@alibaba-inc.com>
 2015-12-28 11:28:42 +08:00
Li Yi
cfd2f03920 Support large layer for OSS driver 
Signed-off-by: Li Yi <denverdino@gmail.com>
 2015-12-11 10:56:50 +08:00
Richard Scothern
e6363e8a20 Merge pull request #1187 from stevvooe/check-storage-drivers-list-path-not-found 
[WIP] registry/storage/driver: checking that non-existent path returns PathNotFoundError
 2015-12-08 16:32:02 -08:00
Stephen J Day
d68acc869e storage/driver/s3: adjust s3 driver to return unmunged path 
This fixes both the s3 driver and the oss driver to return the unmunged path
when returning errors.

Signed-off-by: Stephen J Day <stephen.day@docker.com>
 2015-12-08 15:48:55 -08:00
Stephen Day
3032cd2aa9 Merge pull request #1246 from stevvooe/decrease-driver-testsuite-allocations 
storage/driver: decrease memory allocation done during testsuite
 2015-12-08 14:52:59 -08:00