`cli put` saves files despite errors #1041

New Issue

Closed

opened 2024-03-12 22:13:16 +00:00 by achuprov · 3 comments

achuprov commented

2024-03-12 22:13:16 +00:00

Collaborator

When there's an error, the CLI put command acts like the part of the file it managed to upload is the whole file. The actual file is 7.2 GB, but only 192MB gets uploaded.

Current Behavior

 ./bin/frostfs-cli object put -r s01.frostfs.devenv:8080 --config /home/achuprov/Documents/work/frostfs-dev-env/wallets/conf.yml --file /home/achuprov/Documents/work/frostfs-node/1.mp4 --cid 9SxuafuN25iVT7tFwawTm4QYzUJTnYumXjAyxY8aZsDk --prepare-locally
 204472320 / 3856697054 [=>-------------------------------]   5.30% 1m1s
[/home/achuprov/Documents/work/frostfs-node/1.mp4] Object successfully stored
  OID: Hqkkrc1rc2WprdziWa5AAqNb986vdjcxipzNqZFxhLmK
  CID: 9SxuafuN25iVT7tFwawTm4QYzUJTnYumXjAyxY8aZsDk
  
  
  ./bin/frostfs-cli   object get -r s01.frostfs.devenv:8080 --wallet ./../frostfs-dev-env/wallets/wall
et.json --cid 9SxuafuN25iVT7tFwawTm4QYzUJTnYumXjAyxY8aZsDk  --oid Hqkkrc1rc2WprdziWa5AAqNb986vdjcxipzNqZFxhLmK  --file 4.mp4
Enter password > 
 201326592 / 201326592 [=================================================================================================================] 100.00% 2s
[4.mp4] Object successfully saved
ID: Hqkkrc1rc2WprdziWa5AAqNb986vdjcxipzNqZFxhLmK
CID: 9SxuafuN25iVT7tFwawTm4QYzUJTnYumXjAyxY8aZsDk
Owner: NbUgTSFvPmsRxmGeWpuuGeJUoRoi6PErcM
CreatedAt: 126
Size: 201326592
HomoHash: 3f32f57eaf0284449f156d06d25044d11be70d85d2821473a694f3ef5af9f9f2531575c856b7b8830e65296fc0c9ef6433c63ba9097e9f34978729f4c249c0c1
Checksum: 3fd9d382f95079d9f1531288849bc27ce11abc579990ab195bb236e942cd8424
Type: REGULAR
Attributes:
  FileName=1.mp4
  Timestamp=1710279098 (2024-03-13 00:31:38 +0300 MSK)
ID signature:
  public key: 031a6c6fbbdf02ca351745fa86b9ba5a9452d785ac4f7fc2b7548ca2a46c4fcf4a
  signature: 044a90b77287bdfb03548c5a6087237c1da19edc98aca0fce43e4c9ee575981f80742d0850e20a34b77c698bae412c1c2c8dd0db69877a927315e89e3cb6ec62e8

Steps to Reproduce (for bugs)

I initiated 4 parallel uploads. Most likely, there was a context deadline exceeded error.

Your Environment

Version used: frostfs-node master f42a529

When there's an error, the CLI put command acts like the part of the file it managed to upload is the whole file. The actual file is 7.2 GB, but only 192MB gets uploaded.  ## Current Behavior ``` ./bin/frostfs-cli object put -r s01.frostfs.devenv:8080 --config /home/achuprov/Documents/work/frostfs-dev-env/wallets/conf.yml --file /home/achuprov/Documents/work/frostfs-node/1.mp4 --cid 9SxuafuN25iVT7tFwawTm4QYzUJTnYumXjAyxY8aZsDk --prepare-locally 204472320 / 3856697054 [=>-------------------------------] 5.30% 1m1s [/home/achuprov/Documents/work/frostfs-node/1.mp4] Object successfully stored OID: Hqkkrc1rc2WprdziWa5AAqNb986vdjcxipzNqZFxhLmK CID: 9SxuafuN25iVT7tFwawTm4QYzUJTnYumXjAyxY8aZsDk ./bin/frostfs-cli object get -r s01.frostfs.devenv:8080 --wallet ./../frostfs-dev-env/wallets/wall et.json --cid 9SxuafuN25iVT7tFwawTm4QYzUJTnYumXjAyxY8aZsDk --oid Hqkkrc1rc2WprdziWa5AAqNb986vdjcxipzNqZFxhLmK --file 4.mp4 Enter password > 201326592 / 201326592 [=================================================================================================================] 100.00% 2s [4.mp4] Object successfully saved ID: Hqkkrc1rc2WprdziWa5AAqNb986vdjcxipzNqZFxhLmK CID: 9SxuafuN25iVT7tFwawTm4QYzUJTnYumXjAyxY8aZsDk Owner: NbUgTSFvPmsRxmGeWpuuGeJUoRoi6PErcM CreatedAt: 126 Size: 201326592 HomoHash: 3f32f57eaf0284449f156d06d25044d11be70d85d2821473a694f3ef5af9f9f2531575c856b7b8830e65296fc0c9ef6433c63ba9097e9f34978729f4c249c0c1 Checksum: 3fd9d382f95079d9f1531288849bc27ce11abc579990ab195bb236e942cd8424 Type: REGULAR Attributes: FileName=1.mp4 Timestamp=1710279098 (2024-03-13 00:31:38 +0300 MSK) ID signature: public key: 031a6c6fbbdf02ca351745fa86b9ba5a9452d785ac4f7fc2b7548ca2a46c4fcf4a signature: 044a90b77287bdfb03548c5a6087237c1da19edc98aca0fce43e4c9ee575981f80742d0850e20a34b77c698bae412c1c2c8dd0db69877a927315e89e3cb6ec62e8 ``` ## Steps to Reproduce (for bugs)  I initiated 4 parallel uploads. Most likely, there was a `context deadline exceeded` error. ## Your Environment  * Version used: frostfs-node master f42a529