cli put saves files despite errors #1041

Closed
opened 2024-03-12 22:13:16 +00:00 by achuprov · 3 comments
Member

When there's an error, the CLI put command acts like the part of the file it managed to upload is the whole file. The actual file is 7.2 GB, but only 192MB gets uploaded.

Current Behavior

 ./bin/frostfs-cli object put -r s01.frostfs.devenv:8080 --config /home/achuprov/Documents/work/frostfs-dev-env/wallets/conf.yml --file /home/achuprov/Documents/work/frostfs-node/1.mp4 --cid 9SxuafuN25iVT7tFwawTm4QYzUJTnYumXjAyxY8aZsDk --prepare-locally
 204472320 / 3856697054 [=>-------------------------------]   5.30% 1m1s
[/home/achuprov/Documents/work/frostfs-node/1.mp4] Object successfully stored
  OID: Hqkkrc1rc2WprdziWa5AAqNb986vdjcxipzNqZFxhLmK
  CID: 9SxuafuN25iVT7tFwawTm4QYzUJTnYumXjAyxY8aZsDk
  
  
  ./bin/frostfs-cli   object get -r s01.frostfs.devenv:8080 --wallet ./../frostfs-dev-env/wallets/wall
et.json --cid 9SxuafuN25iVT7tFwawTm4QYzUJTnYumXjAyxY8aZsDk  --oid Hqkkrc1rc2WprdziWa5AAqNb986vdjcxipzNqZFxhLmK  --file 4.mp4
Enter password > 
 201326592 / 201326592 [=================================================================================================================] 100.00% 2s
[4.mp4] Object successfully saved
ID: Hqkkrc1rc2WprdziWa5AAqNb986vdjcxipzNqZFxhLmK
CID: 9SxuafuN25iVT7tFwawTm4QYzUJTnYumXjAyxY8aZsDk
Owner: NbUgTSFvPmsRxmGeWpuuGeJUoRoi6PErcM
CreatedAt: 126
Size: 201326592
HomoHash: 3f32f57eaf0284449f156d06d25044d11be70d85d2821473a694f3ef5af9f9f2531575c856b7b8830e65296fc0c9ef6433c63ba9097e9f34978729f4c249c0c1
Checksum: 3fd9d382f95079d9f1531288849bc27ce11abc579990ab195bb236e942cd8424
Type: REGULAR
Attributes:
  FileName=1.mp4
  Timestamp=1710279098 (2024-03-13 00:31:38 +0300 MSK)
ID signature:
  public key: 031a6c6fbbdf02ca351745fa86b9ba5a9452d785ac4f7fc2b7548ca2a46c4fcf4a
  signature: 044a90b77287bdfb03548c5a6087237c1da19edc98aca0fce43e4c9ee575981f80742d0850e20a34b77c698bae412c1c2c8dd0db69877a927315e89e3cb6ec62e8

Steps to Reproduce (for bugs)

I initiated 4 parallel uploads. Most likely, there was a context deadline exceeded error.

Your Environment

  • Version used: frostfs-node master f42a529
When there's an error, the CLI put command acts like the part of the file it managed to upload is the whole file. The actual file is 7.2 GB, but only 192MB gets uploaded. <!-- Provide a general summary of the issue in the Title above --> ## Current Behavior ``` ./bin/frostfs-cli object put -r s01.frostfs.devenv:8080 --config /home/achuprov/Documents/work/frostfs-dev-env/wallets/conf.yml --file /home/achuprov/Documents/work/frostfs-node/1.mp4 --cid 9SxuafuN25iVT7tFwawTm4QYzUJTnYumXjAyxY8aZsDk --prepare-locally 204472320 / 3856697054 [=>-------------------------------] 5.30% 1m1s [/home/achuprov/Documents/work/frostfs-node/1.mp4] Object successfully stored OID: Hqkkrc1rc2WprdziWa5AAqNb986vdjcxipzNqZFxhLmK CID: 9SxuafuN25iVT7tFwawTm4QYzUJTnYumXjAyxY8aZsDk ./bin/frostfs-cli object get -r s01.frostfs.devenv:8080 --wallet ./../frostfs-dev-env/wallets/wall et.json --cid 9SxuafuN25iVT7tFwawTm4QYzUJTnYumXjAyxY8aZsDk --oid Hqkkrc1rc2WprdziWa5AAqNb986vdjcxipzNqZFxhLmK --file 4.mp4 Enter password > 201326592 / 201326592 [=================================================================================================================] 100.00% 2s [4.mp4] Object successfully saved ID: Hqkkrc1rc2WprdziWa5AAqNb986vdjcxipzNqZFxhLmK CID: 9SxuafuN25iVT7tFwawTm4QYzUJTnYumXjAyxY8aZsDk Owner: NbUgTSFvPmsRxmGeWpuuGeJUoRoi6PErcM CreatedAt: 126 Size: 201326592 HomoHash: 3f32f57eaf0284449f156d06d25044d11be70d85d2821473a694f3ef5af9f9f2531575c856b7b8830e65296fc0c9ef6433c63ba9097e9f34978729f4c249c0c1 Checksum: 3fd9d382f95079d9f1531288849bc27ce11abc579990ab195bb236e942cd8424 Type: REGULAR Attributes: FileName=1.mp4 Timestamp=1710279098 (2024-03-13 00:31:38 +0300 MSK) ID signature: public key: 031a6c6fbbdf02ca351745fa86b9ba5a9452d785ac4f7fc2b7548ca2a46c4fcf4a signature: 044a90b77287bdfb03548c5a6087237c1da19edc98aca0fce43e4c9ee575981f80742d0850e20a34b77c698bae412c1c2c8dd0db69877a927315e89e3cb6ec62e8 ``` ## Steps to Reproduce (for bugs) <!-- Provide a link to a live example, or an unambiguous set of steps to reproduce this bug. --> I initiated 4 parallel uploads. Most likely, there was a `context deadline exceeded` error. ## Your Environment <!-- Include as many relevant details about the environment you experienced the bug in --> * Version used: frostfs-node master f42a529
achuprov added the
bug
triage
labels 2024-03-12 22:13:16 +00:00
achuprov was assigned by fyrchik 2024-03-13 07:02:14 +00:00
Owner

Do we only have this for --prepare-locally flag?

Do we only have this for `--prepare-locally` flag?
Author
Member

Yes, the bug only manifests with the --prepare-locally flag.

Yes, the bug only manifests with the --prepare-locally flag.
fyrchik added this to the v0.39.0 milestone 2024-03-28 08:33:46 +00:00
Author
Member

Close via 4738508ce2

Close via 4738508ce2
Sign in to join this conversation.
No milestone
No project
No assignees
2 participants
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: TrueCloudLab/frostfs-node#1041
No description provided.