3222 commits

Author	SHA1	Message	Date
Dmitrii Stepanov	7a36729dcd	[#1334] metabase: Add upgrade from v2 to v3 ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-27 16:26:19 +03:00
Evgenii Stratonikov	5e9a97fd3e	[#1336] go.mod: Update api-go and sdk-go ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-08-27 14:48:43 +03:00
Evgenii Stratonikov	806ea37101	[#1328] pilorama: Do not skip items in SortedByFilename ... Benchmark results: ``` goos: linux goarch: amd64 pkg: git.frostfs.info/TrueCloudLab/frostfs-node/pkg/local_object_storage/pilorama cpu: 11th Gen Intel(R) Core(TM) i5-1135G7 @ 2.40GHz │ old │ new │ │ sec/op │ sec/op vs base │ ForestSortedIteration/bbolt,root-8 207.2µ ± 6% 173.6µ ± 6% -16.23% (p=0.000 n=10) ForestSortedIteration/bbolt,leaf-8 3.910µ ± 5% 3.928µ ± 7% ~ (p=0.529 n=10) geomean 28.46µ 26.11µ -8.27% ``` They are not representative, as the worst case is when we have multiple items of different lengths. However, `FileName` is usually less than 100 in practice, so the asymptotics is the same. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-08-26 06:11:32 +00:00
Evgenii Stratonikov	80099d9a2f	[#1328] pilorama: Add tricky test for SortedByFilename ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-08-26 06:11:32 +00:00
Dmitrii Stepanov	bd24beecf8	[#1329] putSvc: Reset SuccessAfter for non-EC objects in EC container broadcasting ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-23 13:51:16 +03:00
Dmitrii Stepanov	76f67ea34e	[#1323] metabase: Bump version ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-22 08:21:40 +00:00
Dmitrii Stepanov	7d0d781db1	[#1323] metabase: Drop user attribute index ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-22 08:21:40 +00:00
Dmitrii Stepanov	0f08a2efba	[#1323] metabase: Resolve funlen linter ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-22 08:21:40 +00:00
Dmitrii Stepanov	7bf20c9f1f	[#1323] metabase: Add expiration epoch buckets ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-22 08:21:40 +00:00
Dmitrii Stepanov	2542d4f5df	[#1323] metabase: Drop payload checksum index ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-22 08:21:40 +00:00
Dmitrii Stepanov	15dae8685e	[#1323] metabase: Drop ownerID index ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-22 08:21:40 +00:00
Evgenii Stratonikov	7bca428db0	[#1322] Use new protobuf marshaler ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-08-22 07:17:41 +00:00
Ekaterina Lebedeva	a345c972bf	[#1316] lint: Fix warnings ... Renamed parameters `min/max` to avoid conflicts with predeclared identifiers. Replaced background context with parent context without cancellation in closer functions in frostfs-node. Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2024-08-21 18:18:25 +03:00
Anton Nikiforov	cfda9003a7	[#1318] meta: Add test TestInhumeECObject ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-08-20 16:21:27 +03:00
Anton Nikiforov	6ff0b0996b	[#1318] metrics: Fix container_size_bytes for EC ... When node put chunk into EC container, `policer` may remove it as redundant. This chunk marked as removed. When parent object removed and `gc` start iterating over chunk, node count removing chunk twice. Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-08-20 15:33:28 +03:00
Anton Nikiforov	8319b59238	[#1318] Fix gofumpt issue ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-08-20 14:34:54 +03:00
Dmitrii Stepanov	b7acb34fa4	[#1319] treeSvc: Do not wrap error from APE ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-19 18:38:27 +03:00
Airat Arifullin	eeab417dcf	[#1307] object: Add APE check for Patch handler ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-08-16 14:13:09 +00:00
Airat Arifullin	e890f1b4b1	[#1307] object: Implement Patch method ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-08-16 14:13:09 +00:00
Airat Arifullin	a4a1c3f18b	[#1307] go.mod: Bump frostfs-sdk-go/frostfs-api-go/v2 versions ... * Also, resolve dependencies and conflicts for object service by creating stub for `Patch` method. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-08-16 14:13:09 +00:00
Ekaterina Lebedeva	ec1509de4e	[#1262] sdnotify: Send system monotonic time on reload ... The synchronized service reload protocol added in systemd version 253 requires that the service provides a MONOTONIC_USEC field alongside the RELOADING=1 notification message for synchronization purposes. The value carried in this field must be the system CLOCK_MONOTONIC timestamp at the time the notification message was generated as systemd compares it to other CLOCK_MONOTONIC timestamps taken by pid1. Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2024-08-16 12:05:31 +03:00
Ekaterina Lebedeva	5da41f1fe5	Revert "[#1262] sdnotify: Get rid of go:linkname for nanotime" ... This reverts commit 327d364f34. Reverted due to the problem with reload signal sent by systemd. `frostfs-ir` service reconfigures correctly and service's statuses are being reported to systemd. However, since we replaced `go:linkname` & `nanotime()` with `time.Since()`, systemd refuses to accept reload signal response from `frostfs-ir`. To maintain correct behaviour it was decided to revevrt systemd-related changes until a better solution is found. Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2024-08-15 16:54:45 +03:00
Ekaterina Lebedeva	d055168e2a	[#1135] ir: Add healthstatus RECONFIGURING ... Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2024-08-15 16:54:45 +03:00
Dmitrii Stepanov	80ce7c3a00	[#1284] shard: Resolve funlen linter ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-09 13:23:35 +03:00
Dmitrii Stepanov	93d63e1632	[#1284] writecache: Allow to seal writecache async ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-09 13:23:35 +03:00
Dmitrii Stepanov	68029d756e	[#1302] writecache: Allow to specify custom page size ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-09 12:12:07 +03:00
Dmitrii Stepanov	fa82854af4	[#1302] writecache: Add put->flush->put benchmark ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-09 12:12:07 +03:00
Dmitrii Stepanov	c985b1198f	[#1302] putSvc: Override SuccessAfter for non-regular objects in EC containers ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-09 10:42:55 +03:00
Dmitrii Stepanov	08b1f18bca	[#1296] writecache: Add count limit ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-09 06:30:32 +00:00
Dmitrii Stepanov	36efccd862	[#1298] writecache: Add shrink flag for Seal command ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-08 16:32:29 +03:00
Dmitrii Stepanov	5c01bd5be8	[#1298] writecache: Add restore-mode flag for Seal command ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-07 11:20:14 +03:00
Dmitrii Stepanov	8e51d7849a	[#1295] getSvc: Assemble complex EC object headers without linking object ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-06 16:48:12 +03:00
Dmitrii Stepanov	10602b55b1	[#1295] engine: Resolve funlen linter ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-06 09:45:47 +03:00
Dmitrii Stepanov	eeca796d2e	[#1295] engine: Log object address in case of error ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-06 09:45:43 +03:00
Ekaterina Lebedeva	327d364f34	[#1262] sdnotify: Get rid of go:linkname for nanotime ... Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2024-08-05 12:37:16 +00:00
Dmitrii Stepanov	dc3dcabadc	[#1291] morph: Reconnect to the highest priority endpoint ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-02 17:54:22 +03:00
Dmitrii Stepanov	8021bacc43	[#1288] putSvc: Respect TTL for EC put ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-02 13:01:42 +00:00
Dmitrii Stepanov	7e04083c27	[#1278] containerSvc: Validate FrostFSID subject exitence on Put ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-07-29 16:01:37 +03:00
Dmitrii Stepanov	a12c39667d	[#1278] ir: Do not allow to create container without FrostFSID record ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-07-29 16:01:37 +03:00
Evgenii Stratonikov	8377372a40	[#1276] go.mod: Update api-go ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-07-26 16:44:19 +03:00
Dmitrii Stepanov	7fd7961dfa	[#1271] getSvc: Fix local EC chunk get ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-07-24 08:52:16 +03:00
Dmitrii Stepanov	8398a8b4b3	[#1271] getSvc: Fix head --raw assemble for EC ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-07-24 08:52:08 +03:00
George Bartolomey	9c2c76ca32	[#1259] Move pkg/util/locode to frostfs-locode-db ... Removed pkg/util/locode package, added git.frostfs.info/TrueCloudLab/frostfs-locode-db/pkg/locode dependency. Signed-off-by: George Bartolomey <george@bh4.ru>	2024-07-23 14:59:14 +03:00
Aleksey Savchuk	9ee1bd3669	[#1265] *: Run gofumpt ... Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-07-23 10:36:32 +03:00
Dmitrii Stepanov	18182e578e	[#1261] shard: Fix delete objects from FSTree ... Replace nil storageID with empty like by shard.Get. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-07-22 14:38:09 +03:00
Dmitrii Stepanov	3119f2fbc3	[#1257] metabase: Delete EC gc marks and split info ... EC parent and split gc marks should be deleted after last EC chunk delete. Also should delete split info for EC parent and split parent. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-07-19 17:14:14 +03:00
Airat Arifullin	eadcea8df0	[#1249] object: Remove all APE pre-checks in handlers ... * Methods `Head`, `Get`, `GetRangeHash` should no longer use APE pre-checks as that leads only to incorrect rule chain processing for requests: 1. Immediate return with `NoRuleFound` may be unexpected as some `Allow` rule is actually defined but can't be matched yet as it gets no object attributes; 2. Immdediate return with `Allow` may be incorrect as some `Deny` rule is actually defined but can't bet matched yet as it gets no object attirbutes; 3. Pre-check breaks compatibility for converted EACL-tables. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-07-18 13:52:43 +00:00
Dmitrii Stepanov	5e5ee545b6	[#1254] policer: Fix svacer warning ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-07-18 11:30:39 +00:00
Dmitrii Stepanov	27caa8a72f	[#1256] metabase: Put split parent object ID for EC chunks ... It is required to save split parent ID too, not only split ID. Otherwise inhume operation works incorrect: shard with last part may be skipped and parent object will be available. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-07-17 18:08:07 +03:00
Dmitrii Stepanov	e83d39e33f	[#1253] deleteSvc: Use copy of common parameters ... getSvc may change the values of some fields, so Head will affect Delete or Put. In this case, the change is necessary so that the session token is stored in the tombstone object (EC assemble calls `ForgetTokens`). Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-07-17 14:24:27 +03:00