1198 commits

Author	SHA1	Message	Date
Evgenii Stratonikov	b0c5def2d9	[#1433] shard/test: Use WithDisabledGC() option where possible ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-17 14:38:07 +03:00
Alexander Chuprov	41038b2ec0	[#1431] node: Fix 'empty slice declaration using a literal' ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-10-15 08:53:59 +00:00
Alexander Chuprov	d83879d4b8	[#1431] node: Fix comment format ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-10-15 08:53:59 +00:00
Alexander Chuprov	f6582081a4	[#1431] obj_storage/metabase: Delete unused variable ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-10-15 08:53:59 +00:00
Alexander Chuprov	00b1cecfb7	[#1431] obj_storage/shard: Fix visibility of 'newMetricStore' ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-10-15 08:53:59 +00:00
Alexander Chuprov	d53732f663	[#1431] engine: Delete always false condition ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-10-15 08:53:59 +00:00
Alexander Chuprov	3012286452	[#1431] metabase: Fix unreachable code ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-10-15 08:53:59 +00:00
Anton Nikiforov	936ebbb8e5	[#1423] metabase: Hide BucketName form upper levels ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-10-08 18:41:16 +03:00
Dmitrii Stepanov	c065d55ca3	[#1412] metabase: Drop logging inside transaction ... This could lead to hang the db. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-08 11:41:52 +03:00
Dmitrii Stepanov	fe9f664b57	[#1412] metabase: Drop empty user attribute buckets on upgrade ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-08 11:41:52 +03:00
Dmitrii Stepanov	87f4b934d1	[#1412] metabase: Run bucket drop steps on upgrade concurrently ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-08 11:41:52 +03:00
Dmitrii Stepanov	8093e145b3	[#1412] adm: Resolve container type by metabase upgrade ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-08 11:41:51 +03:00
Dmitrii Stepanov	3da168f8cf	[#1412] shard: Resolve container is indexed on metabase resync ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-08 11:41:51 +03:00
Dmitrii Stepanov	4572fa4874	[#1412] searchSvc: Check container is indexed ... For non S3 containers it is expected to use attributes index for some attributes. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-08 11:41:50 +03:00
Dmitrii Stepanov	1efa64ee72	[#1412] metabase: Add search by indexed attributes ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-08 11:41:50 +03:00
Dmitrii Stepanov	be744ae3e6	[#1412] metabase: Index attributes for indexed containers ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-08 11:41:49 +03:00
Dmitrii Stepanov	1b520f7973	[#1412] engine: Add IsIndexedContainer flag ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-08 11:41:49 +03:00
Dmitrii Stepanov	899cd55c27	[#1412] engine: PutPrm refactoring ... Use fields instead of methods. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-08 11:41:48 +03:00
Evgenii Stratonikov	fc032838c0	[#1215] blobstor/test: Cover iteration behaviour ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-07 12:44:27 +00:00
Anton Nikiforov	2f710d8f94	[#1414] metabase: Check parameter for CountAliveObjectsInBucket ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-10-04 17:11:15 +03:00
Evgenii Stratonikov	4dc9a1b300	[#1413] engine: Remove error counting methods from Shard ... All error counting and hangling logic is present on the engine level. Currently, we pass engine metrics with shard ID metric to shard, then export 3 methods to manipulate these metrics. In this commits all methods are removed and error counter is tracked on the engine level exlusively. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-04 15:10:17 +03:00
Evgenii Stratonikov	963faa615a	[#1413] engine: Cleanup shard error reporting ... - `reportShardErrorBackground()` no longer differs from `reportShardError()`, reflect this in its name; - reuse common pieces of code to make it simpler. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-04 15:10:17 +03:00
Evgenii Stratonikov	9a87acb87a	[#1410] engine: Provide the default implementation to MetricsRegister ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-03 08:23:06 +00:00
Evgenii Stratonikov	9206ce5cd2	[#1410] shard: Provide the default implementation for MetricsWriter ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-03 08:23:06 +00:00
Evgenii Stratonikov	6c46044c9c	[#1410] shard: Move MetricsWriter interface to a separate file ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-03 08:23:06 +00:00
Dmitrii Stepanov	01e3944b31	[#1408] metabase: Fix tests ... No need to specify container ID for objects created with `testutil.GenerateObjectWithCID`. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-02 14:41:40 +03:00
Dmitrii Stepanov	434048e8d9	[#1408] metabase: Fix EC search with slow and fast filters ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-02 14:36:59 +03:00
Anton Nikiforov	d0ed29b3c7	[#1350] node: Add ability to evacuate objects from REP 1 only ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-09-27 15:41:17 +03:00
Dmitrii Stepanov	401c398704	[#1388] metabase: Drop unused ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-25 08:55:38 +00:00
Dmitrii Stepanov	004ff9e9bf	[#1388] blobstor: Drop unused ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-25 08:55:38 +00:00
Dmitrii Stepanov	63a567a1de	[#1388] engine: Drop unused ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-25 08:55:38 +00:00
Dmitrii Stepanov	fd18aa363b	[#1385] metabase: Optimize isTomb check ... As tombstone and target must have the same containerID, do not iterate other containers. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-24 17:09:06 +03:00
Dmitrii Stepanov	76268e3ea2	[#1385] metabase: Validate that tombstone and target have the same container ID ... Target container ID is taken from tombstone: cmd/frostfs-node/object.go:507 Also object of type `TOMBSTONE` contains objectID, so tombstone and tombstoned object must have the same containerID. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-24 17:09:06 +03:00
Dmitrii Stepanov	8434f3dbfc	[#1385] metabase: Use Batch for delete-related operations ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-24 17:09:06 +03:00
Anton Nikiforov	34e6a309c6	[#1356] engine: Evacuate object from shards concurrently ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-09-24 12:50:19 +03:00
Dmitrii Stepanov	0b87be804a	[#1381] engine: Fix tests ... Drop not required `Eventually` calls. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-23 11:10:29 +03:00
Aleksey Savchuk	c34b8acedd	[#1312] Drop handling of system attributes with NeoFS prefix ... Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-09-20 11:37:18 +00:00
Dmitrii Stepanov	e3764c51df	[#1347] metabase: Fix EC search ... For EC chunks need to return EC parent object ID as EC chunks don't have own attributes but inherit parent's. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-12 13:23:29 +00:00
Dmitrii Stepanov	b33559754d	[#1367] fstree: Add size hint for Delete ... This allow to not to call `os.Stat` if caller already knows data size. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-12 15:06:33 +03:00
Dmitrii Stepanov	f345fe9a58	[#1367] writecache: Move DB related code to upgrade.go ... This is done to drop this file in the future. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-12 15:06:33 +03:00
Dmitrii Stepanov	3b236160a6	[#1367] writecache: Drop DB label from metrics ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-12 15:06:33 +03:00
Dmitrii Stepanov	25d2ae8aaf	[#1367] writecache: Drop BBolt related config variables ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-12 15:06:33 +03:00
Dmitrii Stepanov	e39378b1c3	[#1367] writecache: Add background flushing objects limiter ... To limit memory usage by background flush. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-12 15:06:33 +03:00
Dmitrii Stepanov	8a6e3025a0	[#1367] writecache: Flush from FSTree concurrently ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-12 15:06:33 +03:00
Dmitrii Stepanov	2dd3a6f7a8	[#1367] fstree: Add IterateInfo method ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-12 15:06:33 +03:00
Dmitrii Stepanov	b142b6f48e	[#1367] fstree: Add size to file counter ... FSTree file counter used by writecache. As writecache has now only one storage, so it is required to use real object size to get writecache size more accurate than `count * max_object_size`. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-12 15:06:33 +03:00
Dmitrii Stepanov	5f6c7cbdb1	[#1367] writecache: Drop bbolt DB ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-12 14:22:29 +03:00
Dmitrii Stepanov	92fe5d90f5	[#1359] writecache: Drop unused ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-09 18:45:21 +03:00
Dmitrii Stepanov	4668efc0bf	[#1355] metabase: Upgrade improvements ... Do not fail on same latest version to run compact on upgraded metabase. Use NoSync on compact. Log every batch on bucket delete stage. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-09 11:37:36 +03:00
Dmitrii Stepanov	d3b209c8e1	[#1337] shard: Disable background rebuild ... Since `frostfs-cli control shards rebuild` command was added, there is no need for background rebuild now. For failover tests used used value 1 to rebuild only schema change. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-06 15:19:55 +03:00