Refactor working with container list #175

New issue

Closed

opened 2023-03-24 10:25:09 +00:00 by fyrchik · 2 comments

fyrchik commented

2023-03-24 10:25:09 +00:00

Owner

In #172 we removed a technical limitation regarding containers number, but replaced it with another one instead: container list must reside in RAM.

While the number of containers won't, most likely, be not THAT big, there are other problems:

Listing latency. We don't want to wait for another hour just to fetch 32M containers.
Our system is intended to be as scalable as possible, let's keep the promise.

In #172 we removed a technical limitation regarding containers number, but replaced it with another one instead: container list must reside in RAM. While the number of containers won't, most likely, be not THAT big, there are other problems: 1. Listing latency. We don't want to wait for another hour just to fetch 32M containers. 2. Our system is intended to be as scalable as possible, let's keep the promise.

fyrchik added the

triage

label 2023-03-24 10:25:09 +00:00

fyrchik added the

frostfs-node

label 2023-03-24 10:57:31 +00:00

~~fyrchik referenced this issue 2023-04-03 11:47:37 +00:00~~

Use containersOf in neofs-adm #200

acid-ant was assigned by fyrchik

2023-04-03 16:05:25 +00:00

acid-ant was unassigned by fyrchik

2023-04-03 16:05:41 +00:00

fyrchik commented

2023-04-03 16:06:15 +00:00

Author

Owner

I am not sure how to do it for the tree synchronization: synchronization time can be much more than iterator session lifetime.

fyrchik referenced this issue

2023-04-04 07:26:19 +00:00

Use containersOf in neofs-adm #200

fyrchik referenced this issue from a commit

2023-04-04 07:26:25 +00:00

[#175] adm: list containers using `containersOf`

fyrchik referenced this issue from a commit

2023-04-04 07:26:25 +00:00

[#175] adm: pipeline container iteration

fyrchik added this to the vNext milestone 2023-05-18 08:33:25 +00:00

fyrchik added the

label 2024-01-16 12:30:04 +00:00

fyrchik commented

2024-01-16 12:31:30 +00:00

Author

Owner

If we use the iterator, it will take some of the neo-go resources.
There are lots of problems with sessions which seem more severe (we have already encountered some), closing this issue.

If we use the iterator, it will take some of the neo-go resources. There are lots of problems with sessions which seem more severe (we have already encountered some), closing this issue.

fyrchik closed this issue

2024-01-16 12:31:30 +00:00

fyrchik modified the milestone from vNext to v0.39.0

2024-05-02 07:38:06 +00:00