Index page for FrostFS containers #151

New issue

Closed

opened 2024-09-30 09:28:36 +00:00 by alexvanin · 0 comments

alexvanin commented

2024-09-30 09:28:36 +00:00

Owner

In #137 we introduced index page for S3 buckets. S3 buckets store metadata in a tree service, so it is very convenient to iterate over object names, sizes and build tree.

However, index page will also be useful for FrostFS containers. FrostFS native protocol is more efficient to store raw objects. These objects may be accessed from HTTP Gateway, so listing of these objects will be useful.

Describe the solution you'd like

HTTP gateway should list all objects and efficiently receive all meta data about these objects ( probably some parallel HEAD requests?). Based on FilePath object attribute, it should create a directory tree and render it the same way as S3 Bucket index page.

This is definitely may take some time to process in a large container. For now, consider simple implementation without any native protocol optimizations.

## Is your feature request related to a problem? Please describe. In #137 we introduced index page for S3 buckets. S3 buckets store metadata in a tree service, so it is very convenient to iterate over object names, sizes and build tree. However, index page will also be useful for FrostFS containers. FrostFS native protocol is more efficient to store raw objects. These objects may be accessed from HTTP Gateway, so listing of these objects will be useful. ## Describe the solution you'd like HTTP gateway should list all objects and efficiently receive all meta data about these objects ( probably some parallel HEAD requests?). Based on `FilePath` object attribute, it should create a directory tree and render it the same way as S3 Bucket index page. This is definitely may take some time to process in a large container. For now, consider simple implementation without any native protocol optimizations.

❤️ 1