FrostFS local Development and Testing environment
 
 
Go to file
Alexey Vanin 0f6f2722c2 [#61] Update frostfs-s3-gw
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
2023-12-14 17:30:01 +03:00
.forgejo/workflows [#46] .forgejo: Update DCO action 2023-08-11 13:48:36 +00:00
.github [#1] Add DCO check for forgejo runner 2023-06-07 17:27:28 +03:00
bin [#18] bin: Remove passwd.exp 2023-05-02 17:01:46 +00:00
configs [#20] Add frostfs-cli configurations 2023-09-13 16:28:48 +03:00
docs [#1] Update S3 gateway description 2023-06-07 17:27:28 +03:00
services [#61] Update frostfs-s3-gw 2023-12-14 17:30:01 +03:00
wallets [#76] Update neo-go and contracts to N3 testnet RC2 version 2021-05-21 14:26:43 +03:00
.basic_services [#208] Split basic services into basic and essential 2022-09-13 17:48:51 +03:00
.bootstrap_services [#38] grafana: Change start order 2023-07-31 12:06:15 +03:00
.dockerignore [#1] Add DCO check for forgejo runner 2023-06-07 17:27:28 +03:00
.editorconfig
.env [#61] Update frostfs-s3-gw 2023-12-14 17:30:01 +03:00
.gitattributes [#38] grafana: Fix writecache boards 2023-08-07 13:59:42 +03:00
.gitignore [#242] gitignore: Add VSCode settings 2022-11-30 17:08:32 +03:00
.int_test.env Add .int_test.env files for config amendments (#167) 2022-04-07 15:33:53 +03:00
.services [#38] grafana: Change start order 2023-07-31 12:06:15 +03:00
CONTRIBUTING.md [#1] Update CONTRIBUTING 2023-06-07 17:27:28 +03:00
LICENSE
Makefile [#22] morph_chain: Do not use deprecated config fields 2023-05-03 12:34:46 +03:00
README.md [#1] Update README 2023-06-07 17:27:28 +03:00
frostfs-adm.yml [#52] frostfs-adm.yml: Allow maintenance mode by default 2023-08-25 14:10:54 +03:00
frostfs_config.mk [#18] bin: Replace some commands with frostfs-adm 2023-05-02 17:01:46 +00:00
help.mk [#172] Makefile: Add filter to help target 2022-10-26 19:08:08 +03:00

README.md

FrostFS logo

FrostFS local Development and Testing environment


Overview

Tools to set up local FrostFS network and N3 privnets. Devenv, for short.

Prerequisites

Make sure you have installed all of the following prerequisites on your machine:

  • docker
  • docker-compose
  • make (3.82+)
  • expect
  • openssl
  • jq
  • base64 (coreutils)

Quick Start

Clone repo:

$ git clone https://git.frostfs.info/TrueCloudLab/frostfs-dev-env.git

Run next commands from project's root:

$ make get

This command should be executed for the first run only to execute make hosts. It is part of the make up and, if the hosts have been added already, there is no need to run it separately.

$ make hosts
192.168.130.10 bastion.frostfs.devenv
192.168.130.50 main-chain.frostfs.devenv
192.168.130.61 ir01.frostfs.devenv
...
192.168.130.74 s04.frostfs.devenv

This command shows addresses and hostnames of components. Add make hosts output to your local /etc/hosts file.

Run all services with command:

$ make up

Also, you should add self-signed node (s04.frostfs.devenv) certificate to trusted store (default location might be changed using CA_CERTS_TRUSTED_STORE variable). This step is required for client services (frostfs-http-gw, frostfs-s3-gw) to interact with the node:

$ sudo make prepare.storage

Change FrostFS global configuration values with make update.* commands. The password of inner ring wallet is one. See examples in make help.

$ make update.epoch_duration val=30
Waiting for transactions to persist...

For instructions on how to set up DevEnv on macOS, please refer the guide in docs directory.

How it's organized

.
├── Makefile         # Commands to manage devenv
├── .services        # List of services to work with
├── services         # Services definitions and files
│   ├── basenet
│   ├── chain
│   ├── ir
│   ├── morph_chain
│   └── storage
├── vendor           # Temporary files and artifacts
└── wallets          # Wallet files to manage GAS assets

Main commands and targets to manage devenv's services are in Makefile.

Each service is defined in it's own directory under services/ with all required files to run and scripts to get external artifacts or dependencies.

The list of services and the starting order is defined in .services file. You can comment out services you don't want to start or add your own new services.

You can find more information on each service in docs directory.

Maybe you will find the answer for your question in F.A.Q.

Using FrostFS Admin Tool in dev-env

Devenv supports FrostFS network management via frostfs-adm. services/ir contains the Alphabet wallet in a proper format, specify it with --alphabet-wallets flag.

Notable make targets

make help will print the brief description of available targets. Here we describe some of them in a more detailed way.

up

Start all Devenv services.

This target call pull to get container images, get to download required artifacts, vendor/hosts to generate hosts file and then starts all services in the order defined in .services file.

down

Shutdowns all services. This will destroy all containers and networks. All changes made inside containers will be lost.

hosts

Display addresses and host names for each running service, if available.

clean

Clean up vendor directory.

Contributing

Feel free to contribute to this project after reading the contributing guidelines.

Before starting to work on a certain topic, create an new issue first, describing the feature/topic you are going to implement.

License