Measuring your own setup

docker compose exec app python -m scripts.benchmark_scale                  # 10k, 100k and 500k records
docker compose exec app python -m scripts.benchmark_scale 50000 250000     # other sizes

It uses a throwaway database schema and a prefix in the lake-test bucket, and removes both afterwards.