Skip to content

Commit 8cd8e37

Browse files
hmgaudeckerclaude
andcommitted
Halve aca-model production assets batch size to fit V100 16GB
Reduce n_assets_batch_size from 2 to 1 in MODEL_CONFIG so the assets state axis is streamed one slice at a time, lowering peak GPU memory during solve on the V100-PCIE-16GB. Benchmark grid config is unchanged. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
1 parent 1342861 commit 8cd8e37

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

src/aca_model/config.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -36,7 +36,7 @@ class GridConfig:
3636
# `batch_size` on the assets grid: chunked vmap stride for the
3737
# outer state loop. Useful at prod sizes for memory reasons; set
3838
# to 0 in BENCHMARK_GRID_CONFIG to skip the Python-loop overhead.
39-
n_assets_batch_size: int = 2
39+
n_assets_batch_size: int = 1
4040

4141

4242
MODEL_CONFIG = ModelConfig()

0 commit comments

Comments
 (0)