Skip to content

Commit c46ec47

Browse files
fix(mlperf-edu): anomaly-ae-train model-size gate impossible to pass (#1937)
max_model_size_kb: 32 could never be satisfied by the reference model it gates: AnomalyDetectionAE (640/784 -> 128x4 -> 8 -> 128x4 -> 640) has ~266K parameters -- matching this same file's own `params: 0.3M` -- which is ~1.03MB at FP32 and ~260KB even fully INT8-quantized. A submitter who trains exactly this reference model and reports the true model size would automatically fail the size gate regardless of reconstruction quality. Corrected the budget to 300KB, consistent with the file's own stated 0.3M parameter count at 1 byte/param (INT8), the standard deployment target for this suite's "microcontroller" framing.
1 parent 3cb000e commit c46ec47

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

mlperf-edu/registry/suites/tiny/anomaly-ae-train.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -44,7 +44,7 @@ verified_baseline:
4444
epochs: 20
4545
time_seconds: 5
4646
note: Val loss intentionally higher — anomalous digits have high recon error
47-
max_model_size_kb: 32
47+
max_model_size_kb: 300
4848
scenario: offline
4949
public:
5050
status: score-bearing

0 commit comments

Comments
 (0)