Skip to content

benchmark.md

Latest commit

 

History

History
14 lines (10 loc) · 998 Bytes

benchmark.md

File metadata and controls

14 lines (10 loc) · 998 Bytes
Raw

Boundary

  • OWNS: benchmarks/
  • MUST NOT WRITE: tileops/ops/, tileops/kernels/, tests/, workloads/, tileops/manifest/
  • MUST NOT (oracle-leakage rule): import oracle/ref functions from tests/ or workloads/. Reads of any other file are unrestricted.

→ trust-model.md §Benchmark | testing.md §Benchmarks

  • Every benchmark records ≥1 non-tileops baseline. If the external baseline is conditional, add a local torch fallback.
  • Tag names: lowercase, hyphen-separated. Tags starting with tileops are TileOPs entries; everything else is a baseline.
  • calculate_flops() / calculate_memory() return None to omit the metric.
  • Benchmark shapes reflect real DNN workloads (LLaMA-family by default). Annotate shape constants with the model/scenario; never use arbitrary flat numbers (262K, 1M, 4M).