Commit 86e5bbd
Tune feedsim_autoscale_dlrm_mini toward production CPU profile (1800 stories, 8 inferences) (#715)
Summary:
Pull Request resolved: #715
The first sweep with async feature extraction (D...c58bc574d94c stack tip prior) confirmed the runFlatExtractors fanout reaches GlobalCPUThread correctly, but the dlrm_mini defaults left two large gaps vs production multifeed_aggregator's strobelight breakdown:
| Category | Bench % non-idle (BGM q150 s05) | Prod target |
|-------------------|---------------------------------|-------------|
| DLRM-Inference | 61.6% | 7-13% |
| FeatureExtraction | 1.9% | 30-35% |
Two knob changes get both metrics moving toward prod:
1. dlrm_inferences=64 -> 8. Shrinks the per-request DLRM matmul work 8x. Should drop the DLRM-Inference share from ~55-62% toward prod's 7-13% Ranking-Prediction share.
2. num_stories=100 -> 1800. With extractors_per_story=50 unchanged, that's 90K extractor calls/req (was 5K). Should push FeatureExtraction CPU share from 1.7-1.9% toward prod's 28-32% Ranking-FeatureExtraction share. The system has plenty of CPU headroom (BGM 80% idle past saturation, CPL 60% idle), so adding 90K extractor calls/req shouldn't break throughput.
Both knobs only affect feedsim_autoscale_dlrm_mini. The full feedsim_autoscale_dlrm job keeps its existing config. Knobs remain overridable per-run via -i.
Reviewed By: YifanYuan3
Differential Revision: D105119226
fbshipit-source-id: b4e531b83866f1e6b4a4a1b6fde965c1b943b3ce1 parent 293728a commit 86e5bbd
1 file changed
Lines changed: 7 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
828 | 828 | | |
829 | 829 | | |
830 | 830 | | |
831 | | - | |
| 831 | + | |
| 832 | + | |
| 833 | + | |
832 | 834 | | |
833 | 835 | | |
834 | 836 | | |
835 | 837 | | |
836 | 838 | | |
837 | 839 | | |
838 | 840 | | |
839 | | - | |
| 841 | + | |
| 842 | + | |
| 843 | + | |
| 844 | + | |
840 | 845 | | |
841 | 846 | | |
842 | 847 | | |
| |||
0 commit comments