Commit 386e3f2
Remove srvIOThreadPool and its throw-away datagen + compression (#728)
Summary:
Pull Request resolved: #728
The srvIOThread pool was a synthetic CPU placeholder for outbound RPC work back when LeafNodeRank had no real outbound RPCs: each request would fan out N tasks onto srvIOThread, each of which generated a fake response, serialized it, ran ZSTD over half the chain, and discarded the result. With Phase 5 in place, the SREventBase pool now carries real outbound RPC fanout to mock_services (issueOutboundFanout), so the placeholder is redundant and was actively skewing the prod-vs-bench category breakdown by overweighting Compression (8-13% bench vs 3-5% prod).
This commit:
* Drops the srvIOThread pool construction, warmup, and the --srv_io_threads CLI flag.
* Removes the per-request throw-away generateResponse + serializePayload + compressThrift fanout from AsyncPageRankRequestHandler, DLRMRequestHandler (async chain), and PageRankRequestHandler (sync). The single response we actually send back to the driver is still generated and serialized — just once instead of srv_io_threads times.
* Removes the unused dispatcher-thread `compressed = compressPayload(...)` / `decompressPayload(compressed)` pair from the sync PageRankRequestHandler that was paired with the same throw-away pattern.
* Removes srvIOThreadPool from ThreadData and from both ThreadStartup overloads.
* Removes -s / --srv_io_threads handling from packages/feedsim/run.sh and the static --srv_io_threads=36 from start_leaf_node_rank.sh.
The SREventBase pool's comment is updated from "idle in Phase 4" to its actual role (carries outbound fanout), and the startup banner now lists 4 pools instead of 5.
Reviewed By: YifanYuan3
Differential Revision: D1051192221 parent a05298f commit 386e3f2
4 files changed
Lines changed: 42 additions & 164 deletions
File tree
- packages/feedsim
- third_party/src
- scripts
- workloads/ranking
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
50 | 50 | | |
51 | 51 | | |
52 | 52 | | |
53 | | - | |
54 | 53 | | |
55 | 54 | | |
56 | 55 | | |
57 | 56 | | |
58 | 57 | | |
59 | | - | |
60 | 58 | | |
61 | 59 | | |
62 | 60 | | |
| |||
69 | 67 | | |
70 | 68 | | |
71 | 69 | | |
72 | | - | |
73 | 70 | | |
74 | 71 | | |
75 | 72 | | |
| |||
146 | 143 | | |
147 | 144 | | |
148 | 145 | | |
149 | | - | |
150 | | - | |
151 | | - | |
152 | 146 | | |
153 | 147 | | |
154 | 148 | | |
| |||
303 | 297 | | |
304 | 298 | | |
305 | 299 | | |
306 | | - | |
307 | | - | |
308 | | - | |
309 | | - | |
310 | 300 | | |
311 | 301 | | |
312 | 302 | | |
| |||
724 | 714 | | |
725 | 715 | | |
726 | 716 | | |
727 | | - | |
728 | 717 | | |
729 | 718 | | |
730 | 719 | | |
| |||
Lines changed: 0 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
12 | 12 | | |
13 | 13 | | |
14 | 14 | | |
15 | | - | |
16 | 15 | | |
17 | 16 | | |
18 | 17 | | |
| |||
0 commit comments