Commit 64c9862
committed
perf/robustness(api-runner): hard per-turn timeout (anti-wedge)
A heavy MoA run hung ~1h45m on a single non-returning /chat/completions call —
the httpx read timeout didn't fire (kept-alive stream). Wrap each turn's request
in asyncio.wait_for(timeout=SPECA_API_TURN_TIMEOUT, default 150s); on timeout log
an api_error and continue to the next turn so one stuck model can't wedge the
whole run. 119 runner tests green.1 parent cee8d03 commit 64c9862
1 file changed
Lines changed: 12 additions & 3 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
392 | 392 | | |
393 | 393 | | |
394 | 394 | | |
| 395 | + | |
| 396 | + | |
395 | 397 | | |
396 | 398 | | |
397 | 399 | | |
| |||
542 | 544 | | |
543 | 545 | | |
544 | 546 | | |
545 | | - | |
546 | | - | |
547 | | - | |
| 547 | + | |
| 548 | + | |
| 549 | + | |
548 | 550 | | |
549 | 551 | | |
| 552 | + | |
| 553 | + | |
| 554 | + | |
| 555 | + | |
| 556 | + | |
| 557 | + | |
| 558 | + | |
550 | 559 | | |
551 | 560 | | |
552 | 561 | | |
| |||
0 commit comments