built-on-envoy/extension-llm-proxy 0.11.0-dev Public Latest

Routes LLM API requests by the module name and monitors token usage and latency via Envoy metadata and metrics.

Install from the command line


      
  
      
        $ docker pull ghcr.io/tetratelabs/built-on-envoy/extension-llm-proxy:0.11.0-dev

linux/amd64


      
  
      
        $ docker pull ghcr.io/tetratelabs/built-on-envoy/extension-llm-proxy:0.11.0-dev@sha256:ebb6fb81ad03acc0ffa3fed39ea8326a1aa2adb900e42ab30a2ba91f5c223bdf

linux/arm64


      
  
      
        $ docker pull ghcr.io/tetratelabs/built-on-envoy/extension-llm-proxy:0.11.0-dev@sha256:a32bd5d8c1237c301c8c329272267784ce498cec83255d3bdd5259fcc7d0a0c9

Recent tagged image versions

0.11.0-dev dev

Published 3 days ago · Digest
sha256:125e3379e611521485076196361e3d4112aeb1093db273218b01b4afaee8e2ce

1 Version downloads
0.10.0

Published 6 days ago · Digest
sha256:71c7f8cc897215936a77a36e0c138dfe270e74ad23f0136f1acc2f22eda4d685

2 Version downloads
0.10.0-dev

Published 7 days ago · Digest
sha256:b79299567cf52ec50625800826245c5fbb775e7fec66becf3dcaf09e5d152846

1 Version downloads
0.9.0

Published 26 days ago · Digest
sha256:4819ac2788130447413441f0aa1912bfd0ed81a2da5602cfb0bd07c945dfeeb4

21 Version downloads
0.9.0-dev

Published 26 days ago · Digest
sha256:f101cf281b91d3e7f46d1cc237e6159e725bb5cf59e4c330584149e17f6bbc1a

7 Version downloads