Skip to content

Commit a7de599

Browse files
authored
chore: remove remote::passthrough inference provider (#6368)
Remove the remote::passthrough provider, its registry entry, and all supporting code: the passthrough module (passthrough.py, config.py, __init__.py), the forward_headers utility module, the unit test suite, and documentation files. Update the codex CLI test to use a generic api_key instead of passthrough_api_key since X-OGX-Provider-Data forwarding is a generic mechanism not tied to any one provider. Signed-off-by: Matthew Farrellee <matt@cs.wisc.edu>
1 parent ffa6142 commit a7de599

13 files changed

Lines changed: 4 additions & 1198 deletions

File tree

docs/docs/distributions/self_hosted_distro/passthrough.md

Lines changed: 0 additions & 32 deletions
This file was deleted.

docs/docs/providers/inference/remote_passthrough.mdx

Lines changed: 0 additions & 50 deletions
This file was deleted.

scripts/generate_target_models_docs.py

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -74,7 +74,6 @@
7474
"meta",
7575
"nvidia",
7676
"oci",
77-
"passthrough",
7877
"runpod",
7978
"sambanova",
8079
}

src/ogx/providers/registry/inference.py

Lines changed: 0 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -267,16 +267,6 @@ def available_providers() -> list[ProviderSpec]:
267267
provider_data_validator="ogx.providers.remote.inference.sambanova.config.SambaNovaProviderDataValidator",
268268
description="SambaNova inference provider for running models on SambaNova's dataflow architecture.",
269269
),
270-
RemoteProviderSpec(
271-
api=Api.inference,
272-
adapter_type="passthrough",
273-
provider_type="remote::passthrough",
274-
pip_packages=[],
275-
module="ogx.providers.remote.inference.passthrough",
276-
config_class="ogx.providers.remote.inference.passthrough.PassthroughImplConfig",
277-
provider_data_validator="ogx.providers.remote.inference.passthrough.PassthroughProviderDataValidator",
278-
description="Passthrough inference provider for connecting to any external inference service not directly supported.",
279-
),
280270
RemoteProviderSpec(
281271
api=Api.inference,
282272
adapter_type="watsonx",

src/ogx/providers/remote/README.md

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -21,7 +21,6 @@ remote/
2121
oci/ # Oracle Cloud Infrastructure
2222
ollama/ # Ollama
2323
openai/ # OpenAI
24-
passthrough/ # Generic passthrough to any endpoint
2524
runpod/ # RunPod
2625
sambanova/ # SambaNova
2726
together/ # Together AI

src/ogx/providers/remote/inference/README.md

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,6 @@ inference/
1919
oci/ # Oracle Cloud Infrastructure GenAI
2020
ollama/ # Ollama (local model serving)
2121
openai/ # OpenAI API
22-
passthrough/ # Generic passthrough to any endpoint
2322
runpod/ # RunPod cloud GPU
2423
sambanova/ # SambaNova
2524
tgi/ # HuggingFace TGI and Inference API

src/ogx/providers/remote/inference/passthrough/__init__.py

Lines changed: 0 additions & 34 deletions
This file was deleted.

src/ogx/providers/remote/inference/passthrough/config.py

Lines changed: 0 additions & 70 deletions
This file was deleted.

0 commit comments

Comments
 (0)