Merge main into fix/anthropic-tool-result-order

Author: LuShadowX

README.md

@@ -60,10 +60,10 @@ Install and run a OGX server:
 curl -LsSf https://github.com/ogx-ai/ogx/raw/main/scripts/install.sh | bash
 
 # Or install via uv
-uv pip install ogx[starter]
+uv pip install ogx
 
-# Start the server (uses the starter distribution with Ollama)
-uv run ogx run starter
+# Start the server (auto-detects providers from the environment)
+uv run ogx go
 ```
 
 Then connect with any OpenAI, Anthropic, or Google GenAI client — [Python](https://github.com/openai/openai-python), [TypeScript](https://github.com/openai/openai-node), [curl](https://platform.openai.com/docs/api-reference), or any framework that speaks these APIs.

docs/docs/getting_started/quickstart.mdx

@@ -19,16 +19,15 @@ Install [Ollama](https://ollama.com/download), then pull a model and start the s
 
 ```bash
 ollama pull llama3.2:3b
-export OLLAMA_URL=http://localhost:11434/v1
-uvx --from 'ogx[starter]' ogx run starter
+uvx ogx go
 ```
 
 </TabItem>
 <TabItem value="openai" label="OpenAI">
 
 ```bash
 export OPENAI_API_KEY=sk-xxx
-uvx --from 'ogx[starter]' ogx run starter
+uvx ogx go
 ```
 
 </TabItem>
@@ -52,13 +51,14 @@ The `uvx` command above is great for trying things out. For a real project, inst
 
 ```bash
 uv init my-ai-app && cd my-ai-app
-uv add 'ogx[starter]' openai
-export OLLAMA_URL=http://localhost:11434/v1
-uv run ogx run starter
+uv add ogx openai
+uv run ogx go
 ```
 :::
 
-The server is now running at `http://localhost:8321`. You can use any OpenAI-compatible client.
+The server is now running at `https://localhost:8321`. You can use any OpenAI-compatible client.
+
+OGX is secure by default and listens on https. Passing `--insecure` forces the server to listen on http.
 
 ## Verify it works
 
@@ -68,16 +68,17 @@ Before writing any code, confirm the server is healthy and models are registered
 <TabItem value="curl" label="curl" default>
 
 ```bash
-curl -s http://localhost:8321/v1/models | python -m json.tool
+curl -k -s https://localhost:8321/v1/models | python -m json.tool
 ```
 
 </TabItem>
 <TabItem value="python" label="Python">
 
 ```python
+import httpx
 from openai import OpenAI
 
-client = OpenAI(base_url="http://localhost:8321/v1", api_key="fake")
+client = OpenAI(base_url="http://localhost:8321/v1", api_key="fake", http_client=httpx.Client(verify=False))
 
 for model in client.models.list():
     print(model.id)
@@ -108,9 +109,10 @@ If the list is empty or the command fails, check the [Troubleshooting](#troubles
 Open a new terminal and run:
 
 ```python title="app.py"
+import httpx
 from openai import OpenAI
 
-client = OpenAI(base_url="http://localhost:8321/v1", api_key="fake")
+client = OpenAI(base_url="https://localhost:8321/v1", api_key="fake", http_client=httpx.Client(verify=False))
 
 response = client.responses.create(
     model="ollama/llama3.2:3b",
@@ -128,9 +130,10 @@ pip install openai && python app.py
 Upload a file, create a vector store, and ask questions about it:
 
 ```python
+import httpx
 from openai import OpenAI
 
-client = OpenAI(base_url="http://localhost:8321/v1", api_key="fake")
+client = OpenAI(base_url="http://localhost:8321/v1", api_key="fake", http_client=httpx.Client(verify=False))
 
 # Upload a document
 file = client.files.create(
@@ -166,7 +169,7 @@ That's it. Same OpenAI SDK, local model, your own vector store.
 If you see `Address already in use`, another process is using port 8321. Either stop it or run on a different port:
 
 ```bash
-uvx --from 'ogx[starter]' ogx run starter --port 8322
+uvx ogx go --port 8322
 ```
 
 </details>

docs/docs/index.mdx

@@ -113,11 +113,13 @@ curl -LsSf https://github.com/ogx-ai/ogx/raw/main/scripts/install.sh | bash
 pip install ogx
 
 # Start the server
-ogx stack run
+uv run ogx go --insecure
 ```
 
 :::tip
 OGX works with any OpenAI-compatible client. Point your existing code at `http://localhost:8321/v1` and you're ready to go.
+
+OGX is secure by default. `--insecure` forces the server to listen on http. By default it runs on https with a self-signed cert. You'll have to skip cert verification or trust the automatically generated cert.
 :::
 
 [Quick Start Guide](/docs/getting_started/quickstart) | [OpenAI API Compatibility](./api-openai) | [GitHub](https://github.com/ogx-ai/ogx)

docs/docs/providers/inference/remote_anthropic.mdx

@@ -34,6 +34,10 @@ Anthropic inference provider for accessing Claude models and Anthropic's AI serv
 | `network.timeout.connect` | `float \| None` | No |  | Connection timeout in seconds. |
 | `network.timeout.read` | `float \| None` | No |  | Read timeout in seconds. |
 | `network.headers` | `dict[str, str] \| None` | No |  | Additional HTTP headers to include in all requests. |
+| `network.limits` | `LimitsConfig \| None` | No |  | HTTP connection pool limits (max connections, keepalive connections, keepalive expiry). None uses httpx's own defaults. |
+| `network.limits.max_connections` | `int \| None` | No | 100 | Maximum number of concurrent connections in the pool. None means no limit. Values must be >= 1 if set. |
+| `network.limits.max_keepalive_connections` | `int \| None` | No | 20 | Maximum number of idle keep-alive connections to retain. None means no limit. Values must be >= 0 if set. |
+| `network.limits.keepalive_expiry` | `float \| None` | No | 5.0 | Time in seconds to keep idle keep-alive connections open before closing them. None means no expiry. Values must be >= 0 if set. |
 
 ## Sample Configuration
 

docs/docs/providers/inference/remote_azure.mdx

@@ -41,6 +41,10 @@ https://learn.microsoft.com/en-us/azure/ai-foundry/openai/overview
 | `network.timeout.connect` | `float \| None` | No |  | Connection timeout in seconds. |
 | `network.timeout.read` | `float \| None` | No |  | Read timeout in seconds. |
 | `network.headers` | `dict[str, str] \| None` | No |  | Additional HTTP headers to include in all requests. |
+| `network.limits` | `LimitsConfig \| None` | No |  | HTTP connection pool limits (max connections, keepalive connections, keepalive expiry). None uses httpx's own defaults. |
+| `network.limits.max_connections` | `int \| None` | No | 100 | Maximum number of concurrent connections in the pool. None means no limit. Values must be >= 1 if set. |
+| `network.limits.max_keepalive_connections` | `int \| None` | No | 20 | Maximum number of idle keep-alive connections to retain. None means no limit. Values must be >= 0 if set. |
+| `network.limits.keepalive_expiry` | `float \| None` | No | 5.0 | Time in seconds to keep idle keep-alive connections open before closing them. None means no expiry. Values must be >= 0 if set. |
 | `base_url` | `HttpUrl \| None` | No |  | Azure API base for Azure (e.g., https://your-resource-name.openai.azure.com/openai/v1) |
 | `api_version` | `str \| None` | No |  | Azure API version for Azure (e.g., 2024-12-01-preview) |
 | `api_type` | `str \| None` | No | azure | Azure API type for Azure (e.g., azure) |

docs/docs/providers/inference/remote_bedrock.mdx

@@ -34,6 +34,10 @@ AWS Bedrock inference provider for the OpenAI-compatible runtime, with AWS crede
 | `network.timeout.connect` | `float \| None` | No |  | Connection timeout in seconds. |
 | `network.timeout.read` | `float \| None` | No |  | Read timeout in seconds. |
 | `network.headers` | `dict[str, str] \| None` | No |  | Additional HTTP headers to include in all requests. |
+| `network.limits` | `LimitsConfig \| None` | No |  | HTTP connection pool limits (max connections, keepalive connections, keepalive expiry). None uses httpx's own defaults. |
+| `network.limits.max_connections` | `int \| None` | No | 100 | Maximum number of concurrent connections in the pool. None means no limit. Values must be >= 1 if set. |
+| `network.limits.max_keepalive_connections` | `int \| None` | No | 20 | Maximum number of idle keep-alive connections to retain. None means no limit. Values must be >= 0 if set. |
+| `network.limits.keepalive_expiry` | `float \| None` | No | 5.0 | Time in seconds to keep idle keep-alive connections open before closing them. None means no expiry. Values must be >= 0 if set. |
 | `aws_access_key_id` | `SecretStr \| None` | No |  | The AWS access key to use. Default use environment variable: AWS_ACCESS_KEY_ID |
 | `aws_secret_access_key` | `SecretStr \| None` | No |  | The AWS secret access key to use. Default use environment variable: AWS_SECRET_ACCESS_KEY |
 | `aws_session_token` | `SecretStr \| None` | No |  | The AWS session token to use. Default use environment variable: AWS_SESSION_TOKEN |

docs/docs/providers/inference/remote_cerebras.mdx

@@ -34,6 +34,10 @@ Cerebras inference provider for running models on Cerebras Cloud platform.
 | `network.timeout.connect` | `float \| None` | No |  | Connection timeout in seconds. |
 | `network.timeout.read` | `float \| None` | No |  | Read timeout in seconds. |
 | `network.headers` | `dict[str, str] \| None` | No |  | Additional HTTP headers to include in all requests. |
+| `network.limits` | `LimitsConfig \| None` | No |  | HTTP connection pool limits (max connections, keepalive connections, keepalive expiry). None uses httpx's own defaults. |
+| `network.limits.max_connections` | `int \| None` | No | 100 | Maximum number of concurrent connections in the pool. None means no limit. Values must be >= 1 if set. |
+| `network.limits.max_keepalive_connections` | `int \| None` | No | 20 | Maximum number of idle keep-alive connections to retain. None means no limit. Values must be >= 0 if set. |
+| `network.limits.keepalive_expiry` | `float \| None` | No | 5.0 | Time in seconds to keep idle keep-alive connections open before closing them. None means no expiry. Values must be >= 0 if set. |
 | `base_url` | `HttpUrl \| None` | No | https://api.cerebras.ai/v1 | Base URL for the Cerebras API |
 
 ## Sample Configuration

docs/docs/providers/inference/remote_databricks.mdx

@@ -34,6 +34,10 @@ Databricks inference provider for running models on Databricks' unified analytic
 | `network.timeout.connect` | `float \| None` | No |  | Connection timeout in seconds. |
 | `network.timeout.read` | `float \| None` | No |  | Read timeout in seconds. |
 | `network.headers` | `dict[str, str] \| None` | No |  | Additional HTTP headers to include in all requests. |
+| `network.limits` | `LimitsConfig \| None` | No |  | HTTP connection pool limits (max connections, keepalive connections, keepalive expiry). None uses httpx's own defaults. |
+| `network.limits.max_connections` | `int \| None` | No | 100 | Maximum number of concurrent connections in the pool. None means no limit. Values must be >= 1 if set. |
+| `network.limits.max_keepalive_connections` | `int \| None` | No | 20 | Maximum number of idle keep-alive connections to retain. None means no limit. Values must be >= 0 if set. |
+| `network.limits.keepalive_expiry` | `float \| None` | No | 5.0 | Time in seconds to keep idle keep-alive connections open before closing them. None means no expiry. Values must be >= 0 if set. |
 | `base_url` | `HttpUrl \| None` | No |  | The URL for the Databricks model serving endpoint (should include /serving-endpoints path) |
 
 ## Sample Configuration

docs/docs/providers/inference/remote_deepseek.mdx

@@ -34,6 +34,10 @@ DeepSeek inference provider for accessing DeepSeek models via the DeepSeek API.
 | `network.timeout.connect` | `float \| None` | No |  | Connection timeout in seconds. |
 | `network.timeout.read` | `float \| None` | No |  | Read timeout in seconds. |
 | `network.headers` | `dict[str, str] \| None` | No |  | Additional HTTP headers to include in all requests. |
+| `network.limits` | `LimitsConfig \| None` | No |  | HTTP connection pool limits (max connections, keepalive connections, keepalive expiry). None uses httpx's own defaults. |
+| `network.limits.max_connections` | `int \| None` | No | 100 | Maximum number of concurrent connections in the pool. None means no limit. Values must be >= 1 if set. |
+| `network.limits.max_keepalive_connections` | `int \| None` | No | 20 | Maximum number of idle keep-alive connections to retain. None means no limit. Values must be >= 0 if set. |
+| `network.limits.keepalive_expiry` | `float \| None` | No | 5.0 | Time in seconds to keep idle keep-alive connections open before closing them. None means no expiry. Values must be >= 0 if set. |
 | `base_url` | `HttpUrl \| None` | No | https://api.deepseek.com/v1 | Base URL for the DeepSeek API |
 
 ## Sample Configuration

docs/docs/providers/inference/remote_fireworks.mdx

@@ -34,6 +34,10 @@ Fireworks AI inference provider for Llama models and other AI models on the Fire
 | `network.timeout.connect` | `float \| None` | No |  | Connection timeout in seconds. |
 | `network.timeout.read` | `float \| None` | No |  | Read timeout in seconds. |
 | `network.headers` | `dict[str, str] \| None` | No |  | Additional HTTP headers to include in all requests. |
+| `network.limits` | `LimitsConfig \| None` | No |  | HTTP connection pool limits (max connections, keepalive connections, keepalive expiry). None uses httpx's own defaults. |
+| `network.limits.max_connections` | `int \| None` | No | 100 | Maximum number of concurrent connections in the pool. None means no limit. Values must be >= 1 if set. |
+| `network.limits.max_keepalive_connections` | `int \| None` | No | 20 | Maximum number of idle keep-alive connections to retain. None means no limit. Values must be >= 0 if set. |
+| `network.limits.keepalive_expiry` | `float \| None` | No | 5.0 | Time in seconds to keep idle keep-alive connections open before closing them. None means no expiry. Values must be >= 0 if set. |
 | `base_url` | `HttpUrl \| None` | No | https://api.fireworks.ai/inference/v1 | The URL for the Fireworks server |
 
 ## Sample Configuration