Remote access to LLM using a corporate proxy #1084

[olivier-jobert]

Hello,

Unless I’m mistaken, it does not seem possible to configure an outbound proxy so that the AI gateway (AI Proxy plugin) can reach remote LLMs (for example, AWS Bedrock) through a corporate proxy.

I tried setting the proxy using the HTTPS_PROXY / https_proxy environment variables, but this does not allow access to the LLMs (The upstream server is currently unavailable).

Did I miss any configuration step?

Thank you

[tzssangglass]

The upstream server is currently unavailable means that the upstream you configured might be incorrect. Kong is unable to connect to this upstream. You can check the upstream configuration and use tools like curl on the machine where Kong is running to verify upstream network connectivity.

[olivier-jobert]

If I use curl with the proxy, it works to reach the LLM endpoint. I suspect Kong isn't picking up the environment proxy configuration where the process is launched (via systemd). Therefore, I'm wondering if there is a specific configuration setting to define the proxy Kong should use to connect to external services.

[tzssangglass]

Maybe you need to change the upstream to your the proxy

[gray63659-glitch]

Could I provide the exact error message

…

On Thu, Mar 19, 2026, 2:04 AM kurt ***@***.***> wrote: Maybe you need to change the upstream to your the proxy — Reply to this email directly, view it on GitHub <#14841 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/B72N4ZG76KRYEKELB5RHJDT4ROLXRAVCNFSM6AAAAACWD5X6ECVHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTMMRQGM2TINQ> . You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>