Helm chart installation in EKS using custom ECR images

[oskarnrk]

Hey everyone,
I'm trying to set up a local dev workflow with Floci. These are my steps:

• I run Floci with docker compose (to have more configuration freedom)
• I build custom images with Podman
• I push them to the Floci ECR registry
• I install an Helm chart on the Floci EKS cluster (k3s under the hood)

The push side works fine. I tag my images as 000000000000.dkr.ecr.us-east-1.localhost:5100/my-repo:tag and Docker pushes without issues since it auto-trusts *.localhost as insecure.

The problem is on the pull side inside k3s. The EKS cluster (k3s container) needs to pull those images from the ECR registry, but localhost inside k3s refers to itself, not to the host or the Floci container, so the *.localhost:5100 URI that ECR returns is unreachable from within k3s.
So I tried FLOCI_SERVICES_ECR_URI_STYLE: path and floci-ecr-registry:5100/000000000000/us-east-1 as the registry in my Helm chart values: connection refused.
So again I tried host.docker.internal:5100/000000000000/us-east-1 and it found it! But containerd in k3s defaults to HTTPS, while Floci's ECR registry only serves HTTP. So the pull fails with "server gave HTTP response to HTTPS client".

The standard k3s fix for this is a /etc/rancher/k3s/registries.yaml that configures the registry as an insecure HTTP endpoint. However, since Floci manages the k3s container internally, I don't see a way to inject this file through docker-compose.yml or any FLOCI_SERVICES_EKS_* environment variable.
Enabling HTTPS seems not possibile at the moment since FLOCI_SERVICES_ECR_TLS_ENABLED seems to be "reserved for future ACM-backed TLS".

Is there a supported way to achieve what I'm trying to do? Or am I missing something?

Every advice is welcome! Thanks in advance!

[hectorvent]

Hi @oskarnrk,

We will need to apply a fix for this. The /etc/rancher/k3s/registries.yaml should populated by floci in the flight.

I will try to get this fixed in the next release.

[hectorvent]

@oskarnrk I created issue #1761

[oskarnrk]

That's great! Thank you @hectorvent! 🚀