Kubernetes

1201 readers

9 users here now

founded 2 years ago

MODERATORS

erlingur@programming.dev

Daemon@programming.dev

Why are long ingress timeouts bad? (lemmy.world)

submitted 2 months ago by Klordok@lemmy.world to c/kubernetes@programming.dev

3 comments fedilink hide all child comments

A few of our users occasionally spin up pods that do a lot of number crunching. The front end is a web app that queries the pod and waits for a response.

Some of these queries exceed the default 30s timeout for the pod ingress. So, I added an annotation to the pod ingress to increase the timeout to 60s. Users still report occasional timeouts.

I asked how long they need the timeout to be. They requested 1 hour.

This seems excessive. My gut feeling is this will cause problems. However, I don't know enough about ingress timeouts to know what will break. So, what is the worst case scenario of 3-10 pods having 1 hour ingress timeouts?

you are viewing a single comment's thread
view the rest of the comments

[–] lemmyng@piefed.ca 2 points 2 months ago

It depends. If it's an internal facing cluster with little other traffic then it's probably fine. If it's a public facing cluster with NAT then you risk the possibility of exhausting the number of ports for open connections.

If the frontend reliably closes connections when done, then it's probably fine to just set a 1h timeout. If you run into the problem of clients leaving idle connections open then you may want to consider setting an idle timeout, and then have the client send keepalive packets to the backend, websocket style.