Memory Usage

[abillits]

Hi,

We're using the docker image provided and we've run into an issue where Titiler increases memory consumption with every request. The amount of memory used never decreases. It'll use the entire 128GB available on the server unless we restart the container.

The logs don't contain anything other than http 200 messages and everything technically works until the server runs out of available memory.

Any idea what could be causing this?

[vincentsarago]

@idtstudios I've seen this too but I've never been able to really track down where it was.

fastapi/fastapi#1624 might be an interesting issue. I was also going to try using https://github.com/bloomberg/memray to track down this but didn't had time yet.

[abillits]

Well, at least I'm not crazy. I figured I had something misconfigured but nothing I tweaked helped.

I'll see what I can find.

[abillits]

Well, this is definitely an upstream issue and not a Titiler issue. It apparently plagues numerous projects built on fastapi and/or uvicorn.

I've run out of time tonight to dig into this but I've slapped a bandage on the problem by using max_requests to restart workers. Not ideal but it'll keep things running for now.