faster-whisper-server backend not practical (using constant 5-10GB memory)

[heliole]

Is there a memory efficient way to use Faster-whisper-server backend? Because from my understanding the docker container needs to be on in order for the transcription to work. So that means in order to use whispering on demand, it would always use 5GB+ memory on my laptop which isn't practical.