Request: Enable Multi-GPU Support for FLUX.1-Kontext-Dev Space

#20
by zytoh - opened

Hi team,

I've been exploring the FLUX.1-Kontext-Dev Space and its source at this repository. It's an impressive project, and I was able to successfully run it locally using the provided Docker setup.

Here’s the command I used:

docker run -it -p 7860:7860 --platform=linux/amd64 --gpus all
-e HF_TOKEN="YOUR_VALUE_HERE"
registry.hf.space/black-forest-labs-flux-1-kontext-dev:latest python app.py

While the container runs smoothly, I noticed that the application only utilizes one GPU, despite my system having multiple available.

Could you please consider adding multi-GPU support for this space? This would significantly benefit users who demand speed and multi-concurrency.

Thanks in advance for considering this request.

Sign up or log in to comment