
Please register for RunPod at: https://runpod.io?ref=1aka98lq

Select a GPU with a minimum of 48 GB VRAM, such as the RTX A6000. Higher resolution uses more VRAM thus to be sure

Choose a RunPod template:

RunPod PyTorch 2.1
runpod/pytorch
:2.1.0-py3.10-cuda11.8.0-devel-ubuntu22.04

Edit the pod configuration:
Set the volume disk size to 50 GB or your preferred size.

Add HTTP port 7861 to the exposed ports list to enable proxy connection.
By default, it will start with the --share option for Gradio sharing.

Upload all files to the workspace folder.

To install, run the following commands:

export HF_HOME="/workspace"
chmod +x Runpod_Install.sh
./Runpod_Install.sh

To use after installation:

Open a new terminal and run the following code each time you start:


cd /workspace
export HF_HOME="/workspace"
export PYTHONWARNINGS="ignore"
export CUDA_VISIBLE_DEVICES=0
source venv/bin/activate
python App.py --share

You will receive a Gradio live link, and you'll be able to connect via the proxy on port 7861.

Pay attention to the Gradio share link among the printed messages.

Remove the --share option if you don't want the Gradio live link

If you rent multiple GPU machine, you can start different instances on each GPU by changing export CUDA_VISIBLE_DEVICES=1 2 3 4 etc
