

Register RunPod from here please : https://runpod.io?ref=1aka98lq

So important to select template:
RunPod Pytorch 2.1
runpod/pytorch:2.1.0-py3.10-cuda11.8.0-devel-ubuntu22.04

Edit pod
Make volume disk 100 gb

Add expose HTTP ports 7861 to connect via proxy

It will by defualt start with --share with gradio share as well

Connect via Jupyterlab interface Port 8888

Upload RunPod files to your workspace

To install run below command

export HF_HOME="/workspace"
chmod +x RunPod_Install.sh
./RunPod_Install.sh

To use after install

Open a new terminal and execute below commands on different terminals

The first one will give you gradio live link

cd /workspace
export HF_HOME="/workspace"
cd /workspace/LLaVA
source venv/bin/activate
cd ..
chmod +x RunPod_Run_PT_1.sh
./RunPod_Run_PT_1.sh

Second command

cd /workspace
export HF_HOME="/workspace"
cd /workspace/LLaVA
source venv/bin/activate
cd ..
chmod +x RunPod_Run_PT_2.sh
./RunPod_Run_PT_2.sh

You will get a Gradio live link and you will be able to connect with proxy 7861 port

Pay attention to see gradio share link among all printed messages

