select runpod template

RunPod Pytorch 2.1
runpod/pytorch
:2.1.0-py3.10-cuda11.8.0-devel-ubuntu22.04

edit pod
make volume disk 100 gb

add expose HTTP ports 7861 to connect via proxy
it will by defualt start with --share with gradio share as well

upload everything into workspace folder

to install run below command

export HF_HOME="/workspace"
chmod +x install_Linux.sh
./install_Linux.sh

to use after install

open a new terminal and run below code to start every time

this will ask you which model to load open in a new terminal

cd /workspace
export HF_HOME="/workspace"
cd /workspace/CogVLM
source venv/bin/activate
cd ..
chmod +x run_linux.sh
./run_linux.sh


you will get a gradio live link and you will be able to connect with proxy 7861 port
pay attention to see gradio share link among all printed messages

