To uninstall the main game, simply delete the folder that you extracted. :)

All other external data (settings/save games/etc) is stored at:
C:\Users\<your username>\AppData\LocalLow\PostalRoo\CursedObjects