I made an article a while back specifically on setting this up with websites. Could definitely use it for your server.

https://www.itspixelperfect.ca/2023/02/10/the-ultimate-guide-to-setting-up-a-reverse-proxy/