Vikunja can be fully local. You just need a database (I think it only supports postgres). You can use the sqlite database for 1-2 users but I would use a full fledged database for an office setting.
I know they have a docker solution and if I remember correctly, a package solution as well. As others have said, you can get a RasPi or a cheap mini pc (better option in my opinion) and load Linux on it.
Once it is set up, you can use the machines ip to access it or put it in to a reverse proxy if you have one set up.