There are a few sad reasons why you're having issues getting someone and why they keep pushing you to get a handyman. 1. It's a small job that is tedious to do and requires just enough expertise that most general carpenters don't really want to mess with it. 2. It's a short enough job that whoever you're talking to would see it as a loss for income on the day. They cannot justify pricing out mobilization, travel time, etc for a maybe 2 hour job. Depending on how much it needs to be tweaked, any handy person with a couple tools should be able to handle it but because of the perceived issues with the job, many will flat out deny it.

Door work is one of the most tedious because it's immediately apparent if something is slightly off. You're putting a rectangular block into a rectangular hole, any small defects are VERY accentuated by the nature of it, which is why many people do not want to get involved with a door that needs tweaks. (which is one of the things I've been dealing with at work this past week. Welded steel frames in plastered walls and just having to make the door fit.. no matter what shape the frame has moved itself to.