I have recently learned that this is called Delayed sleep phase syndrome (DSPS) and is very common in many people 'on the spectrum'. I think it's nonsense to call it a syndrome but that's modern society for you.
Anyway, I usually don't sleep before 4am, often even later. It's rough 😬