It's probably too bare bones, but I'm currently using https://github.com/nikolassv/bartib for my personal time tracking. Maybe you can build something around it.

Another one I've came across but never tried: https://github.com/almarklein/timetagger.