If the board is infinite, it means that bishops, queens and rooks can move an infinite distance and then must move at an infinite speed, constantly breaking the laws of physics. While knights, pawns and kings, having finite moves, travel at regular speeds.

The potential high energy collision during a castling would flatten the galaxy.

Promotion from a low energy pawn to a high energy queen would require the consumption of a black hole (approx.)