Well, I use micro-inverters on my panels... which converts their DC, into AC on the panel itself.
The microinverters are around 98/99% efficient, and actually PRODUCE more energy than they use- by allowing each panel to produce its maximum capacity, regardless of if one of the panels is randomly shaded.
And- overall, the efficiency gains has been easily quantifiable, especially during the winter when one of my panels is partially shaded by the power riser.
That being said.
If you really want to avoid the inefficiency- and you use 48v battery banks, connect your server to those. But- not to the panels DC.