How were you measuring the current in the power cable? Is this with a Kill-o-watt device or perhaps with a clamp meter and a line splitter?
As for why there is a capacitor across the mains input, a switching DC power supply like an ATX PSU draws current in a fairly jagged fashion. So to stabilize the input voltage, as well as preventing the switching noise from propagating through the mains and radiating everywhere, some capacitors are placed across the AC lines. This is a large oversimplification, though, as the type and values of these capacitors are the subject of careful design.
Since a capacitor charges and discharges based on the voltage across it, and because AC power changes voltage "polarity" at 50 or 60 Hz, the flow of charge into and out of the capacitor will be measurable as a small current.
Your choice of measuring instrument will affect how precisely you can measure this apparent power, which will in-turn affect how your instrument reports the power factor. It can also be that the current in question also includes some of the standby current for keeping the PSU's logic ICs in a ready state, for when the computer starts up. So that would also explain why the power factor isn't exactly zero.