I've always taken it that the guard knew Gandalf's staff was a weapon, but also knew his king was compromised and Gandalf was there to help. There was enough plausible deniability to let the staff through.