As your income increases you increase your defenses. Guards, armored caravans, a bank to store your gold, a connection to the local ruler so guards respond quickly, etc.

Besides, a wizard is probably spending most of their profits and books and other spell supplies. They gotta fund that Wizard's Tower of Compensation some how.