Provinces above level 1 gain fortification, which provides them with a certain amount of base defense.
Provinces will gain a higher fortification, the higher their level is. It’s also possible to station units there as defense.