Provinces above level 1 gain fortification, which provides them with a certain amount of base defense. Provinces will gain a higher fortification, the higher their level is.
It’s also possible to station units there as defense.