If you conquer a province, it will belong to you and provides you with additional resources. If you conquer the province of another player, he will lose control over it and it will keep its current level in your possession.
In order to take over the province, you’ll need to be stronger in all three categories of combat: Infantry, Artillery and Cavalry.