When you are in the Stronghold of your alliance, go to the "Members" menu and look for yourself in the list. You will see a red button. When you click it, you will leave the alliance.