It is the same process as building normally, but at the building menu you have a new point called build as alliance building. This is only possible with academies and prisons or hospitals.