You can switch positions with abandoned ruins by clicking on them on the map. The relocate of the county costs gold or tokens.