If your castle is not within 3 fields you can not link the castle to your center and it is not shown in the list.
You should also check if your castle is fully upgraded and researched all knowledges.
Also make sure your castle you want to link has 20.000 silver.