The Rector’s Palace is located on the main square. It was built in the 15th century and completed under the rule of Rector Toma Zorzi. It has been the centre of town and island administration for centuries.

Until the mid-19th century, the town of Pag was encircled by sizeable and lovely walls with defence towers. Pag had several town gates, and the largest was in the Katine section, called the Porta Marina. Only the lintel of Rector Nikola Tiepolo remains preserved from this gate. The Minor Gate was a little farther south.