The centerpiece of the Seton Family was the Palace of Seton, standing on the same spot on the Seton baronial lands for upwards of eight hundred years, the original castle was a square tower built during the time of Seier de Seton sometime after 1066.  It was enlarged to become a more commodious residence, with a military character and French styling, after the "rough wooing" by England's King Henry VIII, when it became known as the "Palace of Seton", a magnificent Palatial residence by the 6th Lord Seton and continued by the famed George, 7th Lord Seton, and the 1st & 3rd Earls of Winton.