Less-known sites feature alongside castles, James Bond and Jeremy Clarkson's pub