Prince Harry made a low-key visit to a small town for Remembrance Sunday service while the royals led commemorations in London.