The Air Force Sports Complex, which includes the golf course, is the latest property near the Prime Minister's residence set to be taken back this year, as the land is owned by ministries.