Cole said Dowden hasn’t been ‘up to the challenge’ for ‘the last few years’