Bank of England Governor Andrew Bailey played down inflation fears, although banks missed out amid fears of a tax hit.