Broadly speaking yes, in your case around £84 to leave, although given that there may be partial months already run it may wobble about a bit. You'd have to give 30 days notice and then pay three months early disconnection fees, and VM insist they do charge VAT as that's in line with HMRC rules.
If you want to dispute the VAT aspect you'll need to use VM's complaint process, and because it'll be too complicated for the complaints laundering team, you'll almost certainly need to involve the industry adjudication scheme CISAS - and "other companies don't charge VAT" is not the basis of a valid complaint, you'd need to link to actual HMRC guidance or legislation to make a successful case. All of which seems a whole lot of effort for about fifteen quid or so?
