If the broadband is part of a package it well affect the pricing on the rest of the pacakge. If it's standalone broadband then it's a straightforward cancellation.
You could try the text messaging service. Just send a text with a description of cancellation to 07533 051809. Your message will go into a queue and a representative will respond to you as soon as possible. It may take a few days.
You can also call 150 from a Virgin landline, or 0345 454 1111, but best to call at 8am to avoid call queues
Or write to them to as per the terms and conditions. If writing send it by registered post.