I have broadband and phone but I never use the phone can I remove the phone from my contract?
In theory, yes. In reality, and the way VM prices its services, it is often cheaper with VM to have a bundle of services (say, broadband plus phone). Bundling to obtain a discount works OK if you renew regularly after each minimum contract term, otherwise you move to a higher long-term bundle price and continue with a bundled service you probably make no use of.
If you wish to be a broadband-only customer then there may be other providers who can offer better pricing (especially as a new customer) if speed is not an overriding concern for you.
As with all things to do with VM though, you may be able to agree a suitable individual deal with VM for broadband-only at a price which is acceptable to you.