You (or he) should setup a BQM over at Thinkbroadband. Post a link to shared, live graph and we can see what you're dealing with.
VM latency is always worse than Openreach because VM's technology is more convoluted, but that alone is relatively modest (10-15ms, and depends where you are), so if he's noticing a problem then there might be a fixable fault.
