The latency issue seemed to be OK for the last few days (although not a massive amount of use) that was until last night and we're back to how it was. I left it until about an hour ago when I tried and again and as before, as soon as I use it, it's a nightmare.
Here's the BQMs from the 24th and the last 24h. Most of the day it was in use on the the 24th, whereas the last 24h you can probably tell where I tried to use it.
I will call VM again in the New Year and check on if they are actually going to dig up my road in a crazy attempt to fix this.