Although it would be possible to request a number port for that then to transfer it from Sky to Virgin Media, the number needs to be active with no disconnection order on it usually in order for the request to be accepted.
If the line has a disconnection request pending the port request from Virgin Media to Sky is likely to be rejected.
**********************************
I work for Virgin Media - but all opinions posted here are my own