Menu
Reply
dojm
  • 6
  • 0
  • 0
Joining in
498 Views
Message 1 of 10
Flag for a moderator

Walls of red + yellow: What is going on?

My hardware setup:

  • Edgerouter X running OpenWRT
  • Superhub 3.0 on M350 in modem mode
  • FTTC connection on Uno with Huawei modem

Both connections are terminated by the ERX.

For the past couple of weeks I've noticed a lot of failovers from Virgin to Uno taking place. The connection then comes back up, fails back, but 30 minutes later it will failover again. I've tracked this down to a pingcheck which has a 10 second ping interval and it will wait for 30 seconds with no response before tearing the connection down. The target host is of course 8.8.8.8 since Virgin's DNS servers don't seem to respond to ping.

I can't interpret the modem stats, but they are below:

Downstream bonded channels

Channel Frequency (Hz) Power (dBmV) SNR (dB) Modulation Channel ID

1

402750000

3

40

256 qam

30

2

202750000

4.8

40

256 qam

9

3

210750000

4.5

40

256 qam

10

4

218750000

4.5

40

256 qam

11

5

226750000

4.3

40

256 qam

12

6

234750000

4.1

40

256 qam

13

7

242750000

4

40

256 qam

14

8

250750000

4.1

40

256 qam

15

9

258750000

4.1

40

256 qam

16

10

266750000

4.3

40

256 qam

17

11

274750000

4

40

256 qam

18

12

282750000

4.1

40

256 qam

19

13

290750000

4

40

256 qam

20

14

298750000

4

38

256 qam

21

15

306750000

4

40

256 qam

22

16

314750000

4

40

256 qam

23

17

322750000

4.1

40

256 qam

24

18

330750000

4

40

256 qam

25

19

370750000

3.5

40

256 qam

26

20

378750000

3.5

40

256 qam

27

21

386750000

3.5

40

256 qam

28

22

394750000

3.4

40

256 qam

29

23

410750000

3.4

40

256 qam

31

24

418750000

3.5

40

256 qam

32



Downstream bonded channels

Channel Locked Status RxMER (dB) Pre RS Errors Post RS Errors

1

Locked

40.3

85

0

2

Locked

40.3

18

0

3

Locked

40.3

44

0

4

Locked

40.3

31

0

5

Locked

40.3

43

0

6

Locked

40.3

31

0

7

Locked

40.3

99

0

8

Locked

40.9

42

0

9

Locked

40.3

35

0

10

Locked

40.3

40

0

11

Locked

40.3

51

0

12

Locked

40.3

40

0

13

Locked

40.3

51

0

14

Locked

38.9

60

0

15

Locked

40.9

64

0

16

Locked

40.3

77

0

17

Locked

40.9

68

0

18

Locked

40.3

66

0

19

Locked

40.3

51

0

20

Locked

40.3

55

0

21

Locked

40.9

65

0

22

Locked

40.3

82

0

23

Locked

40.3

60

0

24

Locked

40.9

47

0

 

Upstream bonded channels

Channel Frequency (Hz) Power (dBmV) Symbol Rate (ksps) Modulation Channel ID

1

39400000

45

5120

64 qam

4

2

46200000

45.3

5120

64 qam

3

3

53700000

45.5

5120

64 qam

2

4

60300000

45.3

5120

64 qam

1

 

Upstream bonded channels

Channel Channel Type T1 Timeouts T2 Timeouts T3 Timeouts T4 Timeouts

1

ATDMA

0

0

1

0

2

ATDMA

0

0

0

0

3

ATDMA

0

0

0

0

4

ATDMA

0

0

0

0

 

So, time for some BQM graphs...

(4b94e41c992fc791cc636b113118836279735a47).png

 

And for comparison with Uno (remember it's terminating at the same piece of hardware):

uno.png

Overall speed isn't too badly affected.

It's taken me a while to get back to finishing this post, and it now looks like the latency is better, but the packet drops are worse:

92c52d68e06d6c357f4d032f024714b6f0ff7e5d-29-11-2020

Interestingly during the dropouts, there's still network traffic and I can still observe the usual ARP requests from networks outside of the /22 netmask assigned, SYNs from known "bad hosts" to other Virgin IPs (again outside of the /22 netmask) 

Moving back to taking a look at the first hop, pinging the virgin gateway assigned by DHCP I get this result:

248 packets transmitted, 218 packets received, 12% packet loss
round-trip min/avg/max = 6.471/8.985/25.670 ms

I'm a bit stuck as to what else I can investigate or fix, all internal coax connections are tight, the hub has been rebooted countless times. 

0 Kudos
Reply
MikeRobbo
  • 15.27K
  • 1.17K
  • 1.95K
Alessandro Volta
478 Views
Message 2 of 10
Flag for a moderator

Re: Walls of red + yellow: What is going on?

Have you got two devices running as Modems ?


*********************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************
BT Smart Hub 2 with 70Mbs Download,18Mbs Upload, 9.17ms Latency & 0.35ms Jitter.
0 Kudos
Reply
dojm
  • 6
  • 0
  • 0
Joining in
470 Views
Message 3 of 10
Flag for a moderator

Re: Walls of red + yellow: What is going on?

Yes, I'm dual homed via two different providers and disparate technologies - I've had that working for years so that isn't a problem here and it has been something of a job-saver over the past few weeks.

I only mentioned it because the BQM is hitting the same device via the two different connections and the quality difference is eyeopening.

0 Kudos
Reply
MikeRobbo
  • 15.27K
  • 1.17K
  • 1.95K
Alessandro Volta
462 Views
Message 4 of 10
Flag for a moderator

Re: Walls of red + yellow: What is going on?

Can you start again please without bringing the other ISP kit into the picture.

Your images are still waiting to be authorised.

Post a 'Live Link' to your BQM on here.

Instructions for posting BQM Link

Under your BQM graph are two links in red.

Click the lower link (Share Live Graph) then click generate.

Copy the text in the Direct Link box, beware, there may be more text than you can see.

On here click the Link icon (2 links chain to the left of the camera icon)

In the URL box paste the link you copied and in the ‘text to display’ box write My BQM then click OK


*********************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************
BT Smart Hub 2 with 70Mbs Download,18Mbs Upload, 9.17ms Latency & 0.35ms Jitter.
0 Kudos
Reply
MikeRobbo
  • 15.27K
  • 1.17K
  • 1.95K
Alessandro Volta
460 Views
Message 5 of 10
Flag for a moderator

Re: Walls of red + yellow: What is going on?

Can you please

Type 192.168.0.1 (192.168.100.1 in Modem mode) into your browser URL bar and press enter. 

Hub 2 & 3 When the page appears DO NOT LOG IN but click ‘Check Router Status’.

Hub 4 When the page appears LOG IN then Advanced Settings > Tools > Network Status.

Copy and paste the contents of the Downstream, Upstream, Configuration and Network Log tabs onto here, if you get a yellow / straw box warning click the Post button again. Use one post for each tab if you wish.

Please do not use screen grabs.

A Guru will be along soon to decipher the info.


*********************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************
BT Smart Hub 2 with 70Mbs Download,18Mbs Upload, 9.17ms Latency & 0.35ms Jitter.
0 Kudos
Reply
dojm
  • 6
  • 0
  • 0
Joining in
454 Views
Message 6 of 10
Flag for a moderator

Re: Walls of red + yellow: What is going on?

I didn't realise the pictures would be moderated, however when they are approved at least there's a snapshot of the state at the time.

Live link here: 

https://www.thinkbroadband.com/broadband/monitoring/quality/share/cfa50b327129d121ffc1fe589ff3126ded8585f5

 

Stats from today are below, stats from yesterday are in the first post.

  Downstream bonded channels

Channel Frequency (Hz) Power (dBmV) SNR (dB) Modulation Channel ID

14027500003.240256 qam30
2202750000540256 qam9
32107500004.640256 qam10
42187500004.540256 qam11
52267500004.440256 qam12
62347500004.340256 qam13
7242750000440256 qam14
82507500004.340256 qam15
92587500004.340256 qam16
102667500004.440256 qam17
112747500004.140256 qam18
122827500004.440256 qam19
132907500004.140256 qam20
142987500004.138256 qam21
153067500004.140256 qam22
163147500004.340256 qam23
173227500004.340256 qam24
183307500004.140256 qam25
193707500003.740256 qam26
203787500003.740256 qam27
213867500003.540256 qam28
223947500003.540256 qam29
234107500003.540256 qam31
244187500003.740256 qam32



Downstream bonded channels

Channel Locked Status RxMER (dB) Pre RS Errors Post RS Errors

1Locked40.3170
2Locked40.380
3Locked40.3120
4Locked40.3160
5Locked40.3200
6Locked40.370
7Locked40.3210
8Locked40.3100
9Locked40.3150
10Locked40.3110
11Locked40.3190
12Locked40.3110
13Locked40.3130
14Locked38.9200
15Locked40.3320
16Locked40.3260
17Locked40.3120
18Locked40.3180
19Locked40.390
20Locked40.3130
21Locked40.9210
22Locked40.9160
23Locked40.390
24Locked40.3140

 

Upstream bonded channels

Channel Frequency (Hz) Power (dBmV) Symbol Rate (ksps) Modulation Channel ID

13940000045512064 qam4
24620000045.3512064 qam3
35370000045.5512064 qam2
46030000045.3512064 qam1



Upstream bonded channels

Channel Channel Type T1 Timeouts T2 Timeouts T3 Timeouts T4 Timeouts

1ATDMA0000
2ATDMA0000
3ATDMA0000
4ATDMA0000

 

General Configuration

Network access
Allowed
Maximum Number of CPEs
1
Baseline Privacy
Enabled
DOCSIS Mode
Docsis30
Config file
cmreg-vmdg505-bbt062+voc-b.cm

 

0 Kudos
Reply
dojm
  • 6
  • 0
  • 0
Joining in
453 Views
Message 7 of 10
Flag for a moderator

Re: Walls of red + yellow: What is going on?

Character limit exceeded, second part below:

 

 

Primary Downstream Service Flow

SFID555388
Max Traffic Rate402500089
Max Traffic Burst42600
Min Traffic Rate0



Primary Upstream Service Flow

SFID555387
Max Traffic Rate38500089
Max Traffic Burst42600
Min Traffic Rate0
Max Concatenated Burst42600
Scheduling TypeBestEffort

 

Network Log

Time Priority Description

01/01/1970 00:00:13ErrorToD request sent- No Response received;CM-MAC=**:**:**:**:**:**;CMTS-MAC=**:**:**:**:**:**;CM-QOS=1.1;CM-VER=3.0;
01/01/1970 00:01:56Warning!ToD request sent - No Response received;CM-MAC=**:**:**:**:**:**;CMTS-MAC=**:**:**:**:**:**;CM-QOS=1.1;CM-VER=3.0;
01/01/1970 00:01:42criticalNo Ranging Response received - T3 time-out;CM-MAC=**:**:**:**:**:**;CMTS-MAC=**:**:**:**:**:**;CM-QOS=1.1;CM-VER=3.0;
28/11/2020 18:08:56ErrorDHCP RENEW WARNING - Field invalid in response v4 option;CM-MAC=**:**:**:**:**:**;CMTS-MAC=**:**:**:**:**:**;CM-QOS=1.1;CM-VER=3.0;
28/11/2020 17:48:4noticeLAN login Success;CM-MAC=**:**:**:**:**:**;CMTS-MAC=**:**:**:**:**:**;CM-QOS=1.1;CM-VER=3.0;
28/11/2020 17:38:56ErrorDHCP RENEW WARNING - Field invalid in response v4 option;CM-MAC=**:**:**:**:**:**;CMTS-MAC=**:**:**:**:**:**;CM-QOS=1.1;CM-VER=3.0;
28/11/2020 05:00:56criticalNo Ranging Response received - T3 time-out;CM-MAC=**:**:**:**:**:**;CMTS-MAC=**:**:**:**:**:**;CM-QOS=1.1;CM-VER=3.0;
25/11/2020 10:17:26noticeLAN login Success;CM-MAC=**:**:**:**:**:**;CMTS-MAC=**:**:**:**:**:**;CM-QOS=1.1;CM-VER=3.0;
25/11/2020 10:13:30Warning!LAN login FAILED : Incorrect Username / Password / ConnectionType;CM-MAC=**:**:**:**:**:**;CMTS-MAC=**:**:**:**:**:**;CM-QOS=1.1;CM-VER=3.0;
25/11/2020 00:56:14ErrorDHCP RENEW WARNING - Field invalid in response v4 option;CM-MAC=**:**:**:**:**:**;CMTS-MAC=**:**:**:**:**:**;CM-QOS=1.1;CM-VER=3.0;
24/11/2020 16:18:33Warning!LAN login FAILED : Incorrect Username / Password / ConnectionType;CM-MAC=**:**:**:**:**:**;CMTS-MAC=**:**:**:**:**:**;CM-QOS=1.1;CM-VER=3.0;
21/11/2020 15:38:32criticalNo Ranging Response received - T3 time-out;CM-MAC=**:**:**:**:**:**;CMTS-MAC=**:**:**:**:**:**;CM-QOS=1.1;CM-VER=3.0;
21/11/2020 12:56:14ErrorDHCP RENEW WARNING - Field invalid in response v4 option;CM-MAC=**:**:**:**:**:**;CMTS-MAC=**:**:**:**:**:**;CM-QOS=1.1;CM-VER=3.0;
18/11/2020 22:06:17criticalNo Ranging Response received - T3 time-out;CM-MAC=**:**:**:**:**:**;CMTS-MAC=**:**:**:**:**:**;CM-QOS=1.1;CM-VER=3.0;
18/11/2020 00:56:14ErrorDHCP RENEW WARNING - Field invalid in response v4 option;CM-MAC=**:**:**:**:**:**;CMTS-MAC=**:**:**:**:**:**;CM-QOS=1.1;CM-VER=3.0;
18/11/2020 00:25:23criticalNo Ranging Response received - T3 time-out;CM-MAC=**:**:**:**:**:**;CMTS-MAC=**:**:**:**:**:**;CM-QOS=1.1;CM-VER=3.0;
18/11/2020 00:24:16criticalReceived Response to Broadcast Maintenance Request, But no Unicast Maintenance opportunities received - T4 time out;CM-MAC=**:**:**:**:**:**;CMTS-MAC=**:**:**:**:**:**;CM-QOS=1.1;CM-VER=3.0;
18/11/2020 00:18:49Warning!Lost MDD Timeout;CM-MAC=**:**:**:**:**:**;CMTS-MAC=**:**:**:**:**:**;CM-QOS=1.1;CM-VER=3.0;
18/11/2020 00:18:45Warning!RCS Partial Service;CM-MAC=**:**:**:**:**:**;CMTS-MAC=**:**:**:**:**:**;CM-QOS=1.1;CM-VER=3.0;
18/11/2020 00:18:45criticalSYNC Timing Synchronization failure - Loss of Sync;CM-MAC=**:**:**:**:**:**;CMTS-MAC=**:**:**:**:**:**;CM-QOS=1.1;CM-VER=3.0;

 

0 Kudos
Reply
MikeRobbo
  • 15.27K
  • 1.17K
  • 1.95K
Alessandro Volta
450 Views
Message 8 of 10
Flag for a moderator

Re: Walls of red + yellow: What is going on?

Have you checked the 'Check Service Status' at the top of the page ?

If nothing is showing try phoning 0800 561 0061, this will tell you of more local issues that may be affecting your district. Be aware that it isn't a manned line.

It looks to me like there is noise on the WAN side line.

Go round all the accessible internal and external co-ax connections and ensure that they are finger tight.


*********************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************
BT Smart Hub 2 with 70Mbs Download,18Mbs Upload, 9.17ms Latency & 0.35ms Jitter.
0 Kudos
Reply
dojm
  • 6
  • 0
  • 0
Joining in
438 Views
Message 9 of 10
Flag for a moderator

Re: Walls of red + yellow: What is going on?

Thanks for your help.

All connections were tight, though the outdoor cover seems to have popped off at some point in the past (it's in a fairly sheltered location, so hopefully it's not been too exposed).

No issues outstanding in the area either.

The BQM will no longer update - I've turned the modem off since the connection is so unstable.

 

0 Kudos
Reply
dojm
  • 6
  • 0
  • 0
Joining in
268 Views
Message 10 of 10
Flag for a moderator

Re: Walls of red + yellow: What is going on?

Well, it's early days (only an hour or so) but I think I've managed to solve this issue, at the very least, the only packet drop I've seen was expected as I swapped around a few cables.

I've swapped out my ERX router for another, identically configured ERX router. Of course this has a different MAC address which means I've now got a new IP address and my next hop is now different.

Reviewing some (incomplete) logs, I can see that my Virgin IP address changed at some point after 11/11, which correlates well with problems starting around 21/11.

To be polite, this has been a very frustrating yet enlightening experience.

 

 

 

 

 

0 Kudos
Reply