OVHcloud Network Status
Current status
Legend
- Operational
- Degraded performance
- Partial Outage
- Major Outage
- Under maintenance
FS#7147 — Bell
Incident
Report for Network & Infrastructure
Resolved
The TATA transit at Montreal has became a priority in routing. We have cut it off.
We are searching the origin of the problem.
Update(s):
Date: 2012-08-08 23:03:27 UTC
We are routing correctly to Bell now.
Date: 2012-08-08 23:02:32 UTC
198.32.118.113 4 577 220959 198518 0 0 0 00:38:27 Idle (PfxCt)
We have reactivated the peering in New York with Bell.
198.32.118.113 4 577 221723 199188 399559233 0 0 00:01:11 3925
nyk-1-6k#sh ip bgp neighbors 198.32.118.113 routes
BGP table version is 399559655, local router ID is 213.251.130.23
Status codes: s suppressed, d damped, h history, * valid, > best, i - internal,
r RIB-failure, S Stale
Origin codes: i - IGP, e - EGP, ? - incomplete
Network Next Hop Metric LocPrf Weight Path
*> 23.34.192.0/20 198.32.118.113 0 300 0 577 i
*> 23.34.196.0/22 198.32.118.113 0 300 0 577 i
*> 23.34.200.0/22 198.32.118.113 0 300 0 577 i
*> 23.34.204.0/22 198.32.118.113 0 300 0 577 i
*> 23.34.208.0/20 198.32.118.113 0 300 0 577 i
*> 23.34.212.0/22 198.32.118.113 0 300 0 577 i
*> 23.34.216.0/22 198.32.118.113 0 300 0 577 i
*> 23.34.220.0/22 198.32.118.113 0 300 0 577 i
*> 23.58.84.0/23 198.32.118.113 0 300 0 577 i
*> 23.58.86.0/23 198.32.118.113 0 300 0 577 i
*> 23.58.112.0/20 198.32.118.113 0 300 0 577 i
*> 23.58.116.0/22 198.32.118.113 0 300 0 577 i
*> 23.58.120.0/22 198.32.118.113 0 300 0 577 i
*> 23.58.124.0/22 198.32.118.113 0 300 0 577 i
*> 23.58.128.0/20 198.32.118.113 0 300 0 577 i
*> 23.58.144.0/22 198.32.118.113 0 300 0 577 i
Date: 2012-08-08 23:01:04 UTC
Bell is down.
Date: 2012-08-08 23:00:48 UTC
Visibly there was a problem on MTL between TATA and Bell.
6. mtl-1-6k.qc.ca 9.5% 22 178.1 104.3 83.7 271.5 51.6
7. tata.as6453.qc.ca 0.0% 22 83.5 89.3 83.5 142.0 13.4
8. if-5-2.tcore1.MTT-Montreal.as6453.net 90.0% 21 170.5 169.7 169.0 170.5 1.0
9. if-4-2.tcore1.TTT-Scarborough.as6453.net 0.0% 21 168.4 172.7 167.3 185.7 5.4
10. if-8-2.tcore1.CT8-Chicago.as6453.net 0.0% 21 165.0 169.2 164.9 191.9 7.8
11. 64.86.79.1 75.0% 21 167.1 167.1 167.0 167.2 0.1
12. if-6-0-0.core1.00S-Seattle.as6453.net 0.0% 21 260.8 234.4 163.5 344.1 56.8
13. if-5-0.core2.VCW-Vancouver.as6453.net 0.0% 21 170.7 244.6 168.0 370.2 62.6
14. if-4-1-0.core3.VCW-Vancouver.as6453.net 0.0% 21 388.9 177.6 166.5 388.9 48.4
mtl-1-6k.qc.ca
Date: 2012-08-08 23:00:07 UTC
We have filtered the defective announces that Bell causes to TATA which accepts them and we announce it on its behalf (!!).
Date: 2012-08-08 22:43:31 UTC
Bell announces at Montreal announces a bit to the entire world. We will filter it.
mtl-1-6k#sh ip bgp neighbors 178.32.135.82 routes
BGP table version is 1614027857, local router ID is 178.32.135.103
Status codes: s suppressed, d damped, h history, * valid, > best, i - internal,
r RIB-failure, S Stale
Origin codes: i - IGP, e - EGP, ? - incomplete
Network Next Hop Metric LocPrf Weight Path
* 1.0.0.0/24 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 15169 i
* 1.0.64.0/18 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 6939 4725 7670 7670 18144 i
* 1.0.128.0/18 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 10026 38040 9737 i
* 1.0.129.0/24 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 1273 4651 9737 23969 i
* 1.1.1.0/24 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 15169 i
* 1.1.128.0/17 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 10026 38040 9737 i
* 1.2.3.0/24 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 15169 i
* 1.2.128.0/17 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 10026 38040 9737 i
* 1.4.128.0/17 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 10026 38040 9737 i
* 1.5.0.0/16 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 6939 4725 i
* 1.8.101.0/24 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 6939 10026 7497 38345 i
* 1.8.150.0/24 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 6939 10026 7497 38345 i
* 1.8.151.0/24 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 6939 10026 7497 38345 i
* 1.18.118.0/24 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 6939 4766 23600 i
* 1.18.119.0/24 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 6939 4766 23600 i
* 1.20.0.0/24 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 1273 4651 9737 56120 i
* 1.20.0.0/17 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 1273 4651 9737 56120 i
* 1.20.1.0/24 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 1273 4651 9737 56120 i
* 1.20.2.0/24 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 10026 38040 9737 9737 9737 56120 i
We are searching the origin of the problem.
Update(s):
Date: 2012-08-08 23:03:27 UTC
We are routing correctly to Bell now.
Date: 2012-08-08 23:02:32 UTC
198.32.118.113 4 577 220959 198518 0 0 0 00:38:27 Idle (PfxCt)
We have reactivated the peering in New York with Bell.
198.32.118.113 4 577 221723 199188 399559233 0 0 00:01:11 3925
nyk-1-6k#sh ip bgp neighbors 198.32.118.113 routes
BGP table version is 399559655, local router ID is 213.251.130.23
Status codes: s suppressed, d damped, h history, * valid, > best, i - internal,
r RIB-failure, S Stale
Origin codes: i - IGP, e - EGP, ? - incomplete
Network Next Hop Metric LocPrf Weight Path
*> 23.34.192.0/20 198.32.118.113 0 300 0 577 i
*> 23.34.196.0/22 198.32.118.113 0 300 0 577 i
*> 23.34.200.0/22 198.32.118.113 0 300 0 577 i
*> 23.34.204.0/22 198.32.118.113 0 300 0 577 i
*> 23.34.208.0/20 198.32.118.113 0 300 0 577 i
*> 23.34.212.0/22 198.32.118.113 0 300 0 577 i
*> 23.34.216.0/22 198.32.118.113 0 300 0 577 i
*> 23.34.220.0/22 198.32.118.113 0 300 0 577 i
*> 23.58.84.0/23 198.32.118.113 0 300 0 577 i
*> 23.58.86.0/23 198.32.118.113 0 300 0 577 i
*> 23.58.112.0/20 198.32.118.113 0 300 0 577 i
*> 23.58.116.0/22 198.32.118.113 0 300 0 577 i
*> 23.58.120.0/22 198.32.118.113 0 300 0 577 i
*> 23.58.124.0/22 198.32.118.113 0 300 0 577 i
*> 23.58.128.0/20 198.32.118.113 0 300 0 577 i
*> 23.58.144.0/22 198.32.118.113 0 300 0 577 i
Date: 2012-08-08 23:01:04 UTC
Bell is down.
Date: 2012-08-08 23:00:48 UTC
Visibly there was a problem on MTL between TATA and Bell.
6. mtl-1-6k.qc.ca 9.5% 22 178.1 104.3 83.7 271.5 51.6
7. tata.as6453.qc.ca 0.0% 22 83.5 89.3 83.5 142.0 13.4
8. if-5-2.tcore1.MTT-Montreal.as6453.net 90.0% 21 170.5 169.7 169.0 170.5 1.0
9. if-4-2.tcore1.TTT-Scarborough.as6453.net 0.0% 21 168.4 172.7 167.3 185.7 5.4
10. if-8-2.tcore1.CT8-Chicago.as6453.net 0.0% 21 165.0 169.2 164.9 191.9 7.8
11. 64.86.79.1 75.0% 21 167.1 167.1 167.0 167.2 0.1
12. if-6-0-0.core1.00S-Seattle.as6453.net 0.0% 21 260.8 234.4 163.5 344.1 56.8
13. if-5-0.core2.VCW-Vancouver.as6453.net 0.0% 21 170.7 244.6 168.0 370.2 62.6
14. if-4-1-0.core3.VCW-Vancouver.as6453.net 0.0% 21 388.9 177.6 166.5 388.9 48.4
mtl-1-6k.qc.ca
Date: 2012-08-08 23:00:07 UTC
We have filtered the defective announces that Bell causes to TATA which accepts them and we announce it on its behalf (!!).
Date: 2012-08-08 22:43:31 UTC
Bell announces at Montreal announces a bit to the entire world. We will filter it.
mtl-1-6k#sh ip bgp neighbors 178.32.135.82 routes
BGP table version is 1614027857, local router ID is 178.32.135.103
Status codes: s suppressed, d damped, h history, * valid, > best, i - internal,
r RIB-failure, S Stale
Origin codes: i - IGP, e - EGP, ? - incomplete
Network Next Hop Metric LocPrf Weight Path
* 1.0.0.0/24 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 15169 i
* 1.0.64.0/18 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 6939 4725 7670 7670 18144 i
* 1.0.128.0/18 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 10026 38040 9737 i
* 1.0.129.0/24 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 1273 4651 9737 23969 i
* 1.1.1.0/24 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 15169 i
* 1.1.128.0/17 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 10026 38040 9737 i
* 1.2.3.0/24 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 15169 i
* 1.2.128.0/17 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 10026 38040 9737 i
* 1.4.128.0/17 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 10026 38040 9737 i
* 1.5.0.0/16 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 6939 4725 i
* 1.8.101.0/24 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 6939 10026 7497 38345 i
* 1.8.150.0/24 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 6939 10026 7497 38345 i
* 1.8.151.0/24 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 6939 10026 7497 38345 i
* 1.18.118.0/24 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 6939 4766 23600 i
* 1.18.119.0/24 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 6939 4766 23600 i
* 1.20.0.0/24 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 1273 4651 9737 56120 i
* 1.20.0.0/17 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 1273 4651 9737 56120 i
* 1.20.1.0/24 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 1273 4651 9737 56120 i
* 1.20.2.0/24 178.32.135.82 0 35 0 6453 577 46618 46618 46618 46618 46618 5769 10026 38040 9737 9737 9737 56120 i