OVHcloud Private Cloud Status

Current status
Legend
  • Operational
  • Degraded performance
  • Partial Outage
  • Major Outage
  • Under maintenance
FS#5840 — pcc-22 et pcc-25
Incident Report for Hosted Private Cloud
Resolved
We have just detected 2 switch down.
WE intervene.

Update(s):

Date: 2011-09-29 14:47:53 UTC
cc-22-n5(config-if-range)# sh proc cpu sort

PID Runtime(ms) Invoked uSecs 1Sec Process
----- ----------- -------- ----- ------ -----------
3206 211 139 1519 20.9% netstack

20%-30% for software treatment.


Date: 2011-09-29 14:47:20 UTC
we have found the origin of the problem which was due to a
human error and a bug: a technician took
an IP already in production pcc-25 for another
equipment which has caused the alert on the PCC-25 that has
not planted and does not degraded the service. the
technician also took the IP of the PCC-22 and plated the switch (!)

it has been updated with the version
N5000-uk9.5.1.3.N1.0.254.bin
we turned the spantree. we protect the CPU against
the BPDU packets that we have on the network and
are processed in software.





Date: 2011-09-29 14:36:54 UTC
PCC-22 has a stable version of NX-OS but to get
around a bug that grubs the CPU of N5 we
have enabled the spantree.

Since we have received an alpha version of NX-OS which we are using in all the other pcc-XX-n5
and which allows us to protect the CPU to some
measure. waiting the beta next week.




Date: 2011-09-29 14:26:45 UTC
pcc-25 has come back.
pcc-25 was not completely planted but partially
so it has not cut the hosts ports.
We have cut the pcc-22 port.The traffic has been taken by the PCC-23 card on the other network hosts.
Posted Sep 29, 2011 - 13:50 UTC