OVHcloud Private Cloud Status

Current status
Legend
  • Operational
  • Degraded performance
  • Partial Outage
  • Major Outage
  • Under maintenance
FS#8140 — The infrastructure pcc infrastructure monitoring
Scheduled Maintenance Report for Hosted Private Cloud
Completed
We will move the infrastructure of pCC infrastructure monitoring of the room 20 to room 30 RBX2.
This maintenance has no impact on production.



Update(s):

Date: 2013-03-01 21:57:52 UTC
The whole monitoring infrastructure is performing.

Date: 2013-03-01 14:54:24 UTC
The machine has been migrated and the hardware is operational.
We launch software tests.

Date: 2013-03-01 14:53:38 UTC
All tests are conclusive.

We move to the second machine of the monitoring infrastructure.

Date: 2013-03-01 14:52:30 UTC
The card was the problem.
All 10G ports are up and operational.

Name PCI Driver Link Speed Duplex MAC Address MTU Description
vmnic2 0000:07:00.00 e1000e Up 1000Mbps Full 00:23:54:57:8f:e8 1500 Intel Corporation 80003ES2LAN Gigabit Ethernet Controller
vmnic3 0000:07:00.01 e1000e Up 1000Mbps Full 00:23:54:57:8f:e9 1500 Intel Corporation 80003ES2LAN Gigabit Ethernet Controller
vmnic8 0000:0a:00.00 ixgbe Up 10000Mbps Full 90:e2:ba:04:f3:ec 1500 Intel Corporation Ethernet Server Adapter X520-2
vmnic9 0000:0a:00.01 ixgbe Up 10000Mbps Full 90:e2:ba:04:f3:ed 1500 Intel Corporation Ethernet Server Adapter X520-2


The first machine is then completely migrated and operational hardware.
We continue with tests.

Date: 2013-03-01 11:23:09 UTC
The card has been replaced. The two 10G nics are now up.

The host no longer load the card

Name PCI Driver Link Speed Duplex MAC Address MTU Description
vmnic4 0000:05:00.00 e1000e Up 1000Mbps Full 00:23:54:57:8f:e8 1500 Intel Corporation 80003ES2LAN Gigabit Ethernet Controller
vmnic5 0000:05:00.01 e1000e Up 1000Mbps Full 00:23:54:57:8f:e9 1500 Intel Corporation 80003ES2LAN Gigabit Ethernet Controller
vmnic6 0000:08:00.00 ixgbe Up 10000Mbps Full 00:1b:21:5c:df:93 1500 Intel Corporation 10 Gigabit AF DA Dual Port Server Adapter

but is it here
000:008:00.1 Network controller: Intel Corporation 10 Gigabit AF DA Dual Port Server Adapter [vmnic7]

~ # vmkvsitools hwinfo -p |grep 000:008:00.1
000:008:00.1 8086:10f1 8086:a21f 7/ 7/0xd0 B V vmnic7
~ # vmkvsitools hwinfo -p |grep 000:008:00.0
000:008:00.0 8086:10f1 8086:a21f 10/ 10/0x78 A V ixgbe vmnic6

We upgrade the driver

Date: 2013-03-01 11:15:08 UTC
We noticed one of the defective 10g card on on2. We replace the card.

Name PCI Driver Link Speed Duplex MAC Address MTU Description
vmnic4 0000:05:00.00 e1000e Up 1000Mbps Full 00:23:54:57:8f:e8 1500 Intel Corporation 80003ES2LAN Gigabit Ethernet Controller
vmnic5 0000:05:00.01 e1000e Up 1000Mbps Full 00:23:54:57:8f:e9 1500 Intel Corporation 80003ES2LAN Gigabit Ethernet Controller
vmnic6 0000:08:00.00 ixgbe Up 10000Mbps Full 00:1b:21:83:9c:5f 1500 Intel Corporation 10 Gigabit AF DA Dual Port Server Adapter
vmnic7 0000:08:00.01 ixgbe Down 0Mbps Half 00:1b:21:83:9c:5e 1500 Intel Corporation 10 Gigabit AF DA Dual Port Server Adapter

Date: 2013-03-01 11:14:17 UTC
We have moved the infra mon2.
Everything was successful.

We launch production tests
Posted Mar 01, 2013 - 11:13 UTC