OVHcloud Network Status

Current status
Legend
  • Operational
  • Degraded performance
  • Partial Outage
  • Major Outage
  • Under maintenance
FS#17518 — bhs-1a/b-n7
Scheduled Maintenance Report for Network & Infrastructure
Completed
To integrate the latest functional and security patches, we will update this pair of routers on Tuesday, April 19th as of 7am CEST.

The update will be carried out on ISSU.

Update(s):

Date: 2016-04-21 16:13:11 UTC
During isolation of bhs-1b-n7 to prepare the update process, an error occurred.
The two devices are redundant and functionning on virtual PortChannel (vPC). This technology allows two devices to work together and form a single logical entity for all equipment connected to it.
This morning, bhs-1a-n7 was \"vPC secondary\" and bhs-1b-n7 \"vPC primary\". We first performed the update on bhs-1a-n7. When we wanted to update bhs-1b-n7, we first cut all links: uplinks (to the OVH network) and downlinks (on switches which are connected hosts and storage). The next step was to cut the links operating vPC: the vPC peer link (which allows to synchronize the states and the traffic that can cross in some cases) and the vPC peer keepalive link (link dedicated to the monitoring of switches between them: messages \"hello\").
During this stage, the order of execution of the procedure was reversed: the peer link has been disabled before the peer keepalive. Under these conditions, the vPC secondary switch cut all of its ports to avoid a Dual Active scenario. We immediately reactivated the port, but those few seconds outage impacted cutting off access to public paw and communication between storage and hosts which can cause the passage of VMs in read-only.

Date: 2016-04-21 16:08:11 UTC
Switch B is updated, we are restarting it.

Date: 2016-04-21 16:07:47 UTC
A flap occurred during the isolation of switch B, an interruption of a few moments occurred.
Some VMs can be set in read-only.

Date: 2016-04-21 16:06:42 UTC
We are isolating switch B.

Date: 2016-04-21 16:06:23 UTC
Switch A is updated, we are prodding.

Date: 2016-04-21 16:05:53 UTC
We will start by isolating switch A.

Date: 2016-04-21 16:05:10 UTC
We will start by bhs-1a-n7-pcc (vPC role: secondary).

Date: 2016-04-21 16:04:47 UTC
We are starting the procedure, operations will be suspended during maintenance.
Posted Apr 13, 2016 - 18:10 UTC