CH cloud: delays due to outage at hosting provider

We’re still waiting for the final statement from provider but we close the incident

we got confirmation from provider and can confirm that the issue is solved since about 20min. Our systems could process the mails in the queues.

We closely monitoring the situation and are awaiting an official statement from provider about the exact cause and the measures taken.

We apologize for the inconvenience caused by this issue.

We just received the following update from our provider:

Here is a status update regarding the network incident:

Unfortunately, the situation has not yet been fully resolved. Our network
engineering team has already implemented several measures under high pressure to mitigate the situation. However, these measures have not yet achieved the desired outcome.

The next step is the imminent hardware replacement of a central network component at the Internet border. The goal of this measure is to stabilize Internet traffic and restore full availability to and from the public Internet.

We will inform you as soon as possible about further developments.

According to our provider:

Currently there are network issues on our border, impacting incoming and outgoing traffic to / from the public internet. Our network team is currently analysing the root-cause. As soon as we have more information we will update you.

We sincerely apologize for the inconvenience caused and thank you for your understanding.

One of our hosting provider encounters network issues. Our VPN between data centres is broken. As a consequence some internal communication of our cluster is interrupted. We are working on a bypass to re-enable full mail processing. Some mail is being queued and will be delivered with delay. No loss of mail or permanent reject is expected.