We are the KDE Sysadmins. Status updates should appear here.

KTown
Joined February 2012
KDE Sysadmin retweeted
Problems using Matrix on Libera.Chat have been reported over recent days, impacting projects. The @element_hq bridge is one-way in some rooms & message delivery can't be guaranteed. We have communicated to EMS on this matter and hope they have a resolution ASAP
4
2
6
All KDE servers hosted on DigitalOcean were briefly inaccessible, between 23:40 and 0:05 UTC. This notably includes KDE Identity, the IRC bouncer, and Meet (BigBlueButton). Seems to be all back working now...
Investigating: As of approximately 23:40 UTC, our Engineering team is investigating multiple failures with DigitalOcean services, including our Cloud Control Panel, API, events such as creation of all resources, and WWW endpoints fail… stspg.io/fmlx6wbmpfl4?u=fyjd…
1
At 2:53 UTC our DigitalOcean servers lost connectivity again. Sorry for the IRC disruption in particular, but there isn't much we can do about it...
Replying to @DOStatus
Identified: Our Engineering team is now beginning emergency maintenance in NYC1, NYC2, FRA1, and TOR1 to implement a long-term fix for the multiple issues referenced in this incident. As this work progresses, we do not expect user imp… stspg.io/fmlx6wbmpfl4?u=0lgk…
1
DigitalOcean has now published more information about this network incident from last month:
Replying to @DOStatus
We published a postmortem on our June 13th incident: stspg.io/fmlx6wbmpfl4
KDE's primary mail server stopped working at around 13:48 UTC, we are investigating
1
Email server is fixed and processing the backlog.
2
We have a failed disk on a server, which hosts most of our websites, including the kde.org homepage, Bugzilla, wikis, etc. We will try to get it replaced without downtime.
1
2
Disk hot swap was successful. RAID array is now recovering.
2
On Saturday 16th at 9pm UTC we will be moving KDE Identity to a new server. This will mainly affect identity.kde.org itself, but for a short period there may be issues logging in to all KDE websites and services.
1
2
2
Ok, I got home later than expected 😅 Identity move starting now.
1
KDE Identity is now all moved to the new server, so it should start working again as DNS caches expire...
1
Shoutout to all the sea creatures gliding around in the @digitalocean! Thank you for renewing your sponsorship for another year! @digitalocean generously donates resources that help keep vital KDE infrastructures and services online.
1
8
87
We're temporarily shutting down GitLab, Phabricator and MyKDE to replace a failed SSD.
1
1
Still waiting for the hosting provider...
1
1
There will be some brief downtime on GitLab and MyKDE in about 15 minutes (server needs a reboot).
1
The server isn't responding after the reboot so this may take longer than expected...
1
Okay, KDE Invent is back now!
2
Tech @akademy stats: 2TB of traffic and 2.4 million requests through the CDN for the video streaming during the weekend.
2
8
Shoutout to our sponsor @CDN77com, who made a quick change on their end and greatly improved network traffic for the @Akademy video livestream 😃