We are fully back up again. The problems were minor, but the downtime was rather long due the streaming API problems that started 8 hours ago (at 4am in the morning), because we were asleep here at Finland 😅 I like my long beauty sleep on Sundays.
Kinda stupid disk issue that was related to the upgrades yesterday... On top of that I had accidentally disabled alerts. Everything should sail smoothly again, so sorry about that.
Thanks @ikkeT for coming to rescue.
status.mementomori.social
#MementoMoriSocial #MastoAdmin
Mementomori.social status
Welcome to Mementomori.social status page for real-time and historical data on system performance.status.mementomori.social
This entry was edited (2 weeks ago)
Joseph likes this.
Roni Laukkarinen
in reply to Roni Laukkarinen • • •On the side note, it seems the website was never fully down. Only posting was affected.
To err is human.
Jippi 🇩🇰
in reply to Roni Laukkarinen • • •Roni Laukkarinen reshared this.
Roni Laukkarinen
in reply to Jippi 🇩🇰 • • •@jippi Yeah and this was not about that either. Just forgot to check how big is the cache folder and what is the status of the disk space...
Then went off to rest. Disk space ran out in main level because there were some leftover processes that hold the deleted files.
It's funny when you're running bleeding edge and the actual issues are caused by everyday stuff.
Jippi 🇩🇰
in reply to Roni Laukkarinen • • •Roni Laukkarinen
in reply to Jippi 🇩🇰 • • •@jippi Exactly. I'm still in a sysop team and been doing servers for 20 years.
Top 5:
1. Human error, someone restarted an erroneous process or crashed production in some way - deploy fails, workflow fails, etc.
2. Bottlenecks in processes and CPU usage
3. Disk space runs out in root level, thus cannot write to disk
4. DDoS attacks
5. Network issues
#SysOps #MastoAdmin #Servers
Sander Meijer
in reply to Roni Laukkarinen • • •Roni Laukkarinen
in reply to Sander Meijer • • •Soheb
in reply to Roni Laukkarinen • • •Roni Laukkarinen
in reply to Soheb • • •Ilkka Tengvall
in reply to Roni Laukkarinen • • •jack
in reply to Roni Laukkarinen • • •Roni Laukkarinen
in reply to jack • • •@jglypt Yes. If you give a solid reason and accept the terms, welcome! mementomori.social/about
More about us and instance features: help.mementomori.social/mement…
#MementoMoriSocial
About Mementomori.social | Mementomori.social Docs
help.mementomori.socialWTL
in reply to Roni Laukkarinen • • •Roni Laukkarinen
in reply to WTL • • •@WTL Exactly. However, I had my full beauty sleep. Power 100%. Can't complain.
It was a conscious choice not having audible alarms while I sleep. Even now it would have awoken me at 4am. But it seems I have disabled them completely for some reason 😅 gotta fix that.
WTL
in reply to Roni Laukkarinen • • •