Service API seems to be down
Major incident
API
2021-12-22 17:46 CET
· 16 minutes
Updates
Post-mortem
December 22, 2021 · 21:50 CET
Root cause was identified to be a dependency that removed support for Python 2 that was used to orchestrate the deployment pipeline. Through that change, automatic scaling and deployment of API instances could no longer be performed, which led to the API instance CPU load to max out. The deployment pipeline has been updated accordingly.
Update
December 22, 2021 · 18:11 CET
Instances recovered through the rollback and are back up as of 18:02 CET. We are investigating the root cause.
Investigating
December 22, 2021 · 17:58 CET
We are attempting a rollback of a Postgres connection scaling change that was deployed earlier today.
Issue
December 22, 2021 · 17:46 CET
According to our monitoring system this service has become unresponsive, we’re investigating.
← Back