This page lists incidents by Namespace and known upstream issues.
This page lists incidents by Namespace and known upstream issues.
No components marked as affected
Resolved
All systems are operational.
Monitoring
We're currently seeing healthy ingestion again, with all new jobs being picked up normally.
Monitoring
We again see webhooks being delivered with malformed data, making it impossible to ingest these events.
This will lead to increased queue time for a subset of jobs, as we're only able to discover these jobs through secondary ingestion paths.
Monitoring
We have confirmed that GitHub was issuing malformed event data for a subset of events.
This issue has resolved now.
New jobs already start fast consistently, we are working through the backlog of affected jobs.
Investigating
We see an elevated error rate in event ingestion from GitHub - we are investigating.