All systems are operational

About This Site

This page shows the status of The Things Network services that are operated by The Things Network Foundation and The Things Industries.

If you are experiencing issues with any of our services, but this page shows that everything is operational, you can check on the Forum or the #ops channel on Slack if anyone else is experiencing the same problems. If you're the first to detect a possible incident, please alert us in the #ops channel on Slack.

The "Past Incidents" section shows the reports of high impact incidents and incidents that lasted longer than 30 minutes. Planned maintenance will also be published here.

Past Incidents

Wednesday 15th May 2019

Routing Services Downtime of EU region

Our EU routing experienced an outage ealier. After investigation we discovered that the servers of one of our routing partners were misbehaving. This caused our EU cluster to forward all uplink traffic to a "black hole". We have disconnected this routing partner from the public community network, which resolved the issue.

Tuesday 14th May 2019

No incidents reported

Monday 13th May 2019

No incidents reported

Sunday 12th May 2019

No incidents reported

Saturday 11th May 2019

No incidents reported

Friday 10th May 2019

No incidents reported

Thursday 9th May 2019

Major Outage Integrations

During routine server maintenance the server running the coordination services for our integrations suffered severe disk failure. We're investigating the issue.

Update: we are in the process of disk recovery.

Update: we have recovered the relevant data from our failed disk and are restarting the integrations.

Update: we have restarted the integrations, which are now catching up on their queues.

Update: all integrations are caught up on their queues and are back to normal.

Infrastructure updates, scheduled 2 weeks ago

We're rolling out infrastructure updates. There will be short service interruptions.

Update: Most servers have been updated successfully. We will not run any further updates until we've made sure that these updates will not break servers as happened in incident 71.