Borealis Status - Incident history https://borealis.instatus.com Borealis Wed, 21 Aug 2024 08:40:47 +0000 Issues with add-on provisioning Type: Incident Duration: 9 hours and 12 minutes Affected Components: Borealis Isolated Postgres Add-on Aug 21, 08:40:47 GMT+0 - Investigating - An upstream service provider is experiencing a temporary service outage, which is causing some add-on provisioning attempts to fail. We are investigating the issue. Aug 21, 17:52:44 GMT+0 - Resolved - The dev plan's us-east-1 database clusters were experiencing add-on database provisioning errors. Existing add-on databases were unaffected. The issue has been resolved. Type: Incident

Duration: 9 hours and 12 minutes

Affected Components:

<p><small>Aug <var data-var='date'> 21</var>, <var data-var='time'>08:40:47</var> GMT+0</small><br><strong>Investigating</strong> - An upstream service provider is experiencing a temporary service outage, which is causing some add-on provisioning attempts to fail. We are investigating the issue..</p> <p><small>Aug <var data-var='date'> 21</var>, <var data-var='time'>17:52:44</var> GMT+0</small><br><strong>Resolved</strong> - The dev plan's us-east-1 database clusters were experiencing add-on database provisioning errors. Existing add-on databases were unaffected. The issue has been resolved..</p> ]]> Wed, 21 Aug 2024 08:40:47 +0000 https://borealis.instatus.com/incident/cm03ltayk001n11em3mduxpfk https://borealis.instatus.com/incident/cm03ltayk001n11em3mduxpfk Upgrade multi-tenant clusters to PostgreSQL 14 Type: Maintenance Duration: 1 hour and 30 minutes Affected Components: Borealis Isolated Postgres Add-on Oct 23, 06:01:00 GMT+0 - Identified - Maintenance is now in progress. Oct 23, 06:00:00 GMT+0 - Identified - The Borealis Isolated Postgres beta multi-tenant database clusters in the United States and Europe regions are currently running PostgreSQL 13. The objective of this maintenance session is to upgrade those clusters to PostgreSQL 14. Affected databases will be inaccessible for the duration of the maintenance. Oct 23, 07:09:36 GMT+0 - Identified - The upgrade has finished for the Europe region. The US region's upgrade is proceeding normally but a little slower than expected. Further updates soon. Oct 23, 07:30:24 GMT+0 - Completed - The upgrades have been completed successfully. Type: Maintenance

Duration: 1 hour and 30 minutes

Affected Components:

<p><small>Oct <var data-var='date'> 23</var>, <var data-var='time'>06:01:00</var> GMT+0</small><br><strong>Identified</strong> - Maintenance is now in progress..</p> <p><small>Oct <var data-var='date'> 23</var>, <var data-var='time'>06:00:00</var> GMT+0</small><br><strong>Identified</strong> - The Borealis Isolated Postgres beta multi-tenant database clusters in the United States and Europe regions are currently running PostgreSQL 13. The objective of this maintenance session is to upgrade those clusters to PostgreSQL 14. Affected databases will be inaccessible for the duration of the maintenance..</p> <p><small>Oct <var data-var='date'> 23</var>, <var data-var='time'>07:09:36</var> GMT+0</small><br><strong>Identified</strong> - The upgrade has finished for the Europe region. The US region's upgrade is proceeding normally but a little slower than expected. Further updates soon..</p> <p><small>Oct <var data-var='date'> 23</var>, <var data-var='time'>07:30:24</var> GMT+0</small><br><strong>Completed</strong> - The upgrades have been completed successfully..</p> ]]> Sun, 23 Oct 2022 06:00:00 +0000 https://borealis.instatus.com/maintenance/cl9kbzu715066hon16yealkil https://borealis.instatus.com/maintenance/cl9kbzu715066hon16yealkil Intermittent CLI request timeouts Type: Incident Duration: 2 hours and 26 minutes Affected Components: Borealis Isolated Postgres Add-on Jul 27, 01:06:01 GMT+0 - Resolved - We have confirmed all systems are operating normally. Jul 26, 22:39:33 GMT+0 - Investigating - We are seeing an increase in the number of requests from the add-on's command line interface (CLI) that are timing out. In most cases, requests can simply be retried later. We are currently investigating the cause of the incident. Jul 26, 23:51:57 GMT+0 - Monitoring - The third party provider has mitigated the partial outage in their systems. We will continue monitor the situation to ensure it is resolved. Jul 26, 23:08:17 GMT+0 - Identified - The issue appears to be due to a third party service provider's partial outage. We are working with them to resolve the incident. Type: Incident

Duration: 2 hours and 26 minutes

Affected Components:

<p><small>Jul <var data-var='date'> 27</var>, <var data-var='time'>01:06:01</var> GMT+0</small><br><strong>Resolved</strong> - We have confirmed all systems are operating normally..</p> <p><small>Jul <var data-var='date'> 26</var>, <var data-var='time'>22:39:33</var> GMT+0</small><br><strong>Investigating</strong> - We are seeing an increase in the number of requests from the add-on's command line interface (CLI) that are timing out. In most cases, requests can simply be retried later. We are currently investigating the cause of the incident..</p> <p><small>Jul <var data-var='date'> 26</var>, <var data-var='time'>23:51:57</var> GMT+0</small><br><strong>Monitoring</strong> - The third party provider has mitigated the partial outage in their systems. We will continue monitor the situation to ensure it is resolved..</p> <p><small>Jul <var data-var='date'> 26</var>, <var data-var='time'>23:08:17</var> GMT+0</small><br><strong>Identified</strong> - The issue appears to be due to a third party service provider's partial outage. We are working with them to resolve the incident..</p> ]]> Tue, 26 Jul 2022 22:39:33 +0000 https://borealis.instatus.com/incident/cl62rg3zw2699yan1g37h7p7i https://borealis.instatus.com/incident/cl62rg3zw2699yan1g37h7p7i US region unavailable Type: Incident Duration: 1 hour and 56 minutes Affected Components: Borealis Isolated Postgres Add-on May 13, 08:30:42 GMT+0 - Investigating - We are investigating an issue preventing all database connections in the US region for the Borealis Isolated Postgres add-on. May 13, 09:54:00 GMT+0 - Monitoring - We have identified and fixed the problem and we will continue to monitor. May 13, 10:26:18 GMT+0 - Resolved - We have confirmed the issue has been resolved. Type: Incident

Duration: 1 hour and 56 minutes

Affected Components:

<p><small>May <var data-var='date'> 13</var>, <var data-var='time'>08:30:42</var> GMT+0</small><br><strong>Investigating</strong> - We are investigating an issue preventing all database connections in the US region for the Borealis Isolated Postgres add-on..</p> <p><small>May <var data-var='date'> 13</var>, <var data-var='time'>09:54:00</var> GMT+0</small><br><strong>Monitoring</strong> - We have identified and fixed the problem and we will continue to monitor..</p> <p><small>May <var data-var='date'> 13</var>, <var data-var='time'>10:26:18</var> GMT+0</small><br><strong>Resolved</strong> - We have confirmed the issue has been resolved..</p> ]]> Fri, 13 May 2022 08:30:42 +0000 https://borealis.instatus.com/incident/cl346jg7y116653iwohxuqcz9hd https://borealis.instatus.com/incident/cl346jg7y116653iwohxuqcz9hd Legacy PostgreSQL database maintenance Type: Maintenance Duration: 38 minutes Affected Components: Borealis Isolated Postgres Add-on May 13, 06:38:14 GMT+0 - Completed - Maintenance has completed successfully. May 13, 06:00:01 GMT+0 - Identified - Maintenance is now in progress May 13, 06:00:00 GMT+0 - Identified - Borealis Isolated Postgres add-on databases that were created before April 16, 2022 require minor maintenance to ensure their capabilities match those of more recently-created add-on databases. During maintenance each affected add-on database will experience a brief period where it is made temporarily read-only to ensure data is preserved during the process; write access for each add-on will be restored as soon as maintenance is finished for its corresponding database. All add-on databases created on or after April 16, 2022 will be unaffected by this maintenance. Type: Maintenance

Duration: 38 minutes

Affected Components:

<p><small>May <var data-var='date'> 13</var>, <var data-var='time'>06:38:14</var> GMT+0</small><br><strong>Completed</strong> - Maintenance has completed successfully..</p> <p><small>May <var data-var='date'> 13</var>, <var data-var='time'>06:00:01</var> GMT+0</small><br><strong>Identified</strong> - Maintenance is now in progress.</p> <p><small>May <var data-var='date'> 13</var>, <var data-var='time'>06:00:00</var> GMT+0</small><br><strong>Identified</strong> - Borealis Isolated Postgres add-on databases that were created before April 16, 2022 require minor maintenance to ensure their capabilities match those of more recently-created add-on databases. During maintenance each affected add-on database will experience a brief period where it is made temporarily read-only to ensure data is preserved during the process; write access for each add-on will be restored as soon as maintenance is finished for its corresponding database. All add-on databases created on or after April 16, 2022 will be unaffected by this maintenance..</p> ]]> Fri, 13 May 2022 06:00:00 +0000 https://borealis.instatus.com/maintenance/cl32ea5u6337519ibmy357ji0fc https://borealis.instatus.com/maintenance/cl32ea5u6337519ibmy357ji0fc Upgrade to PostgreSQL 13 Type: Maintenance Duration: 2 hours and 34 minutes Affected Components: Borealis Isolated Postgres Add-on May 6, 06:00:00 GMT+0 - Identified - Borealis Isolated Postgres add-on databases that were created before April 16, 2022 are currently stored in a PostgreSQL 10 database cluster. The objective of this maintenance session is to upgrade that database cluster to PostgreSQL 13. Affected databases will be read-only for the duration of the maintenance; write access will be restored once the upgrade is finished. Any add-on database created on or after April 16, 2022 is already in a PostgreSQL 13 database cluster and will be unaffected by this maintenance. May 6, 08:00:36 GMT+0 - Identified - Upgrade is proceeding normally now. Next update within half an hour. May 6, 08:34:00 GMT+0 - Completed - Maintenance has completed successfully. May 6, 07:21:04 GMT+0 - Identified - The process is proceeding normally, but it is taking longer than anticipated. We will provide an update within the next 40 minutes. May 6, 06:00:01 GMT+0 - Identified - Maintenance is now in progress Type: Maintenance

Duration: 2 hours and 34 minutes

Affected Components:

<p><small>May <var data-var='date'> 6</var>, <var data-var='time'>06:00:00</var> GMT+0</small><br><strong>Identified</strong> - Borealis Isolated Postgres add-on databases that were created before April 16, 2022 are currently stored in a PostgreSQL 10 database cluster. The objective of this maintenance session is to upgrade that database cluster to PostgreSQL 13. Affected databases will be read-only for the duration of the maintenance; write access will be restored once the upgrade is finished. Any add-on database created on or after April 16, 2022 is already in a PostgreSQL 13 database cluster and will be unaffected by this maintenance..</p> <p><small>May <var data-var='date'> 6</var>, <var data-var='time'>08:00:36</var> GMT+0</small><br><strong>Identified</strong> - Upgrade is proceeding normally now. Next update within half an hour..</p> <p><small>May <var data-var='date'> 6</var>, <var data-var='time'>08:34:00</var> GMT+0</small><br><strong>Completed</strong> - Maintenance has completed successfully..</p> <p><small>May <var data-var='date'> 6</var>, <var data-var='time'>07:21:04</var> GMT+0</small><br><strong>Identified</strong> - The process is proceeding normally, but it is taking longer than anticipated. We will provide an update within the next 40 minutes..</p> <p><small>May <var data-var='date'> 6</var>, <var data-var='time'>06:00:01</var> GMT+0</small><br><strong>Identified</strong> - Maintenance is now in progress.</p> ]]> Fri, 6 May 2022 06:00:00 +0000 https://borealis.instatus.com/maintenance/cl2sdcsvu1334inn6iw9e7ltk https://borealis.instatus.com/maintenance/cl2sdcsvu1334inn6iw9e7ltk AWS outage Type: Incident Duration: 12 hours and 53 minutes Affected Components: Borealis Isolated Postgres Add-on Dec 7, 16:45:00 GMT+0 - Identified - Amazon Web Services is experiencing widespread API outages in the us-east-1 region. They have not yet provided an ETA for recovery. This may impact provisioning of new Borealis Isolated Postgres add-ons. Dec 8, 02:40:43 GMT+0 - Monitoring - Affected AWS services in the us-east-1 region have been restored. Borealis Isolated Postgres add-ons can once again be provisioned and managed. We will continue to monitor the situation. Dec 8, 05:38:19 GMT+0 - Resolved - Monitoring indicates all systems are operational once again. Type: Incident

Duration: 12 hours and 53 minutes

Affected Components:

<p><small>Dec <var data-var='date'> 7</var>, <var data-var='time'>16:45:00</var> GMT+0</small><br><strong>Identified</strong> - Amazon Web Services is experiencing widespread API outages in the us-east-1 region. They have not yet provided an ETA for recovery. This may impact provisioning of new Borealis Isolated Postgres add-ons..</p> <p><small>Dec <var data-var='date'> 8</var>, <var data-var='time'>02:40:43</var> GMT+0</small><br><strong>Monitoring</strong> - Affected AWS services in the us-east-1 region have been restored. Borealis Isolated Postgres add-ons can once again be provisioned and managed. We will continue to monitor the situation..</p> <p><small>Dec <var data-var='date'> 8</var>, <var data-var='time'>05:38:19</var> GMT+0</small><br><strong>Resolved</strong> - Monitoring indicates all systems are operational once again..</p> ]]> Tue, 7 Dec 2021 16:45:00 +0000 https://borealis.instatus.com/incident/ckwwfn38o21061181oc8cdpyov3 https://borealis.instatus.com/incident/ckwwfn38o21061181oc8cdpyov3