Qubole Status

Aug 22, 2019

No incidents reported today.

Aug 21, 2019

No incidents reported.

Aug 20, 2019

No incidents reported.

Aug 19, 2019

Multiple Qubole environments unavailable

Resolved - Qubole DevOps has completed the validation of all affected environments from this incident. As noted in prior updates and applicable across all affected environments: Customers will need to re-process commands which were submitted prior to or during the unavailability window. Qubole DevOps will be marking most commands as Cancelled which were stuck during this the impact timeframe.

We appreciate everyone's patience through this process and are officially closing this incident.
Aug 19, 23:06 PDT

Update - Qubole DevOps has brought up the azure.qubole.com environment and verified full functionality. Customers will need to re-process commands which were submitted prior to or during the unavailability window. Qubole DevOps will be marking most commands as Cancelled which were stuck during this the impact timeframe.

Qubole DevOps continues to work to bring up and verify the oraclecloud.qubole.com and will provide another update shortly.
Aug 19, 22:55 PDT

Update - Qubole DevOps has brought up the us.qubole.com and in.qubole.com environment and verified full functionality. Customers will need to re-process commands which were submitted prior to or during the unavailability window. Qubole DevOps will be marking most commands as Cancelled which were stuck during this the impact timeframe.

Qubole DevOps continues to work to bring up and verify the other impacted environments azure.qubole.com and oraclecloud.qubole.com and will provide another update shortly.
Aug 19, 22:22 PDT

Update - Qubole DevOps has brought up the api.qubole.com and eu-central-1.qubole.com environment and verified full functionality. Customers will need to re-process commands which were submitted prior to or during the unavailability window. Qubole DevOps will be marking most commands as Cancelled which were stuck during this the impact timeframe.

Qubole DevOps continues to work to bring up and verify the other impacted environments.
Aug 19, 21:57 PDT

Update - Qubole DevOps is in the process of bringing up the api.qubole.com environment. A few supporting application components are in the process of starting up and full functionality will be restored shortly.

In parallel, Qubole DevOps is bringing up the us.qubole.com environment.

We will address other affected environments once these two environments are fully functional. Again, we appreciate your patience through this process and assure you that we have all of the right resources addressing the incident with the highest urgency.
Aug 19, 21:05 PDT

Update - We are continuing to work on a fix for this issue.
Aug 19, 20:52 PDT

Identified - Qubole DevOps, Engineering and Support are currently working on the issue with the most urgent priority. Currently site availability, cluster operations and command processing are unavailable. We appreciate your patience while we work to restore service at the earliest possible point.
Aug 19, 20:35 PDT

Update - We are continuing to investigate this issue.
Aug 19, 20:09 PDT

Investigating - Qubole is investigating a major outage across environments. We will provide regular updates as we have more information.
Aug 19, 20:07 PDT

Google OAuth outage from Google

Resolved - Update from Google (note the follow-up actions are not part of Qubole): The issue with authentication to Google App Engine sites, the Google Cloud Console, Identity Aware Proxy, and Google OAuth 2.0 endpoints has been resolved for all affected customers as of Monday, 2019-08-19 12:30 US/Pacific. We will conduct an internal investigation of this issue and make appropriate improvements to our systems to help prevent or minimize future recurrence.
Aug 19, 13:42 PDT

Monitoring - A fix has been implemented and we are monitoring the results.
Aug 19, 13:20 PDT

Identified - Update from Google: The issue with authentication to Google App Engine sites, Google Cloud Console, Identity Aware Proxy, and Google OAuth 2.0 endpoints should be resolved for the majority of customers and we expect a full resolution in the near future. We will provide another status update by Monday, 2019-08-19 13:30 US/Pacific with current details.

Workaround: Some customers have reported success attempting to utilize an incognito window under the Chrome browser to login.
Aug 19, 13:14 PDT

Investigating - We have confirmed reports of Google OAuth login failures. This is not limited to Qubole, but does affect any users who uses Google OAuth to log into any of our environments. We will stay in touch with Google Updates to track the progress of this issue.
Aug 19, 12:04 PDT

api.qubole.com is unaccessible

Resolved - This incident has been resolved.
Aug 19, 09:17 PDT

Monitoring - A fix has been implemented and we are monitoring the results.
Aug 19, 07:32 PDT

Identified - The issue has been identified and a fix is being implemented.
Aug 19, 06:25 PDT

Investigating - We are currently investigating this issue.
Aug 19, 05:59 PDT

Maintenance on eu-central-1.qubole.com

Completed - The scheduled maintenance has been completed.
Aug 19, 04:00 PDT

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 19, 03:30 PDT

Scheduled - We have planned a maintenance activity in eu-central-1.qubole.com. This maintenance activity is required for stability, higher concurrency and security. There is no change in the way customers interact with QDS. We do not expect any impact to these capabilities during the change and we will be closely monitoring performance across our customer base during and after the maintenance.
Aug 19, 00:57 PDT

Aug 18, 2019

No incidents reported.

Aug 17, 2019

No incidents reported.

Aug 16, 2019

No incidents reported.

Aug 15, 2019

No incidents reported.

Aug 14, 2019

Maintenance on us.qubole.com - Part 3

Completed - The scheduled maintenance has been completed.
Aug 14, 01:00 PDT

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 14, 00:30 PDT

Scheduled - We have planned a maintenance activity in us.qubole.com. This maintenance activity is required for stability, higher concurrency and security. There is no change in the way customers interact with QDS. We do not expect any impact to these capabilities during the change and we will be closely monitoring performance across our customer base during and after the maintenance.
Aug 11, 22:52 PDT

Maintenance on eu-central-1.qubole.com - Part 4

Completed - The scheduled maintenance has been completed.
Aug 14, 01:00 PDT

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 14, 00:30 PDT

Scheduled - We have planned a maintenance activity in eu-central-1.qubole.com. This maintenance activity is required for stability, higher concurrency and security. There is no change in the way customers interact with QDS. We do not expect any impact to these capabilities during the change and we will be closely monitoring performance across our customer base during and after the maintenance.
Aug 9, 01:49 PDT

Aug 13, 2019

Maintenance on us.qubole.com - Part 2

Completed - The scheduled maintenance has been completed.
Aug 13, 01:00 PDT

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 13, 00:30 PDT

Scheduled - We have planned a maintenance activity in us.qubole.com. This maintenance activity is required for stability, higher concurrency and security. There is no change in the way customers interact with QDS. We do not expect any impact to these capabilities during the change and we will be closely monitoring performance across our customer base during and after the maintenance.
Aug 11, 22:52 PDT

Maintenance on eu-central-1.qubole.com - Part 3

Completed - The scheduled maintenance has been completed.
Aug 13, 01:00 PDT

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 13, 00:30 PDT

Scheduled - We have planned a maintenance activity in eu-central-1.qubole.com. This maintenance activity is required for stability, higher concurrency and security. There is no change in the way customers interact with QDS. We do not expect any impact to these capabilities during the change and we will be closely monitoring performance across our customer base during and after the maintenance.
Aug 9, 01:48 PDT

Aug 12, 2019

Emergency maintenance on us.qubole.com

Completed - The scheduled maintenance has been completed.
Aug 12, 23:15 PDT

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 12, 22:45 PDT

Scheduled - We are performing emergency maintenance to us.qubole.com to increase the allocated storage for RDS.
This is an online operation and no impact to any workloads is expected.
Aug 12, 22:42 PDT

Maintenance on us.qubole.com - Part 1

Completed - The scheduled maintenance has been completed.
Aug 12, 01:00 PDT

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 12, 00:30 PDT

Scheduled - We have planned a maintenance activity in us.qubole.com. This maintenance activity is required for stability, higher concurrency and security. There is no change in the way customers interact with QDS. We do not expect any impact to these capabilities during the change and we will be closely monitoring performance across our customer base during and after the maintenance.
Aug 11, 22:51 PDT

Maintenance on eu-central-1.qubole.com - Part 2

Completed - The scheduled maintenance has been completed.
Aug 12, 01:00 PDT

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 12, 00:30 PDT

Scheduled - We have planned a maintenance activity in eu-central-1.qubole.com. This maintenance activity is required for stability, higher concurrency and security. There is no change in the way customers interact with QDS. We do not expect any impact to these capabilities during the change and we will be closely monitoring performance across our customer base during and after the maintenance.
Aug 9, 01:48 PDT

Aug 11, 2019

No incidents reported.

Aug 10, 2019

No incidents reported.

Aug 9, 2019

Maintenance on eu-central-1.qubole.com - part 1

Completed - The scheduled maintenance has been completed.
Aug 9, 01:00 PDT

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 9, 00:30 PDT

Scheduled - We have planned a maintenance activity in eu-central-1.qubole.com. This maintenance activity is required for stability, higher concurrency and security. There is no change in the way customers interact with QDS. We do not expect any impact to these capabilities during the change and we will be closely monitoring performance across our customer base during and after the maintenance.
Aug 9, 00:26 PDT

Aug 8, 2019

No incidents reported.

About This Site