Release Version: 47.53.0
Qubole provides Qubole Data Service (QDS) on Amazon Web Service (AWS), Microsoft Azure, and Oracle Bare Metal Cloud (BMC).
Note: This set of release notes only contains details about the release of QDS-on-Azure.
For details of what has changed in this version of QDS-on-Azure, see:
- What is New in QDS-on-Microsoft Azure
- List of Changes and Bug Fixes in QDS-on-Microsoft Azure
What is New in QDS-on-Microsoft Azure
QDS supports Importing ipynb Notebooks
With this release, Qubole supports importing ipynb notebooks.
Qubole Supports Azure Data Lake Store
Qubole supports Azure Data Lake Store (ADLS), which is an enterprise-wide hyper-scale repository for Big Data workloads. It allows you to capture data of any size, type, and ingestion speed in one single place for operational and exploratory analytics. ADLS is supported in East US 2, Central US, and North Europe Microsoft Azure regions.
ADLS Hadoop client is an Apache Hadoop file system compatible with Hadoop Distributed File System and works with the Hadoop ecosystem. For more information, see ADLS creation and Qubole Account Settings.
Qubole Supports Custom SSH Keys on Clusters
Enabling custom SSH key is supported, which causes clusters to come up with a different SSH key pair each time, thus strengthening the security.
Pig11 is supported on QDS-on-Azure
Pig11 is supported on QDS clusters that use Microsoft Azure.
Qubole Supports Azure Native Data Stores
QDS supports Azure SQL database and Azure SQL data warehouse
List of Changes and Bug Fixes in QDS-on-Microsoft Azure
Azure Cluster Management
New ACM-1125: Adding a custom SSH key is supported, which causes clusters to come up with a different SSH key pair each time, thus strengthening the security.
Change ACM-1453: Pig11 is supported on QDS-on-Azure.
Change HADTWO-990: Azure Data Lake Store is supported on the Job History Server.
Fix MUL-559: Presto clusters on Qubole currently do not support ADSL. Qubole will soon add this support in a forthcoming release. When you switch the QDS account from Blob store to ADLS, existing Presto clusters fail to start and you cannot create new Presto clusters.
Change PRES-1115: Added jitter-based retry logic in the ObjectListing of S3.
Change PRES-1128: The issue in which Hive Authorization on Table Views was not working in Presto 0.157 has been resolved now.
New UI-4100: Unvalidated data stores are supported in DB import/export commands.
New UI-6141: Added the Refresh Table as a supported command type under the Workflow command in the Analyzer/Scheduler UI query composer.
Fix MUL-474: Errors during a cluster upscaling will be reported in the scaling logs.
Fix SQOOP-116: QDS supports Azure SQL database and Azure SQL data warehouse.
Change MUL-484: Azure CLI tool installed on cluster nodes as default and commands can be used to fetch the Azure cloud related information.
Fix SPAR-1350: The issue in which the Spark Session name getting printed as SparkContext has been resolved now.
Change SPAR-1751: Azure Data Lake Store is supported on the Spark History Server.
New ZEP-858: With this release, Qubole supports importing ipynb notebooks.
New ZEP-928: The cursor appearance in the Notebooks UI has been changed.