Qubole Release Notes for QDS-on-Azure Version R47 25-Sep-2017

Release Version: 47.53.0

Qubole provides Qubole Data Service (QDS) on Amazon Web Service (AWS), Microsoft Azure, and Oracle Bare Metal Cloud (BMC).

Note: This set of release notes only contains details about the release of QDS-on-Azure.

For details of what has changed in this version of QDS-on-Azure, see:

  • What is New in QDS-on-Microsoft Azure
  • List of Changes and Bug Fixes in QDS-on-Microsoft Azure

 

What is New in QDS-on-Microsoft Azure

 

QDS supports Importing ipynb Notebooks

With this release, Qubole supports importing ipynb notebooks.


Qubole Supports Azure Data Lake Store


Qubole supports Azure Data Lake Store (ADLS), which is an enterprise-wide hyper-scale repository for Big Data workloads. It allows you to capture data of any size, type, and ingestion speed in one single place for operational and exploratory analytics. ADLS is supported in East US 2, Central US, and North Europe Microsoft Azure regions. 

ADLS Hadoop client is an Apache Hadoop file system compatible with Hadoop Distributed File System and works with the Hadoop ecosystem. For more information, see ADLS creation and Qubole Account Settings


Qubole Supports Custom SSH Keys on Clusters

Enabling custom SSH key is supported, which causes clusters to come up with a different SSH key pair each time, thus strengthening the security.

Pig11 is supported on QDS-on-Azure

Pig11 is supported on QDS clusters that use Microsoft Azure.

 

Qubole Supports Azure Native Data Stores

QDS supports Azure SQL database and Azure SQL data warehouse


List of Changes and Bug Fixes in QDS-on-Microsoft Azure

Azure Cluster Management

New Features

New   ACM-1125: Adding a custom SSH key is supported, which causes clusters to come up with a different SSH key pair each time, thus strengthening the security.

Enhancements

Change   ACM-1453: Pig11 is supported on QDS-on-Azure.

HADOOP 2


Enhancements

Change   HADTWO-990: Azure Data Lake Store is supported on the Job History Server.


PRESTO


Bug Fixes

Fix   MUL-559: Presto clusters on Qubole currently do not support ADSL. Qubole will soon add this support in a forthcoming release. When you switch the QDS account from Blob store to ADLS, existing Presto clusters fail to start and you cannot create new Presto clusters.

Enhancements

Change   PRES-1115: Added jitter-based retry logic in the ObjectListing of S3.
Change   PRES-1128: The issue in which Hive Authorization on Table Views was not working in Presto 0.157 has been resolved now.


QDS


New Features

New   UI-4100: Unvalidated data stores are supported in DB import/export commands.
New   UI-6141: Added the Refresh Table as a supported command type under the Workflow command in the Analyzer/Scheduler UI query composer.

Bug Fixes

 

Fix   MUL-474: Errors during a cluster upscaling will be reported in the scaling logs.
Fix   SQOOP-116: QDS supports Azure SQL database and Azure SQL data warehouse.

Enhancements

Change   MUL-484: Azure CLI tool installed on cluster nodes as default and commands can be used to fetch the Azure cloud related information.

 

SPARK

 

Bug Fixes

Fix   SPAR-1350: The issue in which the Spark Session name getting printed as SparkContext has been resolved now.

Enhancements

Change   SPAR-1751: Azure Data Lake Store is supported on the Spark History Server.


ZEPPELIN/NOTEBOOKS

New Features

New   ZEP-858: With this release, Qubole supports importing ipynb notebooks.
New   ZEP-928: The cursor appearance in the Notebooks UI has been changed.

Have more questions? Submit a request

Comments

Powered by Zendesk