Qubole Release Notes 01-Sep-2016

Release Version: 36.1.0

For details of what has changed in this version of QDS, see What is New and List of Changes and Bug Fixes in this Release.


What is New

UI Enhancements

These are the UI new features and enhancements in this QDS release:

  • You can allow/deny access to various command types while configuring roles for different commands. For more information, see the description.
  • Analyze UI remembers last expanded database schema and opens it by default the next time.


Airflow Cluster Enhancements

These features have been added in an Airflow cluster type to improve the Reliability of the service:

  • Added default retry and failure handler for Qubole Operator. The Handler makes sure that states of the Airflow task and corresponding QDS commands are in synchronization. As a consequence even if the machine goes down no manual clean up before bringing up the machine again. For more details, see the documentation.
  • Added monit support inside Airflow cluster to monitor and auto bringup Airflow services in case of failure. This includes Scheduler, Webserver, Rabbitmq, and Celery.

New Beta Features

UI Support for Heterogenous Slave Node Types in Hadoop 2 and Spark Clusters

You can now select multiple slave node types in a Hadoop-2 and Spark cluster configuration UI as part of the Heterogeneous cluster feature UI support. This feature is available for beta access. Contact help@qubole.com to get this feature enabled for the Qubole account. For more information, see the description

List of Changes and Bug Fixes in this Release

AWS CLUSTER MANAGEMENT

Fix   ACM-532: Fixed an issue that had come up while changing the cluster configuration from Stable Spot to On-Demand nodes.
Fix   ACM-184: This will enable Granular Access control of clusters for a given user and group. The UI for the feature is under progress. To enable this feature for the Qubole account, contact help@qubole.com.


Airflow

New   QBOL-5303: Added monit support within an Airflow cluster to monitor and auto bringup when Webserver, Rabbitmq, and Celery services in case of a failure.
New   QBOL-5592 Added default retry and failure handler for Qubole Operator. The handler makes sure that states of the Airflow task are synchronized with corresponding QDS commands.

HADOOP 2

Fix   HADTWO-586: Fixed the issue where upscaling was not happening when a cluster is set to a different timezone.


HIVE 0.13

Fix   HIVE-1351: Provides a generic way to modify JVM parameters ( xmx, permgen, and so on) at the Hive end.
Fix   HIVE-1517: Fixed Hive constrained run issues.
Fix   HIVE-1534: Fixed permissions issues for various directories created by Hive in a Hive on master usecase.

HIVE 1.2

Fix   HIVE-1351: Provides a generic way to modify JVM parameters ( xmx, permgen, and so on) at the Hive end.
Fix   HIVE-1517: Fixed Hive constrained run issues.
Fix   HIVE-1534: Fixed permissions issues for various directories created by Hive in a Hive on master usecase.
Fix   HIVE-1544: Fix for alter table to parquet. OS jira: HIVE-7199

PRESTO 0.142

Fix   PRES-725: Fixed the issue where work on the master node is being scheduled despite when node-scheduler.include-coordinator is set to false.


QDS

New   UI-3583: You can allow/deny access to various command types while configuring roles commands.
New   UI-4089: You can now select multiple slave node types only in the Hadoop 2 and Spark clusters. This is the UI support for Heterogeneous clusters and is available for beta access. Contact help@qubole.com to get it enabled for the Qubole account.
New   UI-4191: Analyze UI remembers last expanded database schema and opens it by default the next time.
Change   UI-4146: Approximate aggregation is now supported in Scheduler UI.


ZEPPELIN

Change   ZEP-456: Users can select the paragraph text when it is in the RUNNING or PENDING state.


List of Hotfixes Since 24th August 2016

None

 

List of Hotfixes After 1st September 2016

Fix   HIVE-1579: Throwing an exception as soon as the transfer of the files fails.
Fix   QBOL-5709: Do not escape from the shell command submitted inside an Airflow cluster.
Fix   UI-4262: A bug which caused the Run button to be disabled even if the correct permissions were present has been resolved.

Have more questions? Submit a request

Comments

Powered by Zendesk