Qubole Release Notes for QDS Version R41CP1 14-Mar-2017

Release Version: 41.32.0

For details of what has changed in this version of QDS, see What is New, List of Changes and Bug Fixes in this Release, and New Beta Features.

 

What is New

ACID Transactions in Hive

With this QDS release, Hive ACID transactions are supported on Hive 1.2 to insert, update, and delete data. For more information, see this documentation.

Other Significant Enhancements in this QDS Release

These are a few significant enhancements in this QDS release:

  • DirectFileOutputCommitter (DFOC) for data writes to S3 is now enabled by default on all Spark clusters.
  • S3 jars can be specified as part of a notebook’s interpreter dependencies. This works only in earlier versions of Spark 2.0 and does not work in Spark 2.0 and later versions.


UI Enhancements
Group ID is displayed in the Control Panel UI and returned in the API response as well.


New Beta Features

None

 

List of Changes and Bug Fixes in this Release

HIVE 1.2

New   HIVE-1900: Appending Hadoop MapReduce job name with the command ID to provide better searchability.
Fix   HIVE-1882: Performance improvement for dynamic partition loading.
Fix   HIVE-1898: CTAS temporary table creation to pass is allowed now.

 

PRESTO

Fix   PRES-918: Fixed the way Presto creates table so that a DB Export query can work with the tables that Presto creates.
Change   PRES-927: Fixed an issue in Presto auto-scaling where more nodes were getting added than the configured maximum number of nodes.

 

QDS

Change   UI-5153: Group ID is displayed in the Control Panel UI and returned in the API response as well.

 


SPARK

Fix   SPAR-1319: DirectFileOutputCommitter (DFOC) for data writes to S3 is now enabled by default on all Spark clusters.
Fix   SPAR-1421: The data store/DBTap Issue on Spark 2.x version has been fixed.


TEZ

Fix   QTEZ-125: Pulled the fix, https://issues.apache.org/jira/browse/HIVE-11051 from the open source.

 

ZEPPELIN

Fix   ZEP-762: Spark jobs spawned by SparkR paragraphs will be accessible from the UI.
Change   ZEP-433: S3 jars can be specified as part of a notebook’s interpreter dependencies. This works only in the earlier versions of Spark 2.0 and does not work in Spark 2.0 and later versions.

 

List of Hotfixes Since 28th February 2017


Fix   PRES-968: RubiX version has been upgraded to 0.2.7

Have more questions? Submit a request

Comments

Powered by Zendesk