Feedback

Feedback

Did this article resolve your question/issue?

   

Article

Slow performance with Connect for JDBC Apache Hive Wire Protocol driver when calling catalog functions.

Printable View

Information

 
TitleSlow performance with Connect for JDBC Apache Hive Wire Protocol driver when calling catalog functions.
URL Nameslow-performance-with-connect-for-jdbc-apache-hive-wire-protocol-driver-when-calling-catalog-functions
Article Number000141126
EnvironmentProduct: Connect for JDBC Apache Hive Wire Protocol Driver
Version: 5.1
O/S: Java
Database: Apache Hive
Application: N/A
Question/Problem Description
Slow performance with Connect for JDBC Apache Hive Wire Protocol driver when calling catalog functions; such as getTables() and getColumns()
Steps to Reproduce
Clarifying Information
Error Message
Defect Number
Enhancement Number
Cause
The performance behavior is likely the result of server characteristics. Historically, Hive servers didn't have native metadata calls. When they were implemented , they were (and sometimes remain) inaccurate. So, by default, the driver gathers metadata itself, which can incur a performance penalty. 
Resolution
Include the following connection option in the connection URL: 

UseNativeCatalogFunctions=true 

This will trigger the use of the native methods for catalog metadata.

For SQLTables this is generally safe, but for SQLColumns it can return inaccurate descriptions at least for DECIMAL, CHAR, and VARCHAR columns. 

For example:

Hive's native descriptions of DECIMAL types return precision and scale values of 10 and 0, respectively, even if the column had been created as a DECIMAL(10,2). 
Workaround
Notes
Last Modified Date10/19/2017 8:47 PM
Files
Disclaimer The origins of the information on this site may be internal or external to Progress Software Corporation (“Progress”). Progress Software Corporation makes all reasonable efforts to verify this information. However, the information provided is for your information only. Progress Software Corporation makes no explicit or implied claims to the validity of this information.

Any sample code provided on this site is not supported under any Progress support program or service. The sample code is provided on an "AS IS" basis. Progress makes no warranties, express or implied, and disclaims all implied warranties including, without limitation, the implied warranties of merchantability or of fitness for a particular purpose. The entire risk arising out of the use or performance of the sample code is borne by the user. In no event shall Progress, its employees, or anyone else involved in the creation, production, or delivery of the code be liable for any damages whatsoever (including, without limitation, damages for loss of business profits, business interruption, loss of business information, or other pecuniary loss) arising out of the use of or inability to use the sample code, even if Progress has been advised of the possibility of such damages.


Copyright © 2022 Progress Software Corporation and/or its subsidiaries or affiliates.
All Rights Reserved.

Progress, Telerik, Ipswitch, Chef, Kemp, Flowmon and certain product names used herein are trademarks or registered trademarks of Progress Software Corporation and/or one of its subsidiaries or affiliates in the U.S. and/or other countries. See Trademarks for appropriate markings.

Terms of Use Privacy Center Security Center Trademarks License Agreements Code of Conduct Careers Offices
Do Not Sell My Personal Information