Feedback
Did this article resolve your question/issue?

   

Article

Spark SQL table and column statistics display in a confusing format

Information

 
TitleSpark SQL table and column statistics display in a confusing format
URL NameSpark-SQL-table-and-column-statistics-display-in-a-confusing-format
Article Number000153748
EnvironmentProduct: Progress DataDirect for JDBC for Spark SQL Driver
Version: 6.0
OS: Java
Database: Apache Spark SQL
Application: All supported applications
Question/Problem Description
Spark SQL table and column statistics display in a confusing format when using the Progress DataDirect for JDBC for Spark SQL Driver
Steps to ReproduceQueries run:
describe formatted schema_name.table_name
describe formatted schema_name.table_name colnname

Sample output:
# col_name data_type min max num_nulls distinct_count avg_col_len max_col_len num_trues num_falses comment id int
Clarifying Information
All data displayed in one line versus a column format. 
Problem is seen on Apache Spark SQL version 1.6
Error Message
Defect Number
Enhancement Number
Cause
This is not a driver issue. The database is returning the data in this format.
Resolution
The application running the query would need to be modified to display the data in a different format.

The problem does not occur with Apache Spark SQL version 2.4.
Workaround
Notes
Last Modified Date2/25/2020 8:38 PM
Files
Disclaimer The origins of the information on this site may be internal or external to Progress Software Corporation (“Progress”). Progress Software Corporation makes all reasonable efforts to verify this information. However, the information provided is for your information only. Progress Software Corporation makes no explicit or implied claims to the validity of this information.

Any sample code provided on this site is not supported under any Progress support program or service. The sample code is provided on an "AS IS" basis. Progress makes no warranties, express or implied, and disclaims all implied warranties including, without limitation, the implied warranties of merchantability or of fitness for a particular purpose. The entire risk arising out of the use or performance of the sample code is borne by the user. In no event shall Progress, its employees, or anyone else involved in the creation, production, or delivery of the code be liable for any damages whatsoever (including, without limitation, damages for loss of business profits, business interruption, loss of business information, or other pecuniary loss) arising out of the use of or inability to use the sample code, even if Progress has been advised of the possibility of such damages.