000182902
Queries fail to Apache Spark SQL with Java out of memory errors.
Information |
| Title | Queries fail to Apache Spark SQL with Java out of memory errors. |
|---|
| URL Name | Queries-fail-to-Apache-Spark-SQL-with-Java-out-of-memory-errors |
|---|
| Article Number | 000182902 |
|---|
| Environment | Product: Connect for ODBC Apache Spark SQL Wire Protocol driver
Version: All supported versions OS: All supported platforms Database: Spark SQL Application: All supported applications |
|---|
| Question/Problem Description |
|
|---|
| Steps to Reproduce |
|---|
| Clarifying Information |
|
|---|
| Error Message | [DataDirect][ODBC Apache Spark SQL Wire Protocol driver][Spark SQL]org.apache.spark.SparkException: Job aborted due to stage failure: Task x in stage xxx failed x times, most recent failure: Lost task x in stage xxx: java.lang.OutOfMemoryError: Unable to acquire xxxxxxx bytes of memory, got xxxx
at org.apache.spark.memory.MemoryConsumer.allocateArray(MemoryConsumer.java) at org.apache.spark.unsafe.map.BytesToBytesMap.allocate(BytesToBytesMap.java) at org.apach. [nQSError: 16002] Cannot obtain number of columns for the query result. Statement execute failed |
|---|
| Defect Number |
|---|
| Enhancement Number |
|---|
| Cause |
|
|---|
| Resolution |
|
|---|
| Workaround |
|---|
| Notes |
|---|
| Last Modified Date | 11/2/2018 3:14 PM |
|---|
| Files |
| Disclaimer |
The origins of the information on this site may be internal or external to Progress Software Corporation (“Progress”). Progress Software Corporation makes all reasonable efforts to verify this information. However, the information provided is for your information only. Progress Software Corporation makes no explicit or implied claims to the validity of this information. Any sample code provided on this site is not supported under any Progress support program or service. The sample code is provided on an "AS IS" basis. Progress makes no warranties, express or implied, and disclaims all implied warranties including, without limitation, the implied warranties of merchantability or of fitness for a particular purpose. The entire risk arising out of the use or performance of the sample code is borne by the user. In no event shall Progress, its employees, or anyone else involved in the creation, production, or delivery of the code be liable for any damages whatsoever (including, without limitation, damages for loss of business profits, business interruption, loss of business information, or other pecuniary loss) arising out of the use of or inability to use the sample code, even if Progress has been advised of the possibility of such damages. |