[jira] [Commented] (CARBONDATA-132) Parse some Spark Exception which can be shown to driver side and show them directly.

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (CARBONDATA-132) Parse some Spark Exception which can be shown to driver side and show them directly.

JIRA jira@apache.org

    [ https://issues.apache.org/jira/browse/CARBONDATA-132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432820#comment-15432820 ]

ASF GitHub Bot commented on CARBONDATA-132:
-------------------------------------------

Github user manishgupta88 commented on a diff in the pull request:

    https://github.com/apache/incubator-carbondata/pull/81#discussion_r75869120
 
    --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataRDDFactory.scala ---
    @@ -775,6 +777,13 @@ object CarbonDataRDDFactory extends Logging {
               loadStatus = CarbonCommonConstants.STORE_LOADSTATUS_FAILURE
               logInfo("DataLoad failure")
               logger.error(ex)
    +          ex match {
    +            case sparkException: SparkException =>
    +              if (sparkException.getCause.isInstanceOf[DataLoadingException]) {
    +                executorMessage = sparkException.getCause.getMessage
    +              }
    +            case _ =>
    --- End diff --
   
    @Zhangshunyu ...for underscore case also get the message and assign it to variable executorMessage because lets say the control comes to case _ then variable executorMessage will have empty value and message will remain as "DataLoad failure: " which will be incorrect


> Parse some Spark Exception which can be shown to driver side and show them directly.
> ------------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-132
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-132
>             Project: CarbonData
>          Issue Type: Improvement
>            Reporter: zhangshunyu
>            Priority: Minor
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)