[jira] [Created] (CARBONDATA-1180) Dictionary file id is locked for updation when loading data

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

[jira] [Created] (CARBONDATA-1180) Dictionary file id is locked for updation when loading data

JIRA jira@apache.org
Liu Shaohui created CARBONDATA-1180:
---------------------------------------

             Summary:  Dictionary file id is locked for updation when loading data
                 Key: CARBONDATA-1180
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1180
             Project: CarbonData
          Issue Type: Bug
          Components: data-load
    Affects Versions: 1.2.0
            Reporter: Liu Shaohui


use Spark 2.1 in yarn-client mode and query from beeline to spark sql thriftserver
{code}
CREATE TABLE IF NOT EXISTS carbondata_test(id string, name string, city string, age Int) STORED BY 'carbondata';
LOAD DATA INPATH 'hdfs:///user/sample-data/sample.csv' INTO TABLE carbondata_test;
{code}

Data load is failed for following exception.
{code}
java.lang.RuntimeException: Dictionary file id is locked for updation. Please try after some time +details
java.lang.RuntimeException: Dictionary file id is locked for updation. Please try after some time
        at scala.sys.package$.error(package.scala:27)
        at org.apache.carbondata.spark.rdd.CarbonGlobalDictionaryGenerateRDD$$anon$1.<init>(CarbonGlobalDictionaryRDD.scala:407)
        at org.apache.carbondata.spark.rdd.CarbonGlobalDictionaryGenerateRDD.compute(CarbonGlobalDictionaryRDD.scala:345)
        at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
        at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
        at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
        at org.apache.spark.scheduler.Task.run(Task.scala:99)
        at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:282)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
{code}
The 1.2.0 contains the fix in CARBONDATA-614.

Any suggestion about this problem? Thanks~



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
Loading...