[jira] [Created] (CARBONDATA-144) Minor compaction is not working

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-144) Minor compaction is not working

JIRA jira@apache.org
Krishna Reddy created CARBONDATA-144:
----------------------------------------

             Summary: Minor compaction is not working
                 Key: CARBONDATA-144
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-144
             Project: CarbonData
          Issue Type: Bug
          Components: data-query
    Affects Versions: 0.1.0-incubating
         Environment: SUSE11SP3, standalone application with Spark 1.5.2 and Hadoop 2.7.2 version
            Reporter: Krishna Reddy


1. Create table
create table table1(column1 string, Amount int)  STORED BY 'org.apache.carbondata.format'
2. Load the data for 10 times
3 . Run the Minor compaction query
alter table table compact 'Minor';
4. Verify the result

Minor compaction is not working

Driver Log:
16/08/05 14:54:07 ERROR CarbonDataRDDFactory$: Thread-1994 Exception in compaction thread java.lang.Exception: Compaction Failure in Merger Rdd.
Exception in thread "Thread-1994" java.util.concurrent.ExecutionException: java.lang.Exception: Compaction Failure in Merger Rdd.
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at org.carbondata.spark.rdd.CarbonDataRDDFactory$$anon$1$$anonfun$run$1.apply(CarbonDataRDDFactory.scala:366)
        at org.carbondata.spark.rdd.CarbonDataRDDFactory$$anon$1$$anonfun$run$1.apply(CarbonDataRDDFactory.scala:365)
        at scala.collection.Iterator$class.foreach(Iterator.scala:727)
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)
        at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
        at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
        at org.carbondata.spark.rdd.CarbonDataRDDFactory$$anon$1.run(CarbonDataRDDFactory.scala:365)
Caused by: java.lang.Exception: Compaction Failure in Merger Rdd.
        at org.carbondata.spark.rdd.Compactor$.triggerCompaction(Compactor.scala:151)
        at org.carbondata.spark.rdd.Compactor.triggerCompaction(Compactor.scala)
        at org.carbondata.integration.spark.merger.CompactionCallable.call(CompactionCallable.java:40)
        at org.carbondata.integration.spark.merger.CompactionCallable.call(CompactionCallable.java:29)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)