[jira] [Created] (CARBONDATA-156) We are hoping to support the same table parallel load data

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-156) We are hoping to support the same table parallel load data

JIRA jira@apache.org
ke xu created CARBONDATA-156:
--------------------------------

             Summary: We are hoping to support the same table parallel load data
                 Key: CARBONDATA-156
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-156
             Project: CarbonData
          Issue Type: Wish
          Components: data-load
    Affects Versions: 0.2.0-incubating
            Reporter: ke xu


We found carbondata table plus the global lock when load data,only one by one the  load data .We are hoping to support the same table parallel load data.This improves load efficiency.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Reply | Threaded
Open this post in threaded view
|

Re: [jira] [Created] (CARBONDATA-156) We are hoping to support the same table parallel load data

Liang Chen
Administrator
Hi As i understood, should support parallel load dataļ¼ˆbuild MDK index and sort for each data block processingļ¼‰, only to sort and join all data blocks into carbondata files, use one thread to handle.