[jira] [Created] (CARBONDATA-1179) Improve the Object Size calculation for Objects added to LRU cache

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-1179) Improve the Object Size calculation for Objects added to LRU cache

JIRA jira@apache.org
Raghunandan created CARBONDATA-1179:
---------------------------------------

             Summary: Improve the Object Size calculation for Objects added to LRU cache
                 Key: CARBONDATA-1179
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1179
             Project: CarbonData
          Issue Type: Bug
            Reporter: Raghunandan
            Priority: Minor


Java Object model has a bigger overhead when loading the objects into memory.
The current way of estimating the object size by looking at the file size is not correct and gives wrong results.Moreover due to this calculation, we are storing more than the configured size for LRU cache.

Improve the ObjectSize calculation by using the spark SizeEstimator utility



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)