...
The solution is to read into MATLAB. However, we run out of java heap memory, so we need to 1) increase the meomery, and 2) set the db preferences to read in batches.
Now we get a pretty good reduction - 48+hours to 1 minute!
...
The solution is to read into MATLAB. However, we run out of java heap memory, so we need to 1) increase the meomery, and 2) set the db preferences to read in batches.
Now we get a pretty good reduction - 48+hours to 1 minute!