back to forum.

Topic: Quantity of Data

Topic by
venkatshrinivas

2009-05-18
06:05

Quantity of Data

Hi all

Is there a limit on the amount of data that the cleaner can handle or it just depends on the capacity of my hard disk and RAM ?

Reply by
kasper

2009-05-18
10:47
Hi venkatshrinivas,

There are no "hard" limits to DataCleaners capacity. It depends on a few things:
  • The quality of the database driver. Some database drivers unfortunately have memory leaks and cannot stream data succesfully so if you try to transfer huge amounts of data from your database to the application, it will eventually boast up.
  • If youre using the profiler, the kind of profiler that you are using - A few profiles are more memory intensive than others, namely the "value distribution" profile (we're looking at an improvement) others are totally unaffected by the amount of data that you use them for (Standard analysis, String analysis, Number analysis etc.).
  • The JVM memory settings. If you download the platform independent (or *nix) version of datacleaner you will be able to tweak memory settings in the .ssh/.cmd executable files.

You need to be logged in to participate

In order to post your own comments on this topic, you need to be logged in.

Username:

Log in by clicking the login link at the top of the screen

 

Go back to forum.