back to forum.

Topic: horisontal scroll

Topic by
fortuinw

2011-05-11
12:43

horisontal scroll

Hi Kasper

Compliments with a very good profiling tool. Version 2.1 was a major step forward but I have a few enhancement ideas that I like to share with you:

1. A configurable option to enable horisontal scroll on all windows eg. preview form - useful when previewing table with many (30+) columns.

2. When moving and resizing windows, save the new position and size of windows eg. preview window - currently you need to resize the preview window everytime you access it.

3. Facility to profile ad-hoc sql statements (not just tables) ie in a dataware house scenario where you work with dimensions and facts, you want to profile results where the keys has been resolved

table column
----------------------
fact_1 | dim1_fk
| dim1_fk
| date_fk
| val1
| val2
----------------------
dim_1 | dim1_pk
| dim1_type
| dim1_desc
----------------------
dim_2 | dim2_pk
| dim2_type
| dim2_desc
----------------------
date_dim | date_pk
| day
----------------------

A facility to profile this sql:
select
d.day
, a.dim1_type
, a.dim1_desc
, a.dim2_type
, a.dim2_desc
, c.val1
, c.val2
from
dim_1 a
, dim_2 b
, fact_1 c
, date_dim d
where
c.date_fk = date_pk
and d.day >= '01-Jan-2011'
and d.day < '01-Feb-2011'
and c.dim1_fk = a.dim1_pk
and c.dim2_fk = b.dim2_pk;

Kind regards
Wayne

Reply by
kasper

2011-05-12
10:08
Hi Wayne,

Thank you for all the feedback!

Some of your items are very easy to fix and some are quite larger tasks.

For now I have added a quick revision to automatically enable horizontal scroll when a preview table has more than 10 columns.

I'm not entirely sure what you mean by "you have to move the preview window" - why do you have to do that?

And the SQL-based profiling option is a quite big tasks and we have some alternative ideas on how to make this possible that would not include SQL (because SQL varies from datastore to datastore, some datastores (like CSV and Excel) don't even support SQL and user-written SQL is quite a task to error handle)... Instead I think we might see (sometime in the future) a way to create "virtual tables" (~views) where you specify your join semantics or whatever and then apply your job to this virtual table.

Right now this is not my (or Human Inference's) highest priority though, but if you can gather some community interest (or work on it yourself?) it would be a very nice thing to add!

Reply by
fortuinw

2011-05-12
15:31
Hi Kasper

Thanks for your quick response. The reason why I resize the preview window is because I work on multiple monitors (2) and the preview window spans over both screens. In general, the windows in datacleaner doesn't remember its position and sizes, when you do resizing. But its probably just a usability thing and not a big issue.

Thanks again for your prompt assistance.

Reply by
kasper

2011-05-16
10:16
Hi again,

Just wanted to say that 2.1.1 is out now and it includes the fix for the horizontal scrollbars (and a lot more), see the news item.

Reply by
ctian

2011-05-16
14:17
May I add some comments on the SQL-based profiling option: personally I always want to got the the maximum with tools, but especially with DataCleaner one of the outstanding features is the easy to use and nearly out of the box creation of analysis jobs.

Although I am often working on SQL-level I believe that going into that direction this will have a big impact on the number of (potential) users.

Also thinking about really large DWH scenarios (on Oracle or Teradata or whatever) then by doing this DataCleaner has to fight with real performance issues. And I personally do not believe that this would be a good direction DataCleaner should go to.

I really prefer the fast analysis scan and would suggest in case of complex query requirements to go for another strategy(if you do your analysis on Oracle why not creating for example views or materialized views then).

Regards,
Christian

Reply by
fortuinw

2011-05-19
09:51
HI Kasper

Thanks. I have downloaded version 2.1.1 and I see that the fix for the horizontal bars are in there.

Regards
Wayne

You need to be logged in to participate

In order to post your own comments on this topic, you need to be logged in.

Username:

Log in by clicking the login link at the top of the screen

 

Go back to forum.