Beefy Boxes and Bandwidth Generously Provided by pair Networks
Keep It Simple, Stupid
 
PerlMonks  

Re: Bucketing,Slicing and Reporting data across multiple dimensions

by roboticus (Canon)
on Aug 17, 2011 at 17:53 UTC ( #920731=note: print w/ replies, xml ) Need Help??


in reply to Bucketing,Slicing and Reporting data across multiple dimensions

Voronich:

I'd try making a 15000H x 550W bitmap (+ space for rulers on the borders) where the pixel values would show the variation: e.g., use red to represent positive and green for negative variation. That'll give you a quick feel for the data, and you can use the ruler to locate the dataset(s) of interest.

...roboticus

When your only tool is a hammer, all problems look like your thumb.


Comment on Re: Bucketing,Slicing and Reporting data across multiple dimensions
Re^2: Bucketing,Slicing and Reporting data across multiple dimensions
by Voronich (Hermit) on Aug 17, 2011 at 18:09 UTC
    That's... sick and delightful. I probably won't go that route. But I'm going to keep that idea in my bag of tricks as it will almost certainly come up before too terribly long.
    Me
Re^2: Bucketing,Slicing and Reporting data across multiple dimensions
by blue_cowdawg (Prior) on Aug 17, 2011 at 18:13 UTC

    Talk about visual!! That's great!!!


    Peter L. Berghold -- Unix Professional
    Peter -at- Berghold -dot- Net; AOL IM redcowdawg Yahoo IM: blue_cowdawg
      Still too abstract to me, but I think that when you say impact quantification you say: the last column number
      use GraphViz; open DATA, "<", "/my/data"; my $plot = GraphViz->new( layout => 'dot', # <--or neato, or circo etc node => {height => '0.05', shape => 'box',fontsize => '11', fontname = +> 'Times-Roman', style=>'filled', color=>'lightgray'}, bgcolor=> 'white', center=> 'true', dpi=> '1800', #resolution of the graph, higher = sloower ... more general parameters following here... ); while (<DATA>){ my ($idname, $fooname, $blah, $blah2, $impact) = split //,$_, 5 # spli +t ID in fields next if $impact = 0 # no impact between tests, so we discard this id-> +foo node $plot->add_node($idname, label => "$idname"); #create parent node $plot->add_edge($idname => $fooname, size => $impact) # trace an arrow + from to each id to its foo #i don't remember if size is valid, but instead you could use better +the tag color => $mycolor The goal with this is that you can create easily a customized %colorha +sh (when key = impact and value is a custom color... you can have mor +e, less hot, more blue, more red... for any impact range } # whe close while loop # and we print the plot to a svg file, or gv, or png, or txt... svg fi +le looks reasonably good in a browser and you can zoom it a loot $plot->as_svg("my_big_plot.svg"); system("iceweasel my_big_plot.svg");

      something like this, I warn you that in real life this is not so simple and this is only an skeleton and WILL fail for sure until you work and tune this a little, but you can explore this idea in any case, specially if you feel comfortable with dot files.

        hey thanks very much. I'm sufficiently familiar with dot files from Doxygen in my C++ stuff, so this isn't going to be SO out there. I'll definitely pick this up, noodle with it and let you know how it goes. o/

        UPDATE:Yes, the last column is just the difference between the two test runs (the previous two columns) so it measure the impact of the other changes that were made between the baseline and the test.
        Me

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://920731]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others about the Monastery: (3)
As of 2014-07-12 20:19 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    When choosing user names for websites, I prefer to use:








    Results (241 votes), past polls