Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Documentation should give description of output table #153

Open
ssiegel95 opened this issue Feb 27, 2019 · 5 comments
Open

Documentation should give description of output table #153

ssiegel95 opened this issue Feb 27, 2019 · 5 comments

Comments

@ssiegel95
Copy link

ssiegel95 commented Feb 27, 2019

For the following table, most of the fields are self-explanatory. However, I'm scratching my head understanding the (inf) values for some of them. Is this documented anywhere? I've grepped the code to see when these get generated but I'm only guessing that it has something to do with comparison to baseline runs. Really not sure, thanks.

------------------------------------------------------------------------------------- benchmark: 4 tests -------------------------------------------------------------------------------------
Name (time in s)                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_modelbuild_two_models       1.3795 (1.0)       5.6846 (3.35)      2.2636 (1.34)     1.9126 (inf)       1.4213 (1.0)      1.1133 (inf)           1;1  0.4418 (0.75)          5           1
test_cosload                     1.6946 (1.23)      1.6946 (1.0)       1.6946 (1.0)      0.0000 (1.0)       1.6946 (1.19)     0.0000 (1.0)           0;0  0.5901 (1.0)           1           1
test_modelbuild_four_models      3.9670 (2.88)      4.5160 (2.66)      4.1924 (2.47)     0.2270 (inf)       4.1089 (2.89)     0.3587 (inf)           1;0  0.2385 (0.40)          5           1
test_grid_optimizer             11.8117 (8.56)     11.8117 (6.97)     11.8117 (6.97)     0.0000 (1.0)      11.8117 (8.31)     0.0000 (1.0)           0;0  0.0847 (0.14)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------```
@ionelmc
Copy link
Owner

ionelmc commented Feb 28, 2019

inf means that you can't give a ratio comparing to something that's zero.

It's a bit confusing yea, but then again, probably stddev, iqr and outliers are probably also confusing. I was thinking to hide them by default in a future version ...

@LucaPaterlini
Copy link

hello, may I ask what is the command line you have used to generate the 2 picture in the documentation?

@ionelmc
Copy link
Owner

ionelmc commented Nov 2, 2020

@LucaPaterlini which picture exactly? There are more than 1 pages with pictures in the docs.

@LucaPaterlini
Copy link

few months passed, I think I was referring to those in the readme file. otherwise, feel free to close my request

@ionelmc
Copy link
Owner

ionelmc commented Nov 2, 2020

Those are just screenshots of my terminal. Nothing automated there.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants