Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Display of a particular parameter/metric in keepsake ls #605

Open
Pangoraw opened this issue Apr 9, 2021 · 1 comment
Open

Display of a particular parameter/metric in keepsake ls #605

Pangoraw opened this issue Apr 9, 2021 · 1 comment

Comments

@Pangoraw
Copy link

Pangoraw commented Apr 9, 2021

Hi!

I have a project with many parameters/metrics, so keepsake ls is only showing a subset of them which is fine. However, if I want to compare the different experiments with regard to a parameter not displayed by keepsake, the only possibility is doing keepsake diff with two experiments at a time (or I missed something).

Example:
I want to see all experiments with a mean IoU greater than 0.1 and compare the actual values but the values are not displayed:

 $ keepsake ls --filter "mean_iou > 0.1"
EXPERIMENT  STARTED       STATUS   PARAMS                            BEST CHECKPOINT   LATEST CHECKPOINT
951eca5     23 hours ago  stopped  ae_n_epochs=0                     dff7f56 (step 5)  7d1bcec (step 7)
                                   deep=false                        f1_score=0.3743   f1_score=0.25648
                                   n_epochs=0
                                   params_path=./models/train-hy...
                                   train_limit=10000

8d2f62f     22 hours ago  stopped  ae_n_epochs=30                    f6b8339 (step 3)  a7a1b91 (step 7)
                                   deep=true                         f1_score=0.25103  f1_score=0.003937
                                   n_epochs=50
                                   params_path=./models/train-de...
                                   train_limit=1000

Since there is already sort & filter is there any plan to add some sort of selection parameter to keepsake ls ? If it is not too tricky I would be happy to contribute. This has already been mentioned on #284 (comment)

Anyway, thanks for making keepsake 🎊

Edit: I made my own query tool called sake.

@zeke
Copy link
Member

zeke commented Mar 15, 2022

Hi @Pangoraw

The Keepsake project is no longer actively maintained. If you're interested in helping maintain it, please let us know.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants