Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Significantly slower selection of matching error cells in v3.0.2 vs much older version #2335

Open
NickOveracker opened this issue Mar 2, 2024 · 1 comment
Labels

Comments

@NickOveracker
Copy link

NickOveracker commented Mar 2, 2024

Small description
Yesterday I installed an old version of vd with a very outdated version of pip. I don't remember the original version number, but it wasn't version 3. The interface and plugin list matched the tutorial screenshots.

Today, I updated pip and installed the latest version of VisiData, v3.0.2.

I'm not at liberty to share the full dataset, but I can share a single screen of it below.

vd_scrsh

Expected result
The cmdlog should have executed completely within a few seconds.

Actual result with screenshot
The "select rows matching current cell in column" commands took a very long time to execute. For the commands executed in the screenshot below, the first several commands took around 6 seconds, and the final "select" command took 91 seconds to complete.

The cell was a Python error cell for a calculated column. I was selecting all cells with errors in order to determine the most common sources of errors.

vd_scrsh2

Steps to reproduce with sample data and a .vd
The following sample dataset and cmdlog are sufficient to reproduce the issue.

faa-wildlife-strikes.csv
faa-wildlife-strikes.vdj.txt

Additional context
VisiData v3.0.2
Python 3.8.0

@NickOveracker
Copy link
Author

The more I think about it, the less sure I am that the revision number wasn't 2 instead of 1. In any case, I followed the tutorial with it, and both the overall interface and pre-packaged plugin list matched whatever version was in the tutorial screenshots.

@NickOveracker NickOveracker changed the title Significantly slower selection of matching error cells in v3.0.2 vs v1.?.? Significantly slower selection of matching error cells in v3.0.2 vs much older version Mar 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant