Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fully embracing separation of agent/informant "recipes" and target tbls #603

Open
jl5000 opened this issue Feb 19, 2025 · 0 comments
Open
Assignees

Comments

@jl5000
Copy link

jl5000 commented Feb 19, 2025

I have a use case where we have a master dataset containing all columns and rows. This data is then used for bespoke downstream analyses, often using subsets of this data. I would like to use the same validation plan and data dictionary on these smaller datasets.

The functionality of pointblank already goes some way in allowing this re-use, through functions such as has_columns(), set_tbl(), and yaml_write(), however I don't think the package has yet fully embraced this approach.

I have made a couple of suggestions below which would make this use case fully possible, it just depends on whether it fits with your vision:

  1. If set_tbl() allows you to change the target dataframe, then is there any need to define the tbl when creating the agent/informant? It would allow the full separation between "recipe" and tbl. As far as I can see interrogate()/incorporate() already provides informative errors when the tbl defined isn't valid.

  2. When writing an agent to YAML (pre-interrogation), the package does a great job in preserving all of the logic in preconditions and active, such that it can be re-used downstream. However, this isn't the case for informants where info_columns() and info_snippet() don't seem to be recorded.

Recording the "recipes" for these objects to YAML is a really useful thing, and would negate the need to create a separate package containing functions to regenerate the agents/informants.

@jl5000 jl5000 changed the title Fully embracing agent/informant "recipes" and target tbls Fully embracing separation of agent/informant "recipes" and target tbls Feb 19, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants