Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove hard-coded year from EIA AEO archiver #379

Open
3 tasks
e-belfer opened this issue Jul 8, 2024 · 0 comments
Open
3 tasks

Remove hard-coded year from EIA AEO archiver #379

e-belfer opened this issue Jul 8, 2024 · 0 comments
Labels
eiaaeo EIA Annual Energy Outlook

Comments

@e-belfer
Copy link
Member

e-belfer commented Jul 8, 2024

As noted in #372 and #377, hardcoding the range of years archived by our data means that our archivers will never automatically catch a new year's release of data. There will be no 2024 AEO release, but to be able to catch the release of AEO in 2025 we should remove the hardcoded years in the archiver.

Ideally, we would do this by:

  • identifying a directory or page where all years of data are listed
  • querying this list to establish the date range
  • iterating through this data range to feed a year parameter to the open data URL currently used in the archiver

If no such directory is found, we could attempt to download all years of data since the first year using a try/except clause. This would be less robust and less ideal, however.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
eiaaeo EIA Annual Energy Outlook
Projects
Status: Backlog
Development

No branches or pull requests

1 participant