Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

s3 url for validated downloads #250

Open
missinglink opened this issue Dec 2, 2021 · 3 comments
Open

s3 url for validated downloads #250

missinglink opened this issue Dec 2, 2021 · 3 comments
Assignees
Labels
question Further information is requested

Comments

@missinglink
Copy link
Contributor

are there s3 versions of the validated data downloads?
I tried taking an s3 url and changing the filename from source.geojson.gz to validated.geojson.gz without success.

@missinglink missinglink added the question Further information is requested label Dec 2, 2021
@ingalls
Copy link
Member

ingalls commented Dec 2, 2021

Hey @missinglink, sorry busy work week. I'm hoping to get to S3 validation this coming weekend. At the moment sources that are processed successfully will generate both a normal source.geojson.gz file and a validated address file and store it, but only the source file is currently accessible.

@ingalls
Copy link
Member

ingalls commented Feb 28, 2022

@missinglink Validatd data downloads should now work. Please note that this feature is not retroactive. Sources that haven't run successfully since the validated processor was introduced will not currently return a successful object.

I've also updated openaddresses/lib with the new endpoints.

OA_TOKEN='<redacted>' ./oa job validated --:job 123 --script > out.geojson.gz

@ingalls ingalls closed this as completed Feb 28, 2022
@ingalls ingalls reopened this Feb 28, 2022
@ingalls
Copy link
Member

ingalls commented Feb 28, 2022

I'll update the API with an S3 location shortly.

ingalls added a commit that referenced this issue Mar 2, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants