Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automation of daily code run #26

Open
MGMD-96 opened this issue Jun 27, 2020 · 3 comments
Open

Automation of daily code run #26

MGMD-96 opened this issue Jun 27, 2020 · 3 comments
Labels
Priority: High Work when critical priority issues are done. Status: assigned The issue has been assigned to a developer(s) and is being worked on Status: available This issue has been verified and is available to claim Type: enhancement New feature or request

Comments

@MGMD-96
Copy link
Member

MGMD-96 commented Jun 27, 2020

No description provided.

@MGMD-96 MGMD-96 added Type: enhancement New feature or request Status: available This issue has been verified and is available to claim Priority: High Work when critical priority issues are done. labels Jun 27, 2020
@darmis007
Copy link

can somebody describe what has to be done in this issue?

@MGMD-96
Copy link
Member Author

MGMD-96 commented Aug 4, 2020

We update our data once daily, preferably as soon as latest whole-day data is available in the source API.

This update cycle involves running a python script(s) which gives the output json(s). The frontend of website is connected to these latest jsons through their raw github urls. These jsons lie in our Backend repo.

Earlier the scripts were multiple and it was all messy but now, we have worked to produce a single python script which gives all the required output files. Also the Reproduction number script involved some loops in R, and also took like 3 hours to run. Now we are changing our method altogether, which is only python and runs within minutes. So we are GO for automation.

Now the thing is to automate this daily code run. That is, the said python scripts (one each for states and districts) automatically run on a virtual machine at a preset time once every day. The output jsons need to go into the Backend repo so that website can pickup the latest data (we can change this if smth better is available).

@MGMD-96
Copy link
Member Author

MGMD-96 commented Aug 4, 2020

Since I am a newbie at coding stuff, I welcome any and all suggestions to automate this. Let us know if you have something to revamp the entire flow which makes it more efficient or something like that.

@nightmare-adi @PratikMandlecha can pitch in and help out.

@MGMD-96 MGMD-96 added the Status: assigned The issue has been assigned to a developer(s) and is being worked on label Aug 10, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Priority: High Work when critical priority issues are done. Status: assigned The issue has been assigned to a developer(s) and is being worked on Status: available This issue has been verified and is available to claim Type: enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants