This repository automates data collection from the UNHCR and the World Bank microdata libraries.
It uses a Python script and Github Action to run weekly.
Created by the Joint Data Center on Forced Displacement.
Right-click and "Save link as" to download the files.
Each microdata library has its own subfolder. The records are saved in the following format:
-
metadata.csv
: list of all datasets available -
datasets.csv
: all information about the datasets in both microdata libraries
list.py
: Lists all datasets in the MDLs and creates a CSV file with the metadata
get.py
: Loop through all rows in metadata.csv
to get data from the datasets and generate the datasets.csv
file.