This repository automates data collection from the UNHCR and the World Bank microdata libraries.
It uses a Python script and Github Action to run weekly.
Created by the Joint Data Center on Forced Displacement.
Right-click and "Save link as" to download the files.
Each microdata library has its own subfolder. The records are saved in the following format:
-
metadata.csv: list of all datasets available -
datasets.csv: all information about the datasets in both microdata libraries
list.py: Lists all datasets in the MDLs and creates a CSV file with the metadata
get.py: Loop through all rows in metadata.csv to get data from the datasets and generate the datasets.csv file.