Skip to content

Latest commit

 

History

History
60 lines (37 loc) · 2.12 KB

roadmap.md

File metadata and controls

60 lines (37 loc) · 2.12 KB

Aim

The aim of the package is to analyse the environnemental impact of importing bio based commodities.

Downloading data

  • Downloading data from FAOSTAT.

    • Status: implemented in faostat/pump.py (December 2021) for the following datasets.

      datasets = { "forestry_production": "Forestry_E_All_Data_(Normalized).zip", "forestry_trade": "Forestry_Trade_Flows_E_All_Data_(Normalized).zip", "forest_land": "Emissions_Land_Use_Forests_E_All_Data_(Normalized).zip", "crop_production": "Production_Crops_Livestock_E_All_Data_(Normalized).zip", "crop_trade": "Trade_DetailedTradeMatrix_E_All_Data_(Normalized).zip", "land_cover": "Environment_LandCover_E_All_Data_(Normalized).zip", "land_use": "Inputs_LandUse_E_All_Data_(Normalized).zip", }

  • Downloading monthly data from the Comtrade bulk API.

    • Status: Implemented in comtrade/pump.py (January 2022)
  • Downloading yearly data at the 6 digit level from the Comtrade API later. Comtrade does some additional validation on the yearly data so it's useful to have it as a complement to the FAOSTAT data. Status: planned.

Database structure

The database structure is defined as SQL Alchemy statements in faostat/database.py and comtrade/database.py.

Inspiration

Sources of inspiration

  • A database of COVID 19 vaccination "where official sources release vaccination figures in a consistent, machine-readable format, or where structured data are published at a stable location, we have automated the data collection using Python scripts that we execute every day."

Concerning open source packages used for data preparation