This project cleans and extracts metrics related to public school outcomes. Data is sourced from the UNESCO Institute of Statistics (UIS). Original source files exceed the file size limits set by Github, but are available for download directly from UNESCO: https://apiportal.uis.unesco.org/bdds Data will need to be downloaded and extracted into the appropriate hierarchy before running the .py.
UNESCO.py - The script for joining, cleaning, and subsetting the data. TZA_OPRI.csv - Output containing OPRI indicators for Tanzania. TZA_SDG.csv - Output containing SDG indicators for Tanzania SDG.zip - Source data files from Unesco for SDG indicators
This file is a list of all indicator codes and their descriptive labels:
| Field Name | Field Description |
|---|---|
| INDICATOR_ID | Indicator code |
| INDICATOR_LABEL_EN | Indicator code English label |
This file contains all the national data available for this dataset and includes the following fields:
| Field Name | Field Description |
|---|---|
| INDICATOR_ID | Indicator code |
| COUNTRY_ID | ISO 3166-1 alpha-3 country code |
| YEAR | Year of the measured value |
| VALUE | Measured value |
| MAGNITUDE | Metadata describing the NATURE of the measured value (see metadata section below) |
| QUALIFIER | Metadata describing the QUALITY of the measured value (see metadata section below) |
This file contains all the regional data available for this dataset and includes the following fields:
| Field Name | Field Description |
|---|---|
| INDICATOR_ID | Indicator code |
| REGION_ID | ISO 3166-1 alpha-3 country code |
| YEAR | Year of the measured value |
| VALUE | Measured value |
| MAGNITUDE | Metadata describing the NATURE of the measured value (see metadata section below) |
| QUALIFIER | Metadata describing the QUALITY of the measured value (see metadata section below) |
This file contains all the metadata associated to the NATIONAL and REGIONAL data files above and includes the following fields:
| Field Name | Field Description |
|---|---|
| INDICATOR_ID | Indicator code |
| COUNTRY_ID | ISO 3166-1 alpha-3 country code |
| YEAR | Year of the metadata value |
| TYPE | Type of metadata |
| METADATA | Metadata value |
This file lists all country codes and their descriptive labels:
| Field Name | Field Description |
|---|---|
| COUNTRY_ID | ISO 3166-1 alpha-3 country code |
| COUNTRY_NAME_EN | UNSTATS M49 STANDARD English country name (https://unstats.un.org/unsd/methodology/m49/) |
This file lists all regions and the countries that belong to each region:
| Field Name | Field Description |
|---|---|
| REGION_ID | Label is composed of the name (acronym) of the organization that is responsible for the regional composition + ': ' + name of the region |
| COUNTRY_ID | ISO 3166-1 alpha-3 country code |
| COUNTRY_NAME_EN | UNSTATS M49 STANDARD English country name (https://unstats.un.org/unsd/methodology/m49/) |
The National (and Regional when available) data files can be linked with the:
- label file using the “INDICATOR_ID” variable as the matching key.
- metadata file (when available) using the “INDICATOR_ID”+”COUNTRY_ID”+”YEAR” variables combined as the matching key. Be aware that multiple metadata entries can match a unique data point from the data file i.e. there can be multiple metadata rows for a specific INDICATOR_ID/COUNTRY_ID/YEAR combination. Note that there can also be multiple entries within the same INDICATOR_ID/COUNTRY_ID/YEAR/TYPE combination.
Most indicators have a Glossary entry that can be accessed on the UIS website at http://uis.unesco.org/en/glossary containing the indicators’: definition, interpretation, purpose, quality standards, calculation, types of disaggregation and limitation.
MAGNITUDE describes the NATURE of the data point. Possible values are:
- NIL – The value will be 0, and should be treated as NIL.
- NA – The value will be 0. This data point is NOT APPLICABLE for the submitting nation.
- SUPP - The value will be BLANK. The data point was SUPPRESSED by request of the submitting nation.
- LOWREL – The value will be NUMERIC. The data point is of LOW RELIABILITY.
- INCLUDED – The value will be BLANK. This data is INCLUDED in ANOTHER data point.
- INCLUDES – The value will be NUMERIC. This data point INCLUDES data from another data point.
QUALIFIER describes the QUALITIES of the data point. Possible values are:
- NAT_EST – The value will be NUMERIC. This data point is a NATIONAL ESTIMATE.
- UIS_EST – The value will be NUMERIC. This data point is an ESTIMATE produced by the UNESCO INSTITUTE FOR STATISTICS.