Part 4: Downloading the Dataset

4. Why Do We Need a Dataset?

Before training models, we must understand the role of data in Machine Learning.

A machine learning model has no innate human intelligence. It cannot guess whether a country is highly developed based on intuition. Instead, it relies entirely on historical evidence.

A dataset is a structured compilation of past historical records. In our case, the dataset contains developmental factors (schooling, life expectancy, GNI) for different countries, each labeled with its actual, officially computed HDI score. The model acts like a student looking at past exams: it analyzes these historical records, learns which factors correlate with high development index scores, and uses those patterns to predict scores for new country configurations in real-time.

In machine learning, we say “Garbage In, Garbage Out”. The accuracy and fairness of your model depend entirely on the quality and size of your dataset. If your dataset contains incorrect records or represents only one region of the world, your model will make poor predictions in production.

---

4.1 The HDI Dataset

For this project, we utilize the official Human Development Index Dataset available on Kaggle.

Place your downloaded dataset file inside your project’s data folder and name it exactly hdi_data.csv. The final path must be: hdi_project/data/hdi_data.csv

---

4.2 Dataset Columns Explained

The raw fields inside hdi_data.csv are structured as follows:

• Life Expectancy Index:
  • life_expectancy: The life expectancy at birth of a region (measured in years).
• Educational Metrics:
  • expec_yr_school: The expected number of years of schooling a child of school-entrance age can expect to receive.
  • mean_yr_school: The average number of years of education received by people aged 25 and older.
• Economic Factor:
  • gross_inc_percap: Gross National Income (GNI) per capita (measured in USD).
    • Logarithmic scaling: Since GNI scales exponentially between low and high-income countries, we will log-transform this variable during preprocessing to enable linear model convergence.
• Target Regression Score:
  • hdi: The official Human Development Index score, ranging from 0.0 (undeveloped) to 1.0 (highly developed).

---