Add introduction and purpose to README.md

Added an introduction and purpose section for GPC Encoder, outlining limitations of common encoding methods and the advantages of GPC Encoder.
This commit is contained in:
stingray
2026-01-08 22:33:30 +09:00
committed by GitHub
parent 8f73250237
commit eb75ddf1e4
+31
View File
@@ -0,0 +1,31 @@
# GPC Encoder (Geometry Preserving Category Encoder)
## Introduction & Purpose
In ML/DL preprocessing, categorical data is commonly encoded using **one-hot**, **label**, or **target mean encoding**, each of which has clear limitations:
- **One-Hot Encoding**
- Causes a rapid increase in dimensionality for high-cardinality features
- Increases model complexity and memory usage
- **Label Encoding**
- Introduces artificial ordinal relationships between categories
- Can mislead linear or distance-based models
- **Target Mean Encoding**
- Prone to **data leakage**, as global target statistics influence encoding
- Unstable for rare categories or small datasets, leading to bias
The purpose of **GPC Encoder** is to address all of these issues by designing an encoding method that:
1. Does **not impose any ordering** on categories
2. Does **not drastically increase dimensionality**
3. **Avoids data leakage** by relying only on training data statistics
---
## Requirements
- **Python 3.11.4**
- See `requirements.txt` for full dependency details