Spaces:
Sleeping
Sleeping
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -1,3 +1,12 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
# DataCentric-Env
|
| 2 |
|
| 3 |
**An RL environment that trains an LLM to act as a data engineer.**
|
|
@@ -60,7 +69,7 @@ POST /step → Query a specialist agent
|
|
| 60 |
| **CleanerAgent** | `query_cleaner` | Missing values + zero-as-missing (domain-aware) + log-transform for skewed features |
|
| 61 |
| **AugmenterAgent** | `query_augmenter` | SMOTE-like interpolation to synthesize minority class rows |
|
| 62 |
| **BalancerAgent** | `query_balancer` | Oversample/undersample with explicit tradeoff explanation |
|
| 63 |
-
| **ValidatorAgent** | `query_validator` (cost 2) | Duplicates + outlier clipping (conservative
|
| 64 |
| **AnalystAgent** | `query_analyst` (cost 2) | Holistic diagnosis + prioritized action plan + published baseline reference |
|
| 65 |
|
| 66 |
### What's Domain-Aware
|
|
@@ -71,8 +80,8 @@ The CleanerAgent knows:
|
|
| 71 |
- Redundant features (e.g. `education` + `education-num`) → recommend dropping one
|
| 72 |
|
| 73 |
The ValidatorAgent knows:
|
| 74 |
-
- In medical domains, use
|
| 75 |
-
- In credit/income domains, use standard
|
| 76 |
|
| 77 |
---
|
| 78 |
|
|
@@ -121,7 +130,7 @@ When accuracy drops after an apply:
|
|
| 121 |
```json
|
| 122 |
"regression_explanation": {
|
| 123 |
"likely_cause": "large_augmentation_overfitting",
|
| 124 |
-
"suggestion": "Synthetic rows
|
| 125 |
}
|
| 126 |
```
|
| 127 |
|
|
@@ -179,10 +188,10 @@ ENV_URL = "https://aswini-kumar-datacentric-env.hf.space"
|
|
| 179 |
| Rule | What it blocks |
|
| 180 |
|---|---|
|
| 181 |
| `action_spam` | Same query 3+ times in a row |
|
| 182 |
-
| `low_budget_expensive_query` | Cost-2 queries when budget
|
| 183 |
| `duplicate_apply` | Applying the same rec_id twice |
|
| 184 |
-
| `invalid_rec_id` | Applying a rec_id that
|
| 185 |
-
| `data_integrity_violation` | Deleting
|
| 186 |
|
| 187 |
---
|
| 188 |
|
|
|
|
| 1 |
+
---
|
| 2 |
+
title: DataCentric-Env
|
| 3 |
+
emoji: 🧹
|
| 4 |
+
colorFrom: purple
|
| 5 |
+
colorTo: indigo
|
| 6 |
+
sdk: docker
|
| 7 |
+
pinned: false
|
| 8 |
+
---
|
| 9 |
+
|
| 10 |
# DataCentric-Env
|
| 11 |
|
| 12 |
**An RL environment that trains an LLM to act as a data engineer.**
|
|
|
|
| 69 |
| **CleanerAgent** | `query_cleaner` | Missing values + zero-as-missing (domain-aware) + log-transform for skewed features |
|
| 70 |
| **AugmenterAgent** | `query_augmenter` | SMOTE-like interpolation to synthesize minority class rows |
|
| 71 |
| **BalancerAgent** | `query_balancer` | Oversample/undersample with explicit tradeoff explanation |
|
| 72 |
+
| **ValidatorAgent** | `query_validator` (cost 2) | Duplicates + outlier clipping (conservative 5x IQR for medical domains) |
|
| 73 |
| **AnalystAgent** | `query_analyst` (cost 2) | Holistic diagnosis + prioritized action plan + published baseline reference |
|
| 74 |
|
| 75 |
### What's Domain-Aware
|
|
|
|
| 80 |
- Redundant features (e.g. `education` + `education-num`) → recommend dropping one
|
| 81 |
|
| 82 |
The ValidatorAgent knows:
|
| 83 |
+
- In medical domains, use 5x IQR instead of 3x — outliers may be real rare conditions
|
| 84 |
+
- In credit/income domains, use standard 3x IQR
|
| 85 |
|
| 86 |
---
|
| 87 |
|
|
|
|
| 130 |
```json
|
| 131 |
"regression_explanation": {
|
| 132 |
"likely_cause": "large_augmentation_overfitting",
|
| 133 |
+
"suggestion": "Synthetic rows do not generalise to holdout. Try undersample_majority or rollback."
|
| 134 |
}
|
| 135 |
```
|
| 136 |
|
|
|
|
| 188 |
| Rule | What it blocks |
|
| 189 |
|---|---|
|
| 190 |
| `action_spam` | Same query 3+ times in a row |
|
| 191 |
+
| `low_budget_expensive_query` | Cost-2 queries when budget is 2 or less |
|
| 192 |
| `duplicate_apply` | Applying the same rec_id twice |
|
| 193 |
+
| `invalid_rec_id` | Applying a rec_id that does not exist |
|
| 194 |
+
| `data_integrity_violation` | Deleting more than 10% of training rows in one operation |
|
| 195 |
|
| 196 |
---
|
| 197 |
|