Aswini-Kumar commited on
Commit
16c757c
·
verified ·
1 Parent(s): 054ddcc

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +16 -7
README.md CHANGED
@@ -1,3 +1,12 @@
 
 
 
 
 
 
 
 
 
1
  # DataCentric-Env
2
 
3
  **An RL environment that trains an LLM to act as a data engineer.**
@@ -60,7 +69,7 @@ POST /step → Query a specialist agent
60
  | **CleanerAgent** | `query_cleaner` | Missing values + zero-as-missing (domain-aware) + log-transform for skewed features |
61
  | **AugmenterAgent** | `query_augmenter` | SMOTE-like interpolation to synthesize minority class rows |
62
  | **BalancerAgent** | `query_balancer` | Oversample/undersample with explicit tradeoff explanation |
63
- | **ValidatorAgent** | `query_validator` (cost 2) | Duplicates + outlier clipping (conservative IQR for medical domains) |
64
  | **AnalystAgent** | `query_analyst` (cost 2) | Holistic diagnosis + prioritized action plan + published baseline reference |
65
 
66
  ### What's Domain-Aware
@@ -71,8 +80,8 @@ The CleanerAgent knows:
71
  - Redundant features (e.g. `education` + `education-num`) → recommend dropping one
72
 
73
  The ValidatorAgent knows:
74
- - In medical domains, use IQR instead of — outliers may be real rare conditions
75
- - In credit/income domains, use standard IQR
76
 
77
  ---
78
 
@@ -121,7 +130,7 @@ When accuracy drops after an apply:
121
  ```json
122
  "regression_explanation": {
123
  "likely_cause": "large_augmentation_overfitting",
124
- "suggestion": "Synthetic rows don't generalise to holdout. Try undersample_majority or rollback."
125
  }
126
  ```
127
 
@@ -179,10 +188,10 @@ ENV_URL = "https://aswini-kumar-datacentric-env.hf.space"
179
  | Rule | What it blocks |
180
  |---|---|
181
  | `action_spam` | Same query 3+ times in a row |
182
- | `low_budget_expensive_query` | Cost-2 queries when budget 2 |
183
  | `duplicate_apply` | Applying the same rec_id twice |
184
- | `invalid_rec_id` | Applying a rec_id that doesn't exist |
185
- | `data_integrity_violation` | Deleting >10% of training rows in one operation |
186
 
187
  ---
188
 
 
1
+ ---
2
+ title: DataCentric-Env
3
+ emoji: 🧹
4
+ colorFrom: purple
5
+ colorTo: indigo
6
+ sdk: docker
7
+ pinned: false
8
+ ---
9
+
10
  # DataCentric-Env
11
 
12
  **An RL environment that trains an LLM to act as a data engineer.**
 
69
  | **CleanerAgent** | `query_cleaner` | Missing values + zero-as-missing (domain-aware) + log-transform for skewed features |
70
  | **AugmenterAgent** | `query_augmenter` | SMOTE-like interpolation to synthesize minority class rows |
71
  | **BalancerAgent** | `query_balancer` | Oversample/undersample with explicit tradeoff explanation |
72
+ | **ValidatorAgent** | `query_validator` (cost 2) | Duplicates + outlier clipping (conservative 5x IQR for medical domains) |
73
  | **AnalystAgent** | `query_analyst` (cost 2) | Holistic diagnosis + prioritized action plan + published baseline reference |
74
 
75
  ### What's Domain-Aware
 
80
  - Redundant features (e.g. `education` + `education-num`) → recommend dropping one
81
 
82
  The ValidatorAgent knows:
83
+ - In medical domains, use 5x IQR instead of 3x — outliers may be real rare conditions
84
+ - In credit/income domains, use standard 3x IQR
85
 
86
  ---
87
 
 
130
  ```json
131
  "regression_explanation": {
132
  "likely_cause": "large_augmentation_overfitting",
133
+ "suggestion": "Synthetic rows do not generalise to holdout. Try undersample_majority or rollback."
134
  }
135
  ```
136
 
 
188
  | Rule | What it blocks |
189
  |---|---|
190
  | `action_spam` | Same query 3+ times in a row |
191
+ | `low_budget_expensive_query` | Cost-2 queries when budget is 2 or less |
192
  | `duplicate_apply` | Applying the same rec_id twice |
193
+ | `invalid_rec_id` | Applying a rec_id that does not exist |
194
+ | `data_integrity_violation` | Deleting more than 10% of training rows in one operation |
195
 
196
  ---
197