CPSPX commited on
Commit
81830df
·
verified ·
1 Parent(s): 577b90a

Add evaluation config.yaml (locked NLU finetune hparams)

Browse files
Files changed (1) hide show
  1. config.yaml +32 -0
config.yaml ADDED
@@ -0,0 +1,32 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Chinese BabyLM 2026 — EVALUATION config for CPSPX/babylm-zho-pinyin-code-33M.
2
+ # This is the eval-pipeline config (NOT a training-params file). It fixes the
3
+ # NLU-track fine-tuning hyperparameters used at evaluation time.
4
+ models:
5
+ - path: CPSPX/babylm-zho-pinyin-code-33M
6
+ backend: causal
7
+
8
+ tasks:
9
+ zero_shot:
10
+ - zhoblimp
11
+ - hanzi_structure
12
+ - hanzi_pinyin
13
+ cogbench:
14
+ - word_fmri
15
+ - fmri
16
+ finetune:
17
+ - afqmc
18
+ - ocnli
19
+ - tnews
20
+ - cluewsc2020
21
+
22
+ eval_dir: evaluation_data
23
+ results_dir: results
24
+ save_item_with_unk: true
25
+
26
+ # NLU-track fine-tuning hyperparameters (locked before hidden tasks).
27
+ finetune_hparams:
28
+ lr: 3.0e-5
29
+ batch_size: 64
30
+ max_epochs: 5
31
+ sequence_length: 256
32
+ seed: 42