Skip to content

Commit b8d1eee

Browse files
#LUU MINH THANG##LUU MINH THANG#
authored andcommitted
add fleurs zh task
1 parent fddbda4 commit b8d1eee

File tree

1 file changed

+30
-0
lines changed

1 file changed

+30
-0
lines changed
Lines changed: 30 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,30 @@
1+
dataset_path: google/fleurs
2+
dataset_name: cmn_hans_cn
3+
dataset_kwargs:
4+
token: True
5+
task: fleurs_cmn_hans_cn
6+
test_split: test
7+
output_type: generate_until
8+
doc_to_visual: !function utils.fleurs_doc_to_audio
9+
doc_to_text: !function utils.fleurs_doc_to_text
10+
doc_to_target: "transcription"
11+
generation_kwargs:
12+
max_new_tokens: 256
13+
temperature: 0
14+
top_p: 1.0
15+
num_beams: 1
16+
do_sample: false
17+
process_results: !function utils.fleurs_process_result
18+
metric_list:
19+
- metric: wer
20+
aggregation : !function utils.fleurs_wer
21+
higher_is_better : false
22+
metadata:
23+
- version: 0.0
24+
lmms_eval_specific_kwargs:
25+
default:
26+
pre_prompt: ""
27+
post_prompt: ""
28+
qwen2_audio:
29+
pre_prompt: ""
30+
post_prompt: " <|zh|>"

0 commit comments

Comments
 (0)