diff --git a/README.md b/README.md index 726f2662..b283d81c 100644 --- a/README.md +++ b/README.md @@ -207,7 +207,7 @@ packages and Git. | RIR estimation | NPM, RT30/RT60 MAE, DRR/C50/C80/EDC, IACC full/early/late, ITD/ILD/IPD/DOA errors | [RIR estimation](docs/tasks/rir.md) | | TSE | SI-SDR, speaker similarity, DNSMOS, WV-MOS, UTMOS, CER, WER | [TSE](docs/tasks/tse.md) | | Classification / SER / GR | Accuracy | [Classification](docs/tasks/classification.md) | -| SLU | Accuracy | [SLU](docs/tasks/slu.md) | +| SLU | Accuracy, LLM Judge | [SLU](docs/tasks/slu.md) | | KWS | Per-keyword/macro recall at 0.1 FA/hour, trigger latency; optional ROC/AUC | [KWS](docs/tasks/kws.md) | | VAD | F1, false alarm, miss, NIST DCF, ROC AUC | [VAD](docs/tasks/vad.md) | | DOA | MAE, RMSE, threshold accuracy, localization precision/recall/F1 | [DOA](docs/tasks/doa.md) | diff --git a/README_ZH.md b/README_ZH.md index f922405c..940d402e 100644 --- a/README_ZH.md +++ b/README_ZH.md @@ -196,7 +196,7 @@ node-local 虚拟环境只保留在本地,不会进入安装包或 Git。 | RIR estimation | NPM、RT30/RT60 MAE、DRR/C50/C80/EDC、IACC 全窗/早期/晚期、ITD/ILD/IPD/DOA 误差 | [RIR estimation](docs/tasks/rir.md) | | TSE | SI-SDR、说话人相似度、DNSMOS、WV-MOS、UTMOS、CER、WER | [TSE](docs/tasks/tse.md) | | Classification / SER / GR | Accuracy | [Classification](docs/tasks/classification.md) | -| SLU | Accuracy | [SLU](docs/tasks/slu.md) | +| SLU | Accuracy、LLM Judge | [SLU](docs/tasks/slu.md) | | KWS | 固定 FA/hour 下逐词 recall、Macro recall(默认 0.1 次/小时)、触发延时,可选 ROC/AUC | [KWS](docs/tasks/kws.md) | | VAD | F1、false alarm、miss、NIST DCF、ROC AUC | [VAD](docs/tasks/vad.md) | | DOA | MAE、RMSE、阈值准确率、定位 precision/recall/F1 | [DOA](docs/tasks/doa.md) | diff --git a/docs/atlas/index.html b/docs/atlas/index.html index 5d4f6285..e48d0e2d 100644 --- a/docs/atlas/index.html +++ b/docs/atlas/index.html @@ -102,18 +102,18 @@
| Task | Lang | Metric | Pipeline ID | Node chain |
|---|---|---|---|---|
| ASR | ar | cer | asr.ar.cer.nemo_norm_ar_tn_v1.wenet_cer_v1 | nemo_norm → wenet_cer |
| ASR | zh | cer | asr.zh.cer.wetext_norm_zh_itn_v1.wenet_cer_v1 | wetext_norm → wenet_cer |
| ASR | zh | cer | asr.zh.cer.aispeech_norm_zh_v1.wenet_cer_v1 | aispeech_norm → wenet_cer |
| ASR | en | wer | asr.en.wer.whisper_norm_english_v1.wenet_wer_v1 | whisper_norm → wenet_wer |
| ASR | en | wer | asr.en.wer.aispeech_norm_en_v1.wenet_wer_v1 | aispeech_norm → wenet_wer |
| ASR | zh | cer | asr.zh.cer.canonical_itn_zh_v2.token_cer_v1 | canonical_itn → token_cer |
| ASR | cs | mer | asr.cs.mer.aispeech_norm_cs_v1.wenet_mer_v1 | aispeech_norm → wenet_mer |
| ASR | cs | mer | asr.cs.mer.canonical_itn_cs_v2.token_mer_v1 | canonical_itn → token_mer |
| ASR | en | wer | asr.en.wer.canonical_itn_en_v2.token_mer_v1 | canonical_itn → token_mer |
| ASR | ja | cer | asr.ja.cer.funasr_itn_ja_v1.wenet_cer_v1 | funasr_itn → wenet_cer |
| ASR | es | wer | asr.es.wer.funasr_itn_es_v1.wenet_wer_v1 | funasr_itn → wenet_wer |
| ASR | fr | wer | asr.fr.wer.funasr_itn_fr_v1.wenet_wer_v1 | funasr_itn → wenet_wer |
| ASR | de | wer | asr.de.wer.funasr_itn_de_v1.wenet_wer_v1 | funasr_itn → wenet_wer |
| ASR | ko | cer | asr.ko.cer.funasr_itn_ko_v1.wenet_cer_v1 | funasr_itn → wenet_cer |
| ASR | ru | wer | asr.ru.wer.funasr_itn_ru_v1.wenet_wer_v1 | funasr_itn → wenet_wer |
| ASR | pt | wer | asr.pt.wer.funasr_itn_pt_v1.wenet_wer_v1 | funasr_itn → wenet_wer |
| ASR | vi | wer | asr.vi.wer.funasr_itn_vi_v1.wenet_wer_v1 | funasr_itn → wenet_wer |
| ASR | id | wer | asr.id.wer.funasr_itn_id_v1.wenet_wer_v1 | funasr_itn → wenet_wer |
| ASR | tl | wer | asr.tl.wer.funasr_itn_tl_v1.wenet_wer_v1 | funasr_itn → wenet_wer |
| ASR | zh | cer | asr.zh.cer.giga_norm_chn_v1.wenet_cer_v1 | giga_norm → wenet_cer |
| ASR | en | wer | asr.en.wer.giga_norm_usa_v1.wenet_wer_v1 | giga_norm → wenet_wer |
| ASR | ja | cer | asr.ja.cer.giga_norm_jpn_v1.wenet_cer_v1 | giga_norm → wenet_cer |
| ASR | ko | cer | asr.ko.cer.giga_norm_kor_v1.wenet_cer_v1 | giga_norm → wenet_cer |
| ASR | th | cer | asr.th.cer.giga_norm_tha_v1.wenet_cer_v1 | giga_norm → wenet_cer |
| ASR | id | wer | asr.id.wer.giga_norm_idn_v1.wenet_wer_v1 | giga_norm → wenet_wer |
| ASR | ms | wer | asr.ms.wer.giga_norm_mys_v1.wenet_wer_v1 | giga_norm → wenet_wer |
| ASR | fil | wer | asr.fil.wer.giga_norm_phl_v1.wenet_wer_v1 | giga_norm → wenet_wer |
| ASR | vi | wer | asr.vi.wer.giga_norm_vnm_v1.wenet_wer_v1 | giga_norm → wenet_wer |
| ASR | ar | wer | asr.ar.wer.giga_norm_ar_v1.wenet_wer_v1 | giga_norm → wenet_wer |
| ASR | ar-ae | wer | asr.ar_ae.wer.giga_norm_are_v1.wenet_wer_v1 | giga_norm → wenet_wer |
| ASR | ar-dz | wer | asr.ar_dz.wer.giga_norm_dza_v1.wenet_wer_v1 | giga_norm → wenet_wer |
| ASR | ar-eg | wer | asr.ar_eg.wer.giga_norm_egy_v1.wenet_wer_v1 | giga_norm → wenet_wer |
| ASR | ar-iq | wer | asr.ar_iq.wer.giga_norm_irq_v1.wenet_wer_v1 | giga_norm → wenet_wer |
| ASR | ar-ma | wer | asr.ar_ma.wer.giga_norm_mar_v1.wenet_wer_v1 | giga_norm → wenet_wer |
| ASR | ar-sa | wer | asr.ar_sa.wer.giga_norm_sau_v1.wenet_wer_v1 | giga_norm → wenet_wer |
| ASR | ar-sy | wer | asr.ar_sy.wer.giga_norm_syr_v1.wenet_wer_v1 | giga_norm → wenet_wer |
| ASR | ar | cer | asr.ar.cer.xnorm_ar_v1.wenet_cer_v1 | xnorm → wenet_cer |
| ASR | ar | cer | asr.ar.cer.etc_canonicalization_ar_v1.wenet_cer_v1 | etc_canonicalization → wenet_cer |
| ASR | bn | wer | asr.bn.wer.etc_canonicalization_bn_v1.wenet_wer_v1 | etc_canonicalization → wenet_wer |
| ASR | de | wer | asr.de.wer.etc_canonicalization_de_v1.wenet_wer_v1 | etc_canonicalization → wenet_wer |
| ASR | en | wer | asr.en.wer.etc_canonicalization_en_v1.wenet_wer_v1 | etc_canonicalization → wenet_wer |
| ASR | fa | wer | asr.fa.wer.etc_canonicalization_fa_v1.wenet_wer_v1 | etc_canonicalization → wenet_wer |
| ASR | fr | wer | asr.fr.wer.etc_canonicalization_fr_v1.wenet_wer_v1 | etc_canonicalization → wenet_wer |
| ASR | hi | wer | asr.hi.wer.etc_canonicalization_hi_v1.wenet_wer_v1 | etc_canonicalization → wenet_wer |
| ASR | id | wer | asr.id.wer.etc_canonicalization_id_v1.wenet_wer_v1 | etc_canonicalization → wenet_wer |
| ASR | ja | cer | asr.ja.cer.etc_canonicalization_ja_v1.wenet_cer_v1 | etc_canonicalization → wenet_cer |
| ASR | ru | wer | asr.ru.wer.etc_canonicalization_ru_v1.wenet_wer_v1 | etc_canonicalization → wenet_wer |
| ASR | vi | wer | asr.vi.wer.etc_canonicalization_vi_v1.wenet_wer_v1 | etc_canonicalization → wenet_wer |
| ASR | zh | cer | asr.zh.cer.etc_canonicalization_zh_v1.wenet_cer_v1 | etc_canonicalization → wenet_cer |
| ASR | de | wer | asr.de.wer.xnorm_de_v1.wenet_wer_v1 | xnorm → wenet_wer |
| ASR | en | wer | asr.en.wer.xnorm_en_v1.wenet_wer_v1 | xnorm → wenet_wer |
| ASR | es | wer | asr.es.wer.xnorm_es_v1.wenet_wer_v1 | xnorm → wenet_wer |
| ASR | fr | wer | asr.fr.wer.xnorm_fr_v1.wenet_wer_v1 | xnorm → wenet_wer |
| ASR | he | wer | asr.he.wer.xnorm_he_v1.wenet_wer_v1 | xnorm → wenet_wer |
| ASR | hi | wer | asr.hi.wer.xnorm_hi_v1.wenet_wer_v1 | xnorm → wenet_wer |
| ASR | hu | wer | asr.hu.wer.xnorm_hu_v1.wenet_wer_v1 | xnorm → wenet_wer |
| ASR | hy | wer | asr.hy.wer.xnorm_hy_v1.wenet_wer_v1 | xnorm → wenet_wer |
| ASR | id | wer | asr.id.wer.xnorm_id_v1.wenet_wer_v1 | xnorm → wenet_wer |
| ASR | it | wer | asr.it.wer.xnorm_it_v1.wenet_wer_v1 | xnorm → wenet_wer |
| ASR | ja | cer | asr.ja.cer.xnorm_ja_v1.wenet_cer_v1 | xnorm → wenet_cer |
| ASR | ko | cer | asr.ko.cer.xnorm_ko_v1.wenet_cer_v1 | xnorm → wenet_cer |
| ASR | mr | wer | asr.mr.wer.xnorm_mr_v1.wenet_wer_v1 | xnorm → wenet_wer |
| ASR | pt | wer | asr.pt.wer.xnorm_pt_v1.wenet_wer_v1 | xnorm → wenet_wer |
| ASR | ru | wer | asr.ru.wer.xnorm_ru_v1.wenet_wer_v1 | xnorm → wenet_wer |
| ASR | sv | wer | asr.sv.wer.xnorm_sv_v1.wenet_wer_v1 | xnorm → wenet_wer |
| ASR | th | cer | asr.th.cer.xnorm_th_v1.wenet_cer_v1 | xnorm → wenet_cer |
| ASR | vi | wer | asr.vi.wer.xnorm_vi_v1.wenet_wer_v1 | xnorm → wenet_wer |
| ASR | zh | cer | asr.zh.cer.xnorm_zh_v1.wenet_cer_v1 | xnorm → wenet_cer |
| S2TT | zh | bleu | s2tt.zh.bleu.sacrebleu_zh_v1 | sacrebleu |
| S2TT | en | bleu | s2tt.en.bleu.sacrebleu_en_v1 | sacrebleu |
| S2TT | zh | bleu_char | s2tt.zh.bleu_char.sacrebleu_zh_v1 | sacrebleu |
| S2TT | en | bleu_char | s2tt.en.bleu_char.sacrebleu_en_v1 | sacrebleu |
| S2TT | zh | chrf | s2tt.zh.chrf.sacrebleu_zh_v1 | sacrebleu |
| S2TT | en | chrf | s2tt.en.chrf.sacrebleu_en_v1 | sacrebleu |
| S2TT | zh | xcomet_xl | s2tt.zh.xcomet_xl.xcomet_xl_v1 | xcomet_xl |
| S2TT | en | xcomet_xl | s2tt.en.xcomet_xl.xcomet_xl_v1 | xcomet_xl |
| S2TT | zh | bleurt_20 | s2tt.zh.bleurt_20.bleurt_20_v1 | bleurt_20 |
| S2TT | en | bleurt_20 | s2tt.en.bleurt_20.bleurt_20_v1 | bleurt_20 |
| SD | n/a | der | sd.any.der.meeteval_v1 | meeteval |
| SA-ASR | zh | cpwer | sa_asr.zh.cpwer.conversion_sa_asr_cpwer_v1.gstar_norm_v1.meeteval_v1 | gstar_norm → meeteval |
| SA-ASR | en | cpwer | sa_asr.en.cpwer.conversion_sa_asr_cpwer_v1.whisper_norm_english_v1.meeteval_v1 | whisper_norm → meeteval |
| TTS | ar | cer | tts.ar.cer.cohere_transcribe_arabic_07_2026_v1.nemo_norm_ar_tn_v1.wenet_cer_v1 | cohere_transcribe_arabic_07_2026 → nemo_norm → wenet_cer |
| TTS | ar | spk_sim | tts.ar.spk_sim.wavlm_large_sim_v1 | wavlm_large_sim |
| TTS | ar | spk_sim | tts.ar.spk_sim.ecapa_tdnn_sim_v1 | ecapa_tdnn_sim |
| TTS | ar | spk_sim | tts.ar.spk_sim.eres2net_sim_v1 | eres2net_sim |
| TTS | ar | dnsmos | tts.ar.dnsmos.dnsmos_v1 | dnsmos |
| TTS | ar | wv_mos | tts.ar.wv_mos.wv_mos_v1 | wv_mos |
| TTS | ar | utmos | tts.ar.utmos.utmos_v1 | utmos |
| TTS | zh | cer | tts.zh.cer.funasr_loader_16k_mono_v1.paraformer_zh_v1.punctuation_strip_norm_v1.wenet_cer_v1 | funasr_loader_16k_mono → paraformer_zh → punctuation_strip_norm → wenet_cer |
| TTS | zh | cer | tts.zh.cer.qwen3_asr_1_7b_v1.punctuation_strip_norm_v1.wenet_cer_v1 | qwen3_asr_1_7b → punctuation_strip_norm → wenet_cer |
| TTS | zh | spk_sim | tts.zh.spk_sim.wavlm_large_sim_v1 | wavlm_large_sim |
| TTS | zh | spk_sim | tts.zh.spk_sim.ecapa_tdnn_sim_v1 | ecapa_tdnn_sim |
| TTS | zh | spk_sim | tts.zh.spk_sim.eres2net_sim_v1 | eres2net_sim |
| TTS | zh | dnsmos | tts.zh.dnsmos.dnsmos_v1 | dnsmos |
| TTS | zh | wv_mos | tts.zh.wv_mos.wv_mos_v1 | wv_mos |
| TTS | zh | utmos | tts.zh.utmos.utmos_v1 | utmos |
| TTS | en | wer | tts.en.wer.whisper_large_v3_v1.whisper_norm_english_v1.wenet_wer_v1 | whisper_large_v3 → whisper_norm → wenet_wer |
| TTS | en | wer | tts.en.wer.qwen3_asr_1_7b_v1.whisper_norm_english_v1.wenet_wer_v1 | qwen3_asr_1_7b → whisper_norm → wenet_wer |
| TTS | en | spk_sim | tts.en.spk_sim.wavlm_large_sim_v1 | wavlm_large_sim |
| TTS | en | spk_sim | tts.en.spk_sim.ecapa_tdnn_sim_v1 | ecapa_tdnn_sim |
| TTS | en | spk_sim | tts.en.spk_sim.eres2net_sim_v1 | eres2net_sim |
| TTS | en | dnsmos | tts.en.dnsmos.dnsmos_v1 | dnsmos |
| TTS | en | wv_mos | tts.en.wv_mos.wv_mos_v1 | wv_mos |
| TTS | en | utmos | tts.en.utmos.utmos_v1 | utmos |
| TTS | ko | spk_sim | tts.ko.spk_sim.wavlm_large_sim_v1 | wavlm_large_sim |
| TTS | ko | spk_sim | tts.ko.spk_sim.ecapa_tdnn_sim_v1 | ecapa_tdnn_sim |
| TTS | ko | spk_sim | tts.ko.spk_sim.eres2net_sim_v1 | eres2net_sim |
| TTS | ko | dnsmos | tts.ko.dnsmos.dnsmos_v1 | dnsmos |
| TTS | ko | wv_mos | tts.ko.wv_mos.wv_mos_v1 | wv_mos |
| TTS | ko | utmos | tts.ko.utmos.utmos_v1 | utmos |
| TTS | ko | komos | tts.ko.komos.komos_v1 | komos |
| TTA | n/a | fad | tta.any.fad.audioldm_eval_v1 | audioldm_eval |
| TTA | n/a | fd | tta.any.fd.audioldm_eval_v1 | audioldm_eval |
| TTA | n/a | kl | tta.any.kl.audioldm_eval_v1 | audioldm_eval |
| TTA | n/a | is | tta.any.is.audioldm_eval_v1 | audioldm_eval |
| TTA | n/a | clap_score | tta.any.clap_score.clap_score_v1 | clap_score |
| TTA | n/a | audiobox_ce | tta.any.audiobox_ce.audiobox_aesthetics_v1 | audiobox_aesthetics |
| TTA | n/a | audiobox_cu | tta.any.audiobox_cu.audiobox_aesthetics_v1 | audiobox_aesthetics |
| TTA | n/a | audiobox_pc | tta.any.audiobox_pc.audiobox_aesthetics_v1 | audiobox_aesthetics |
| TTA | n/a | audiobox_pq | tta.any.audiobox_pq.audiobox_aesthetics_v1 | audiobox_aesthetics |
| VC | zh | cer | vc.zh.cer.funasr_loader_16k_mono_v1.paraformer_zh_v1.punctuation_strip_norm_v1.wenet_cer_v1 | funasr_loader_16k_mono → paraformer_zh → punctuation_strip_norm → wenet_cer |
| VC | zh | cer | vc.zh.cer.funasr_loader_16k_mono_v1.paraformer_zh_v1.funasr_loader_16k_mono_v1.paraformer_zh_v1.punctuation_strip_norm_v1.wenet_cer_v1 | funasr_loader_16k_mono → paraformer_zh → punctuation_strip_norm → wenet_cer |
| VC | zh | spk_sim | vc.zh.spk_sim.wavlm_large_sim_v1 | wavlm_large_sim |
| VC | zh | spk_sim | vc.zh.spk_sim.ecapa_tdnn_sim_v1 | ecapa_tdnn_sim |
| VC | zh | spk_sim | vc.zh.spk_sim.eres2net_sim_v1 | eres2net_sim |
| VC | zh | dnsmos | vc.zh.dnsmos.dnsmos_v1 | dnsmos |
| VC | zh | wv_mos | vc.zh.wv_mos.wv_mos_v1 | wv_mos |
| VC | zh | utmos | vc.zh.utmos.utmos_v1 | utmos |
| VC | en | wer | vc.en.wer.whisper_large_v3_v1.whisper_norm_english_v1.wenet_wer_v1 | whisper_large_v3 → whisper_norm → wenet_wer |
| VC | en | wer | vc.en.wer.whisper_large_v3_v1.whisper_large_v3_v1.whisper_norm_english_v1.wenet_wer_v1 | whisper_large_v3 → whisper_norm → wenet_wer |
| VC | en | spk_sim | vc.en.spk_sim.wavlm_large_sim_v1 | wavlm_large_sim |
| VC | en | spk_sim | vc.en.spk_sim.ecapa_tdnn_sim_v1 | ecapa_tdnn_sim |
| VC | en | spk_sim | vc.en.spk_sim.eres2net_sim_v1 | eres2net_sim |
| VC | en | dnsmos | vc.en.dnsmos.dnsmos_v1 | dnsmos |
| VC | en | wv_mos | vc.en.wv_mos.wv_mos_v1 | wv_mos |
| VC | en | utmos | vc.en.utmos.utmos_v1 | utmos |
| SE | n/a | si_sdr | se.any.si_sdr.si_sdr_v1 | si_sdr |
| SE | n/a | stoi | se.any.stoi.stoi_v1 | stoi |
| SE | n/a | estoi | se.any.estoi.estoi_v1 | estoi |
| SE | n/a | lsd | se.any.lsd.lsd_v1 | lsd |
| SE | n/a | lps | se.any.lps.lps_v1 | lps |
| SE | n/a | pesq | se.any.pesq.pesq_v1 | pesq |
| SE | n/a | dnsmos | se.any.dnsmos.dnsmos_v1 | dnsmos |
| SE | n/a | dnsmos_p808 | se.any.dnsmos_p808.dnsmos_p808_v1 | dnsmos_p808 |
| SE | n/a | dnsmos_sig | se.any.dnsmos_sig.dnsmos_sig_v1 | dnsmos_sig |
| SE | n/a | dnsmos_bak | se.any.dnsmos_bak.dnsmos_bak_v1 | dnsmos_bak |
| SE | n/a | wv_mos | se.any.wv_mos.wv_mos_v1 | wv_mos |
| SE | n/a | utmos | se.any.utmos.utmos_v1 | utmos |
| SE | n/a | nsrmr | se.any.nsrmr.nsrmr_v1 | nsrmr |
| SE | n/a | squim_stoi | se.any.squim_stoi.squim_stoi_v1 | squim_stoi |
| SE | n/a | squim_pesq | se.any.squim_pesq.squim_pesq_v1 | squim_pesq |
| SE | n/a | squim_si_sdr | se.any.squim_si_sdr.squim_si_sdr_v1 | squim_si_sdr |
| SE | n/a | nisqa_mos | se.any.nisqa_mos.nisqa_mos_v1 | nisqa_mos |
| SE | n/a | nisqa_noi | se.any.nisqa_noi.nisqa_noi_v1 | nisqa_noi |
| SE | n/a | nisqa_dis | se.any.nisqa_dis.nisqa_dis_v1 | nisqa_dis |
| SE | n/a | nisqa_col | se.any.nisqa_col.nisqa_col_v1 | nisqa_col |
| SE | n/a | nisqa_loud | se.any.nisqa_loud.nisqa_loud_v1 | nisqa_loud |
| TSE | zh | si_sdr | tse.zh.si_sdr.si_sdr_v1 | si_sdr |
| TSE | zh | spk_sim | tse.zh.spk_sim.wavlm_large_sim_v1 | wavlm_large_sim |
| TSE | zh | spk_sim | tse.zh.spk_sim.ecapa_tdnn_sim_v1 | ecapa_tdnn_sim |
| TSE | zh | spk_sim | tse.zh.spk_sim.eres2net_sim_v1 | eres2net_sim |
| TSE | zh | dnsmos | tse.zh.dnsmos.dnsmos_v1 | dnsmos |
| TSE | zh | wv_mos | tse.zh.wv_mos.wv_mos_v1 | wv_mos |
| TSE | zh | utmos | tse.zh.utmos.utmos_v1 | utmos |
| TSE | zh | cer | tse.zh.cer.funasr_loader_16k_mono_v1.paraformer_zh_v1.punctuation_strip_norm_v1.wenet_cer_v1 | funasr_loader_16k_mono → paraformer_zh → punctuation_strip_norm → wenet_cer |
| TSE | en | si_sdr | tse.en.si_sdr.si_sdr_v1 | si_sdr |
| TSE | en | spk_sim | tse.en.spk_sim.wavlm_large_sim_v1 | wavlm_large_sim |
| TSE | en | spk_sim | tse.en.spk_sim.ecapa_tdnn_sim_v1 | ecapa_tdnn_sim |
| TSE | en | spk_sim | tse.en.spk_sim.eres2net_sim_v1 | eres2net_sim |
| TSE | en | dnsmos | tse.en.dnsmos.dnsmos_v1 | dnsmos |
| TSE | en | wv_mos | tse.en.wv_mos.wv_mos_v1 | wv_mos |
| TSE | en | utmos | tse.en.utmos.utmos_v1 | utmos |
| TSE | en | wer | tse.en.wer.whisper_large_v3_v1.whisper_norm_english_v1.wenet_wer_v1 | whisper_large_v3 → whisper_norm → wenet_wer |
| classification | n/a | accuracy | classification.any.accuracy.classify_v1 | classify |
| SER | n/a | accuracy | ser.any.accuracy.classify_v1 | classify |
| GR | n/a | accuracy | gr.any.accuracy.classify_v1 | classify |
| SLU | n/a | accuracy | slu.any.accuracy.prompt_norm_choice_id_v1.classify_v1 | prompt_norm → classify |
| SLU | n/a | accuracy | slu.any.accuracy.prompt_norm_choice_text_v1.classify_v1 | prompt_norm → classify |
| KWS | n/a | macro_recall | kws.any.macro_recall.conversion_kws_sure_json_to_samples_v2.wekws_det_v2 | wekws_det |
| KWS | n/a | macro_recall | kws.any.macro_recall.conversion_kws_wekws_score_ctc_to_samples_v2.wekws_det_v2 | wekws_det |
| KWS | n/a | macro_recall | kws.any.macro_recall.conversion_kws_wekws_frame_score_to_samples_v2.wekws_det_v2 | wekws_det |
| VAD | n/a | f1 | vad.any.f1.vad_timebase_strict_v2.vad_detection_duration_v1 | vad_timebase → vad_detection_duration |
| VAD | n/a | p_fa | vad.any.p_fa.vad_timebase_strict_v2.vad_detection_duration_v1 | vad_timebase → vad_detection_duration |
| VAD | n/a | p_miss | vad.any.p_miss.vad_timebase_strict_v2.vad_detection_duration_v1 | vad_timebase → vad_detection_duration |
| VAD | n/a | dcf_nist | vad.any.dcf_nist.vad_timebase_strict_v2.vad_detection_duration_v1 | vad_timebase → vad_detection_duration |
| VAD | n/a | auc_roc | vad.any.auc_roc.vad_timebase_strict_v2.vad_auc_roc_v1 | vad_timebase → vad_auc_roc |
| DOA | n/a | mae | doa.any.mae.doa_jsonl_v1.doa_localization_v1 | doa_jsonl → doa_localization |
| DOA | n/a | rmse | doa.any.rmse.doa_jsonl_v1.doa_localization_v1 | doa_jsonl → doa_localization |
| DOA | n/a | acc_10 | doa.any.acc_10.doa_jsonl_v1.doa_localization_v1 | doa_jsonl → doa_localization |
| DOA | n/a | acc_15 | doa.any.acc_15.doa_jsonl_v1.doa_localization_v1 | doa_jsonl → doa_localization |
| DOA | n/a | acc_30 | doa.any.acc_30.doa_jsonl_v1.doa_localization_v1 | doa_jsonl → doa_localization |
| DOA | n/a | localization_recall | doa.any.localization_recall.doa_jsonl_v1.doa_localization_v1 | doa_jsonl → doa_localization |
| DOA | n/a | localization_precision | doa.any.localization_precision.doa_jsonl_v1.doa_localization_v1 | doa_jsonl → doa_localization |
| DOA | n/a | localization_f1 | doa.any.localization_f1.doa_jsonl_v1.doa_localization_v1 | doa_jsonl → doa_localization |
| LID | n/a | accuracy | lid.any.accuracy.lid_label_canonical_v1.classify_v1 | lid_label → classify |
| SV | n/a | eer | sv.any.eer.cosine_trial_scores_v1.det_eer_v1 | cosine_trial_scores → det_eer |
| SV | n/a | min_dcf | sv.any.min_dcf.cosine_trial_scores_v1.min_dcf_p005_v1 | cosine_trial_scores → min_dcf_p005 |
| RIR estimation | n/a | rir_npm | rir.any.rir_npm.rir_npm_v1 | rir_npm |
| RIR estimation | n/a | rt30_mae | rir.any.rt30_mae.rt30_mae_v1 | rt30_mae |
| RIR estimation | n/a | rt60_mae | rir.any.rt60_mae.rt60_mae_v1 | rt60_mae |
| RIR estimation | n/a | rir_drr_mae | rir.any.rir_drr_mae.rir_drr_mae_v1 | rir_drr_mae |
| RIR estimation | n/a | rir_c50_mae | rir.any.rir_c50_mae.rir_c50_mae_v1 | rir_c50_mae |
| RIR estimation | n/a | rir_c80_mae | rir.any.rir_c80_mae.rir_c80_mae_v1 | rir_c80_mae |
| RIR estimation | n/a | rir_edc_mae | rir.any.rir_edc_mae.rir_edc_mae_v1 | rir_edc_mae |
| RIR estimation | n/a | rir_iacc_mae | rir.any.rir_iacc_mae.rir_iacc_mae_v1 | rir_iacc_mae |
| RIR estimation | n/a | rir_iacc_full_mae | rir.any.rir_iacc_full_mae.rir_iacc_full_mae_v1 | rir_iacc_full_mae |
| RIR estimation | n/a | rir_iacc_early_mae | rir.any.rir_iacc_early_mae.rir_iacc_early_mae_v1 | rir_iacc_early_mae |
| RIR estimation | n/a | rir_iacc_late_mae | rir.any.rir_iacc_late_mae.rir_iacc_late_mae_v1 | rir_iacc_late_mae |
| RIR estimation | n/a | rir_itd_mae | rir.any.rir_itd_mae.rir_itd_mae_v1 | rir_itd_mae |
| RIR estimation | n/a | rir_ild_mae | rir.any.rir_ild_mae.rir_ild_mae_v1 | rir_ild_mae |
| RIR estimation | n/a | rir_ipd_mae | rir.any.rir_ipd_mae.rir_ipd_mae_v1 | rir_ipd_mae |
| RIR estimation | n/a | rir_doa_mae | rir.any.rir_doa_mae.rir_doa_mae_v1 | rir_doa_mae |
| TTA ⛓ | n/a | multi | tta.any.multi.fad.audioldm_eval_v1__fd.audioldm_eval_v1__kl.audioldm_eval_v1__is.audioldm_eval_v1__clap_score.clap_score_v1__audiobox_ce.audiobox_aesthetics_v1__audiobox_cu.audiobox_aesthetics_v1__audiobox_pc.audiobox_aesthetics_v1__audiobox_pq.audiobox_aesthetics_v1 | audioldm_eval → clap_score → audiobox_aesthetics |
| TTS ⛓ | zh | multi | tts.zh.multi.cer.funasr_loader_16k_mono_v1.paraformer_zh_v1.punctuation_strip_norm_v1.wenet_cer_v1__spk_sim.wavlm_large_sim_v1__dnsmos.dnsmos_v1 | funasr_loader_16k_mono → paraformer_zh → punctuation_strip_norm → wenet_cer → wavlm_large_sim → dnsmos |
| TTS ⛓ | ar | multi | tts.ar.multi.cer.cohere_transcribe_arabic_07_2026_v1.nemo_norm_ar_tn_v1.wenet_cer_v1__spk_sim.wavlm_large_sim_v1__spk_sim.ecapa_tdnn_sim_v1__spk_sim.eres2net_sim_v1__dnsmos.dnsmos_v1__wv_mos.wv_mos_v1__utmos.utmos_v1 | cohere_transcribe_arabic_07_2026 → nemo_norm → wenet_cer → wavlm_large_sim → ecapa_tdnn_sim → eres2net_sim → dnsmos → wv_mos → utmos |
| VC ⛓ | zh | multi | vc.zh.multi.cer.funasr_loader_16k_mono_v1.paraformer_zh_v1.punctuation_strip_norm_v1.wenet_cer_v1__spk_sim.wavlm_large_sim_v1__dnsmos.dnsmos_v1 | funasr_loader_16k_mono → paraformer_zh → punctuation_strip_norm → wenet_cer → wavlm_large_sim → dnsmos |
| SE ⛓ | n/a | multi | se.any.multi.si_sdr.si_sdr_v1__stoi.stoi_v1__pesq.pesq_v1__dnsmos.dnsmos_v1__wv_mos.wv_mos_v1__utmos.utmos_v1 | si_sdr → stoi → pesq → dnsmos → wv_mos → utmos |
| TSE ⛓ | zh | multi | tse.zh.multi.si_sdr.si_sdr_v1__spk_sim.wavlm_large_sim_v1__dnsmos.dnsmos_v1 | si_sdr → wavlm_large_sim → dnsmos |
| SV ⛓ | n/a | multi | sv.any.multi.eer.cosine_trial_scores_v1.det_eer_v1__min_dcf.cosine_trial_scores_v1.min_dcf_p005_v1 | cosine_trial_scores → det_eer → min_dcf_p005 |
| RIR estimation ⛓ | n/a | multi | rir.any.multi.rir_npm.rir_npm_v1__rt60_mae.rt60_mae_v1 | rir_npm → rt60_mae |
| RIR estimation ⛓ | n/a | multi | rir.any.multi.rir_npm.rir_npm_v1__rt30_mae.rt30_mae_v1__rt60_mae.rt60_mae_v1__rir_drr_mae.rir_drr_mae_v1__rir_c50_mae.rir_c50_mae_v1__rir_c80_mae.rir_c80_mae_v1__rir_edc_mae.rir_edc_mae_v1 | rir_npm → rt30_mae → rt60_mae → rir_drr_mae → rir_c50_mae → rir_c80_mae → rir_edc_mae |
| RIR estimation ⛓ | n/a | multi | rir.any.multi.rir_npm.rir_npm_v1__rt30_mae.rt30_mae_v1__rt60_mae.rt60_mae_v1__rir_drr_mae.rir_drr_mae_v1__rir_c50_mae.rir_c50_mae_v1__rir_c80_mae.rir_c80_mae_v1__rir_edc_mae.rir_edc_mae_v1__rir_iacc_full_mae.rir_iacc_full_mae_v1__rir_iacc_early_mae.rir_iacc_early_mae_v1__rir_iacc_late_mae.rir_iacc_late_mae_v1__rir_itd_mae.rir_itd_mae_v1__rir_ild_mae.rir_ild_mae_v1__rir_ipd_mae.rir_ipd_mae_v1__rir_doa_mae.rir_doa_mae_v1 | rir_npm → rt30_mae → rt60_mae → rir_drr_mae → rir_c50_mae → rir_c80_mae → rir_edc_mae → rir_iacc_full_mae → rir_iacc_early_mae → rir_iacc_late_mae → rir_itd_mae → rir_ild_mae → rir_ipd_mae → rir_doa_mae |
| RIR estimation ⛓ | n/a | multi | rir.any.multi.rir_npm.rir_npm_v1__rt30_mae.rt30_mae_v1__rt60_mae.rt60_mae_v1__rir_drr_mae.rir_drr_mae_v1__rir_c50_mae.rir_c50_mae_v1__rir_c80_mae.rir_c80_mae_v1__rir_edc_mae.rir_edc_mae_v1__rir_itd_mae.rir_itd_mae_v1__rir_ild_mae.rir_ild_mae_v1__rir_ipd_mae.rir_ipd_mae_v1__rir_doa_mae.rir_doa_mae_v1 | rir_npm → rt30_mae → rt60_mae → rir_drr_mae → rir_c50_mae → rir_c80_mae → rir_edc_mae → rir_itd_mae → rir_ild_mae → rir_ipd_mae → rir_doa_mae |