diff --git a/README.md b/README.md index 6fb9d05..bc5b427 100644 --- a/README.md +++ b/README.md @@ -135,18 +135,92 @@ deployment parameters, and capability boundary beside the implementation: ## Reference results -These reference runs cover 2,081 cases. Operation success averages requested -operations; all-operations success requires every requested operation in a case -to succeed. AuK uses the official Prompt Enhancer. - -| Candidate | One-take operation success | Sequential operation success | One-take all operations | Sequential all operations | -|---|---:|---:|---:|---:| -| dots.tts.edit | **63.9%** | **62.7%** | **48.8%** | **48.2%** | -| MiMo-Audio-Instruct | 37.3% | 39.1% | 25.6% | 26.8% | -| Step-Audio-EditX | 36.0% | 31.1% | 24.9% | 20.6% | -| Ming-UniAudio | 18.7% | 18.8% | 8.7% | 10.5% | -| FireRedTTS3-Instruct | 16.0% | 20.5% | 8.3% | 11.6% | -| AuK | 23.6% | 33.3% | 12.3% | 21.9% | +Precise speech editing requires both successful execution of the requested +operations and preservation of the source speech. These reference results cover +all 2,081 cases across the five editing categories. Each value is the arithmetic +mean of the one-take and sequential results. Bold indicates the best result among +the listed systems. AuK uses the official Prompt Enhancer. + +
| Candidate | +Instruction Following | +Local Preservation | +|||
|---|---|---|---|---|---|
| Operation success (%) ↑ | +All success (%) ↑ | +SIM ↑ | +WDTW-Dur (%) ↓ | +WDTW-F0 (st) ↓ | +|
| dots.tts.edit | +63.30 | +48.49 | +0.779 | +7.18 | +1.84 | +
| MiMo-Audio-Instruct | +38.20 | +26.21 | +0.623 | +15.25 | +4.63 | +
| Step-Audio-EditX | +33.57 | +22.73 | +0.711 | +13.66 | +3.41 | +
| AuK | +28.43 | +17.11 | +0.759 | +9.40 | +2.92 | +
| Ming-UniAudio | +18.73 | +9.61 | +0.514 | +13.19 | +4.19 | +
| FireRedTTS3-Instruct | +18.26 | +9.97 | +0.777 | +7.76 | +2.01 | +