bacow/GPT-SoVITS
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

更改gpt并行推理时的mask策略为padding left (#2144)

Browse Source 
* 更改gpt并行推理时的mask策略为padding left，使batch_infer更接近于naive_infer
减少冗余操作并使用torch_sdpa，以提升推理速度

* rollback tts_infer.yaml
This commit is contained in:
ChasonJiang
2025-03-04 16:45:37 +08:00
committed by GitHub
parent 959a2ddbeb
commit 6dd2f72090
4 changed files with 77 additions and 50 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
GPT_SoVITS/configs/tts_infer.yaml
View File

@@ -1,8 +1,8 @@
custom:
bert_base_path: GPT_SoVITS/pretrained_models/chinese-roberta-wwm-ext-large
cnhuhbert_base_path: GPT_SoVITS/pretrained_models/chinese-hubert-base
device: cuda
is_half: true
device: cpu
is_half: false
t2s_weights_path: GPT_SoVITS/pretrained_models/gsv-v2final-pretrained/s1bert25hz-5kh-longer-epoch=12-step=369668.ckpt
version: v2
vits_weights_path: GPT_SoVITS/pretrained_models/gsv-v2final-pretrained/s2G2333k.pth