增加flash attention 选项: GPT_SoVITS/AR/models/t2s_lightning_module.py

增加flash attention 选项:   GPT_SoVITS/AR/models/t2s_model.py
	增加flash attention 选项:   GPT_SoVITS/TTS_infer_pack/TTS.py
	增加flash attention 选项:   GPT_SoVITS/TTS_infer_pack/TextPreprocessor.py
	增加flash attention 选项:   GPT_SoVITS/configs/tts_infer.yaml
	增加flash attention 选项:   GPT_SoVITS/inference_webui.py
This commit is contained in:
chasonjiang
2024-03-10 14:07:58 +08:00
parent 2155091950
commit 174c4bbab3
6 changed files with 225 additions and 44 deletions

View File

@@ -1,4 +1,7 @@
import os, sys
now_dir = os.getcwd()
sys.path.append(now_dir)
import re
import torch
@@ -7,7 +10,7 @@ from typing import Dict, List, Tuple
from text.cleaner import clean_text
from text import cleaned_text_to_sequence
from transformers import AutoModelForMaskedLM, AutoTokenizer
from .text_segmentation_method import splits, get_method as get_seg_method
from TTS_infer_pack.text_segmentation_method import splits, get_method as get_seg_method
# from tools.i18n.i18n import I18nAuto