Add LM Backend selector (PT vs VLLM) to reduce VRAM usage

PT backend uses ~1.6 GB VRAM vs ~9.2 GB for VLLM, making it accessible
on lower-end GPUs. Adds dropdown in Advanced Settings defaulting to PT.
This commit is contained in:
fspecii
2026-02-05 22:30:23 +02:00
parent 823fbe0cd3
commit d05c665f4d
6 changed files with 37 additions and 2 deletions
+1
View File
@@ -83,6 +83,7 @@ export interface GenerationParams {
lmTopK: number;
lmTopP: number;
lmNegativePrompt: string;
lmBackend?: 'pt' | 'vllm';
// Expert Parameters
referenceAudioUrl?: string;