Add Qwen3.5/3.6 abliterated (safetensors) + split model/quant selectors
No GGUF needed: huihui ships Qwen3.5-9B, Qwen3.6-27B, Qwen3.6-35B-A3B as multimodal SAFETENSORS (abliterated), loadable via transformers AutoModelForMultimodalLM. Added them to the model dropdown. _resolve_vl_classes now tries AutoModelForMultimodalLM (3.5/3.6) and AutoModelForImageTextToText (Qwen3-VL) in name-based order, with load fallback across candidates. model_select is now the model NAME only; precision is the separate quant dropdown applied to it (repo_by_precision routes e.g. the local fp8 dir). Aliases 3.5-9b/3.6-27b/3.6-35b. VRAM-by-quant table in README. Needs a recent transformers for 3.5/3.6. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
This commit is contained in:
+3
-1
@@ -1,4 +1,6 @@
|
||||
# Qwen3-VL needs transformers >= 4.57 (the version the local checkpoint was saved with).
|
||||
# Qwen3-VL needs transformers >= 4.57. The newer natively-multimodal Qwen3.5/3.6
|
||||
# abliterated models need a recent transformers exposing AutoModelForMultimodalLM
|
||||
# (upgrade transformers if a Qwen3.5/3.6 model fails to load).
|
||||
transformers>=4.57.0
|
||||
huggingface_hub # auto-download of models by repo id / alias
|
||||
torch
|
||||
|
||||
Reference in New Issue
Block a user