forked from ggml-org/llama.cpp
-
Notifications
You must be signed in to change notification settings - Fork 7
Open
Labels
Description
Verify the following GGUF models and add them to the supported model list.
For an unsupported model, create an issue for tracking.
- Granite 4.0 Micro : granite-4.0-micro-Q4_K_M.gguf
- Qwen 3 4B : Qwen3-4B-Q4_K_M.gguf
- GPT OSS 20B : gpt-oss-20b-Q4_K_M.gguf
- Google Gemma 3N E4B : gemma-3n-E4B-it-Q4_K_M.gguf
- Mistral Small 3.2 24B : Mistral-Small-3.2-24B-Instruct-2506-Q4_K_M.gguf
- Phi-4 mini instruct Q4_K_M : Phi-4-mini-instruct-Q4_K_M.gguf
- Gemma 34B it Q4_0 : gemma-3-4b-it-qat-q4_0-gguf
- Qwen3-VL 2B FP16 (mmproj) : mmproj-F16.gguf
- Qwen3-VL 2B Q4_K_M (model) : Qwen3-VL-2B-Instruct-Q4_K_M.gguf
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
Projects
Status
Backlog