Quants - a mudler Collection

mudler 's Collections

APEX Quants (GGUF)

Quants

updated Apr 14

Models quantized for LocalAI and llama.cpp

mudler/Minerva-3B-Instruct-v1.0-Q6_K-GGUF

Text Generation • 3B • Updated May 9, 2024 • 8
mudler/Minerva-3B-Instruct-v1.0-Q4_0-GGUF

Text Generation • 3B • Updated May 9, 2024 • 12
mudler/prem-1B-chat-Q6_K-GGUF

Text Generation • 1B • Updated May 9, 2024 • 18
mudler/Minerva-3B-Instruct-v1.0-Q4_K_M-GGUF

Text Generation • 3B • Updated May 9, 2024 • 15
mudler/prem-1B-chat-Q5_0-GGUF

Text Generation • 1B • Updated May 9, 2024 • 16 • 1
mudler/Minerva-1B-base-v1.0-Q5_K_M-GGUF

Text Generation • 1B • Updated May 9, 2024 • 42
mudler/Minerva-1B-base-v1.0-Q4_0-GGUF

Text Generation • 1B • Updated May 9, 2024 • 45
mudler/Minerva-350M-base-v1.0-Q8_0-GGUF

Text Generation • 0.4B • Updated May 9, 2024 • 9
mudler/Minerva-350M-base-v1.0-Q5_0-GGUF

Text Generation • 0.4B • Updated May 9, 2024 • 8
mudler/Minerva-350M-base-v1.0-Q4_0-GGUF

Text Generation • 0.4B • Updated May 9, 2024 • 15
mudler/Llama-3-8b-ita-ties2-Q4_K_M-GGUF

8B • Updated May 19, 2024 • 5 • 1