SamTheDev
/

qwen2.5-3B-oga

Text Generation

onnxruntime-genai

Model card Files Files and versions

My Tests (Tesla P4)

CUDA int4: TBD
CUDA int4_plh: TBD
CUDA fp16: TBD
CUDA fp16_plh: TBD

Downloads last month: -; Downloads are not tracked for this model. How to track

Model tree for SamTheDev/qwen2.5-3B-oga

Base model

Qwen/Qwen2.5-3B

Finetuned

Qwen/Qwen2.5-3B-Instruct

Quantized

(255)

this model

Collection including SamTheDev/qwen2.5-3B-oga

Onnxruntime-Genai Models

onnxruntime-genai models that i've tested on the nvidia tesla p4 • 5 items • Updated 19 days ago