-
-
-
-
-
-
Inference Providers
Active filters:
gptq
TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ
Text Generation
•
33B
•
Updated
•
67.6k
•
592
Qwen/Qwen3-30B-A3B-GPTQ-Int4
Text Generation
•
31B
•
Updated
•
500k
•
42
avtc/GLM-4.6-REAP-268B-A32B-GPTQMODEL-W4A16
Text Generation
•
271B
•
Updated
•
308
•
2
Kirim-ai/Kirim-V1-Base
Text Generation
•
12B
•
Updated
•
51
•
2
TheBloke/Falcon-7B-Instruct-GPTQ
Text Generation
•
7B
•
Updated
•
143
•
68
TheBloke/Llama-2-7B-Chat-GPTQ
Text Generation
•
7B
•
Updated
•
10.2k
•
267
TheBloke/13B-BlueMethod-GPTQ
Text Generation
•
13B
•
Updated
•
144
•
6
TheBloke/Octocoder-GPTQ
Text Generation
•
16B
•
Updated
•
28
•
8
jxy/Tongyi-Finance-14B-Chat-Int4
Text Generation
•
Updated
•
15
•
2
TheBloke/Mistral-7B-Instruct-v0.2-GPTQ
Text Generation
•
7B
•
Updated
•
21.3k
•
55
JunHowie/Qwen3-14B-GPTQ-Int8
Text Generation
•
15B
•
Updated
•
90
•
1
GaborMadarasz/Qwen3-0.6B-8bit-gptq_hungarian_news
Text Generation
•
0.6B
•
Updated
•
10
•
1
MidnightPhreaker/KAT-Dev-72B-Exp-GPTQ-INT4-gs32-0.01
13B
•
Updated
•
18
•
1
openguardrails/OpenGuardrails-Text-2510
Text Generation
•
15B
•
Updated
•
1.66k
•
3
tcclaviger/Qwen3-Coder-42B-A3B-Instruct-TOTAL-RECALL-MASTER-CODER-M-512k-ctx-W4A16
Text Generation
•
6B
•
Updated
•
70
•
1
superjob/Qwen3-4B-Instruct-2507-GPTQ-Int4
Text Generation
•
1B
•
Updated
•
23
•
1
Kirim-ai/Kirim-V1-7B-Chat
Text Generation
•
5B
•
Updated
•
1
elinas/alpaca-13b-lora-int4
Text Generation
•
Updated
•
17
•
41
elinas/alpaca-30b-lora-int4
Text Generation
•
Updated
•
41
•
68
mayaeary/pygmalion-6b-4bit-128g
Text Generation
•
Updated
•
40
•
40
mayaeary/pygmalion-6b_dev-4bit-128g
Text Generation
•
Updated
•
23
•
120
mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g
Text Generation
•
Updated
•
24
•
2
mayaeary/PPO_Pygway-6b-Mix-4bit-128g
Text Generation
•
Updated
•
27
•
2
elinas/vicuna-13b-4bit
Text Generation
•
Updated
•
26
•
45
TheBloke/koala-7B-GPTQ
Text Generation
•
7B
•
Updated
•
95
•
31
TheBloke/koala-7B-HF
Text Generation
•
Updated
•
2.04k
•
21
TheBloke/koala-13B-HF
Text Generation
•
Updated
•
1.91k
•
41
TheBloke/koala-13B-GPTQ
Text Generation
•
13B
•
Updated
•
37
•
38
TheBloke/galpaca-30B-GPTQ
Text Generation
•
Updated
•
19
•
48
Ancestral/Dolly_Shygmalion-6b-4bit-128g
Text Generation
•
Updated
•
14
•
5