EXL3 models
Collection
76 items • Updated • 96
EXL3 quants of Muse-Glimmer-30B
Calibration trace: md JSON safetensors
Eval trace: md JSON
Self-calibrated quants:
1.75 bits per weight / H3
2.00 bits per weight / H3
2.25 bits per weight / H3
2.50 bits per weight / H3
3.00 bits per weight / H4
4.00 bits per weight / H5
5.00 bits per weight / H5
Plain quants:
2.00 bits per weight
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
DFlash drafter is here
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for turboderp/Muse-Glimmer-30B-exl3
Base model
meta-models/Muse-Glimmer-30B