New discussion

AWQ quantization please

#2 opened about 11 hours ago by
hyunw55

Can I run this with vLLM?

👍 3
2
#1 opened about 13 hours ago by
DrXaviere