Run GPTQ, GGML, GGUF… on Apple Silicon?
A community sharing effort on the topic: GPU does not mean NVidia. Mac M1/M2 Metal support and AMD GPUs have their own game too.
9 min readOct 30, 2023
Quantized Models are on trend. The Trend of Enabling Large Language Models on Consumer Hardware
The advent of large language models has revolutionized natural language processing and…
