Hi Johannestephan, by right it should work with all the GGML quantized models. Which quantized version did you encounter problems with, and what was the error? If you could raise an issue on the repo, that would be best