GGUF vs GGML support?

[ZacharyDK]

Which version of the llama_cpp python module supports what format.

GGML became deprecated August 21st. The support of GGUF isn't compatible with GGML, so we need to be cognizant of what version llama.cpp we use at the backend.

Edit. Mentioned under issues:

#628

GGUF Not currently supported yet. Someone probably inpatient will probably throw in a pull request this weekend to handle it.