Recent content by labnathan

I have been exploring llama.cpp and wanted to ask people who have tried it in practice. I am particularly interested in testing and prompt design. I would like to compare approaches that people have actually used rather than just theoretical suggestions. What trade-offs have you found between...