Recent content by graceworld78

I have been exploring llama.cpp and wanted to ask people who have tried it in practice. I am particularly interested in cost control and future improvements. I would like to compare approaches that people have actually used rather than just theoretical suggestions. Are there any settings...