graceworld78's latest activity
-
Ggraceworld78 posted the thread What are the biggest mistakes with cost control in llama.cpp? in llama.cpp.I have been exploring llama.cpp and wanted to ask people who have tried it in practice. I am particularly interested in cost control...