How do you improve productivity when working with llama.cpp?

[sophiaonthinks]

I have a question about llama.cpp that may be useful for other people working with it too.

I am particularly interested in productivity and limitations. I would like to compare approaches that people have actually used rather than just theoretical suggestions.

What has worked best for you, and what would you avoid?



Photo by

Please, Log in or Register to view URLs content!

on

Please, Log in or Register to view URLs content!