Recent content by james5769

  1. J

    llama.cpp knowledge guide: improving performance

    A useful way to understand llama.cpp is to separate the goal, the input, the model or tool, and the way the output is evaluated. One important area is performance. Define what a good result looks like before changing tools or settings, then test one variable at a time so you can tell what...