Recent content by gracechief46

  1. gracechief46

    Key things to know about llama.cpp and performance

    For llama.cpp, it helps to think in terms of inputs, constraints, verification, and iteration. One important area is performance. Define what a good result looks like before changing tools or settings, then test one variable at a time so you can tell what actually improved the outcome. Another...