Recent content by tomcreates38

  1. tomcreates38

    Key things to know about llama.cpp and cost control

    For llama.cpp, it helps to think in terms of inputs, constraints, verification, and iteration. One important area is cost control. Define what a good result looks like before changing tools or settings, then test one variable at a time so you can tell what actually improved the outcome...