Recent content by owen210

  1. owen210

    llama.cpp explained: a practical look at productivity

    I've found llama.cpp is usually easier to improve when you write down exactly what changed between runs. Otherwise after a few attempts it becomes hard to remember which tweak actually helped. It also gives you an easy point to roll back to if the next change makes things worse.