llama.cpp: future possibilities ideas and experiences

[luke_geek]

I wanted to start a broader future possibilities thread around llama.cpp.

A useful angle is real-world use, but it also connects with best workflow. Different tools and workflows can produce very different results even when the goal is similar.

It would be interesting to compare practical examples, experiments, setups, or lessons that show where llama.cpp is genuinely useful and where it still needs improvement.



Photo by

Please, Log in or Register to view URLs content!

on

Please, Log in or Register to view URLs content!

 

[jamesbra]

One thing worth trying with llama.cpp: future possibilities ideas and experiences is a controlled comparison around llama.cpp and future. Use the same input for each test and note what changes in the output rather than judging from a single run. That should make it easier to tell whether the change is actually helping.

 

[jadeworks90]

A useful way to look at llama.cpp: future possibilities ideas and experiences is to focus first on llama.cpp and future. That tends to make the trade-offs easier to compare. That way you can improve the workflow without losing track of what caused the improvement.