What is the best way to approach testing for Local LLMs?

noah5472

New member
Sep 5, 2026
Threads
2
3
2
0
I have a question about Local LLMs that may be useful for other people working with it too.

I am particularly interested in testing and setup choices. I would like to compare approaches that people have actually used rather than just theoretical suggestions.

What has worked best for you, and what would you avoid?

pexels_1181325.jpg

Photo by
Please, Log in or Register to view URLs content!
on
Please, Log in or Register to view URLs content!
 

Attachments

  • pexels_1181325.jpg
    pexels_1181325.jpg
    22.7 KB · Views: 0
For What is the best way to approach testing for Local LLMs?, I would separate the problem into setup, output quality and repeatability. best and testing fits into that because it can change the result quite a lot depending on the workflow. It is usually easier to troubleshoot when each change is tested on its own.