llama-bench is a CLI tool that is a part of a very popular llama.cpp inference engine. It is widely used in LLM community to benchmark models and allows to perform measurement at different context ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results