AI · 2h ago
Lynkr Router Benchmarked: Open-Source Test Reveals Mediocre Accuracy but Low Cost
Lynkr, an open-source LLM router, was submitted to the RouterArena benchmark, scoring 67.65 Arena Score with 68.41% accuracy and $0.29 per 1K queries. The evaluation covered 8,400 queries across 9 domains, measuring accuracy, cost, optimality, and robustness. Lynkr's creator published the results transparently, including poor metrics, to avoid selective reporting.
Meridian48 take
The benchmark's value lies in its standardized, vendor-independent methodology, but Lynkr's mediocre accuracy highlights the trade-off between cost savings and quality in LLM routing.
Read the full reporting
We Put Our Router on an Academic Benchmark. Here Are the Numbers We'd Rather Hide. →
DEV Community
llm-routingbenchmarking