Daily Shaarli

All links of one day in a single page.

July 11, 2024

lm-sys/RouteLLM: A framework for serving and evaluating LLM routers - save LLM costs without compromising quality!

Above, we pick gpt-4-1106-preview as the strong model and anyscale/mistralai/Mixtral-8x7B-Instruct-v0.1 as the weak model, setting the API keys accordingly. You can route between different model pairs or providers by updating the model names as described in Model Support.