Mistral.Rs

What it does

Fast, flexible LLM inference

In their own words: Fast, flexible LLM inference. Contribute to EricLBuehler/mistral.rs development by creating an account on GitHub.

It's a more tools tool from Github. A free tier lets you try it before paying — useful when you're keeping costs low. It's open source — the repository has the docs, issues, and latest releases.