Skip to content
Sign in
  • Browse all toolsFilter by category and pricing
  • Browse categoriesWriting, code, image, audio and more
  • Compare toolsPut up to three side by side
  • Read the blogGuides and comparisons
All categories

LLM Infrastructure

Tools for serving, routing, evaluating and monitoring large language models

6tools listed

Pricing mix

  • 3 Free
  • 3 Freemium

6 tools match

  • Docker Model Runner

    Model running with REST API documentation, configuration options, and IDE and Open WebUI integration guides.

    Code & Development
    Freemium
  • Ollama

    Run open AI models locally or in the cloud with private prompts and usage-based cloud pricing.

    AI Agents & MCP
    Freemium
  • RTK — Rust Token Killer

    Compress tool output and route heavy work to cheaper models for AI coding agents.

    Code & Development
    Free
  • FastMCP

    Python framework for building MCP servers, clients, and interactive applications.

    Code & Development
    Freemium
  • Free Claude Code

    Open-source local proxy connecting coding agents to free, paid, subscription, and local AI models.

    Code & Development
    Free
  • Claude Code Router

    Local model gateway for routing coding agents across providers, models, and accounts.

    Code & Development
    Free