LLM Infrastructure

Tools for serving, routing, evaluating and monitoring large language models

6tools listed

Pricing mix

3 tools match

Docker Model Runner
docs.docker.com
Model running with REST API documentation, configuration options, and IDE and Open WebUI integration guides.
Freemium
Ollama
www.ollama.com
Run open AI models locally or in the cloud with private prompts and usage-based cloud pricing.
Freemium
FastMCP
www.gofastmcp.com
Python framework for building MCP servers, clients, and interactive applications.
Freemium