enterpilot

The enterpilot blog

Notes from building an AI gateway

AI gateway engineering, reproducible benchmarks, cost control, and running LLMs inside your own perimeter.

  • Self hosted
  • Open source

What Is an AI Gateway? The AI Control Plane, Explained (2026)

An AI gateway is software that centralizes your company's AI usage behind one endpoint. Here's what it does, why nobody agrees on its name, and how self-hosted and cloud AI gateways differ.

11 min read

More articles

  • Kong
  • Self hosted

Kong AI Gateway Alternative: Self-Hosted & Open Source (2026)

Kong AI Gateway 2.x needs Konnect's SaaS control plane and Kong OSS stops at 3.9. GoModel is an MIT-licensed LLM gateway that runs entirely in your network.

8 min read

  • AI costs
  • Claude Code

Cutting Claude Code Token Consumption by 10-30%

I proxied Claude Code and read every request I was paying for. Four fixes - CLAUDE.md, memory, untracked files, absolute paths - cut token usage 10-30%.

1 min read

  • AI costs
  • Model routing

Want People to Use Cheaper AI Models? Make Expensive Models Slower

A simple way to reduce growing AI costs: add cost-proportional delay to expensive models at the AI gateway layer.

4 min read

  • Usage
  • Budgets

Your API Key Can't See Its Own Usage — So We Fixed That in GoModel

There is no standard usage API in the LLM world: OpenAI and Anthropic hide usage behind admin keys, and tools resort to scraping dashboards. Here's what our research found, and how GoModel's GET /v1/usage gives every caller their own usage, budget, and rate-limit status.

5 min read

  • Monitoring
  • Observability

Monitoring and Improving Your AI Agents: Coolhand Labs vs LangSmith vs Langfuse

Once a router like GoModel handles model choice, how do you keep your agents getting better? A look at three approaches — Coolhand Labs, LangSmith, and Langfuse — and which one fits your team.

7 min read

  • Benchmarking
  • AI control plane

Benchmarking AI Gateways: GoModel vs LiteLLM vs Portkey vs Bifrost

A reproducible AI gateway benchmark comparing GoModel, LiteLLM, Portkey, and Bifrost on latency, throughput, memory, CPU, cold start, and image size.

10 min read

  • Benchmarking
  • LiteLLM

GoModel, a LiteLLM alternative, is up to 14.5x faster

A March 23, 2026 localhost benchmark comparing GoModel and LiteLLM across chat completions and the Responses API.

5 min read

  • Benchmarking
  • LiteLLM

GoModel vs LiteLLM Benchmark: Speed, Throughput, and Resource Usage

A benchmark by the GoModel team comparing latency, throughput, CPU, and memory against LiteLLM using the same workload.

2 min read