Unite.AIlarge language modelllm2h agoenergy 117
Why LLM Tracing Tools Are Now Building AI Gateways
image: Unite.AI
In 2026, LangSmith, Langfuse, Opik and Braintrust all added a gateway in front of the model providers. The main reason is control: a tracing tool can only record a model call, while a gateway can stop one. Two Tools That Did Separate Jobs For the past two years, many teams ran large language model (LLM) applications with two separate tools. A gateway sat between the application and the model providers. It held the provider API keys, translated between provider APIs and retried failed calls...