What is Brokle?
Brokle is an open-source AI observability platform for tracing, evaluation, cost analytics, and prompt management
Welcome to Brokle
Brokle is an open-source AI observability platform that helps you understand, debug, and improve your AI applications. Whether you're building chatbots, RAG systems, or AI agents, Brokle provides the visibility you need to ship with confidence.
Why Brokle?
Building AI applications is hard. Understanding why they fail is harder. Brokle solves this by giving you complete visibility into every AI interaction:
- Trace every LLM call - See exactly what goes in and out of your models
- Evaluate quality at scale - Score outputs automatically with built-in and custom evaluators
- Track costs in real-time - Know exactly how much you're spending per request
- Manage prompts - Version, test, and deploy prompts with confidence
- Self-host or cloud - Run on your infrastructure or use our managed service
Core Capabilities
Tracing
Capture every LLM call, retrieval, and tool use with distributed tracing
Evaluation
Score your AI outputs with built-in metrics or custom evaluators
Analytics
Understand costs, latency, and usage patterns across your applications
Prompt Management
Version control and test prompts before deploying to production
Quick Start
Get started with Brokle in under 5 minutes:
pip install brokleThen start tracing your AI calls:
from brokle import Brokle
client = Brokle(api_key="your-api-key")
with client.trace("my-first-trace") as trace:
# Your AI code automatically gets traced
response = openai.chat.completions.create(
model="gpt-4",
messages=[{"role": "user", "content": "Hello!"}]
)View the full quickstart guide →
Architecture
Brokle is built as a scalable monolith designed for both self-hosting and cloud deployment:
- HTTP Server - REST API for data ingestion and querying
- Background Workers - Process telemetry streams asynchronously
- PostgreSQL - Transactional data (projects, users, prompts)
- ClickHouse - High-performance analytics and trace storage
- Redis - Caching and job queues
Learn more about the architecture →
Open Source
Brokle's core platform is open source under the MIT license. We believe observability tools should be transparent, customizable, and free from vendor lock-in. Enterprise features are available for teams that need advanced capabilities.
Get Help
- Documentation - You're reading it!
- GitHub Issues - Report bugs or request features
- Discord Community - Chat with the team and other users
- Enterprise Support - For organizations needing SLAs and dedicated support