What is Brokle?
Brokle is the AI engineering platform for teams building AI agents and applications. Observe, evaluate, and manage your AI systems.
Welcome to Brokle
Brokle is the AI engineering platform for AI teams. Whether you're building chatbots, RAG systems, or AI agents, Brokle provides the observability, evaluation, and management tools you need to ship with confidence.
Why Brokle?
Building AI applications is hard. Understanding why they fail is harder. Brokle solves this by giving you complete visibility into every AI interaction:
- Trace every AI call - See exactly what goes in and out of your models and agents
- Evaluate quality at scale - Score outputs automatically with built-in and custom evaluators
- Track costs in real-time - Know exactly how much you're spending per request
- Manage prompts - Version, test, and deploy prompts with confidence
- Self-host or cloud - Run on your infrastructure or use our managed service
Core Capabilities
Tracing
Capture every AI call, retrieval, and tool use with distributed tracing
Evaluation
Score your AI outputs with built-in metrics or custom evaluators
Analytics
Understand costs, latency, and usage patterns across your applications
Prompt Management
Version control and test prompts before deploying to production
Quick Start
Get started with Brokle in under 5 minutes:
pip install brokleThen start tracing your AI calls:
from brokle import Brokle
client = Brokle(api_key="your-api-key")
with client.start_as_current_span("my-first-trace") as span:
# Your AI code automatically gets traced
response = openai.chat.completions.create(
model="gpt-4",
messages=[{"role": "user", "content": "Hello!"}]
)
client.update_current_span(output=response.choices[0].message.content)View the full quickstart guide →
Architecture
Brokle is built as a scalable monolith designed for both self-hosting and cloud deployment:
- HTTP Server - REST API for data ingestion and querying
- Background Workers - Process telemetry streams asynchronously
- PostgreSQL - Transactional data (projects, users, prompts)
- ClickHouse - High-performance analytics and trace storage
- Redis - Caching and job queues
Learn more about the architecture →
Open Source
Brokle's core platform is open source under the MIT license. We believe observability tools should be transparent, customizable, and free from vendor lock-in. Enterprise features are available for teams that need advanced capabilities.
Get Help
- Documentation - You're reading it!
- GitHub Issues - Report bugs or request features
- Discord Community - Chat with the team and other users
- Enterprise Support - For organizations needing SLAs and dedicated support