The AI engineering
platform

Laminar is an open-source platform for engineering LLM products. Trace, evaluate, label, and analyze LLM apps.

Building with LLMs?
Then, you might be

Struggling to monitor LLM calls in production. Don't know how last prompt change affected performance. Lacking data for fine-tuning and prompt engineering.

Laminar is a single solution for
tracing, evaluating, and labeling
LLM products.

Trace

Tracing your LLM application provides visibility into every execution step while collecting valuable data for evaluations, few-shot examples, and fine-tuning. With Laminar, you can start tracing with just 2 lines of code.

import { Laminar, observe } from '@lmnr-ai/lmnr';

// automatically traces common LLM frameworks and SDKs
Laminar.initialize({ projectApiKey: "..." });

// you can also manually trace any function
const myFunction = observe({name: 'myFunc'}, async () => {
...
})

LLM observability that just works

Add 2 lines of code to trace all LLM calls and traces. Traces are sent in the background via gRPC with minimal performance and latency overhead.

Start tracing

Online evaluations

Setup LLM or Python online evaluators to process each received span. Evaluators automatically label spans, which is more scalable than human labeling.

Setup online evaluations

Datasets

You can build datasets from your traces, and use them in evaluations, fine-tuning and prompt engineering.

Create a dataset

Serverless LLM pipelines

Our pipeline builder is an incredible prototyping tool. It lets you quickly build and iterate on both simple prompts and complex LLM chains. After that

Deploy LLM pipeline

Fully open-source

Laminar is fully open-source and easy to self-host. Get started with just a few commands.

Self-host Laminar