Lab¶
The Lab is SwisperStudio's experimentation workspace for optimizing LLM node recipes. It provides a structured workflow for creating test scenarios from real production traces, defining alternative configurations (prompt + model + parameters), running systematic batch evaluations, and deploying the winning configuration — replacing ad-hoc prompt tuning with data-driven decisions.
Key Components¶
| Component | Purpose |
|---|---|
| Playground | Interactive prompt editor with Jinja2 syntax highlighting, variable autocomplete, and single-run execution |
| Scenarios | Reusable test cases capturing frozen node input state and expected results |
| Setups | Named experiment recipes combining a prompt template, model, and model configuration |
| Batches | Systematic N×M×R evaluation producing comparison matrices with quality, latency, and cost metrics |
| Deployments | Promote winning configurations to staging or production via the Config Service |
Documentation Sections¶
- Overview — What the Lab does and who it serves
- Architecture — System design, domain model, components, and trade-offs