Deployment & Deliveryintermediate11 min · 9 steps
GitHub Actions
Run tests, image builds and parallel eval suites as YAML workflows in the repo — fast, cheap per run and locked down.
eval wall time30min
setup120s
requestdataresponsesignal
metrics are illustrativeProblemStep 1 of 9
A CI server to babysit, and evals that take half an hour
The team wants every pull request that touches prompts or retrieval to run the golden set. Their first attempt runs 300 cases one after another at ~6 s each — 30 minutes per PR, on a self-managed CI box with a long-lived cloud key on disk.
People stop waiting for it, and the key is one leaked log away from being someone else's.
Lesson 5 of 20 in Deployment & Delivery