How do I evaluate LLM outputs reliably?

Use a combination of: automated metrics (BLEU/ROUGE for summarisation, pass@k for code), LLM-as-judge (a second model scores outputs against a rubric), human preference rating, and task-specific golden-set tests. Track all three over time — no single metric is sufficient. Log all production inputs/outputs for offline analysis.