Evals
Measured, then shown.
Every change runs through a Synthetic SOC: 68 scenarios across 8 alert families, with 8 planted prompt
injections, 2 alert storms and 2 cases where the data to decide is missing. Each has a hidden answer key.
These are the gates from make eval and make eval-adversarial (October 2026), run on
synthetic data with scripted and replayed model responses. They prove the pipeline’s guarantees, not live-model
accuracy. A public benchmark with live models and published miss rates is coming soon.