A Aeromexico MX — Model Performance
Experiment
— · merchant — ·
web-only · —
Comparison cohort
Smart Router — live
—
—
Heuristic — live
—
—
Δ AR (Router − Heuristic)
—
Positive = router wins
Daily Approval Rate — Router vs Heuristic
Bars = volume · lines = approval % · live (non-shadow) cohort
Daily Decline Rate — Router vs Heuristic
Bars = volume · lines = decline %
Daily Approval Rate by Model Version
One line per MODEL_VERSION · shadow included (rollout view)
Approval Rate by Processor — Router vs Heuristic
Per processor the router chose (PREDICTED_VALUE) · live cohort
MCO treatment — preds (14d)
—
shadow predictions
MCO control — preds (14d)
—
shadow predictions
Daily MCO Prediction Volume — Treatment vs Control
Message-config-optimizer predictions (shadow). No approval outcomes until it live-routes.