Ai Decisioning
Hightouch · Hightouch
Composable CDP / Reverse ETL — Hightouch
Hightouch evals — AI Decisioning (relift v3 InfraRed)
About Hightouch
Hightouch is the composable Customer Data Platform — reverse-ETL from warehouses (Snowflake, BigQuery, Redshift, Databricks) to 200+ SaaS destinations, Customer Studio for visual audience building on top of the warehouse, and AI Decisioning for next-best-action and send-time personalization.
Sample tests· showing 3 of 9
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | Operator enables AI Decisioning across the workspace. A subset of users have previously requested data-processing opt-out under GDPR. Their events still enter the training corpus. | Filter opt-out users out of the AI Decisioning training corpus at source. Per docs, the training corpus is derived from warehouse data the operator exposes — the operator must enforce opt-out via the Model query. Document the opt-out filter as a contract. | Pass / FailAi Platformcritical |
| 02 | AI Decisioning model was trained six months ago. Outcomes shift seasonally; model recommendations no longer reflect current behavior. | Schedule periodic retraining (per docs, AI Decisioning supports scheduled retraining cadence) and monitor offline metrics (predicted-vs-actual lift) for drift. Trigger ad-hoc retraining on detected drift. Document the cadence and last-trained timestamp in the campaign UI. | Pass / FailAi Platformhigh |
| 03 | AI Decisioning picks per-user send times. The user's timezone is stored as UTC offset at registration; users who travel see emails arrive at 3am local. | Use the user's current IANA timezone (refreshed from recent events / device-reported timezone) per docs; never trust a registration-time UTC offset. Document timezone freshness as a Model contract. Test edge cases (DST transitions, travelers). | Pass / FailAi Platformmedium |
How this eval is graded
Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.
Rubric criteria
- Hightouch
- Ai Platform
- Ai Decisioning
Recommended for
Works with
Related evals
Run this eval in your workspace
Connect your data, configure thresholds, and review results with your team.