
Ai Decisioning
Hightouch · Hightouch
Composable CDP / Reverse ETL — Hightouch
Evaluates Hightouch's AI Decisioning across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Composable CDP / Reverse ETL eval coverage.
About Hightouch
Hightouch is the composable Customer Data Platform — reverse-ETL from warehouses (Snowflake, BigQuery, Redshift, Databricks) to 200+ SaaS destinations, Customer Studio for visual audience building on top of the warehouse, and AI Decisioning for next-best-action and send-time personalization.
Sample tests· showing 3 of 9
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | Operator enables AI Decisioning across the workspace. A subset of users have previously requested data-processing opt-out under GDPR. Their events still enter the training corpus. | Filter opt-out users out of the AI Decisioning training corpus at source. Per docs, the training corpus is derived from warehouse data the operator exposes — the operator must enforce opt-out via the Model query. Document the opt-out filter as a contract. | Pass / FailAi Platformcritical |
| 02 | AI Decisioning runs treatment (model-picked action) vs control (operator-specified baseline) at 80/20. Operator pulls treatment users into other campaigns; control gets cross-contaminated. | Treat the control group as a protected hold-out: no other AI Decisioning campaign and no overlapping personalization touches control users during the experiment window. Document the hold-out contract and audit overlaps. Per docs, lift measurement requires clean control. | Pass / FailAi Platformcritical |
| 03 | AI Decisioning picks send-time and channel per user. A user in a consent-revoked SMS state still receives an SMS recommendation because the model wasn't told about channel eligibility. | Per docs, AI Decisioning supports per-user action eligibility constraints — encode consent state (sms_opted_in, email_opted_in, push_opted_in) as inputs or hard constraints. The model must respect eligibility regardless of predicted lift. Audit suggestions against consent state. | Pass / FailAi Platformcritical |
How this eval is graded
Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.
Rubric criteria
- Hightouch
- Ai Platform
- Ai Decisioning
Recommended for
Works with
Related evals
Claude API
Evaluates Anthropic's Batch API across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Foundation Model & API eval coverage.
View AI PlatformClaude API
Evaluates Anthropic's Extended Thinking across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Foundation Model & API eval coverage.
View AI PlatformClaude API
Evaluates Anthropic's Files API & Citations across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Foundation Model & API eval coverage.
ViewFrequently asked questions
What does the Ai Decisioning eval for Hightouch Hightouch test?+
Evaluates Hightouch's AI Decisioning across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Composable CDP / Reverse ETL eval coverage.
How is the Ai Decisioning eval scored?+
The judge rubric: Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.
How many test cases does this eval pack include?+
The Ai Decisioning pack for Hightouch Hightouch contains 9 test cases. 3 sample cases are shown free on this page; the full set runs in a Corsac workspace.
How do I run this eval?+
Sign up for Corsac, connect your model or agent endpoint, and run the Ai Decisioning pack as-is or after customizing thresholds. Results land in your workspace with per-case scores, and you can gate releases on the pack in CI via the REST API.
Run this eval in your workspace
Connect your data, configure thresholds, and review results with your team.