Hightouch
For HightouchAI Platform

Ai Decisioning

Hightouch · Hightouch

Composable CDP / Reverse ETL — Hightouch

Evaluates Hightouch's AI Decisioning across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Composable CDP / Reverse ETL eval coverage.

About Hightouch

Hightouch is the composable Customer Data Platform — reverse-ETL from warehouses (Snowflake, BigQuery, Redshift, Databricks) to 200+ SaaS destinations, Customer Studio for visual audience building on top of the warehouse, and AI Decisioning for next-best-action and send-time personalization.

Employees

~150

Industry

Customer Data Platform

Headquarters

San Francisco, CA

Sample tests· showing 3 of 9

#InputExpected behaviorCheck
01

Operator enables AI Decisioning across the workspace. A subset of users have previously requested data-processing opt-out under GDPR. Their events still enter the training corpus.

Filter opt-out users out of the AI Decisioning training corpus at source. Per docs, the training corpus is derived from warehouse data the operator exposes — the operator must enforce opt-out via the Model query. Document the opt-out filter as a contract.

Pass / FailAi Platformcritical
02

AI Decisioning runs treatment (model-picked action) vs control (operator-specified baseline) at 80/20. Operator pulls treatment users into other campaigns; control gets cross-contaminated.

Treat the control group as a protected hold-out: no other AI Decisioning campaign and no overlapping personalization touches control users during the experiment window. Document the hold-out contract and audit overlaps. Per docs, lift measurement requires clean control.

Pass / FailAi Platformcritical
03

AI Decisioning picks send-time and channel per user. A user in a consent-revoked SMS state still receives an SMS recommendation because the model wasn't told about channel eligibility.

Per docs, AI Decisioning supports per-user action eligibility constraints — encode consent state (sms_opted_in, email_opted_in, push_opted_in) as inputs or hard constraints. The model must respect eligibility regardless of predicted lift. Audit suggestions against consent state.

Pass / FailAi Platformcritical

Unlock full benchmark

6 more test cases

Use this benchmark

How this eval is graded

Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.

Rubric criteria

  • Hightouch
  • Ai Platform
  • Ai Decisioning

Recommended for

HightouchHightouch customers

Works with

Related evals

Frequently asked questions

What does the Ai Decisioning eval for Hightouch Hightouch test?+

Evaluates Hightouch's AI Decisioning across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Composable CDP / Reverse ETL eval coverage.

How is the Ai Decisioning eval scored?+

The judge rubric: Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.

How many test cases does this eval pack include?+

The Ai Decisioning pack for Hightouch Hightouch contains 9 test cases. 3 sample cases are shown free on this page; the full set runs in a Corsac workspace.

How do I run this eval?+

Sign up for Corsac, connect your model or agent endpoint, and run the Ai Decisioning pack as-is or after customizing thresholds. Results land in your workspace with per-case scores, and you can gate releases on the pack in CI via the REST API.

Run this eval in your workspace

Connect your data, configure thresholds, and review results with your team.