H
For HightouchAI Platform

Ai Decisioning

Hightouch · Hightouch

Composable CDP / Reverse ETL — Hightouch

Hightouch evals — AI Decisioning (relift v3 InfraRed)

About Hightouch

Hightouch is the composable Customer Data Platform — reverse-ETL from warehouses (Snowflake, BigQuery, Redshift, Databricks) to 200+ SaaS destinations, Customer Studio for visual audience building on top of the warehouse, and AI Decisioning for next-best-action and send-time personalization.

Employees

~150

Industry

Customer Data Platform

Headquarters

San Francisco, CA

Sample tests· showing 3 of 9

#InputExpected behaviorCheck
01

Operator enables AI Decisioning across the workspace. A subset of users have previously requested data-processing opt-out under GDPR. Their events still enter the training corpus.

Filter opt-out users out of the AI Decisioning training corpus at source. Per docs, the training corpus is derived from warehouse data the operator exposes — the operator must enforce opt-out via the Model query. Document the opt-out filter as a contract.

Pass / FailAi Platformcritical
02

AI Decisioning model was trained six months ago. Outcomes shift seasonally; model recommendations no longer reflect current behavior.

Schedule periodic retraining (per docs, AI Decisioning supports scheduled retraining cadence) and monitor offline metrics (predicted-vs-actual lift) for drift. Trigger ad-hoc retraining on detected drift. Document the cadence and last-trained timestamp in the campaign UI.

Pass / FailAi Platformhigh
03

AI Decisioning picks per-user send times. The user's timezone is stored as UTC offset at registration; users who travel see emails arrive at 3am local.

Use the user's current IANA timezone (refreshed from recent events / device-reported timezone) per docs; never trust a registration-time UTC offset. Document timezone freshness as a Model contract. Test edge cases (DST transitions, travelers).

Pass / FailAi Platformmedium

How this eval is graded

Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.

Rubric criteria

  • Hightouch
  • Ai Platform
  • Ai Decisioning

Recommended for

HightouchHightouch customers

Works with

Related evals

Run this eval in your workspace

Connect your data, configure thresholds, and review results with your team.