Hightouch
For HightouchAI Platform

Audiences Customer Studio

Hightouch · Hightouch

Composable CDP / Reverse ETL — Hightouch

Evaluates Hightouch's Audiences (Customer Studio) across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Composable CDP / Reverse ETL eval coverage.

About Hightouch

Hightouch is the composable Customer Data Platform — reverse-ETL from warehouses (Snowflake, BigQuery, Redshift, Databricks) to 200+ SaaS destinations, Customer Studio for visual audience building on top of the warehouse, and AI Decisioning for next-best-action and send-time personalization.

Employees

~150

Industry

Customer Data Platform

Headquarters

San Francisco, CA

Sample tests· showing 3 of 9

#InputExpected behaviorCheck
01

Operator builds a Customer Studio Parent Model on top of the warehouse but picks an unstable session_id as the identity column instead of customer_id.

Parent Model identity column must be stable across sessions (customer_id, user_uuid). Per Customer Studio docs, every audience traits + related-events join through this identity — instability fragments users and breaks audience membership. Use identity resolution to merge known aliases.

Pass / FailAi Platformcritical
02

Audience filters users where churn_risk_score >= 0.8. The trait is updated daily by dbt; the audience is refreshed hourly. Operators think the audience reflects today's data when it reflects yesterday's.

Document the trait's source-of-truth freshness in the trait description; set the audience refresh cadence to the trait cadence (or chain via dbt Cloud trigger). Surface the trait's as_of timestamp in the audience UI so analysts see actual recency.

Pass / FailAi Platformhigh
03

Operator splits a 'high-value lead' audience 50/50 into Treatment and Control. On every refresh, users reshuffle between the splits; experiment results are meaningless.

Use a deterministic hash on the identity column (e.g., mod(hash(user_id), 100) < 50) for split assignment so users stay in their split across refreshes — per Customer Studio docs, splits should be sticky. Persist the assignment in the warehouse for downstream attribution.

Pass / FailAi Platformcritical

Unlock full benchmark

6 more test cases

Use this benchmark

How this eval is graded

Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.

Rubric criteria

  • Hightouch
  • Ai Platform
  • Audiences Customer Studio

Recommended for

HightouchHightouch customers

Works with

Related evals

Frequently asked questions

What does the Audiences Customer Studio eval for Hightouch Hightouch test?+

Evaluates Hightouch's Audiences (Customer Studio) across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Composable CDP / Reverse ETL eval coverage.

How is the Audiences Customer Studio eval scored?+

The judge rubric: Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.

How many test cases does this eval pack include?+

The Audiences Customer Studio pack for Hightouch Hightouch contains 9 test cases. 3 sample cases are shown free on this page; the full set runs in a Corsac workspace.

How do I run this eval?+

Sign up for Corsac, connect your model or agent endpoint, and run the Audiences Customer Studio pack as-is or after customizing thresholds. Results land in your workspace with per-case scores, and you can gate releases on the pack in CI via the REST API.

Run this eval in your workspace

Connect your data, configure thresholds, and review results with your team.