Databricks
For DatabricksData AnalysisCorrectness

Assistant Nl2sql Smoke V1

Lakehouse / Data Copilot · Databricks

Databricks reliably translates analyst questions into accurate SQL that returns trustworthy business results.

About Databricks

Databricks is the Data + AI Company, providing a unified lakehouse platform for data engineering, analytics, and machine learning at scale. Thousands of organizations use Databricks to build, train, and deploy AI and ML workloads on their own data.

Employees

~6,000

Industry

Data & AI Platform

Headquarters

San Francisco, CA

Sample tests· showing 3 of 3

#InputExpected behaviorCheck
01

How many orders are completed?

sql: SELECT COUNT(*) FROM orders WHERE status = 'completed';

Pass / Fail
02

Total revenue from completed orders?

sql: SELECT SUM(amount) FROM orders WHERE status = 'completed';

Pass / Fail
03

Number of customers in each country?

sql: SELECT country, COUNT(*) FROM customers GROUP BY country;

Pass / Fail

Rubric criteria

  • Query Intent Translation
  • Schema-Constrained Generation
  • Result Reliability

Recommended for

Query Intent TranslationSchema-Constrained GenerationResult Reliability

Works with

Related evals

Run this eval in your workspace

Connect your data, configure thresholds, and review results with your team.