ThoughtSpot
For ThoughtSpotData AnalysisCorrectness

Nl2sql Smoke V1

AI BI Copilot · ThoughtSpot

ThoughtSpot reliably translates analyst questions into accurate SQL that returns trustworthy business results.

About ThoughtSpot

ThoughtSpot is an AI-powered analytics platform that lets anyone explore data and get instant insights using natural language search. Its Sage AI layer translates business questions into SQL, returning charts and answers in seconds without requiring analyst help.

Employees

~1,200

Industry

Business Intelligence

Headquarters

Sunnyvale, CA

Sample tests· showing 3 of 3

#InputExpected behaviorCheck
01

How many orders are completed?

sql: SELECT COUNT(*) FROM orders WHERE status = 'completed';

Pass / Fail
02

Total revenue from completed orders?

sql: SELECT SUM(amount) FROM orders WHERE status = 'completed';

Pass / Fail
03

Number of customers in each country?

sql: SELECT country, COUNT(*) FROM customers GROUP BY country;

Pass / Fail

Rubric criteria

  • Query Intent Translation
  • Schema-Constrained Generation
  • Result Reliability

Recommended for

Query Intent TranslationSchema-Constrained GenerationResult Reliability

Works with

Related evals

Run this eval in your workspace

Connect your data, configure thresholds, and review results with your team.