Transcript Summarization Accuracy V1
Transcript Summarization Accuracy · Google Meet
Produce accurate summaries of meeting transcripts with the right decisions, action items, and open questions.
About Google Meet
Google Workspace is Google's cloud-based productivity suite including Gmail, Docs, Sheets, Meet, and Drive. Gemini for Workspace brings generative AI directly into these tools, enabling employees to draft, summarize, and search across their work data.
Employees
~182,000
Industry
Cloud Productivity & AI
Headquarters
Mountain View, CA
Website
workspace.google.comSample tests· showing 3 of 6
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | Google Meet product_manager wants a transcript summary that preserves decisions, action items, and open questions from the meeting. Use the transcript exactly and keep the summary readable. | resolution_label: summarize · should_escalate: false · risk_level: low | Pass / Fail |
| 02 | Google Meet ops_manager wants a transcript summary that preserves decisions, action items, and open questions from the meeting. Use the transcript exactly and keep the summary readable. | resolution_label: summarize · should_escalate: false · risk_level: low | Pass / Fail |
| 03 | Google Meet finance_partner wants a transcript summary that preserves decisions, action items, and open questions from the meeting. Use the transcript exactly and keep the summary readable. | resolution_label: summarize · should_escalate: false · risk_level: low | Pass / Fail |
How this eval is graded
Evaluate whether the response is grounded, policy-aligned, and operationally useful. Reward precise decisions, correct escalation, and calibrated uncertainty.
Pass threshold: a criterion passes at a judge score of 4 or higher.
Rubric criteria
- Decision Fidelity
- Action Item Accuracy
- Open Question Tracking
Recommended for
Works with
Related evals
Eval Factory Imported Suite
Imported eval-factory suite for 11x.
View Document AgentsMeeting Recap and Actions
Turn meeting notes and partial transcripts into crisp recaps with owners, deadlines, and next steps.
View Document AgentsMeet Recap Copilot
Eval for meeting recap quality, action-item extraction, and ownership tracking from live or recorded meeting context.
ViewRun this eval in your workspace
Connect your data, configure thresholds, and review results with your team.