For Google MeetDocument AgentsKnowledge Retention

Transcript Summary V1

Meet Transcript QA · Google Meet

Meet transcript summarization eval for fidelity, compression, and factual recall.

About Google Meet

Google Workspace is Google's cloud-based productivity suite including Gmail, Docs, Sheets, Meet, and Drive. Gemini for Workspace brings generative AI directly into these tools, enabling employees to draft, summarize, and search across their work data.

Employees

~182,000

Industry

Cloud Productivity & AI

Headquarters

Mountain View, CA

Website

workspace.google.com

Sample tests· showing 3 of 6

#	Input	Expected behavior	Check
01	summary with sections Summarize a project meeting transcript into sections for decisions, risks, and next steps. Keep the summary faithful to the transcript and avoid adding narrative filler.	resolution_label: sectioned_summary · sections: decisions, risks… · filler_removed: true	Pass / Fail
02	exec brief summary Create a short executive brief from the transcript that preserves the key decisions and the one open risk. Do not include every side discussion.	resolution_label: exec_brief · should_include_side_discussions: false · risk_count: 1	Pass / Fail
03	action and owner recall The transcript contains several owner assignments and deadlines. Summarize them accurately, preserving who owns what and the exact dates where stated.	resolution_label: owner_recall · owner_precision: true · deadline_precision: true	Pass / Fail
Use this eval

How this eval is graded

Evaluate whether the response is grounded, policy-aligned, and operationally useful. Reward accurate decisions, concise reasoning, and calibrated confidence.

Pass threshold: a criterion passes at a judge score of 4 or higher.