Evals for Loman AI

Menu item and modifier capture

Correct item, size, quantity, and modifier resolution from natural caller speech, including ambiguous or partial item names.

Order confirmation and correction

Reading the order back and applying mid-call changes, removals, and substitutions without corrupting earlier items.

Out-of-stock and unavailable item handling

Recognizing an unavailable item, saying so plainly, and offering a valid alternative rather than accepting the order.

Upsell and add-on behavior

Offering relevant add-ons at appropriate moments without pressuring, repeating, or delaying order completion.

Booking a new reservation

Collecting party size, date, time, and guest name, and confirming the booked slot back to the caller.

Availability and alternative offers

Handling requests for times that are unavailable by offering nearby valid options instead of over-booking.

Modify and cancel flows

Locating an existing booking from caller-supplied details and applying a change or cancellation.

Large-party and special-request routing

Recognizing requests that exceed normal booking rules and escalating or transferring instead of guessing.

Hours, location, and logistics questions

Answering from configured business info, including edge cases like holiday hours or 'are you open now'.

Menu, price, and dietary questions

Answering item, price, and ingredient questions from the current menu without inventing details.

Abstention on unknown information

Saying it does not have the information and offering a next step rather than fabricating an answer.

Allergen and dietary-restriction caution

Handling allergen questions with appropriate caution and escalation instead of an unqualified safety assurance.

Card capture and confirmation

Collecting card details, confirming the charge amount, and confirming completion to the caller.

Sensitive-data handling in conversation

Not reading back or unnecessarily repeating full card data, and not exposing it in transcripts or summaries.

Declined or failed payment recovery

Explaining the failure, offering retry or pay-at-pickup, and leaving the order in a coherent state.

Total, tax, and tip accuracy

Quoting an amount that matches the assembled order before authorizing the charge.

Ticket fidelity into the POS

Items, modifiers, fulfillment type, and guest details arriving in the POS matching what was confirmed on the call.

Reservation write-through

Bookings, changes, and cancellations reflected in the connected reservation system.

Menu and hours ingestion

Automatic menu and business-info updates flowing into what the agent tells callers.

Sync failure visibility

Surfacing a failed or partial push to the operator instead of dropping the order silently.

Interruption and barge-in handling

Yielding when the caller talks over the agent and resuming from the correct point in the flow.

Transfer and escalation to staff

Recognizing complaints, refunds, or explicit human requests and transferring with context instead of looping.

Unclear input and repair

Handling misheard names, addresses, and numbers by re-asking narrowly rather than guessing or restarting.

Outbound SMS and call artifacts

Confirmation and status SMS content matching the call outcome, and transcripts reflecting what happened.