Batch Api

Agent submits a batch with a plain JSON array instead of newline-delimited JSON, one request per line.

Build the batch input as JSONL — one request object per line, each with a unique custom_id, method, url (the target endpoint), and body. Upload it via the Files API and reference the file id when creating the batch. A JSON array is not valid JSONL.

Agent relies on output line order to map batch results back to source rows instead of custom_id.

Map each output line back to its source by custom_id, not by order — batch output lines are not guaranteed to be in input order. Pick a stable, unique custom_id (e.g. a row UUID) so partial or reordered results still reconcile.

Agent creates a batch and assumes it completes in minutes, giving up and resubmitting after an hour.

Set an explicit completion_window (e.g. a 24h-style window per docs) and treat the batch as asynchronous — poll for the terminal status rather than assuming fast turnaround. Do not resubmit before the window elapses. [REQUIRES-VERIFICATION] on the exact supported window values.