Scrape Single Url

Agent calls POST /v1/scrape for a docs page and needs only clean markdown for an LLM, but passes formats=['markdown','html','rawHtml','screenshot'] 'to be safe.'

Request only the formats actually consumed — formats=['markdown']. Each extra format (especially screenshot) adds latency and consumes additional credits. Read response.markdown from the per-format payload; do not request rawHtml/screenshot unless a downstream step uses them.

A single-page app renders its main content after client-side hydration. A naive scrape returns an empty shell because the DOM was captured too early.

Set waitFor to a millisecond delay (or use actions/wait) so the page hydrates before capture; verify the returned markdown is non-empty. Tune waitFor to the smallest value that yields content — over-large waits inflate latency and credits.

Agent needs a full-page visual capture of a long landing page but requests formats=['screenshot'] and gets only the above-the-fold viewport.

Use the full-page screenshot format (screenshot@fullPage) when the whole page is needed; plain screenshot captures the viewport only. Account for the extra credit cost of screenshots and store the returned image URL/asset deliberately.