Changelog · October 12, 2026
Read the whole of a page that loads as you scroll
All 250 products, not the first 20.
By Roger Campos · Last updated: October 2026
TL;DR
Send page_options.scroll_to_bottom and the page is scrolled to its end before anything is read, and again each time scrolling loads more: a product listing, a search results page or a feed that opens with its first items and fetches the rest as a visitor scrolls. The page is then returned to the top, so the HTML, the Markdown, the extracted data, the screenshot and everything else hold the whole of it. A supermarket category page that opens with 20 products returns all 250.
Free plan, no credit card. 1,000 credits a month.
Scrolling takes as long as the page takes to load its content, up to 25 seconds; a feed with no end is read as far as it got by then. It sits beside wait_for_selector and delay and combines with them. Like every page option it is part of what identifies a stored result, and it is included in the operation's usual credits.
curl -X POST https://urlpipe.dev/markdown \
-H "Authorization: Bearer YOUR_API_KEY" \
-H "Content-Type: application/json" \
-d '{"url": "https://shop.example.com/category/yogurts", "sync": true, "page_options": {"scroll_to_bottom": true}}'Endpoints
The endpoints on this page
- Get the rendered HTML of any URL
Paste a link and get the page's HTML after JavaScript has run and redirects have been followed — the DOM a real browser sees, not the empty shell curl returns.
Try it free - Turn any URL into clean Markdown
Paste a link and get the page's main content as tidy Markdown — headings, lists, links and code kept, navigation and cookie banners stripped. The format LLMs and RAG pipelines work best with.
Try it free - Extract structured data from any web page
Paste a link and get the page's data as JSON — who it belongs to, what it offers, its prices, its contact email and social profiles — with null wherever the page does not say.
Try it free - Screenshot any website from its URL
Paste a link and get a sharp PNG of the page as it opens — JavaScript executed, exactly as a real browser would draw it. Great for previews, thumbnails and visual QA.
Try it free
FAQ
Frequently asked questions
No. Only scrolling is done, as a visitor's mouse wheel would. A list that waits for a click stays as it opened.
It is scrolled for up to 25 seconds and read as far as it got. The request succeeds either way.
No. Page options are included in the operation's usual credits.
Try it on the free plan.
Free plan, no card. Confirm your email and your API key is live — you'll be making real requests in minutes.