Changelog · September 28, 2026
Official LangChain and LlamaIndex packages
Pages an agent can read, and Documents ready to index, without writing the loader yourself.
By Roger Campos · Last updated: September 2026
TL;DR
Two packages on PyPI replace the loader recipes. langchain-urlpipe adds urlpipe_read_page, urlpipe_page_metadata, urlpipe_console_errors and urlpipe_lighthouse as LangChain tools, a UrlpipeToolkit and a UrlpipeLoader. llama-index-readers-urlpipe adds UrlpipeReader, with sync and async loading and a stable id per URL.
Free plan, no credit card. 1,000 credits a month.
Both build on the official Python client, so retries carry an Idempotency-Key, long pages are waited out, and errors come back typed. The LangChain tools return the API's explanation to the model when a page can't be read, so an agent can recover; the loaders skip failed pages with continue_on_failure.
pip install langchain-urlpipe
pip install llama-index-readers-urlpipeEndpoints
The endpoints on this page
- Turn any URL into clean Markdown
Paste a link and get the page's main content as tidy Markdown — headings, lists, links and code kept, navigation and cookie banners stripped. The format LLMs and RAG pipelines work best with.
Try it free - Check a page's Open Graph tags and metadata
Paste a link and get the page's metadata — title, description, author, publication date, feed and main image — cleaned into one structured object.
Try it free - Check any website for JavaScript errors
Paste a link and see the console errors, warnings and uncaught exceptions logged while the page loads in a real browser — no DevTools, no local setup.
Try it free - Run a Lighthouse audit on any URL
Paste a link and get a real Google Lighthouse audit — performance, accessibility, best practices and SEO scores, plus Core Web Vitals — measured against the live page.
Try it free
FAQ
Frequently asked questions
Do the packages need their own API key?
Which Python versions are supported?
Try it on the free plan.
Free plan, no card. Confirm your email and your API key is live — you'll be making real requests in minutes.