URLpipe API
URLpipe turns any public URL into clean, structured data. Point it at a page and get back Markdown, metadata, an AI summary, keywords, a Lighthouse audit, a screenshot, raw HTML or the JavaScript console — all through one simple, bearer-authenticated HTTP API.
Every endpoint takes the same shape: a POST request with a JSON body containing the url you want to process. There is nothing to install on the target site — URLpipe renders each page with headless Chrome from our own servers, so JavaScript-heavy and single-page apps work too.
A first request
Send a URL to the /markdown endpoint and get back clean Markdown, ready to drop into an LLM prompt or a RAG pipeline.
curl -X POST https://urlpipe.dev/markdown \
-H "Authorization: Bearer YOUR_API_KEY" \
-H "Content-Type: application/json" \
-d '{"url": "https://example.com"}'const res = await fetch("https://urlpipe.dev/markdown", {
method: "POST",
headers: {
"Authorization": "Bearer YOUR_API_KEY",
"Content-Type": "application/json",
},
body: JSON.stringify({ url: "https://example.com" }),
})
const markdown = await res.text()import requests
res = requests.post(
"https://urlpipe.dev/markdown",
headers={"Authorization": "Bearer YOUR_API_KEY"},
json={"url": "https://example.com"},
)
markdown = res.textThe endpoints
URLpipe has eight endpoints, split into two families. Web endpoints fetch and measure the page directly; AI endpoints use a language model to extract or transform its content. The two are metered separately, so you can lean on the web endpoints without touching your AI budget.
Web endpoints
The fully rendered HTML of a page, after JavaScript has run.
A base64-encoded PNG screenshot of the rendered page.
A real Google Lighthouse audit — performance, SEO, accessibility.
JavaScript console errors, warnings and uncaught exceptions.
AI endpoints
The page's main content as clean Markdown, chrome stripped.
Title, description, author, dates, feed and main image.
A concise AI summary of the page's main content.
5–15 relevant keywords, ordered by relevance.
Core concepts
How bearer tokens and per-project API keys work.
Caching & freshnessReuse recent results for free with max_age.
Async & sync modesWebhook the result (the default) or get it inline with sync.
Quotas & rate limitsHow AI and web operations are metered.
ErrorsStatus codes and error payloads to handle.
Base URL & conventions
- All requests go to
https://urlpipe.devover HTTPS. - Every endpoint is a POST with a JSON body.
- Authenticate with
Authorization: Bearer YOUR_API_KEY— see Authentication. - Web endpoints return
text/plainorapplication/json; failures return JSON with anerrorfield.