HTML to JSON API

Structured data, without a model in the loop.

An HTML-to-JSON API driven by CSS selectors and the machine-readable data a page already publishes. Nothing is inferred, so a selector that matches nothing returns null instead of something plausible — which is the property you actually need from an extraction step.

display:none — still in the DOM detached before reading
93%renders succeedacross a 29-URL benchmark
69%are actually usablethe gap nobody quotes
1 / 29blocked by bot protection7 ruined by consent walls
~2smedian renderp50, viewport capture

Why a browser, and why it has to remove rather than hide

Modern extraction runs a real browser, because a plain fetch returns a shell that JavaScript was supposed to fill in. But once the browser has run, the consent dialog is in the document — and hiding it with display:none keeps it out of a screenshot, not out of the DOM. So it comes back in the text. Measured on zoom.com in August 2026: a leading browser-based markdown API returned 51 fragments of cookie-consent copy, including the full Cookie Preference Center. The same page through /v1/markdown returned none, because the nodes are detached before a word is read.

Reading https://www.zoom.com Fragments of consent copyWhat you actually get
A plain fetch + a readability parser0…and no article either: the page is a shell until JavaScript runs
A leading browser-based markdown API51including the full “Cookie Preference Center” and the OneTrust logo
rendershed /v1/markdown01 overlay node detached before extraction

Measured August 2026, and it will drift as everyone's pipelines change — the method is a regex for consent wording over each tool's own output, which is as reproducible as it is crude. Run it yourself before believing it.

Cosmetic is not enough for text

Suppression on the capture path is a stylesheet: the consent dialog stops being painted, which is the whole job for a screenshot. It is still a node, so page.content(), textContent and every HTML parser downstream still see it. These endpoints detach the tagged nodes first, and tell you how many in suppressed.stripped.

Where this does not help

Worth saying plainly. Some consent managers render in a cross-origin iframe — Sourcepoint, which fronts the Guardian and the BBC — and no extractor can read inside one, so their copy was never going to reach your text. And when main_only is on, the article-finding step already drops most page furniture. The gap this closes is inline consent managers, whole-document reads, and pages with no clear article body.

It never clicks Accept

Declining on your behalf for a throwaway read is defensible. Agreeing on your behalf is not. Reject buttons that are really subscription funnels are recognised by their own label and skipped in favour of hiding — the Guardian's is exactly that, which is why it comes back marked ~sourcepoint.

It sees what JavaScript built

A fetch returns what the server sent, which on most of the web is a shell. This runs the page, waits for the network to settle, and reads the document that resulted — the same navigation a screenshot gets, because it is the same fleet.

One render, one allowance

The same key, the same quota and the same subscription as a screenshot or a PDF. There is no separate plan for text, and a cached call is free because it cost us a disk read.

One call, no signup POST /v1/json application/json

Anonymous calls run at 40 an hour against your address. A free key raises that and works from anywhere.

# With no schema you get what the page already publishes for machines:
# JSON-LD, microdata and OpenGraph. On a product or recipe page that is
# usually the entire answer, and it costs you no selectors to maintain.
curl -X POST https://shots.rendershed.com/v1/json \
  -H "Content-Type: application/json" \
  -d '{"url": "example.com/product"}'
const res = await fetch("https://shots.rendershed.com/v1/json", {
  method: "POST",
  headers: {
    "Content-Type": "application/json",
    ...(process.env.RENDERSHED_KEY && {
      "X-API-Key": process.env.RENDERSHED_KEY,
    }),
  },
  body: JSON.stringify({
    url: "https://news.ycombinator.com",
    schema: {
      stories: {
        selector: "tr.athing", many: true, limit: 30,
        fields: {
          title: ".titleline > a",
          link: { selector: ".titleline > a", attr: "href" },
          rank: { selector: ".rank", type: "int" },
        },
      },
    },
  }),
});

const { data } = await res.json();
// Links come back absolute; "1 234,56 €" and "$1,099.00" both parse as numbers.
console.log(data.stories[0]);
import os, requests

body = requests.post(
    "https://shots.rendershed.com/v1/json",
    headers={"X-API-Key": os.environ["RENDERSHED_KEY"]},
    json={
        "url": "https://example.com/shop",
        "schema": {
            "title": "h1",
            "items": {
                "selector": ".product", "many": True, "limit": 50,
                "fields": {
                    "name": "h3",
                    "price": {"selector": ".price", "type": "number"},
                    "link": {"selector": "a", "attr": "href"},
                },
            },
        },
    },
    timeout=90,
).json()

# A selector that matches nothing is None. It is never a guess.
for item in body["data"]["items"]:
    print(item["name"], item["price"])

What comes back

Trimmed from a real response through this API.

{
  "url": "https://news.ycombinator.com",
  "title": "Hacker News",
  "ms": 2259,
  "data": {
    "stories": [
      {
        "title": "Kagi added a setting for removing paywalled links",
        "link": "https://kagi.com/changelog#11296",
        "rank": 1
      },
      { "title": "DeepSeek-v4-flash-vision-exp", "link": "...", "rank": 2 }
    ]
  }
}

Parameters

NameTypeDefaultDescription
url stringrequiredThe page to read. http and https only.
schema objectMap of field name to CSS selector. A value is either a bare selector, or {selector, attr, type} — attr defaults to text and may be any attribute or "html"; type may be text, number, int or boolean. Repeat a block with {selector, many: true, limit, fields: {…}}. Up to 60 fields, 3 levels deep.
auto boolwhen no schemaHarvest the structured data the page already publishes: JSON-LD, microdata and OpenGraph.
scroll boolfalseWalk to the bottom first so lazy-loaded rows are present. Paid plans only.
device enumiphone, android or ipad.
overlay_mode enumdismissoff, hide or dismiss.

Errors, response headers and the signed-URL scheme are the same for every product — they live in the reference.

On the same key

Five outputs, one account, one quota. Every call costs one render whichever path you use.

Get a key