Skip to content
Lesuto Render Engine

How it works

The Same Page
Read By Everyone

Render Engine does the work a crawler skips: it runs your JavaScript and hands back the result.

Render Engine crawler activity for 30 days: served from cache, rendered, refused and failed, with protection totals

From Request
To Rendered Page

Every request takes one of two paths, chosen in milliseconds by your routing rule.

  1. A Request Arrives

    Someone or something asks for a page on your site.

  2. Your Rule Checks Who

    A rule in your CDN, server or framework looks at the user agent and picks the path.

  3. Crawlers Get Full HTML

    The request goes to Render Engine, which renders the page in a headless browser or serves the cached snapshot, with content, meta tags and structured data in the source.

    People Get The Live Site

    Visitors go straight to your app, exactly as before. Render Engine never sees them.

What Happens
During A Render

  • A headless browser opens the page the crawler asked for, on your connected hostname.
  • It waits for your scripts to load the content, so products, prices and articles are on the page.
  • Titles, descriptions, Open Graph, Twitter cards and JSON-LD are captured in the HTML.
  • The finished HTML goes back to the crawler and is cached for the time you set on the domain.
Crawler visitsRendered HTML
<title>Linen Throw, Natural</title>
<meta property="og:image" content="/linen.jpg">
<script type="application/ld+json">{"@type":"Product"}</script>
<h1>Linen Throw, Natural</h1>

Get started

Three Steps To
Crawlable JavaScript Pages

  1. 01

    Connect Your Domain

    Verify your domain with one DNS record and create an API key.

  2. 02

    Route Crawlers

    Add one rule to your CDN, server or framework. Only crawlers are forwarded.

  3. 03

    Verify and Share

    Fetch a page as a crawler and confirm the full HTML comes back.

See It On
Your Own Pages

Connect a domain, add one rule, and check the result with a single request.

How Render Engine Works: Rendered HTML for Crawlers, Live Site for People