Skip to main content

Documentation Index

Fetch the complete documentation index at: https://serplens.com/docs/llms.txt

Use this file to discover all available pages before exploring further.

The Indexing panel shows everything that affects whether and how a page gets indexed by search engines. Open it from the browser sidebar to see robots directives, canonical URLs, hreflang tags, and sitemap information for the current page.

​
What it shows

​
URL and indexability

  • The full page URL with character count
  • An indexability status — whether the page is likely to be indexed based on all signals

​
Meta robots

All robots directives found on the page, including:
  • index / noindex
  • follow / nofollow
  • noarchive, nosnippet, max-snippet, and others
The panel reads directives from both <meta name="robots"> tags and X-Robots-Tag HTTP headers.

​
Canonical URL

  • The canonical URL declared on the page
  • Whether it’s self-referencing (points to itself) or points to a different URL
  • Flags mismatches between the page URL and canonical — a common source of indexing issues

​
Robots.txt

  • Whether a robots.txt file exists on the domain
  • A direct link to view the robots.txt file

​
Hreflang tags

A table of all hreflang tags found on the page:
Language codeURL
en-ushttps://example.com/page
de-dehttps://example.com/de/page
The list is expandable if there are many entries. Use this to verify your international targeting is set up correctly.

​
Sitemaps

Auto-discovers sitemaps from:
  • robots.txt sitemap references
  • Common sitemap locations (/sitemap.xml, /sitemap_index.xml)
Shows a list of discovered sitemaps with links to view each one.

​
Export

Click the export button to download all indexing data as a CSV — useful for documenting indexing signals across a site audit.

​
Next steps

Crawling

Check how search engine bots can access your pages.

Structured data

Validate schema markup on the page.