# Data Detective

> GEO (generative engine optimization) audits as an HTTP API. Find out what AI crawlers such as GPTBot, ClaudeBot and PerplexityBot see on a web page: robots.txt rules per crawler, the server response each crawler gets, and how much of the rendered text is present in the raw HTML.

All endpoints take and return JSON. Paid clues need `Authorization: Bearer <key>`; without a key they answer `402 Payment Required` with the price. API keys are in private beta; request one at development@llmo.consulting.

## API

- [Catalog](https://datadetective.app/api/catalog): machine-readable list of products and prices (USD cents)
- `GET https://datadetective.app/api/audit?url=<page>`: free GEO page audit of the raw HTML (basic SEO, LLM readability, structured data, score 0-100). Rate limit 10/min per IP.
- `GET https://datadetective.app/api/check/ai-policy?url=<page>`: free llms.txt & AI policy check: llms.txt format (llmstxt.org), robots.txt rules and Content Signals per AI crawler, X-Robots-Tag and meta robots including noai. Rate limit 10/min per IP.
- `POST https://datadetective.app/api/clue/bot-view` with `{"url": "<page>", "rendered": {"textLength": <int>}}`: Bot-View clue, 5 cents. `rendered.textLength` is optional (length of `document.body.innerText`, whitespace collapsed) and enables the raw-vs-rendered comparison.

## Browser extension

- [GEO Page Audit for Chrome](https://chromewebstore.google.com/detail/geo-page-audit/gfhlhobhpiokniniahmkneileoaafopd) and [for Firefox](https://addons.mozilla.org/addon/geo-page-audit/): free audit of the rendered page in the browser; "Call the detective" runs the Bot-View clue with the user's API key.

## Notes

- Repeating the same paid call (same key, clue and URL) within 10 seconds is not billed again. Failed calls (4xx/5xx) are not billed.
- Crawler fetches use each crawler's published user agent. Sites that verify bots by IP may block the test request but allow the real crawler, so a block is a strong hint, not proof.
- [Privacy](https://datadetective.app/privacy)
- Part of the [leanplugins.dev](https://leanplugins.dev/) store.