MCP/Crawlwise
Crawlwise logo

Crawlwise

Hosted SEO, AEO and GEO MCP server providing page audits, multi-page site crawls, AI-crawler reachability checks, and schema validation.

seo•SEO, AEO & AI Crawler Reachability
Website
License:Commercial / Free Tier
OFFICIAL
ByCrawlwise@Crawlwise

About this Server

Hosted SEO, AEO, and GEO Model Context Protocol server on crawlwise.site. Empowers AI coding assistants with comprehensive page audits, multi-page site crawls, AI-crawler reachability verification (GPTBot, ClaudeBot, Google-Extended), JSON-LD schema validation, and PageSpeed Core Web Vitals checks over streamable HTTP.

Real-time Interaction

Direct low-latency RPC protocol communication with structured JSON schemas.

Scoped Sandboxing

Restricted capability bounds to prevent accidental modifications or leakage.

Security & Best Practices

Transport Layer Encryption: All audits, crawl telemetry, and AI crawler reachability checks transmit over secure TLS 1.3 endpoints.
Non-Intrusive Polling: Audit jobs execute asynchronously using unique job IDs to prevent thread blocking or server timeouts.
Crawler Respect: AI crawler reachability simulations respect robots.txt directives and avoid aggressive request flooding.
Account Credit Safety: The estimate_cost endpoint allows preflight credit checks to avoid unexpected balance depletion.

When to Use (and When Not To)

Best For
  • •Webmasters and technical SEO teams auditing AI-search visibility and crawler reachability for GPTBot, ClaudeBot, and Google-Extended
  • •Validating JSON-LD schema markup and PageSpeed Core Web Vitals directly within AI workflows
  • •Detecting site-wide duplicate titles, redirect loops, and broken internal links across multi-page crawls
  • •Developers needing instant robots.txt generation, meta tags, and schema snippets
Not For / Limitations
  • •Keyword ranking or backlink tracking across legacy search engines (use dedicated rank trackers instead)
  • •Live end-to-end browser DOM interaction or JavaScript form clicks (use Playwright or Browser MCP instead)
  • •Offline local development without internet access to the hosted crawlwise.site endpoint

Install & Setup

terminal command
$claude mcp add --transport http crawlwise https://crawlwise.site/mcp

Exposed Tools & Endpoints

15 tools

Functions your AI agent can invoke via this Model Context Protocol server

audit_page

Start a full page audit returning a job_id immediately with findings grouped by priority, worth considering, and not measured.

get_audit

Poll an audit job started with audit_page using its job_id until completion.

check_ai_crawlers

Fetch target URL as GPTBot, ClaudeBot, and other AI crawlers to report allowed, blocked, challenged, or not established reachability.

validate_schema

Validate JSON-LD and schema.org markup against Google Rich Results eligibility requirements.

check_vitals

Extract Core Web Vitals via PageSpeed Insights for a URL and device strategy.

crawl_site

Initiate a multi-page site crawl to detect architecture, hierarchy, and orphan pages up to plan limit.

get_crawl_issues

Retrieve cross-page crawl findings including duplicate title tags, redirect chains, broken links, and orphaned URLs.

get_internal_link_suggestions

Generate internal link suggestions derived from observed graph relationships across crawled pages.

generate_schema

Generate valid JSON-LD structured data for a schema.org type from user-provided fields.

generate_meta_tags

Generate standard HTML meta tags and social Open Graph tags from user-provided fields.

generate_robots_txt

Generate a formatted robots.txt file adhering to user-defined crawler directives and sitemaps.

explain_finding

Retrieve full detailed documentation and remediation context for a specific check ID.

estimate_cost

Estimate credit consumption for an operation before execution without charging the account.

list_sites

List verified websites and domains associated with the authenticated account.

get_credits

Inspect current credit balance and recent credit usage history.