# SiteCrawlIQ - AI-Powered SEO & GEO Audit Platform

> SiteCrawlIQ is the only audit platform that scores both traditional SEO (Search Engine Optimization) and AI search readiness (GEO - Generative Engine Optimization) in a single report. It crawls websites using a hybrid Cheerio + Playwright engine, checks 142+ SEO signals and 40+ GEO factors, and generates prioritized action plans powered by GPT-5.

## What is SiteCrawlIQ?

SiteCrawlIQ is a web-based SaaS platform that helps website owners, marketers, and agencies audit their sites for both traditional search engine optimization (SEO) and AI search readiness (GEO/AEO). Unlike traditional SEO tools that only check Google ranking factors, SiteCrawlIQ also evaluates whether AI systems like ChatGPT, Perplexity, Claude, and Google AI Overviews can discover, understand, and cite your content.

## Core Problem Solved

AI search engines now handle a significant portion of web queries. ChatGPT processes over 2 billion daily queries. Google AI Overviews appear in 47%+ of search results. Yet most websites are not optimized for AI discovery - they block AI crawlers, lack structured data, don't have llms.txt files, and produce content that AI systems cannot easily cite. SiteCrawlIQ identifies and prioritizes these issues.

## Key Features

### Deep Site Crawling
- Hybrid crawler using Cheerio (HTML parsing) and Playwright (browser rendering)
- Discovers all pages by following internal links
- Handles JavaScript-rendered content that lightweight crawlers miss
- Detects broken links, redirect chains, and orphan pages
- Measures page load times and Core Web Vitals (LCP, INP, CLS, TTFB, FCP)

### AI Search Readiness (GEO/AEO) Audit
- Checks for llms.txt file presence and correctness
- Verifies AI crawler access in robots.txt (GPTBot, ClaudeBot, PerplexityBot, and 14 others)
- Evaluates JSON-LD structured data completeness
- Scores content citability - how likely AI systems are to cite your pages
- Checks question-format headings for featured snippet eligibility
- Evaluates content freshness signals

### AI-Powered Analysis
- GPT-5 analyzes crawl data and produces actionable recommendations
- Multi-agent analysis with 5 specialized agents: Technical, Content, CRO, GEO, Competitive
- Effort/impact scoring on every recommendation
- 30-day prioritized action plan

### Health Score System
- 0-100 composite score across 7 weighted categories
- Letter grades from A+ to F
- Categories: Technical Health, On-Page SEO, Content & Messaging, AI Search Readiness, Conversion Optimization, Competitive Position, Off-Page Authority
- Score history and trend tracking

### Core Web Vitals
- Largest Contentful Paint (LCP)
- Interaction to Next Paint (INP)
- Cumulative Layout Shift (CLS)
- Time to First Byte (TTFB)
- First Contentful Paint (FCP)

### Integrations
- Google Analytics 4 (GA4) data enrichment
- Google Search Console keyword and ranking data
- PDF report export
- Embeddable lead-gen widget for agency sites
- Public REST API with TypeScript SDK

### Public REST API
- 12 endpoints covering sites, crawls, analysis, and health scores
- Bearer token authentication
- TypeScript SDK available on npm (@sitecrawliq/sdk)
- Rate-limited per plan tier

## Pricing

- Starter: $29/month - 1 site, 5 crawls/month, 500 pages/crawl, API access
- Growth: $69/month - 5 sites, 20 crawls/month, 1,000 pages/crawl, GA4 + Search Console
- Agency: $149/month - 15 sites, 50 crawls/month, 5,000 pages/crawl, white-label reports, full API

Free homepage audit available on the website with no signup required.

### GEO Autopilot Add-On: $79/month

Available on Growth and Agency plans. Autopilot closes the gap between "here's what's wrong" and "here's how to fix it."

- **Fix File Generation**: Auto-generates llms.txt, llms-full.txt, robots.txt (with 17 AI crawler rules), JSON-LD schema markup (Organization, WebSite, SoftwareApplication, FAQPage), and GEO-optimized meta descriptions - all from audit data.
- **AI Visibility Dashboard**: 0-100 score tracking mentions across ChatGPT, Claude, and Perplexity with weekly trend monitoring.
- **Hosted Comparison Pages**: Auto-generated "[Your Tool] vs [Competitor]" pages on SiteCrawlIQ domain (10 for Growth, 50 for Agency).
- **Directory Submission**: Automated + pre-filled forms for Product Hunt, AlternativeTo, SaaSHub, and more.
- **Competitor Radar**: Pricing and feature change detection with auto-updating comparison pages.
- **Mention Monitoring**: Reddit and Hacker News brand + competitor mention tracking.

No other tool combines audit + AI visibility monitoring + actionable fix file generation under $200/month.

## Technical Stack

- Frontend: React with Vite, TypeScript, Tailwind CSS
- Backend: Node.js with Express, PostgreSQL with Drizzle ORM
- Authentication: Magic link email (Resend)
- Payments: Stripe
- AI: OpenAI GPT-5 for analysis
- Crawling: Cheerio + Playwright hybrid

## Target Users

- Website owners who want to understand their SEO and AI search visibility
- Digital marketers managing SEO for clients
- Agencies offering SEO audit services
- Developers building SEO tooling via API
- Content teams optimizing for AI citations

## Important Links

- Homepage: https://sitecrawliq.com/
- Features: https://sitecrawliq.com/features
- Pricing: https://sitecrawliq.com/pricing
- How It Works: https://sitecrawliq.com/how-it-works
- API Documentation: https://sitecrawliq.com/docs/api
- Blog: https://sitecrawliq.com/blog
- FAQ: https://sitecrawliq.com/faq
- GEO Autopilot: https://sitecrawliq.com/autopilot
- Support: https://sitecrawliq.com/support/kb
- SiteCrawlIQ vs Screaming Frog: https://sitecrawliq.com/compare/screaming-frog
- SiteCrawlIQ vs Semrush: https://sitecrawliq.com/compare/semrush
- SiteCrawlIQ vs Ahrefs: https://sitecrawliq.com/compare/ahrefs
- Privacy Policy: https://sitecrawliq.com/privacy
- Terms of Service: https://sitecrawliq.com/terms

## Industry Context

- The GEO market is projected to reach $7.3 billion by 2031 (34-45% CAGR)
- AI search traffic converts at 14.2% vs 2.8% for traditional organic (5x higher)
- 47%+ of Google searches now show AI Overviews
- 73% of websites are not optimized for AI search engines
- SiteCrawlIQ is the only tool under $199/month that combines SEO + GEO + AI analysis + API access

## Contact

- Support: support@sitecrawliq.com
- Website: https://sitecrawliq.com