AI Crawlability Test

Product

Changelog

Every update, feature, and fix to the AI Crawlability Test tool — newest first.

v0.7.02026-05-08
  • FeatureAdded "What's new in AEO" page with 3 curated industry updates from Yext, Position.digital, and PR News
  • FeatureAll external links on the new page carry UTM attribution (utm_source=aicrawltest)
  • FeatureAdded "What's new in AEO" to the main nav across all pages
v0.6.02026-05-08
  • FeatureNew blog post: "Per-Page Markdown Files: The Easiest Win for AI Crawlability"
v0.5.02026-05-08
  • FeatureSupabase MCP server added to project config
  • FeatureSupabase agent skills installed (Postgres Best Practices + Supabase)
  • FeatureScanned URLs are now saved to Supabase on every successful check
  • FixMade the Supabase client lazy to prevent build-time crash when env vars are absent
  • FeatureAdded Supabase JS client integration (lib/supabase.ts)
v0.4.02026-05-08
  • FeatureChecked URLs are now logged to Vercel KV with a capped list (5,000 entries)
  • FeatureAdded GET /api/admin/urls endpoint protected by Authorization: Bearer header
v0.3.02026-05-08
  • FeatureAdded blog section with 5 posts on AI crawlability, llms.txt, robots.txt, JSON-LD, and AEO
  • FeatureBlog listing page at /blog with category tags, dates, and reading times
  • FeatureIndividual blog post pages with per-post Open Graph metadata and BlogPosting JSON-LD
  • FeatureAuthor name (Soorya) shown on all blog posts
  • FeatureBlack star SVG favicon replacing default Vercel icon
  • FeatureAdded public/robots.txt with explicit Allow directives for all major AI crawlers
  • FeatureDynamic sitemap at /sitemap covering home, blog index, and all posts
  • FeatureUpgraded layout.tsx with full Open Graph, Twitter Card, and JSON-LD structured data
  • FeatureAdded public/blog/*.md companion Markdown files for each post
  • SEOAligned title, H1, and meta description with top search queries (crawlability checker, crawlability test)
  • FixRemoved event handlers from server components that caused Vercel build failures
v0.2.02026-05-07
  • FeaturePer-page markdown check: fetches homepage + one additional page, detects <link type="text/markdown"> tag
  • FeatureLive check-files API covering llms.txt, robots.txt, sitemap.xml, and per-page markdown
  • FeatureUnified results UI with pass/fail cards for all four checks
  • Featurerobots.txt directive breakdown showing User-agent: *, Disallow, Allow, and Sitemap entries
  • FeatureAdded llms.txt and public/index.md
  • ChoreBumped version to 0.2.0, displayed as semver in the header
  • ChoreRewrote README to describe the AI crawlability test tool
v0.1.02026-05-07
  • FeatureInitial AI crawlability test tool
  • FeatureLive llms.txt check via server-side API
  • FeatureApplied Anthropic-inspired design system from DESIGN.md
  • FeatureAdded Google Tag Manager (GTM-MMVT2P8D)
  • FeatureGit short hash injected as version string in the header