OpenAI crawlers IP ranges. Here are the complete and updated lists of OpenAI IP addresses

A plugin for wechat-gptbot that shows you short videos with pretty girls 🎉

Machine-readable AI permissions for websites. A consolidated spec at /.well-known/ai-policy.json for declaring how AI agents may train on, search, or use your content.

Continuously-updated public IP ranges for major cloud providers, SaaS services, and bots — one txt file per provider, refreshed every 4 hours via GitHub Actions. Drop-in for firewalls, allowlists, and geo blocks.

Self-hosted server log analytics for AI bot detection, AI agent monitoring, and AI visibility. Classifies GPTBot, ClaudeBot, ChatGPT-User, Perplexity & more from edge JSONL — no JS tag, no SaaS. Open-source alternative to Cloudflare AI Crawl Control.

GPT-Connect is a local bridge that lets ChatGPT or a Custom GPT control your own devices with authentication, using the same permissions as the account that runs it.

A plugin for wechat-gptbot that offers you daily weather report for free🎉

Claude Code skill that generates and audits ai.txt, robots.txt (AI-crawler rules), llms.txt, and TDM opt-out files for websites.

🤖 Generate optimized robots.txt files for AI search engine crawlers (GPTBot, PerplexityBot, ClaudeBot, and more)

🛡️ An GEO/SEO-friendly rate limiter for Go. Protects your server from abuse/DDoS while safely whitelisting verified Search Engines & AI Bots (Google, Bing, GPTBot, etc.) via IP/RDNS verification.

See which AI crawlers can read your site — GPTBot, ClaudeBot, PerplexityBot & 20 more. Curated, operator-sourced bot list + a zero-dep CLI and GitHub Action to audit robots.txt, test reachability, read access logs, and gate it all in CI.

Complete database of AI search engine crawler user-agents (GPTBot, PerplexityBot, ClaudeBot) with robots.txt configuration examples

Validates whether GPTBot, ClaudeBot, PerplexityBot and other LLM crawlers are allowed by a robots.txt file.

Agent-native multi-bot web crawler simulator. See your site through the eyes of Googlebot, GPTBot, ClaudeBot, and PerplexityBot.

The best AEO/GEO skill for Claude Code. Audit, fix, and monitor your website's visibility across ChatGPT, Claude, Perplexity, Gemini, and Google AI Overviews. 100+ optimization techniques, 33 evidence collectors, 4-vector GEO Score. Built on Princeton KDD 2024 paper. Free, MIT.

LogWerk is a lightweight, offline-first server log analyzer dashboard that runs entirely in your web browser.

Interactive crawler IP intelligence dashboard for search, AI, and user-triggered fetchers.

Free CLI to scan AI-agent readiness (12/33 signals, MIT). Bad score? Get ready-to-install ZIP fix-pack with llms.txt, schema, A2A, MCP for $1/$29/$99 at agentfix.pro.

Generate robots.txt with smart defaults. Allow or block AI crawlers (GPTBot, ClaudeBot) based on your strategy. Framework presets for Next.js and Gatsby. Staging lockdown. Zero dependencies.

Machine-readable reference of AI crawler user-agents (training vs. search/citation vs. user-action) with robots.txt tokens and a robots generator.