Free Tool
robots.txt Generator for AI Bots
Generate optimized robots.txt files with support for 40+ AI bots including ChatGPT, Claude, Perplexity, and Gemini. Control which bots can access your content.
40+
Bots supported
6
Languages
100%
Free forever
Choose a Starting Template
Configure Bot Access
critical
GPTBot
OpenAI ChatGPT web crawler
critical
ChatGPT-User
ChatGPT Browse with Bing
critical
Google-Extended
Google Gemini AI crawler
critical
PerplexityBot
Perplexity AI search engine
high
ClaudeBot
Anthropic Claude web crawler
high
Claude-Web
Claude web search feature
medium
BLEXBot
Aggressive content scraper
medium
MegaIndex
Spam indexer bot
medium
SeznamBot
Aggressive crawler
medium
linkdexbot
Deprecated link crawler
medium
PetalBot
Aggressive Huawei crawler
Protected Paths
disallow
/admin/disallow
/api/disallow
/dashboard/disallow
/auth/disallow
/login/Usually at https://yoursite.com/sitemap.xml — check by visiting that URL. This tells bots where to find all your pages.
robots.txt23 lines
1# ==========================================================================2# robots.txt3# Generated by Bloffee robots.txt Generator4# https://geo-score.online/tools/robots-generator5# Generated: 2026-02-256# ==========================================================================78# Blocked bots9User-agent: BLEXBot10User-agent: MegaIndex11User-agent: SeznamBot12User-agent: linkdexbot13User-agent: PetalBot14Disallow: /1516# Default rules for all other bots17User-agent: *18Disallow: /admin/19Disallow: /api/20Disallow: /dashboard/21Disallow: /auth/22Disallow: /login/23
No sitemap URL declared
Add your sitemap URL (e.g. https://yoursite.com/sitemap.xml) above. This is the bridge between robots.txt and your sitemap — it helps all bots discover your pages.