# ═══════════════════════════════════════════════ # Logobaker — robots.txt # https://logobaker.pro # ═══════════════════════════════════════════════ # ── Sitemap ────────────────────────────────── Sitemap: https://logobaker.pro/sitemap.xml # ── Default rules for all bots ──────────────────────────────────── User-agent: * Allow: / # Private / auth pages Disallow: /404 Disallow: /signin Disallow: /signup Disallow: /account Disallow: /account/ Disallow: /login Disallow: /login/ # Internal pages not useful for search Disallow: /content/support # Search (thin content — let Google discover pages through sitemap) Disallow: /search Disallow: /search/ # User sub-pages (thin / duplicate content) Disallow: /*/wip Disallow: /*/blogs Disallow: /*/followers Disallow: /*/follow Disallow: /*/comments Disallow: /*/activity # Query parameters that create duplicate pages Disallow: /users/designers?orderType= # ── AI Crawlers (explicitly allowed) ───────────────────────────── # Allowing AI crawlers helps Logobaker content appear in AI answers # (ChatGPT, Claude, Perplexity, Gemini) — free traffic & brand exposure. User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: Google-Extended Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Applebot-Extended Allow: / User-agent: Bytespider Allow: / User-agent: CCBot Allow: / # ── Crawl-delay for aggressive SEO tool bots ──────────────────── User-agent: AhrefsBot Crawl-delay: 5 User-agent: SemrushBot Crawl-delay: 5 User-agent: MJ12bot Crawl-delay: 10 # ── Block low-value aggressive crawlers ────────────────────────── User-agent: DotBot Disallow: / # Sitemap Sitemap: https://logobaker.pro/sitemap.xml