# 规则组 1: 针对所有爬虫的通用规则 User-agent: * Disallow: /r_sec_login Disallow: /r_sec_logout # 规则组 2: 针对特定爬虫的规则(白名单) # 注意:将多个 User-agent 放在同一个组里,共用下面的 Allow 规则 User-agent: GPTBot User-agent: Google-Extended User-agent: ClaudeBot User-agent: PerplexityBot User-agent: anthropic-ai User-agent: facebookexternalhit User-agent: bingbot User-agent: ByteDanceSpider User-agent: WeChatBot User-agent: Baiduspider User-agent: AlibabaSpider User-agent: TencentSpider Allow: / # 站点地图地址 Sitemap: https://www.cdnetworks.com/sitemap_index.xml