# 7-Zip 官网 robots.txt — 加速搜索引擎抓取 User-agent: * Allow: / Allow: /index.html Allow: /download.html Allow: /features.html Allow: /faq.html Allow: /sdk.html Allow: /history.html Allow: /license.html Allow: /css/ Allow: /js/ Allow: /images/ # 必应爬虫优先策略 User-agent: bingbot Allow: / Crawl-delay: 0 User-agent: BingPreview Allow: / User-agent: msnbot Allow: / Crawl-delay: 0 # Google User-agent: Googlebot Allow: / Crawl-delay: 0 # 禁止抓取无用路径(如有) Disallow: /cgi-bin/ Disallow: /*.json$ Sitemap: /sitemap.xml