User-agent: * Disallow: /*.php Disallow: /book/resources/* Disallow: /files Disallow: /javascript Disallow: /lookfeel Disallow: /resources User-agent: Googlebot Disallow: User-agent: Bingbot Disallow: User-agent: AhrefsBot Disallow: / User-agent: Barkrowler Disallow: / User-agent: SemrushBot Disallow: /