# Enables Googlebot User-agent: Googlebot Disallow: # Allow Bingbot User-agent: Bingbot Disallow: # Block Adsbot User-agent: AdsBot-Google Disallow: / User-agent: meta-externalagent Allow: / # Allow everything Disallow: /private/ # Disallow a specific directory # Example 3: Block all crawlers except AdsBot (AdsBot crawlers must be named explicitly) User-agent: * Disallow: /