User-Agent: * Allow: /ads.txt User-agent: Googlebot Allow: / User-agent: Yandex Allow: / User-agent: bingbot Allow: / User-agent: Slurp Allow: / User-agent: DuckDuckBot Allow: / User-agent: Baiduspider Allow: / User-agent: facebot Allow: / User-agent: ia_archiver Allow: / User-agent: iaskspider Allow: / User-agent: Twitterbot Allow: / User-agent: Mediapartners-Google Allow: / User-agent: AdsBot-Google-Mobile Allow: / User-agent: AdsBot Allow: / User-agent: AdsBot-Google-Mobile Allow: / User-agent: Qwantify Allow: / Sitemap: https://gbwhatsapps.com/sitemap_index.xml