User-agent: Bytespider
User-agent: DotBot
User-agent: InternetMeasurement
User-agent: CensysInspect
User-agent: MixrankBot
User-agent: SB Intuitions Corp.
Disallow: /

User-agent: *
Disallow: /cdn-cgi/
Disallow: /search/
Disallow: /actress-recognition/recognize

Sitemap: https://ai-for-av.com/sitemap.xml