User-agent: GPTBot User-agent: Google-Extended User-agent: feed User-agent: BLEXBot User-agent: crawl User-agent: nbot User-agent: AhrefsBot User-agent: BlackWidow User-agent: SemrushBot User-agent: GrapeshotCrawler User-agent: DotBot User-agent: SemrushBot-SI User-agent: scrapy User-agent: LinkCheck User-agent: Sogou web spider User-agent: nbot User-agent: ExtractorPro User-agent: EyeNetIE User-agent: FlashGet User-agent: GetRight User-agent: GetWeb! User-agent: Go!Zilla User-agent: Go-Ahead-Got-It User-agent: GrabNet User-agent: Image\ Stripper User-agent: Image\ Sucker User-agent: InterGET User-agent: Mass\ Downloader User-agent: Navroad User-agent: NearSite User-agent: NetAnts User-agent: NetSpider User-agent: Net\ Vampire User-agent: NetZIP User-agent: Octopus User-agent: Offline\ Explorer User-agent: Offline\ Navigator User-agent: PageGrabber User-agent: pcBrowser User-agent: RealDownload User-agent: ReGet User-agent: SiteSnagger User-agent: SmartDownload User-agent: SuperBot User-agent: Surfbot User-agent: WebAuto User-agent: WebCopier User-agent: WebFetch User-agent: WebLeacher User-agent: WebReaper User-agent: WebSauger User-agent: Website\ eXtractor User-agent: Website\ Quester User-agent: WebStripper User-agent: WebWhacker User-agent: WebZIP User-agent: Wget User-agent: Widow User-agent: WWWOFFLE User-agent: Xaldon\ WebSpider User-agent: Zeus Disallow: /