About this crawler

ExportlabBrandKit/1.0 fetches a website on behalf of the person who entered its address, so they can hand their own content to an AI tool.

• It reads at most 25 pages per run, public pages only.
• It obeys robots.txt, including Disallow: / and Crawl-delay.
• It identifies itself honestly and does not pretend to be a browser.
• Results are deleted from the server after 7 days.
• To block it, add a group for ExportlabBrandKit to your robots.txt.

Questions or a request to stop: hey@exportlab.io