About our crawler

Our crawler identifies itself as:

StoreLeadIndexBot/1.0 (+https://storeleadindex.com/bot)

What it does

• It visits a store's home page and its public /meta.json file, at most once every few weeks, to confirm the store is still open and to refresh catalogue size, theme and tools in use.
• It waits between requests to the same site and stops when a site returns errors.
• It obeys robots.txt. It never signs in, fills in forms or reads anything that is not public.

Blocking it

Add this to your robots.txt:

User-agent: StoreLeadIndexBot
Disallow: /

To remove your business from the database altogether, use Remove my business.