UsefulEconomyBot

UsefulEconomyBot/1.0 is the web crawler operated by Useful Economy, a product search engine that helps consumers discover products from local and independent retailers.

What we crawl

UsefulEconomyBot visits publicly accessible product pages to index basic product information such as product names, prices, and thumbnail images. We do not collect personal data, user accounts, or non-public content.

How we crawl

• We respect your robots.txt directives, including Disallow rules and Crawl-delay.
• We limit ourselves to one concurrent request per domain and use adaptive throttling to avoid placing undue load on your server.
• Our crawler identifies itself with the User-Agent string: UsefulEconomyBot/1.0 (+https://usefuleconomy.com/bot; info@usefuleconomy.com)

Blocking UsefulEconomyBot

To prevent UsefulEconomyBot from crawling your site, add the following to your robots.txt:

User-agent: UsefulEconomyBot
Disallow: /

Opt out or request removal

If you would like your products or store removed from Useful Economy, you can submit a request through our opt-out form or email us at info@usefuleconomy.com.

Contact

For questions or concerns about our crawler, please contact info@usefuleconomy.com.