CoinHuntBot
CoinHuntBot is the crawler operated by CoinHunt LLC. It discovers coin inventory on dealer websites so collectors searching CoinHunt can be referred to the dealer selling the coin.
How it identifies itself
Requests carry the user agent CoinHuntBot/1.0 (+https://getcoinhunt.com/bot).
How it behaves
- It reads and obeys robots.txt on every host before requesting any other page.
- It honors Crawl-delay, and otherwise waits at least one second between requests to the same site.
- It backs off when a server returns 429 or 503, and respects Retry-After.
- It only visits dealers who have given CoinHunt permission to index their inventory.
Blocking it
Add the following to your robots.txt and CoinHuntBot will stop crawling your site:
User-agent: CoinHuntBot Disallow: /
You can also email us and we will remove your inventory promptly, with no explanation needed.
Contact
CoinHunt LLC — [email protected] — (903) 803-8594