About our crawler

User-Agent

What it does

Jelly Deals is a price and stock tracker for Jellycat plush toys. The crawler reads product pages to record the price and whether an item is in stock, so shoppers can compare retailers and get an email when something they want comes back. We send traffic to you; we do not copy your product descriptions or resell your data.

How it behaves

• Reads and obeys robots.txt before every request, including your Crawl-delay.
• Waits at least 2.5 seconds between requests to the same host, longer if your robots.txt asks for more.
• Caps itself at 1500 requests per run across all retailers combined.
• Prefers your product feed or API over crawling wherever one is available to us. If you can give us a feed, we will stop crawling you entirely.
• Never logs in, never fills forms, never touches checkout, never bypasses a block.
• If robots.txt becomes unreachable, we treat that as “do not crawl” and stop, rather than assuming permission.

Want us to stop, or slow down?

Add a Disallow for our user-agent token in your robots.txt and we will stop within six hours, no discussion needed. Or email george@jellydeals.uk and we will adjust or remove you by hand the same day.