DaamBot
DaamBot collects publicly listed prices so people in Pakistan can check whether a price is reasonable. It identifies itself as DaamBot/1.0 with a link to this page.
How it behaves
- Respects robots.txt and crawl-delay; checks robots.txt before fetching.
- Rate-limited per site (default at most one request every two seconds) and prefers catalog feeds over page-by-page crawling.
- Uses conditional requests, so an unchanged page costs your server one small request.
- Backs off on 429/503 and pauses entirely after repeated blocks.
- Never logs in, solves CAPTCHAs, evades bot protection or rotates proxies.
- Stores facts only — prices, specifications and a short text snippet as evidence — never product photos or descriptions.