dadping-bot
User agent: dadping-bot/1.0 (+https://dadping.com/bot)
dadping-bot fetches a short, fixed list of public pages from government agencies and other public-interest sources that our caring-for-parents guides cite, so that our software can check every statement against the original wording. It also re-checks the links and help-line numbers we list.
- It reads
robots.txtfirst, followsDisallowandCrawl-delay, and caches robots rules for 24 hours. - It fetches each page at most a few times per week, one request at a time.
- If a site answers 403, 405 or 429, or shows a challenge page, it stops and does not retry that week. It never tries to get around blocks.
- It does not fetch images, does not log in, and does not submit forms.
Site owners who want it to stop can disallow dadping-bot in robots.txt; it takes effect within 24 hours.