DiscernionBot

DiscernionBot is the news crawler that powers Discernion. It fetches publicly available RSS feeds and article pages to produce AI-generated summaries and analysis.

User-Agent

DiscernionBot/1.0 (+https://www.discernion.com/bot; contact: discernion@outlook.com)

Behavior

• Respects robots.txt directives for all crawled domains.
• Fetches each source at a limited rate (max 30 requests per hour per domain).
• Only accesses publicly available pages (no paywalled or login-gated content).
• Provides attribution and a link back to the original article on every page.

Opting out

To block DiscernionBot from crawling your site, add the following to your robots.txt:

User-agent: DiscernionBot
Disallow: /

To get in touch, email discernion@outlook.com.