Policy sheet · In development

DiscourseMeridianBot

Discourse Meridian collects public documents from a registered panel of media and institutional sources for discourse measurement. This page describes the project's collection policy.

User-Agent

Collection policy

• Checks the applicable robots.txt policy before fetching and respects disallow rules.
• Applies per-domain rate limits and URL-registry checks to avoid duplicate fetches.
• Requests public pages without logging in, bypassing paywalls or access controls, or using anti-bot evasion.
• Retains source attribution; report evidence packs are limited to short quotations with source links.

Exclusion and takedown

A site owner can declare a disallow rule for DiscourseMeridianBot in robots.txt.

For stored-material removal requests, include the relevant URLs: discourse.meridian.research@proton.me