Abstrakt News Crawler

1. Who are we?

abstrakt is a professional news intelligence and monitoring platform. We index online press content to provide analytics and summaries to our verified clients.

We are a signatory of the CFC ("Centre Français d'exploitation du droit de Copie".) "Veille Web" license, which officially authorizes us to crawl, index, and analyse press content.

View the official list of authorized monitoring companies

2. Why are we visiting your site?

Our automated system (AbstraktBot) visits your website to index articles and press content that we are authorized to access through our CFC license or direct partnership agreements.

3. Behavior & Etiquette

• Respect: We strictly adhere to standard robots.txt directives.
• Performance: Our crawler is designed to be lightweight and non-intrusive. We implement strict rate limiting to ensure we never impact your server's performance.
• Identification: Our requests are clearly identified with the User-Agent string: AbstraktBot/1.0 (+https://abstrakt.news/bot; tech@abstrakt.news)

4. Opt-Out & Control

If you wish to block our crawler from specific sections of your site, you can use the standard robots.txt exclusion:

User-agent: AbstraktBot
Disallow: /

5. Contact Us

If you notice any irregular behavior or have questions about our traffic, please contact our engineering team immediately:

tech@abstrakt.news