Dynamic robots.txt for your Laravel app.
A Laravel package for dynamically generating robots.txt files with environment-specific configurations. Control how search engines and AI crawlers interact with your site using modern features like Cloudflare's Content Signals Policy, per-environment rules, and flexible content signal directives.
Perfect for applications that need different robots.txt rules across environments (production, staging, local) or want granular control over AI training, search indexing, and content access.
Features
Environment-Specific Configuration - Different robots.txt rules for production, staging, local, etc.
Content Signals Support - Implement Cloudflare's Content Signals Policy to control AI training, search indexing, and AI content usage
Flexible User-Agent Rules - Define global rules or per-agent directives (disallow, allow, content signals)
Host Directive - Specify preferred domain for crawlers
Sitemap Management - Automatically include sitemap URLs
Custom Text - Add custom content to your robots.txt file
Human-Readable Policies - Optional policy comment blocks with custom or default text