Domain RobotsTxt
Categories
Component ID
1447732
Component name
Domain RobotsTxt
Component type
module
Maintenance status
Development status
Component security advisory coverage
covered
Downloads
2638
Component created
Component changed
Component body
This module allows you to add additional lines to each domain's robots.txt file. The most frequently used scenario is probably to exclude a certain domain from being indexed by search engines entirely. You would use:Disallow: /
Requirements:
The admin settings form is at:admin/structure/domain/robotstxt