Meta robots
Instructions to supporting crawlers about indexing or result presentation, supplied in HTML or X-Robots-Tag. Crawlers must access the response to read noindex. These instructions are not access controls.
Sources and review
Reviewed:
Instructions to supporting crawlers about indexing or result presentation, supplied in HTML or X-Robots-Tag. Crawlers must access the response to read noindex. These instructions are not access controls.
Reviewed: