What Does slot Mean?
The value of your name attribute (robots) specifies which the rule applies to all crawlers. both equally the identify as well as content material attributes are scenario-insensitive. to handle a certain crawler, switch the robots worth of the title attribute Along with the consumer agent token in the crawler that you'll be addressing. Google suppor