Breaking News: Grepper is joining You.com. Read the official announcement!

robot

Elated Elk answered on August 28, 2021 Popularity 10/10 Helpfulness 1/10

answer robot

related robot

robot

Comment

# Pantheon's documentation on robots.txt: https://pantheon.io/docs/bots-and-indexing/
User-agent: *
Disallow: /

User-agent: RavenCrawler
User-agent: rogerbot
User-agent: dotbot
User-agent: SemrushBot
User-agent: SemrushBot-SA
User-agent: PowerMapper
User-agent: Swiftbot
Allow: /

Popularity 10/10 Helpfulness 1/10 Language whatever

Source: dev-rahatanwar.pantheonsite.io

Tags: robot whatever

Link to this answer
Share Copy Link

Contributed on Aug 20 2022

Elated Elk

0 Answers Avg Quality 2/10

Closely Related Answers

robot

Comment

Cannot GET /articles

Popularity 10/10 Helpfulness 1/10 Language whatever

Source: Grepper

Tags: robot robo

Link to this answer
Share Copy Link

Contributed on Aug 28 2021

Creepy Corncrake

0 Answers Avg Quality 2/10

Continue with Google

By continuing, I agree that I have read and agree to Greppers's Terms of Service and Privacy Policy.

robot

Contents

More Related Answers

robot

Closely Related Answers

robot

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.