teutat3s/elk
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

fix: syntax for robots.txt disallow rules (#1925)

Browse source
This commit is contained in:
Baptiste Girardeau 2023-03-26 17:11:22 +02:00 • committed by GitHub
parent e062fb5e52
commit 881a49e0d9
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 15 additions and 15 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

30
public/robots.txt
View file

@ -3,21 +3,21 @@ Allow: /
# Disallow authenticated pages # Disallow authenticated pages
Disallow /intent Disallow: /intent
Disallow /settings Disallow: /settings
Disallow /blocks Disallow: /blocks
Disallow /bookmarks Disallow: /bookmarks
Disallow /compose Disallow: /compose
Disallow /conversations Disallow: /conversations
Disallow /domain_blocks Disallow: /domain_blocks
Disallow /favourites Disallow: /favourites
Disallow /home Disallow: /home
Disallow /mutes Disallow: /mutes
Disallow /notifications Disallow: /notifications
Disallow /pinned Disallow: /pinned
Disallow /search Disallow: /search
Disallow /settings Disallow: /settings
Disallow /share-target Disallow: /share-target
# Wait 1 second between successive requests. # Wait 1 second between successive requests.
Crawl-delay: 1 Crawl-delay: 1